2024-04-14T22:30:32.059346593Z .... 2024-04-14T22:30:32.785672628Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-14T22:30:33.882067963Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-14T22:30:50.979860651Z 2024-04-14T22:30:52.273415369Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-14T22:30:53.527184755Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-14T22:30:58.576288274Z ____________ _____________ 2024-04-14T22:30:58.576305877Z ____ |__( )_________ __/__ /________ __ 2024-04-14T22:30:58.576308747Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-14T22:30:58.576311305Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-14T22:30:58.576313986Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-14T22:30:58.576317005Z [2024-04-14T22:30:58.575+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-14T22:30:58.576320599Z [2024-04-14T22:30:58.575+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-14T22:30:59.170172554Z [2024-04-14T22:30:59.169+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-14T22:30:59.198444015Z [2024-04-14T22:30:59.180+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 17 2024-04-14T22:30:59.198458037Z [2024-04-14T22:30:59.197+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T22:30:59.232676413Z [2024-04-14T22:30:59.216+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-14T22:30:59.237598434Z [2024-04-14T22:30:59.234+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-14T22:32:01.712575943Z [2024-04-14T22:32:01.712+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:32:01.754770539Z [2024-04-14T22:32:01.754+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:32:01.754787623Z 2024-04-14T22:32:01.754796523Z [2024-04-14T22:32:01.754+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:32:01.755536498Z [2024-04-14T22:32:01.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:32:01.755551652Z 2024-04-14T22:32:01.757528977Z [2024-04-14T22:32:01.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:32:01.758075237Z [2024-04-14T22:32:01.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:32:01.958616321Z [2024-04-14T22:32:01.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:32:01.965294341Z [2024-04-14T22:32:01.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 415c95fe-291f-48e9-8151-01edd85899af 2024-04-14T22:32:33.227511742Z [2024-04-14T22:32:33.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:32:33.231635063Z [2024-04-14T22:32:33.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:32:02.642735+00:00, run_end_date=2024-04-14 22:32:33.020576+00:00, run_duration=30.377841, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:32:01.755488+00:00, queued_by_job_id=1, pid=50 2024-04-14T22:32:43.362845055Z [2024-04-14T22:32:43.362+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:32:43.362865143Z 2024-04-14T22:32:43.362891766Z [2024-04-14T22:32:43.362+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:32:43.363342773Z [2024-04-14T22:32:43.363+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:32:43.363350449Z 2024-04-14T22:32:43.364944958Z [2024-04-14T22:32:43.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:32:43.364957378Z [2024-04-14T22:32:43.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:32:43.420525162Z [2024-04-14T22:32:43.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 2 2024-04-14T22:32:43.424189981Z [2024-04-14T22:32:43.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1d85ac7-0726-4d22-81b9-058958f087fa 2024-04-14T22:33:15.044289905Z [2024-04-14T22:33:15.042+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-14T22:33:15.044564708Z [2024-04-14T22:33:15.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:30:00+00:00, run_id=scheduled__2024-04-14T22:30:00+00:00, run_start_date=2024-04-14 22:32:01.722305+00:00, run_end_date=2024-04-14 22:33:15.043984+00:00, run_duration=73.321679, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:30:00+00:00, data_interval_end=2024-04-14 22:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:33:15.055985376Z [2024-04-14T22:33:15.055+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:32:00+00:00, run_after=2024-04-14T22:34:00+00:00 2024-04-14T22:33:15.088957794Z [2024-04-14T22:33:15.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 2 2024-04-14T22:33:15.097158622Z [2024-04-14T22:33:15.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:32:43.917948+00:00, run_end_date=2024-04-14 22:33:14.268603+00:00, run_duration=30.350655, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:32:43.363533+00:00, queued_by_job_id=1, pid=55 2024-04-14T22:34:00.271231923Z [2024-04-14T22:34:00.270+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:34:00.312209932Z [2024-04-14T22:34:00.311+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:34:00.312219522Z 2024-04-14T22:34:00.312287116Z [2024-04-14T22:34:00.312+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:34:00.313405530Z [2024-04-14T22:34:00.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:34:00.313411351Z 2024-04-14T22:34:00.316613102Z [2024-04-14T22:34:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:34:00.316790561Z [2024-04-14T22:34:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:34:00.402988739Z [2024-04-14T22:34:00.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:32:00+00:00 exited with status queued for try_number 1 2024-04-14T22:34:00.421126222Z [2024-04-14T22:34:00.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5da0b98d-cd58-42fa-8d11-8c473b0a5621 2024-04-14T22:34:01.819717259Z [2024-04-14T22:34:01.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:34:01.820120401Z [2024-04-14T22:34:01.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:32:00+00:00, run_id=scheduled__2024-04-14T22:32:00+00:00, run_start_date=2024-04-14 22:34:00.280946+00:00, run_end_date=2024-04-14 22:34:01.819652+00:00, run_duration=1.538706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:32:00+00:00, data_interval_end=2024-04-14 22:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:34:01.826936870Z [2024-04-14T22:34:01.826+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:34:00+00:00, run_after=2024-04-14T22:36:00+00:00 2024-04-14T22:34:01.862143771Z [2024-04-14T22:34:01.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:32:00+00:00 exited with status success for try_number 1 2024-04-14T22:34:01.869565543Z [2024-04-14T22:34:01.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:32:00+00:00, map_index=-1, run_start_date=2024-04-14 22:34:01.168376+00:00, run_end_date=2024-04-14 22:34:01.487955+00:00, run_duration=0.319579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:34:00.313861+00:00, queued_by_job_id=1, pid=86 2024-04-14T22:35:59.477707847Z [2024-04-14T22:35:59.476+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T22:36:00.762415136Z [2024-04-14T22:36:00.762+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:36:00.808603796Z [2024-04-14T22:36:00.808+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:36:00.808613570Z 2024-04-14T22:36:00.808766525Z [2024-04-14T22:36:00.808+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:36:00.809452914Z [2024-04-14T22:36:00.809+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:36:00.809461484Z 2024-04-14T22:36:00.811590612Z [2024-04-14T22:36:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:36:00.811821380Z [2024-04-14T22:36:00.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:36:00.879648784Z [2024-04-14T22:36:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:34:00+00:00 exited with status queued for try_number 1 2024-04-14T22:36:00.887770854Z [2024-04-14T22:36:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to aca7a05f-56c3-4b25-8aa6-65991d8bb476 2024-04-14T22:36:02.594068034Z [2024-04-14T22:36:02.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:36:02.594256794Z [2024-04-14T22:36:02.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:34:00+00:00, run_id=scheduled__2024-04-14T22:34:00+00:00, run_start_date=2024-04-14 22:36:00.770768+00:00, run_end_date=2024-04-14 22:36:02.593910+00:00, run_duration=1.823142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:34:00+00:00, data_interval_end=2024-04-14 22:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:36:02.601159160Z [2024-04-14T22:36:02.600+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:36:00+00:00, run_after=2024-04-14T22:38:00+00:00 2024-04-14T22:36:02.630016626Z [2024-04-14T22:36:02.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:34:00+00:00 exited with status success for try_number 1 2024-04-14T22:36:02.636557463Z [2024-04-14T22:36:02.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:34:00+00:00, map_index=-1, run_start_date=2024-04-14 22:36:01.436394+00:00, run_end_date=2024-04-14 22:36:01.746795+00:00, run_duration=0.310401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:36:00.809899+00:00, queued_by_job_id=1, pid=119 2024-04-14T22:38:00.789599570Z [2024-04-14T22:38:00.788+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:38:00.828484345Z [2024-04-14T22:38:00.828+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:38:00.828497848Z 2024-04-14T22:38:00.828613468Z [2024-04-14T22:38:00.828+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:38:00.829164758Z [2024-04-14T22:38:00.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:38:00.829181799Z 2024-04-14T22:38:00.832082726Z [2024-04-14T22:38:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:38:00.832355755Z [2024-04-14T22:38:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:38:00.889667703Z [2024-04-14T22:38:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:36:00+00:00 exited with status queued for try_number 1 2024-04-14T22:38:00.903655329Z [2024-04-14T22:38:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to b13d4180-c73c-42e9-9e3b-615c1ac83d7f 2024-04-14T22:38:02.195682792Z [2024-04-14T22:38:02.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:38:02.196753838Z [2024-04-14T22:38:02.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:36:00+00:00, run_id=scheduled__2024-04-14T22:36:00+00:00, run_start_date=2024-04-14 22:38:00.799670+00:00, run_end_date=2024-04-14 22:38:02.195589+00:00, run_duration=1.395919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:36:00+00:00, data_interval_end=2024-04-14 22:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:38:02.205578812Z [2024-04-14T22:38:02.205+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:38:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:38:02.235511538Z [2024-04-14T22:38:02.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:36:00+00:00 exited with status success for try_number 1 2024-04-14T22:38:02.243218258Z [2024-04-14T22:38:02.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:36:00+00:00, map_index=-1, run_start_date=2024-04-14 22:38:01.466232+00:00, run_end_date=2024-04-14 22:38:01.754356+00:00, run_duration=0.288124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:38:00.829778+00:00, queued_by_job_id=1, pid=152 2024-04-14T22:38:51.603470273Z [2024-04-14T22:38:51.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:38:00+00:00, run_after=2024-04-14T22:39:00+00:00 2024-04-14T22:38:51.635159722Z [2024-04-14T22:38:51.634+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:38:51.635182860Z 2024-04-14T22:38:51.635190073Z [2024-04-14T22:38:51.635+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:38:51.635812590Z [2024-04-14T22:38:51.635+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:38:51.635822427Z 2024-04-14T22:38:51.637662523Z [2024-04-14T22:38:51.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:38:51.637745618Z [2024-04-14T22:38:51.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:38:51.702591510Z [2024-04-14T22:38:51.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:37:00+00:00 exited with status queued for try_number 1 2024-04-14T22:38:51.709522348Z [2024-04-14T22:38:51.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16dc1b60-b191-4261-b0e5-5a2eb7970abc 2024-04-14T22:38:52.457999479Z [2024-04-14T22:38:52.457+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:38:52.528540180Z [2024-04-14T22:38:52.528+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:38:52.528554366Z 2024-04-14T22:38:52.528742279Z [2024-04-14T22:38:52.528+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:38:52.529223762Z [2024-04-14T22:38:52.529+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:38:52.529235178Z 2024-04-14T22:38:52.531203019Z [2024-04-14T22:38:52.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:38:52.531628222Z [2024-04-14T22:38:52.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:38:52.622735384Z [2024-04-14T22:38:52.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:37:00+00:00 exited with status queued for try_number 1 2024-04-14T22:38:52.647036466Z [2024-04-14T22:38:52.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to c37ae5d1-3132-4fc8-812f-e139e333c847 2024-04-14T22:38:53.797159336Z [2024-04-14T22:38:53.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:38:00+00:00, run_after=2024-04-14T22:39:00+00:00 2024-04-14T22:38:53.840071460Z [2024-04-14T22:38:53.839+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:38:53.840097224Z 2024-04-14T22:38:53.840107091Z [2024-04-14T22:38:53.839+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:38:53.840629159Z [2024-04-14T22:38:53.840+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:38:53.840643601Z 2024-04-14T22:38:53.842694745Z [2024-04-14T22:38:53.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:38:53.842800694Z [2024-04-14T22:38:53.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:38:53.956557967Z [2024-04-14T22:38:53.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:37:00+00:00 exited with status queued for try_number 1 2024-04-14T22:38:53.965421560Z [2024-04-14T22:38:53.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd485697-de51-4b24-87a5-31c7ceade7ba 2024-04-14T22:38:55.144241582Z [2024-04-14T22:38:55.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:38:55.144513663Z [2024-04-14T22:38:55.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:37:00+00:00, run_id=scheduled__2024-04-14T22:37:00+00:00, run_start_date=2024-04-14 22:38:51.611864+00:00, run_end_date=2024-04-14 22:38:55.144252+00:00, run_duration=3.532388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:37:00+00:00, data_interval_end=2024-04-14 22:38:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:38:55.155061400Z [2024-04-14T22:38:55.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:38:00+00:00, run_after=2024-04-14T22:39:00+00:00 2024-04-14T22:38:55.163487176Z [2024-04-14T22:38:55.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:38:55.164205659Z [2024-04-14T22:38:55.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:37:00+00:00, run_id=scheduled__2024-04-14T22:37:00+00:00, run_start_date=2024-04-14 22:38:53.807938+00:00, run_end_date=2024-04-14 22:38:55.163908+00:00, run_duration=1.35597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:37:00+00:00, data_interval_end=2024-04-14 22:38:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:38:55.173253049Z [2024-04-14T22:38:55.173+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:38:00+00:00, run_after=2024-04-14T22:39:00+00:00 2024-04-14T22:38:55.218197255Z [2024-04-14T22:38:55.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:37:00+00:00 exited with status success for try_number 1 2024-04-14T22:38:55.224117364Z [2024-04-14T22:38:55.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:37:00+00:00, map_index=-1, run_start_date=2024-04-14 22:38:53.674329+00:00, run_end_date=2024-04-14 22:38:55.010600+00:00, run_duration=1.336271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:38:51.636016+00:00, queued_by_job_id=1, pid=179 2024-04-14T22:38:56.288835819Z [2024-04-14T22:38:56.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:37:00+00:00 exited with status success for try_number 1 2024-04-14T22:38:56.293389885Z [2024-04-14T22:38:56.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:37:00+00:00, map_index=-1, run_start_date=2024-04-14 22:38:54.720921+00:00, run_end_date=2024-04-14 22:38:55.066921+00:00, run_duration=0.346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:38:53.841010+00:00, queued_by_job_id=1, pid=197 2024-04-14T22:38:56.791063995Z [2024-04-14T22:38:56.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:38:56.791341429Z [2024-04-14T22:38:56.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:37:00+00:00, run_id=scheduled__2024-04-14T22:37:00+00:00, run_start_date=2024-04-14 22:38:52.491111+00:00, run_end_date=2024-04-14 22:38:56.791020+00:00, run_duration=4.299909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:37:00+00:00, data_interval_end=2024-04-14 22:38:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:38:56.803737813Z [2024-04-14T22:38:56.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:38:00+00:00, run_after=2024-04-14T22:39:00+00:00 2024-04-14T22:38:56.825309020Z [2024-04-14T22:38:56.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:37:00+00:00 exited with status success for try_number 1 2024-04-14T22:38:56.830233727Z [2024-04-14T22:38:56.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:37:00+00:00, map_index=-1, run_start_date=2024-04-14 22:38:54.823396+00:00, run_end_date=2024-04-14 22:38:56.361928+00:00, run_duration=1.538532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:38:52.529501+00:00, queued_by_job_id=1, pid=198 2024-04-14T22:39:00.916861248Z [2024-04-14T22:39:00.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:00.932296420Z [2024-04-14T22:39:00.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:35:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:00.943617978Z [2024-04-14T22:39:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:00.948267627Z [2024-04-14T22:39:00.948+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:39:00.997616006Z [2024-04-14T22:39:00.997+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T22:39:00.997631508Z 2024-04-14T22:39:00.997635720Z 2024-04-14T22:39:00.997638946Z 2024-04-14T22:39:00.997657848Z 2024-04-14T22:39:00.997668117Z [2024-04-14T22:39:00.997+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:39:00.997752845Z [2024-04-14T22:39:00.997+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:39:00.997843504Z [2024-04-14T22:39:00.997+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:39:00.997920281Z [2024-04-14T22:39:00.997+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:39:00.998388907Z [2024-04-14T22:39:00.998+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:00.998393379Z 2024-04-14T22:39:00.998396820Z 2024-04-14T22:39:00.998400016Z 2024-04-14T22:39:00.998415121Z 2024-04-14T22:39:01.004420374Z [2024-04-14T22:39:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:39:01.004485594Z [2024-04-14T22:39:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:39:01.004492294Z [2024-04-14T22:39:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:39:01.004497269Z [2024-04-14T22:39:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:39:01.004502050Z [2024-04-14T22:39:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:39:01.004507171Z [2024-04-14T22:39:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:39:01.004520288Z [2024-04-14T22:39:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:39:01.004534460Z [2024-04-14T22:39:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:39:01.482045714Z [2024-04-14T22:39:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:01.484046513Z [2024-04-14T22:39:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:01.484168622Z [2024-04-14T22:39:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:01.484275593Z [2024-04-14T22:39:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:01.496603223Z [2024-04-14T22:39:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfd42b44-e030-4ca0-8356-230b0675c607 2024-04-14T22:39:01.496732706Z [2024-04-14T22:39:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 279565df-5cb8-4f53-8fc4-c0e60d788b88 2024-04-14T22:39:01.496893338Z [2024-04-14T22:39:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbf1e03b-74fc-416d-a6e4-7e3a024198f7 2024-04-14T22:39:01.497024676Z [2024-04-14T22:39:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70874f20-cb42-41a3-8ef7-a16c5f0e06a3 2024-04-14T22:39:02.711748657Z [2024-04-14T22:39:02.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:39:02.712219126Z [2024-04-14T22:39:02.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:38:00+00:00, run_id=scheduled__2024-04-14T22:38:00+00:00, run_start_date=2024-04-14 22:39:00.956175+00:00, run_end_date=2024-04-14 22:39:02.711687+00:00, run_duration=1.755512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:38:00+00:00, data_interval_end=2024-04-14 22:39:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:39:02.722702155Z [2024-04-14T22:39:02.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:02.775076047Z [2024-04-14T22:39:02.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:02.778857480Z [2024-04-14T22:39:02.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:38:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:01.949572+00:00, run_end_date=2024-04-14 22:39:02.349220+00:00, run_duration=0.399648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:00.999396+00:00, queued_by_job_id=1, pid=218 2024-04-14T22:39:03.887259622Z [2024-04-14T22:39:03.886+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:03.887291373Z 2024-04-14T22:39:03.887394272Z [2024-04-14T22:39:03.887+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:39:03.887850520Z [2024-04-14T22:39:03.887+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:03.887913671Z 2024-04-14T22:39:03.889575910Z [2024-04-14T22:39:03.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:39:03.889703711Z [2024-04-14T22:39:03.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:39:03.966618335Z [2024-04-14T22:39:03.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:03.966839429Z [2024-04-14T22:39:03.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:03.973838876Z [2024-04-14T22:39:03.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8157168c-8bcf-4fb1-871c-eca252f907db 2024-04-14T22:39:03.974263093Z [2024-04-14T22:39:03.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:03.033062+00:00, run_end_date=2024-04-14 22:39:03.429587+00:00, run_duration=0.396525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:00.999396+00:00, queued_by_job_id=1, pid=242 2024-04-14T22:39:05.109499019Z [2024-04-14T22:39:05.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:39:05.109929033Z [2024-04-14T22:39:05.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:38:00+00:00, run_id=scheduled__2024-04-14T22:38:00+00:00, run_start_date=2024-04-14 22:39:00.955989+00:00, run_end_date=2024-04-14 22:39:05.109610+00:00, run_duration=4.153621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:38:00+00:00, data_interval_end=2024-04-14 22:39:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:39:05.118089709Z [2024-04-14T22:39:05.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:05.123692987Z [2024-04-14T22:39:05.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:39:05.124032027Z [2024-04-14T22:39:05.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:38:00+00:00, run_id=scheduled__2024-04-14T22:38:00+00:00, run_start_date=2024-04-14 22:39:00.956689+00:00, run_end_date=2024-04-14 22:39:05.123774+00:00, run_duration=4.167085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:38:00+00:00, data_interval_end=2024-04-14 22:39:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:39:05.132813016Z [2024-04-14T22:39:05.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:05.166779135Z [2024-04-14T22:39:05.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:05.166950218Z [2024-04-14T22:39:05.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:05.177413210Z [2024-04-14T22:39:05.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:38:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:03.196527+00:00, run_end_date=2024-04-14 22:39:04.428958+00:00, run_duration=1.232431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:00.999396+00:00, queued_by_job_id=1, pid=244 2024-04-14T22:39:05.177871268Z [2024-04-14T22:39:05.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:38:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:03.150529+00:00, run_end_date=2024-04-14 22:39:04.744829+00:00, run_duration=1.5943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:00.999396+00:00, queued_by_job_id=1, pid=243 2024-04-14T22:39:06.247486904Z [2024-04-14T22:39:06.247+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:06.247520406Z 2024-04-14T22:39:06.247524875Z [2024-04-14T22:39:06.247+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:39:06.248086755Z [2024-04-14T22:39:06.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:06.248099483Z 2024-04-14T22:39:06.249759010Z [2024-04-14T22:39:06.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:39:06.249994462Z [2024-04-14T22:39:06.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:39:06.308411376Z [2024-04-14T22:39:06.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:06.308661333Z [2024-04-14T22:39:06.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:06.316567159Z [2024-04-14T22:39:06.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92ff823e-01b6-481a-9b05-4795564bdc77 2024-04-14T22:39:06.326445926Z [2024-04-14T22:39:06.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:05.628348+00:00, run_end_date=2024-04-14 22:39:05.964658+00:00, run_duration=0.33631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:03.888117+00:00, queued_by_job_id=1, pid=267 2024-04-14T22:39:09.255758741Z [2024-04-14T22:39:09.255+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:09.255768272Z 2024-04-14T22:39:09.256103590Z [2024-04-14T22:39:09.255+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:39:09.256874346Z [2024-04-14T22:39:09.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:09.256883714Z 2024-04-14T22:39:09.259525717Z [2024-04-14T22:39:09.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:39:09.259718934Z [2024-04-14T22:39:09.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:39:09.338058631Z [2024-04-14T22:39:09.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:09.338192211Z [2024-04-14T22:39:09.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:09.343342216Z [2024-04-14T22:39:09.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2a375d0-d8bd-4680-8382-284a6dfaa70d 2024-04-14T22:39:09.343780869Z [2024-04-14T22:39:09.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=0, run_start_date=2024-04-14 22:39:07.764832+00:00, run_end_date=2024-04-14 22:39:08.100775+00:00, run_duration=0.335943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:06.248359+00:00, queued_by_job_id=1, pid=275 2024-04-14T22:39:12.215333326Z [2024-04-14T22:39:12.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:39:12.215567433Z [2024-04-14T22:39:12.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:30:00+00:00, run_id=scheduled__2024-04-14T22:30:00+00:00, run_start_date=2024-04-14 22:39:00.955678+00:00, run_end_date=2024-04-14 22:39:12.215243+00:00, run_duration=11.259565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:30:00+00:00, data_interval_end=2024-04-14 22:35:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T22:39:12.226549728Z [2024-04-14T22:39:12.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:35:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:12.251659509Z [2024-04-14T22:39:12.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:12.257883641Z [2024-04-14T22:39:12.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:11.329725+00:00, run_end_date=2024-04-14 22:39:11.740130+00:00, run_duration=0.410405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:09.257914+00:00, queued_by_job_id=1, pid=283 2024-04-14T22:39:25.032390393Z [2024-04-14T22:39:25.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:39:25.083903648Z [2024-04-14T22:39:25.083+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:25.083922979Z 2024-04-14T22:39:25.084184589Z [2024-04-14T22:39:25.084+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:39:25.084756996Z [2024-04-14T22:39:25.084+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:25.084768484Z 2024-04-14T22:39:25.087234215Z [2024-04-14T22:39:25.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:39:25.087462128Z [2024-04-14T22:39:25.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:39:25.154127663Z [2024-04-14T22:39:25.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:25.159193570Z [2024-04-14T22:39:25.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f4a75b2-dadb-4f80-8090-812ed32aede5 2024-04-14T22:39:28.501438922Z [2024-04-14T22:39:28.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:39:28.501701899Z [2024-04-14T22:39:28.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, execution_date=2024-04-14 22:38:00+00:00, run_id=scheduled__2024-04-14T22:38:00+00:00, run_start_date=2024-04-14 22:39:25.043105+00:00, run_end_date=2024-04-14 22:39:28.501332+00:00, run_duration=3.458227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:38:00+00:00, data_interval_end=2024-04-14 22:39:00+00:00, dag_hash=18af2469c9675b21a8619c9fb21252c0 2024-04-14T22:39:28.514178943Z [2024-04-14T22:39:28.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:28.542322687Z [2024-04-14T22:39:28.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:28.547494471Z [2024-04-14T22:39:28.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:38:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:26.484872+00:00, run_end_date=2024-04-14 22:39:28.023362+00:00, run_duration=1.53849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:25.085126+00:00, queued_by_job_id=1, pid=291 2024-04-14T22:39:32.498808598Z [2024-04-14T22:39:32.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:35:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:32.546285939Z [2024-04-14T22:39:32.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:32.546312008Z 2024-04-14T22:39:32.546321326Z [2024-04-14T22:39:32.546+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:39:32.546752969Z [2024-04-14T22:39:32.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:32.546769206Z 2024-04-14T22:39:32.549367174Z [2024-04-14T22:39:32.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:39:32.549485300Z [2024-04-14T22:39:32.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:39:32.593726874Z [2024-04-14T22:39:32.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:32.601698831Z [2024-04-14T22:39:32.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 588a0239-ec5c-4f9b-ab24-89f6733e8de5 2024-04-14T22:39:35.175794572Z [2024-04-14T22:39:35.175+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:35.175829868Z 2024-04-14T22:39:35.175933200Z [2024-04-14T22:39:35.175+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:39:35.176440582Z [2024-04-14T22:39:35.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:35.176451184Z 2024-04-14T22:39:35.178637804Z [2024-04-14T22:39:35.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='split_metrics', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:39:35.178850400Z [2024-04-14T22:39:35.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'split_metrics', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:39:35.224386892Z [2024-04-14T22:39:35.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.split_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:35.224593078Z [2024-04-14T22:39:35.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:35.228469247Z [2024-04-14T22:39:35.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:33.962655+00:00, run_end_date=2024-04-14 22:39:34.244615+00:00, run_duration=0.28196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:32.546842+00:00, queued_by_job_id=1, pid=304 2024-04-14T22:39:35.228759908Z [2024-04-14T22:39:35.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cac28ff-a5f3-4248-af15-1b47396dd652 2024-04-14T22:39:37.419133964Z [2024-04-14T22:39:37.418+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:37.419154050Z 2024-04-14T22:39:37.419359047Z [2024-04-14T22:39:37.419+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:39:37.419855245Z [2024-04-14T22:39:37.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:37.419865085Z 2024-04-14T22:39:37.421586700Z [2024-04-14T22:39:37.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:39:37.421732919Z [2024-04-14T22:39:37.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'collect_metrics', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:39:37.467792721Z [2024-04-14T22:39:37.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.collect_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:37.467908966Z [2024-04-14T22:39:37.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.split_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:37.475472887Z [2024-04-14T22:39:37.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=split_metrics, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:36.532807+00:00, run_end_date=2024-04-14 22:39:36.794562+00:00, run_duration=0.261755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:35.177105+00:00, queued_by_job_id=1, pid=317 2024-04-14T22:39:37.475688039Z [2024-04-14T22:39:37.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12ee8f78-bfbe-431a-a8ca-625bfded4044 2024-04-14T22:39:39.841073835Z [2024-04-14T22:39:39.840+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:39.841097364Z 2024-04-14T22:39:39.841101345Z [2024-04-14T22:39:39.840+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:39:39.841777421Z [2024-04-14T22:39:39.841+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:39.841791799Z 2024-04-14T22:39:39.843921799Z [2024-04-14T22:39:39.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:39:39.843959562Z [2024-04-14T22:39:39.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'send_prometheus', 'scheduled__2024-04-14T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:39:39.909010118Z [2024-04-14T22:39:39.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.send_prometheus run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:39.909142597Z [2024-04-14T22:39:39.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.collect_metrics run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:39.918256251Z [2024-04-14T22:39:39.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=0, run_start_date=2024-04-14 22:39:39.066139+00:00, run_end_date=2024-04-14 22:39:39.398145+00:00, run_duration=0.332006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:37.420158+00:00, queued_by_job_id=1, pid=325 2024-04-14T22:39:39.919043109Z [2024-04-14T22:39:39.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 466ec3cb-801a-4763-bcf2-a04775669667 2024-04-14T22:39:42.099902058Z [2024-04-14T22:39:42.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:39:42.100508314Z [2024-04-14T22:39:42.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, execution_date=2024-04-14 22:30:00+00:00, run_id=scheduled__2024-04-14T22:30:00+00:00, run_start_date=2024-04-14 22:39:32.512443+00:00, run_end_date=2024-04-14 22:39:42.099821+00:00, run_duration=9.587378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:30:00+00:00, data_interval_end=2024-04-14 22:35:00+00:00, dag_hash=2558869d436d48107bd19a77898c1ceb 2024-04-14T22:39:42.106205071Z [2024-04-14T22:39:42.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:35:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:42.130731672Z [2024-04-14T22:39:42.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.send_prometheus run_id=scheduled__2024-04-14T22:30:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:42.134262338Z [2024-04-14T22:39:42.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:30:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:41.270695+00:00, run_end_date=2024-04-14 22:39:41.554433+00:00, run_duration=0.283738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:39.842122+00:00, queued_by_job_id=1, pid=333 2024-04-14T22:39:55.217261444Z [2024-04-14T22:39:55.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:55.279557964Z [2024-04-14T22:39:55.279+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:39:55.279591348Z 2024-04-14T22:39:55.279953348Z [2024-04-14T22:39:55.279+0000] {scheduler_job.py:425} INFO - DAG vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:39:55.281322788Z [2024-04-14T22:39:55.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:39:55.281342302Z 2024-04-14T22:39:55.285792351Z [2024-04-14T22:39:55.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:39:55.286100715Z [2024-04-14T22:39:55.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:39:55.369046950Z [2024-04-14T22:39:55.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status queued for try_number 1 2024-04-14T22:39:55.374340668Z [2024-04-14T22:39:55.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 532c507b-caf7-4e4f-a84b-e548af57e753 2024-04-14T22:39:57.959217595Z [2024-04-14T22:39:57.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:39:57.959736873Z [2024-04-14T22:39:57.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, execution_date=2024-04-14 22:38:00+00:00, run_id=scheduled__2024-04-14T22:38:00+00:00, run_start_date=2024-04-14 22:39:55.227905+00:00, run_end_date=2024-04-14 22:39:57.959289+00:00, run_duration=2.731384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:38:00+00:00, data_interval_end=2024-04-14 22:39:00+00:00, dag_hash=4e27e12b359e89445d2e1eac9749104f 2024-04-14T22:39:57.975284834Z [2024-04-14T22:39:57.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:39:00+00:00, run_after=2024-04-14T22:40:00+00:00 2024-04-14T22:39:59.077110800Z [2024-04-14T22:39:59.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status success for try_number 1 2024-04-14T22:39:59.081181906Z [2024-04-14T22:39:59.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:38:00+00:00, map_index=-1, run_start_date=2024-04-14 22:39:56.757263+00:00, run_end_date=2024-04-14 22:39:57.937298+00:00, run_duration=1.180035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:39:55.283803+00:00, queued_by_job_id=1, pid=354 2024-04-14T22:40:00.974348617Z [2024-04-14T22:40:00.973+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:40:00.995484194Z [2024-04-14T22:40:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:40:01.004296922Z [2024-04-14T22:40:01.003+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:40:01.014306250Z [2024-04-14T22:40:01.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:40:01.025075060Z [2024-04-14T22:40:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:01.033385808Z [2024-04-14T22:40:01.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:40:01.048555209Z [2024-04-14T22:40:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:01.058417551Z [2024-04-14T22:40:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:01.210865664Z [2024-04-14T22:40:01.210+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-04-14T22:40:01.210908759Z 2024-04-14T22:40:01.210913835Z 2024-04-14T22:40:01.210919359Z 2024-04-14T22:40:01.210925655Z 2024-04-14T22:40:01.210931111Z 2024-04-14T22:40:01.210936413Z 2024-04-14T22:40:01.210941625Z 2024-04-14T22:40:01.210953706Z 2024-04-14T22:40:01.210986331Z [2024-04-14T22:40:01.210+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:40:01.211082335Z [2024-04-14T22:40:01.210+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:40:01.211220608Z [2024-04-14T22:40:01.211+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:40:01.211296785Z [2024-04-14T22:40:01.211+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:40:01.211381125Z [2024-04-14T22:40:01.211+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:40:01.211525951Z [2024-04-14T22:40:01.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:40:01.211585436Z [2024-04-14T22:40:01.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:40:01.211722466Z [2024-04-14T22:40:01.211+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:40:01.212262734Z [2024-04-14T22:40:01.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:01.212287914Z 2024-04-14T22:40:01.212297018Z 2024-04-14T22:40:01.212305265Z 2024-04-14T22:40:01.212312787Z 2024-04-14T22:40:01.212319798Z 2024-04-14T22:40:01.212326653Z 2024-04-14T22:40:01.212333929Z 2024-04-14T22:40:01.212340960Z 2024-04-14T22:40:01.216708358Z [2024-04-14T22:40:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:40:01.216852124Z [2024-04-14T22:40:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:01.217032802Z [2024-04-14T22:40:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:40:01.217661562Z [2024-04-14T22:40:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:01.217882779Z [2024-04-14T22:40:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:01.218013336Z [2024-04-14T22:40:01.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:40:01.218229680Z [2024-04-14T22:40:01.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:01.218625763Z [2024-04-14T22:40:01.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:40:01.218907679Z [2024-04-14T22:40:01.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:01.218952633Z [2024-04-14T22:40:01.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:40:01.219369596Z [2024-04-14T22:40:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:01.219486999Z [2024-04-14T22:40:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:40:01.219662776Z [2024-04-14T22:40:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:01.219745098Z [2024-04-14T22:40:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:40:01.219923806Z [2024-04-14T22:40:01.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:01.219988912Z [2024-04-14T22:40:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:40:01.818042948Z [2024-04-14T22:40:01.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.819056537Z [2024-04-14T22:40:01.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.819233177Z [2024-04-14T22:40:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.819373750Z [2024-04-14T22:40:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.819515371Z [2024-04-14T22:40:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.819656075Z [2024-04-14T22:40:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.819792471Z [2024-04-14T22:40:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.819917932Z [2024-04-14T22:40:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:01.837005435Z [2024-04-14T22:40:01.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1455ea49-934b-4bc9-8129-caf18b7ae80a 2024-04-14T22:40:01.838034094Z [2024-04-14T22:40:01.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f15bb3d-f29a-4a16-8226-b9d8d5d06755 2024-04-14T22:40:01.838544869Z [2024-04-14T22:40:01.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed7852cc-1963-4592-ae4c-fda0ae030474 2024-04-14T22:40:01.838760120Z [2024-04-14T22:40:01.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca667212-ea17-4b54-b5fc-971eb7ad19c6 2024-04-14T22:40:01.839083199Z [2024-04-14T22:40:01.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to bde5e241-e800-4896-b1b5-ef5dbca85ce3 2024-04-14T22:40:01.839270548Z [2024-04-14T22:40:01.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 931d5983-205e-4858-8741-029eab536be8 2024-04-14T22:40:01.839464274Z [2024-04-14T22:40:01.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11b6184d-99f5-4abe-9a11-ed2fb1dfec77 2024-04-14T22:40:01.839663808Z [2024-04-14T22:40:01.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7380ee25-3224-4747-a869-f622f51f3fbd 2024-04-14T22:40:03.140937723Z [2024-04-14T22:40:03.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:03.140956799Z [2024-04-14T22:40:03.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:39:00+00:00, run_id=scheduled__2024-04-14T22:39:00+00:00, run_start_date=2024-04-14 22:40:01.075339+00:00, run_end_date=2024-04-14 22:40:03.140297+00:00, run_duration=2.064958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:39:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:40:03.164194770Z [2024-04-14T22:40:03.163+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:03.295657279Z [2024-04-14T22:40:03.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:03.308858878Z [2024-04-14T22:40:03.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:39:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:02.416679+00:00, run_end_date=2024-04-14 22:40:02.912484+00:00, run_duration=0.495805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=373 2024-04-14T22:40:04.473215063Z [2024-04-14T22:40:04.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:04.473643185Z [2024-04-14T22:40:04.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:38:00+00:00, run_id=scheduled__2024-04-14T22:38:00+00:00, run_start_date=2024-04-14 22:40:01.074241+00:00, run_end_date=2024-04-14 22:40:04.473165+00:00, run_duration=3.398924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:38:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:40:04.490656327Z [2024-04-14T22:40:04.490+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:40:04.710956654Z [2024-04-14T22:40:04.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:38:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:04.717664077Z [2024-04-14T22:40:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:38:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:02.528879+00:00, run_end_date=2024-04-14 22:40:03.403009+00:00, run_duration=0.87413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=374 2024-04-14T22:40:07.044037122Z [2024-04-14T22:40:07.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:07.044532668Z [2024-04-14T22:40:07.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:39:00+00:00, run_id=scheduled__2024-04-14T22:39:00+00:00, run_start_date=2024-04-14 22:40:01.079951+00:00, run_end_date=2024-04-14 22:40:07.043956+00:00, run_duration=5.964005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:39:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:40:07.056234487Z [2024-04-14T22:40:07.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:07.127001644Z [2024-04-14T22:40:07.113+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-14T22:40:07.127017561Z 2024-04-14T22:40:07.127020752Z 2024-04-14T22:40:07.127025266Z [2024-04-14T22:40:07.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:40:07.127028365Z [2024-04-14T22:40:07.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:40:07.127032915Z [2024-04-14T22:40:07.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:07.127039360Z 2024-04-14T22:40:07.127047955Z 2024-04-14T22:40:07.127052436Z [2024-04-14T22:40:07.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:40:07.127057253Z [2024-04-14T22:40:07.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:07.127060207Z [2024-04-14T22:40:07.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='split_metrics', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:40:07.127063279Z [2024-04-14T22:40:07.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'split_metrics', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:07.487362920Z [2024-04-14T22:40:07.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:07.487585441Z [2024-04-14T22:40:07.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.split_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:07.487737937Z [2024-04-14T22:40:07.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:07.487881324Z [2024-04-14T22:40:07.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:07.488097927Z [2024-04-14T22:40:07.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:07.488329356Z [2024-04-14T22:40:07.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:07.488480626Z [2024-04-14T22:40:07.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:07.500207939Z [2024-04-14T22:40:07.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:39:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:05.301419+00:00, run_end_date=2024-04-14 22:40:06.789930+00:00, run_duration=1.488511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=407 2024-04-14T22:40:07.500489529Z [2024-04-14T22:40:07.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c29e5fb-42d3-489d-9898-2207571de4f7 2024-04-14T22:40:07.500707796Z [2024-04-14T22:40:07.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:05.344679+00:00, run_end_date=2024-04-14 22:40:05.866746+00:00, run_duration=0.522067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=408 2024-04-14T22:40:07.500908371Z [2024-04-14T22:40:07.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0461d9f-bf72-4c6c-a3b5-c6e0bb38e4f3 2024-04-14T22:40:07.501110485Z [2024-04-14T22:40:07.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:05.824243+00:00, run_end_date=2024-04-14 22:40:06.255911+00:00, run_duration=0.431668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=440 2024-04-14T22:40:07.501354387Z [2024-04-14T22:40:07.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:39:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:05.825428+00:00, run_end_date=2024-04-14 22:40:07.239412+00:00, run_duration=1.413984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=441 2024-04-14T22:40:07.501679063Z [2024-04-14T22:40:07.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:39:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:05.079862+00:00, run_end_date=2024-04-14 22:40:07.062862+00:00, run_duration=1.983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=406 2024-04-14T22:40:07.552649600Z [2024-04-14T22:40:07.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:07.553188526Z [2024-04-14T22:40:07.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:39:00+00:00, run_id=scheduled__2024-04-14T22:39:00+00:00, run_start_date=2024-04-14 22:40:01.077541+00:00, run_end_date=2024-04-14 22:40:07.552778+00:00, run_duration=6.475237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:39:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:40:07.569289703Z [2024-04-14T22:40:07.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:07.576009429Z [2024-04-14T22:40:07.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:07.576422224Z [2024-04-14T22:40:07.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, execution_date=2024-04-14 22:39:00+00:00, run_id=scheduled__2024-04-14T22:39:00+00:00, run_start_date=2024-04-14 22:40:01.081031+00:00, run_end_date=2024-04-14 22:40:07.575935+00:00, run_duration=6.494904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:39:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=18af2469c9675b21a8619c9fb21252c0 2024-04-14T22:40:07.585015739Z [2024-04-14T22:40:07.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:07.591495504Z [2024-04-14T22:40:07.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:07.591916470Z [2024-04-14T22:40:07.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, execution_date=2024-04-14 22:39:00+00:00, run_id=scheduled__2024-04-14T22:39:00+00:00, run_start_date=2024-04-14 22:40:01.078179+00:00, run_end_date=2024-04-14 22:40:07.591422+00:00, run_duration=6.513243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:39:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=4e27e12b359e89445d2e1eac9749104f 2024-04-14T22:40:07.601921030Z [2024-04-14T22:40:07.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:07.666408873Z [2024-04-14T22:40:07.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:07.670549823Z [2024-04-14T22:40:07.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:39:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:05.711533+00:00, run_end_date=2024-04-14 22:40:07.355816+00:00, run_duration=1.644283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:01.213421+00:00, queued_by_job_id=1, pid=429 2024-04-14T22:40:09.573241817Z [2024-04-14T22:40:09.572+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-14T22:40:09.573268226Z 2024-04-14T22:40:09.573274241Z 2024-04-14T22:40:09.573287245Z [2024-04-14T22:40:09.573+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:40:09.573340673Z [2024-04-14T22:40:09.573+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:40:09.573793006Z [2024-04-14T22:40:09.573+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:09.573804358Z 2024-04-14T22:40:09.573809572Z 2024-04-14T22:40:09.576114671Z [2024-04-14T22:40:09.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:40:09.576268943Z [2024-04-14T22:40:09.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:40:09.576498614Z [2024-04-14T22:40:09.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:40:09.576736597Z [2024-04-14T22:40:09.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'collect_metrics', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:40:09.717505637Z [2024-04-14T22:40:09.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:09.717527323Z [2024-04-14T22:40:09.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.collect_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:09.717607560Z [2024-04-14T22:40:09.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:09.717662769Z [2024-04-14T22:40:09.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.split_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:09.724323312Z [2024-04-14T22:40:09.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=split_metrics, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:08.869212+00:00, run_end_date=2024-04-14 22:40:09.180883+00:00, run_duration=0.311671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:07.115955+00:00, queued_by_job_id=1, pid=472 2024-04-14T22:40:09.724429402Z [2024-04-14T22:40:09.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:08.856624+00:00, run_end_date=2024-04-14 22:40:09.200202+00:00, run_duration=0.343578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:07.115955+00:00, queued_by_job_id=1, pid=471 2024-04-14T22:40:09.724579542Z [2024-04-14T22:40:09.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbfb00a3-1368-48e5-8946-4d43792c16e0 2024-04-14T22:40:09.724671586Z [2024-04-14T22:40:09.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3590ff80-d981-430f-a6e3-8dedabfa3ac8 2024-04-14T22:40:11.954633240Z [2024-04-14T22:40:11.953+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-14T22:40:11.954673432Z 2024-04-14T22:40:11.954686838Z 2024-04-14T22:40:11.957240900Z [2024-04-14T22:40:11.956+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:40:11.958836394Z [2024-04-14T22:40:11.958+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:40:11.960605618Z [2024-04-14T22:40:11.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:11.960624914Z 2024-04-14T22:40:11.960631363Z 2024-04-14T22:40:11.970899053Z [2024-04-14T22:40:11.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:11.971395607Z [2024-04-14T22:40:11.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:11.971996949Z [2024-04-14T22:40:11.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:11.972341713Z [2024-04-14T22:40:11.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'send_prometheus', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:12.156153194Z [2024-04-14T22:40:12.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:12.156729380Z [2024-04-14T22:40:12.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.send_prometheus run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:12.156872802Z [2024-04-14T22:40:12.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:12.156998029Z [2024-04-14T22:40:12.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.collect_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:12.164576235Z [2024-04-14T22:40:12.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=0, run_start_date=2024-04-14 22:40:11.107370+00:00, run_end_date=2024-04-14 22:40:11.369985+00:00, run_duration=0.262615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:09.574192+00:00, queued_by_job_id=1, pid=487 2024-04-14T22:40:12.164836682Z [2024-04-14T22:40:12.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=0, run_start_date=2024-04-14 22:40:11.105901+00:00, run_end_date=2024-04-14 22:40:11.383201+00:00, run_duration=0.2773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:09.574192+00:00, queued_by_job_id=1, pid=488 2024-04-14T22:40:12.165196496Z [2024-04-14T22:40:12.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a05f1f0-ab85-4ede-9f44-608bc148f566 2024-04-14T22:40:12.165507744Z [2024-04-14T22:40:12.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to d36b287a-605b-47c0-be62-f99b4254fcfe 2024-04-14T22:40:14.665847676Z [2024-04-14T22:40:14.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:14.666220554Z [2024-04-14T22:40:14.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, execution_date=2024-04-14 22:35:00+00:00, run_id=scheduled__2024-04-14T22:35:00+00:00, run_start_date=2024-04-14 22:40:01.071912+00:00, run_end_date=2024-04-14 22:40:14.665640+00:00, run_duration=13.593728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:35:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=2558869d436d48107bd19a77898c1ceb 2024-04-14T22:40:14.674526721Z [2024-04-14T22:40:14.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:40:14.682316643Z [2024-04-14T22:40:14.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:14.682554043Z [2024-04-14T22:40:14.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:35:00+00:00, run_id=scheduled__2024-04-14T22:35:00+00:00, run_start_date=2024-04-14 22:40:01.073023+00:00, run_end_date=2024-04-14 22:40:14.682163+00:00, run_duration=13.60914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:35:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T22:40:14.688677306Z [2024-04-14T22:40:14.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:40:14.715905235Z [2024-04-14T22:40:14.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:14.716048797Z [2024-04-14T22:40:14.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.send_prometheus run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:14.724111574Z [2024-04-14T22:40:14.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:13.535116+00:00, run_end_date=2024-04-14 22:40:13.834767+00:00, run_duration=0.299651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:11.964609+00:00, queued_by_job_id=1, pid=498 2024-04-14T22:40:14.724472875Z [2024-04-14T22:40:14.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:13.816228+00:00, run_end_date=2024-04-14 22:40:14.096973+00:00, run_duration=0.280745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:11.964609+00:00, queued_by_job_id=1, pid=504 2024-04-14T22:40:26.893498013Z [2024-04-14T22:40:26.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:26.922661891Z [2024-04-14T22:40:26.922+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:40:26.922690837Z 2024-04-14T22:40:26.922868806Z [2024-04-14T22:40:26.922+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:40:26.923398185Z [2024-04-14T22:40:26.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:26.923408190Z 2024-04-14T22:40:26.925093722Z [2024-04-14T22:40:26.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:26.925295704Z [2024-04-14T22:40:26.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:40:26.965254531Z [2024-04-14T22:40:26.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:26.969525320Z [2024-04-14T22:40:26.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15b2ea45-3a91-4c8c-9b31-53bc88aa72b5 2024-04-14T22:40:28.087853449Z [2024-04-14T22:40:28.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:40:28.153312420Z [2024-04-14T22:40:28.152+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:40:28.153390616Z 2024-04-14T22:40:28.153486195Z [2024-04-14T22:40:28.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:40:28.154202285Z [2024-04-14T22:40:28.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:28.154215029Z 2024-04-14T22:40:28.156262327Z [2024-04-14T22:40:28.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:28.156563096Z [2024-04-14T22:40:28.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:40:28.227470626Z [2024-04-14T22:40:28.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:28.233940061Z [2024-04-14T22:40:28.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2530b0d9-9c11-4521-933b-0a4c4af1a8e8 2024-04-14T22:40:29.891697228Z [2024-04-14T22:40:29.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:29.891986384Z [2024-04-14T22:40:29.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, execution_date=2024-04-14 22:39:00+00:00, run_id=scheduled__2024-04-14T22:39:00+00:00, run_start_date=2024-04-14 22:40:26.904133+00:00, run_end_date=2024-04-14 22:40:29.891601+00:00, run_duration=2.987468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:39:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=cba5261f3c41edac981c987e71fcdbba 2024-04-14T22:40:29.899005965Z [2024-04-14T22:40:29.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:29.930519123Z [2024-04-14T22:40:29.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:29.934653271Z [2024-04-14T22:40:29.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:39:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:28.393641+00:00, run_end_date=2024-04-14 22:40:29.585230+00:00, run_duration=1.191589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:26.923701+00:00, queued_by_job_id=1, pid=513 2024-04-14T22:40:31.966258097Z [2024-04-14T22:40:31.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:31.966299735Z [2024-04-14T22:40:31.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, execution_date=2024-04-14 22:39:00+00:00, run_id=scheduled__2024-04-14T22:39:00+00:00, run_start_date=2024-04-14 22:40:28.098743+00:00, run_end_date=2024-04-14 22:40:31.965282+00:00, run_duration=3.866539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:39:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=187950eda71a688acfffe22812bf65d3 2024-04-14T22:40:31.976376946Z [2024-04-14T22:40:31.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:41:00+00:00 2024-04-14T22:40:31.995139380Z [2024-04-14T22:40:31.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:39:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:31.999652780Z [2024-04-14T22:40:31.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:39:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:29.529085+00:00, run_end_date=2024-04-14 22:40:31.026952+00:00, run_duration=1.497867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:28.154634+00:00, queued_by_job_id=1, pid=525 2024-04-14T22:40:37.122232099Z [2024-04-14T22:40:37.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:40:37.167713363Z [2024-04-14T22:40:37.167+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:40:37.167729290Z 2024-04-14T22:40:37.169090615Z [2024-04-14T22:40:37.167+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:40:37.169101339Z [2024-04-14T22:40:37.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:37.169104620Z 2024-04-14T22:40:37.170153160Z [2024-04-14T22:40:37.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:40:37.170162747Z [2024-04-14T22:40:37.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:37.363558877Z [2024-04-14T22:40:37.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:37.385441386Z [2024-04-14T22:40:37.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f303548-db2f-4b70-990f-6e24d1d397d8 2024-04-14T22:40:40.112921997Z [2024-04-14T22:40:40.112+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:40:40.112952468Z 2024-04-14T22:40:40.113084326Z [2024-04-14T22:40:40.112+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:40:40.113825591Z [2024-04-14T22:40:40.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:40.113833200Z 2024-04-14T22:40:40.117016060Z [2024-04-14T22:40:40.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='split_metrics', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:40:40.117275576Z [2024-04-14T22:40:40.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'split_metrics', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:40.179764462Z [2024-04-14T22:40:40.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.split_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:40.179816469Z [2024-04-14T22:40:40.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:40.186542932Z [2024-04-14T22:40:40.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:38.841755+00:00, run_end_date=2024-04-14 22:40:39.135929+00:00, run_duration=0.294174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:37.168491+00:00, queued_by_job_id=1, pid=538 2024-04-14T22:40:40.186710843Z [2024-04-14T22:40:40.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dad27e6-efd0-46fa-a855-c8f36d71177f 2024-04-14T22:40:42.437428669Z [2024-04-14T22:40:42.436+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:40:42.437467745Z 2024-04-14T22:40:42.437494752Z [2024-04-14T22:40:42.437+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:40:42.438184114Z [2024-04-14T22:40:42.437+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:42.438195327Z 2024-04-14T22:40:42.441058799Z [2024-04-14T22:40:42.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:40:42.441177194Z [2024-04-14T22:40:42.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'collect_metrics', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:40:42.514930305Z [2024-04-14T22:40:42.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.collect_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:42.515041953Z [2024-04-14T22:40:42.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.split_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:42.523851778Z [2024-04-14T22:40:42.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=split_metrics, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:41.479413+00:00, run_end_date=2024-04-14 22:40:41.834550+00:00, run_duration=0.355137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:40.114190+00:00, queued_by_job_id=1, pid=551 2024-04-14T22:40:42.524098130Z [2024-04-14T22:40:42.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51194a66-b5fe-4856-a4f8-287240ff1d01 2024-04-14T22:40:45.212983078Z [2024-04-14T22:40:45.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:40:45.213028283Z 2024-04-14T22:40:45.213359084Z [2024-04-14T22:40:45.213+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:40:45.214199082Z [2024-04-14T22:40:45.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:40:45.214241886Z 2024-04-14T22:40:45.216818679Z [2024-04-14T22:40:45.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:40:45.216993634Z [2024-04-14T22:40:45.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'send_prometheus', 'scheduled__2024-04-14T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:40:45.270549538Z [2024-04-14T22:40:45.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.send_prometheus run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status queued for try_number 1 2024-04-14T22:40:45.270912832Z [2024-04-14T22:40:45.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.collect_metrics run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:45.276897717Z [2024-04-14T22:40:45.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=0, run_start_date=2024-04-14 22:40:43.864757+00:00, run_end_date=2024-04-14 22:40:44.217177+00:00, run_duration=0.35242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:42.438477+00:00, queued_by_job_id=1, pid=559 2024-04-14T22:40:45.277215888Z [2024-04-14T22:40:45.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84e9409b-c8e8-42cb-8325-fde5e05429d4 2024-04-14T22:40:47.050462821Z [2024-04-14T22:40:47.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:40:47.050486225Z [2024-04-14T22:40:47.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, execution_date=2024-04-14 22:35:00+00:00, run_id=scheduled__2024-04-14T22:35:00+00:00, run_start_date=2024-04-14 22:40:37.131634+00:00, run_end_date=2024-04-14 22:40:47.050182+00:00, run_duration=9.918548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:35:00+00:00, data_interval_end=2024-04-14 22:40:00+00:00, dag_hash=484b2068c4d5d0aa9e6cd8cabad6f75f 2024-04-14T22:40:47.056672790Z [2024-04-14T22:40:47.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:40:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:40:48.185680913Z [2024-04-14T22:40:48.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.send_prometheus run_id=scheduled__2024-04-14T22:35:00+00:00 exited with status success for try_number 1 2024-04-14T22:40:48.194229438Z [2024-04-14T22:40:48.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:35:00+00:00, map_index=-1, run_start_date=2024-04-14 22:40:46.611926+00:00, run_end_date=2024-04-14 22:40:46.981619+00:00, run_duration=0.369693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:40:45.214547+00:00, queued_by_job_id=1, pid=580 2024-04-14T22:40:59.538995539Z [2024-04-14T22:40:59.538+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T22:41:01.021172852Z [2024-04-14T22:41:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:41:01.037789479Z [2024-04-14T22:41:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:01.050657136Z [2024-04-14T22:41:01.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:01.057604023Z [2024-04-14T22:41:01.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:41:01.064396444Z [2024-04-14T22:41:01.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:41:01.084752883Z [2024-04-14T22:41:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:01.099807251Z [2024-04-14T22:41:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:01.183453800Z [2024-04-14T22:41:01.183+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-14T22:41:01.183488830Z 2024-04-14T22:41:01.183497462Z 2024-04-14T22:41:01.183506284Z 2024-04-14T22:41:01.183514186Z 2024-04-14T22:41:01.183521824Z 2024-04-14T22:41:01.183529921Z 2024-04-14T22:41:01.183537840Z 2024-04-14T22:41:01.183584970Z [2024-04-14T22:41:01.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:41:01.183728191Z [2024-04-14T22:41:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:41:01.183955804Z [2024-04-14T22:41:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:41:01.184130165Z [2024-04-14T22:41:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 has 0/16 running and queued tasks 2024-04-14T22:41:01.184251125Z [2024-04-14T22:41:01.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:41:01.184377818Z [2024-04-14T22:41:01.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:41:01.184556644Z [2024-04-14T22:41:01.184+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:41:01.185151603Z [2024-04-14T22:41:01.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:41:01.185167011Z 2024-04-14T22:41:01.185175921Z 2024-04-14T22:41:01.185184439Z 2024-04-14T22:41:01.185226862Z 2024-04-14T22:41:01.185235976Z 2024-04-14T22:41:01.185244340Z 2024-04-14T22:41:01.185253357Z 2024-04-14T22:41:01.196175530Z [2024-04-14T22:41:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:01.196262359Z [2024-04-14T22:41:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:41:01.196441296Z [2024-04-14T22:41:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:01.196538943Z [2024-04-14T22:41:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:41:01.196757719Z [2024-04-14T22:41:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:01.196780904Z [2024-04-14T22:41:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:41:01.197048063Z [2024-04-14T22:41:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:01.197071000Z [2024-04-14T22:41:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:41:01.197266052Z [2024-04-14T22:41:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:01.197353909Z [2024-04-14T22:41:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:41:01.197572053Z [2024-04-14T22:41:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:01.197721485Z [2024-04-14T22:41:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:41:01.197950085Z [2024-04-14T22:41:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:01.198050446Z [2024-04-14T22:41:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:41:01.819799858Z [2024-04-14T22:41:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:41:01.819971215Z [2024-04-14T22:41:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:41:01.820118295Z [2024-04-14T22:41:01.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:41:01.820235569Z [2024-04-14T22:41:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:41:01.820366081Z [2024-04-14T22:41:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:41:01.820483863Z [2024-04-14T22:41:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:41:01.820636594Z [2024-04-14T22:41:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:41:01.860467235Z [2024-04-14T22:41:01.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58e95e18-16b3-45e2-a7e1-d5107246f132 2024-04-14T22:41:01.860853644Z [2024-04-14T22:41:01.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09ed8d39-0afd-4ec1-85d0-f6ac3cb824af 2024-04-14T22:41:01.861133779Z [2024-04-14T22:41:01.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9a49148-fa1f-4147-a8f9-3770eaaab281 2024-04-14T22:41:01.861334249Z [2024-04-14T22:41:01.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8caaf2ce-51f0-41e5-b2d5-8c7808647d3b 2024-04-14T22:41:01.861527358Z [2024-04-14T22:41:01.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9603059-bff6-4899-89f8-c7fe1ac68f37 2024-04-14T22:41:01.861701818Z [2024-04-14T22:41:01.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9759282a-2770-4a7f-8f89-08f2a06a8173 2024-04-14T22:41:01.861853827Z [2024-04-14T22:41:01.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc8cb6ff-8106-4f3b-9479-1d0346c58b77 2024-04-14T22:41:03.272930213Z [2024-04-14T22:41:03.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:41:03.273637640Z [2024-04-14T22:41:03.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:40:00+00:00, run_id=scheduled__2024-04-14T22:40:00+00:00, run_start_date=2024-04-14 22:41:01.113369+00:00, run_end_date=2024-04-14 22:41:03.272930+00:00, run_duration=2.159561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:40:00+00:00, data_interval_end=2024-04-14 22:41:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:41:03.286671318Z [2024-04-14T22:41:03.286+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:03.336003159Z [2024-04-14T22:41:03.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:41:03.343141793Z [2024-04-14T22:41:03.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=2024-04-14 22:41:02.537081+00:00, run_end_date=2024-04-14 22:41:02.990811+00:00, run_duration=0.45373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:01.191242+00:00, queued_by_job_id=1, pid=594 2024-04-14T22:41:03.881972287Z [2024-04-14T22:41:03.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status failed for try_number 1 2024-04-14T22:41:03.883817523Z [2024-04-14T22:41:03.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status failed for try_number 1 2024-04-14T22:41:03.883940494Z [2024-04-14T22:41:03.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status failed for try_number 1 2024-04-14T22:41:03.896311064Z [2024-04-14T22:41:03.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:01.191242+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:41:03.896779265Z [2024-04-14T22:41:03.896+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:03.900214724Z [2024-04-14T22:41:03.900+0000] {dagbag.py:207} WARNING - Serialized DAG vim_status_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 no longer exists 2024-04-14T22:41:03.903135997Z [2024-04-14T22:41:03.901+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-14T22:41:03.903164718Z Traceback (most recent call last): 2024-04-14T22:41:03.903170598Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-14T22:41:03.903174968Z task = dag.get_task(ti.task_id) 2024-04-14T22:41:03.903179939Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-14T22:41:03.917917941Z [2024-04-14T22:41:03.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:01.191242+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:41:03.918311142Z [2024-04-14T22:41:03.918+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:03.919806825Z [2024-04-14T22:41:03.919+0000] {dagbag.py:207} WARNING - Serialized DAG vm_status_vim_5af8c24b-a488-4ecb-a0fb-b8a0155b4f41 no longer exists 2024-04-14T22:41:03.920917966Z [2024-04-14T22:41:03.920+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-14T22:41:03.920931570Z Traceback (most recent call last): 2024-04-14T22:41:03.920964006Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-14T22:41:03.920969269Z task = dag.get_task(ti.task_id) 2024-04-14T22:41:03.920974114Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-14T22:41:03.929216770Z [2024-04-14T22:41:03.928+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:01.191242+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:41:03.929585991Z [2024-04-14T22:41:03.929+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:03.931426350Z [2024-04-14T22:41:03.931+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:03.972283504Z [2024-04-14T22:41:03.972+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240414T224000, start_date=, end_date=20240414T224103 2024-04-14T22:41:04.472335477Z [2024-04-14T22:41:04.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status failed for try_number 1 2024-04-14T22:41:04.478839025Z [2024-04-14T22:41:04.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:01.191242+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:41:04.479267104Z [2024-04-14T22:41:04.479+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:04.481155941Z [2024-04-14T22:41:04.480+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:04.491750035Z [2024-04-14T22:41:04.491+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240414T224000, start_date=, end_date=20240414T224104 2024-04-14T22:41:05.549902995Z [2024-04-14T22:41:05.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:41:05.550156057Z [2024-04-14T22:41:05.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:40:00+00:00, run_id=scheduled__2024-04-14T22:40:00+00:00, run_start_date=2024-04-14 22:41:01.111748+00:00, run_end_date=2024-04-14 22:41:05.549716+00:00, run_duration=4.437968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:40:00+00:00, data_interval_end=2024-04-14 22:41:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:41:05.569255248Z [2024-04-14T22:41:05.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:05.645310020Z [2024-04-14T22:41:05.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:41:05.652160119Z [2024-04-14T22:41:05.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=2024-04-14 22:41:04.120189+00:00, run_end_date=2024-04-14 22:41:05.366441+00:00, run_duration=1.246252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:01.191242+00:00, queued_by_job_id=1, pid=656 2024-04-14T22:41:06.712028488Z [2024-04-14T22:41:06.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:41:06.712858324Z [2024-04-14T22:41:06.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:40:00+00:00, run_id=scheduled__2024-04-14T22:40:00+00:00, run_start_date=2024-04-14 22:41:01.110053+00:00, run_end_date=2024-04-14 22:41:06.711815+00:00, run_duration=5.601762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:40:00+00:00, data_interval_end=2024-04-14 22:41:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:41:06.727942344Z [2024-04-14T22:41:06.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:06.795098000Z [2024-04-14T22:41:06.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:41:06.809847071Z [2024-04-14T22:41:06.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=2024-04-14 22:41:04.015361+00:00, run_end_date=2024-04-14 22:41:05.642366+00:00, run_duration=1.627005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:01.191242+00:00, queued_by_job_id=1, pid=645 2024-04-14T22:41:14.034851957Z [2024-04-14T22:41:14.034+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:41:14.034954855Z 2024-04-14T22:41:14.035096584Z [2024-04-14T22:41:14.034+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:41:14.035878450Z [2024-04-14T22:41:14.035+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:41:14.035893041Z 2024-04-14T22:41:14.038714988Z [2024-04-14T22:41:14.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:14.038984877Z [2024-04-14T22:41:14.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:41:14.097469644Z [2024-04-14T22:41:14.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 2 2024-04-14T22:41:14.104025333Z [2024-04-14T22:41:14.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to aec8ff2f-cddf-4c3e-b17f-74a5983c7544 2024-04-14T22:41:14.726218863Z [2024-04-14T22:41:14.725+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:41:14.726241230Z 2024-04-14T22:41:14.726244464Z [2024-04-14T22:41:14.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:41:14.726894100Z [2024-04-14T22:41:14.726+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:41:14.726908353Z 2024-04-14T22:41:14.728874625Z [2024-04-14T22:41:14.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:41:14.729011158Z [2024-04-14T22:41:14.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:41:14.787886795Z [2024-04-14T22:41:14.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 2 2024-04-14T22:41:14.798174328Z [2024-04-14T22:41:14.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70cff563-aef3-4b81-bb54-b96a80b166e4 2024-04-14T22:41:15.945560547Z [2024-04-14T22:41:15.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status failed for try_number 2 2024-04-14T22:41:15.950597477Z [2024-04-14T22:41:15.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-14 22:41:03.934687+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:14.036264+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:41:15.951295008Z [2024-04-14T22:41:15.950+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:15.953186325Z [2024-04-14T22:41:15.952+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:15.963420613Z [2024-04-14T22:41:15.963+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240414T224000, start_date=, end_date=20240414T224115 2024-04-14T22:41:17.033040731Z [2024-04-14T22:41:17.032+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-14T22:41:17.033374010Z [2024-04-14T22:41:17.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, execution_date=2024-04-14 22:40:00+00:00, run_id=scheduled__2024-04-14T22:40:00+00:00, run_start_date=2024-04-14 22:41:01.109144+00:00, run_end_date=2024-04-14 22:41:17.032919+00:00, run_duration=15.923775, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:40:00+00:00, data_interval_end=2024-04-14 22:41:00+00:00, dag_hash=187950eda71a688acfffe22812bf65d3 2024-04-14T22:41:17.042867515Z [2024-04-14T22:41:17.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:41:17.098291347Z [2024-04-14T22:41:17.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status failed for try_number 2 2024-04-14T22:41:17.118977325Z [2024-04-14T22:41:17.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-14 22:41:04.483107+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:41:14.727160+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:41:17.120206721Z [2024-04-14T22:41:17.119+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:17.121790473Z [2024-04-14T22:41:17.121+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:41:17.138382331Z [2024-04-14T22:41:17.138+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240414T224000, start_date=, end_date=20240414T224117 2024-04-14T22:41:18.206731266Z [2024-04-14T22:41:18.205+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-14T22:41:18.207581719Z [2024-04-14T22:41:18.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, execution_date=2024-04-14 22:40:00+00:00, run_id=scheduled__2024-04-14T22:40:00+00:00, run_start_date=2024-04-14 22:41:01.112559+00:00, run_end_date=2024-04-14 22:41:18.207025+00:00, run_duration=17.094466, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:40:00+00:00, data_interval_end=2024-04-14 22:41:00+00:00, dag_hash=cba5261f3c41edac981c987e71fcdbba 2024-04-14T22:41:18.222075694Z [2024-04-14T22:41:18.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:41:00+00:00, run_after=2024-04-14T22:42:00+00:00 2024-04-14T22:42:00.443217367Z [2024-04-14T22:42:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 to 2024-04-14T22:42:00+00:00, run_after=2024-04-14T22:43:00+00:00 2024-04-14T22:42:00.455769515Z [2024-04-14T22:42:00.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:42:00+00:00, run_after=2024-04-14T22:43:00+00:00 2024-04-14T22:42:00.461874214Z [2024-04-14T22:42:00.461+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:42:00.467264949Z [2024-04-14T22:42:00.467+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:42:00.472809782Z [2024-04-14T22:42:00.472+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:42:00.483918652Z [2024-04-14T22:42:00.483+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:42:00+00:00, run_after=2024-04-14T22:43:00+00:00 2024-04-14T22:42:00.595400598Z [2024-04-14T22:42:00.595+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-14T22:42:00.595423024Z 2024-04-14T22:42:00.595427589Z 2024-04-14T22:42:00.595442607Z 2024-04-14T22:42:00.595445641Z 2024-04-14T22:42:00.595448886Z 2024-04-14T22:42:00.595451778Z 2024-04-14T22:42:00.595719333Z [2024-04-14T22:42:00.595+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:42:00.595916320Z [2024-04-14T22:42:00.595+0000] {scheduler_job.py:425} INFO - DAG vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:42:00.596102312Z [2024-04-14T22:42:00.595+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:42:00.596281430Z [2024-04-14T22:42:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8 has 0/16 running and queued tasks 2024-04-14T22:42:00.596457902Z [2024-04-14T22:42:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:42:00.596632611Z [2024-04-14T22:42:00.596+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:42:00.597249852Z [2024-04-14T22:42:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:42:00.597260990Z 2024-04-14T22:42:00.597264786Z 2024-04-14T22:42:00.597267793Z 2024-04-14T22:42:00.597270741Z 2024-04-14T22:42:00.597273838Z 2024-04-14T22:42:00.597276754Z 2024-04-14T22:42:00.602777382Z [2024-04-14T22:42:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:42:00.603031407Z [2024-04-14T22:42:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:42:00.603315611Z [2024-04-14T22:42:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:42:00.603491141Z [2024-04-14T22:42:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:42:00.603769445Z [2024-04-14T22:42:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:42:00.604034933Z [2024-04-14T22:42:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:42:00.604300170Z [2024-04-14T22:42:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:42:00.604480213Z [2024-04-14T22:42:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:42:00.604745035Z [2024-04-14T22:42:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:42:00.604920346Z [2024-04-14T22:42:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:42:00.605192784Z [2024-04-14T22:42:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:42:00.605367078Z [2024-04-14T22:42:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:42:01.119980372Z [2024-04-14T22:42:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:42:01.123154350Z [2024-04-14T22:42:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status queued for try_number 1 2024-04-14T22:42:01.123321431Z [2024-04-14T22:42:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status queued for try_number 1 2024-04-14T22:42:01.123460122Z [2024-04-14T22:42:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status queued for try_number 1 2024-04-14T22:42:01.123577993Z [2024-04-14T22:42:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status queued for try_number 1 2024-04-14T22:42:01.123682405Z [2024-04-14T22:42:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status queued for try_number 1 2024-04-14T22:42:01.160265387Z [2024-04-14T22:42:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f34fef8-2699-4ca2-a0aa-61ab4c0a501c 2024-04-14T22:42:01.167215504Z [2024-04-14T22:42:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5484076d-4b10-4e8f-a3d8-fb8643348eff 2024-04-14T22:42:01.167412685Z [2024-04-14T22:42:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57f44251-8d95-49a9-83f8-45a46b617847 2024-04-14T22:42:01.179117970Z [2024-04-14T22:42:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97b0f2e9-e58c-46e0-bba1-a6269b1d59d1 2024-04-14T22:42:01.179322911Z [2024-04-14T22:42:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d7566f9-c111-47af-894b-adbe1101b9e1 2024-04-14T22:42:01.179490582Z [2024-04-14T22:42:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49359e47-161f-4a9e-ac6e-ff31d9b88786 2024-04-14T22:42:02.293806216Z [2024-04-14T22:42:02.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:42:02.298203747Z [2024-04-14T22:42:02.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:40:00+00:00, run_id=scheduled__2024-04-14T22:40:00+00:00, run_start_date=2024-04-14 22:42:00.497564+00:00, run_end_date=2024-04-14 22:42:02.297753+00:00, run_duration=1.800189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:40:00+00:00, data_interval_end=2024-04-14 22:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:42:02.310561310Z [2024-04-14T22:42:02.310+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:42:00+00:00, run_after=2024-04-14T22:44:00+00:00 2024-04-14T22:42:02.497068157Z [2024-04-14T22:42:02.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:42:02.515892821Z [2024-04-14T22:42:02.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=2024-04-14 22:42:01.617212+00:00, run_end_date=2024-04-14 22:42:01.896128+00:00, run_duration=0.278916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:42:00.598338+00:00, queued_by_job_id=1, pid=710 2024-04-14T22:42:03.603123032Z [2024-04-14T22:42:03.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:42:03.603339023Z [2024-04-14T22:42:03.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:41:00+00:00, run_id=scheduled__2024-04-14T22:41:00+00:00, run_start_date=2024-04-14 22:42:00.502690+00:00, run_end_date=2024-04-14 22:42:03.602891+00:00, run_duration=3.100201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:41:00+00:00, data_interval_end=2024-04-14 22:42:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:42:03.615010505Z [2024-04-14T22:42:03.614+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:42:00+00:00, run_after=2024-04-14T22:43:00+00:00 2024-04-14T22:42:03.648646928Z [2024-04-14T22:42:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status failed for try_number 1 2024-04-14T22:42:03.648809536Z [2024-04-14T22:42:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status failed for try_number 1 2024-04-14T22:42:03.648955261Z [2024-04-14T22:42:03.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status success for try_number 1 2024-04-14T22:42:03.654980769Z [2024-04-14T22:42:03.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:42:00.598338+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:42:03.655506674Z [2024-04-14T22:42:03.655+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:42:03.664307515Z [2024-04-14T22:42:03.663+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:42:03.675630410Z [2024-04-14T22:42:03.675+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240414T224100, start_date=, end_date=20240414T224203 2024-04-14T22:42:03.682662787Z [2024-04-14T22:42:03.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:42:00.598338+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:42:03.683064770Z [2024-04-14T22:42:03.682+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:42:03.685047933Z [2024-04-14T22:42:03.684+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:42:03.694437001Z [2024-04-14T22:42:03.694+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ff174421-fa0f-48c7-a19f-c66eaf0981b8, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240414T224100, start_date=, end_date=20240414T224203 2024-04-14T22:42:03.704256709Z [2024-04-14T22:42:03.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:41:00+00:00, map_index=-1, run_start_date=2024-04-14 22:42:02.638133+00:00, run_end_date=2024-04-14 22:42:02.989948+00:00, run_duration=0.351815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:42:00.598338+00:00, queued_by_job_id=1, pid=724 2024-04-14T22:42:04.454739043Z [2024-04-14T22:42:04.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:42:04.455000406Z [2024-04-14T22:42:04.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:41:00+00:00, run_id=scheduled__2024-04-14T22:41:00+00:00, run_start_date=2024-04-14 22:42:00.499887+00:00, run_end_date=2024-04-14 22:42:04.454646+00:00, run_duration=3.954759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:41:00+00:00, data_interval_end=2024-04-14 22:42:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:42:04.462599260Z [2024-04-14T22:42:04.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:42:00+00:00, run_after=2024-04-14T22:43:00+00:00 2024-04-14T22:42:04.492478122Z [2024-04-14T22:42:04.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status success for try_number 1 2024-04-14T22:42:04.497186735Z [2024-04-14T22:42:04.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:41:00+00:00, map_index=-1, run_start_date=2024-04-14 22:42:03.058566+00:00, run_end_date=2024-04-14 22:42:04.386448+00:00, run_duration=1.327882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:42:00.598338+00:00, queued_by_job_id=1, pid=742 2024-04-14T22:42:05.562222597Z [2024-04-14T22:42:05.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:42:05.562647573Z [2024-04-14T22:42:05.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:41:00+00:00, run_id=scheduled__2024-04-14T22:41:00+00:00, run_start_date=2024-04-14 22:42:00.501807+00:00, run_end_date=2024-04-14 22:42:05.561983+00:00, run_duration=5.060176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:41:00+00:00, data_interval_end=2024-04-14 22:42:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:42:05.577273081Z [2024-04-14T22:42:05.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:42:00+00:00, run_after=2024-04-14T22:43:00+00:00 2024-04-14T22:42:05.615690417Z [2024-04-14T22:42:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:41:00+00:00 exited with status success for try_number 1 2024-04-14T22:42:05.623755049Z [2024-04-14T22:42:05.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:41:00+00:00, map_index=-1, run_start_date=2024-04-14 22:42:03.587695+00:00, run_end_date=2024-04-14 22:42:05.255540+00:00, run_duration=1.667845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:42:00.598338+00:00, queued_by_job_id=1, pid=767 2024-04-14T22:43:00.104120695Z [2024-04-14T22:43:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:43:00+00:00, run_after=2024-04-14T22:44:00+00:00 2024-04-14T22:43:00.118717498Z [2024-04-14T22:43:00.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:43:00+00:00, run_after=2024-04-14T22:44:00+00:00 2024-04-14T22:43:00.133755956Z [2024-04-14T22:43:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:43:00.218657629Z [2024-04-14T22:43:00.218+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T22:43:00.218687176Z 2024-04-14T22:43:00.218692829Z 2024-04-14T22:43:00.218697595Z 2024-04-14T22:43:00.218862182Z [2024-04-14T22:43:00.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:43:00.219157528Z [2024-04-14T22:43:00.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:43:00.219382557Z [2024-04-14T22:43:00.219+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:43:00.220207076Z [2024-04-14T22:43:00.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:43:00.220221936Z 2024-04-14T22:43:00.220227136Z 2024-04-14T22:43:00.220231888Z 2024-04-14T22:43:00.225239536Z [2024-04-14T22:43:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:43:00.225488437Z [2024-04-14T22:43:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:43:00.225877439Z [2024-04-14T22:43:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:43:00.226090784Z [2024-04-14T22:43:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:43:00.226441906Z [2024-04-14T22:43:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:43:00.226661028Z [2024-04-14T22:43:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:43:00.588315526Z [2024-04-14T22:43:00.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status queued for try_number 1 2024-04-14T22:43:00.588402717Z [2024-04-14T22:43:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status queued for try_number 1 2024-04-14T22:43:00.588481565Z [2024-04-14T22:43:00.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status queued for try_number 1 2024-04-14T22:43:00.596405073Z [2024-04-14T22:43:00.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f9fb38c-f022-40d9-8a3f-5d46ce7e4605 2024-04-14T22:43:00.596498817Z [2024-04-14T22:43:00.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to a73f5c4d-3a58-4b1d-a95a-ff91ceaecf13 2024-04-14T22:43:00.596679916Z [2024-04-14T22:43:00.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76b4108e-e026-4384-9dc8-351b65bc288b 2024-04-14T22:43:01.861031012Z [2024-04-14T22:43:01.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:43:01.861851011Z [2024-04-14T22:43:01.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:42:00+00:00, run_id=scheduled__2024-04-14T22:42:00+00:00, run_start_date=2024-04-14 22:43:00.166020+00:00, run_end_date=2024-04-14 22:43:01.861460+00:00, run_duration=1.69544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:42:00+00:00, data_interval_end=2024-04-14 22:43:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:43:01.876038498Z [2024-04-14T22:43:01.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:43:00+00:00, run_after=2024-04-14T22:44:00+00:00 2024-04-14T22:43:01.925034588Z [2024-04-14T22:43:01.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status success for try_number 1 2024-04-14T22:43:01.931945032Z [2024-04-14T22:43:01.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:42:00+00:00, map_index=-1, run_start_date=2024-04-14 22:43:01.121370+00:00, run_end_date=2024-04-14 22:43:01.507919+00:00, run_duration=0.386549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:43:00.221062+00:00, queued_by_job_id=1, pid=795 2024-04-14T22:43:03.879947957Z [2024-04-14T22:43:03.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:43:03.880230565Z [2024-04-14T22:43:03.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:42:00+00:00, run_id=scheduled__2024-04-14T22:42:00+00:00, run_start_date=2024-04-14 22:43:00.164252+00:00, run_end_date=2024-04-14 22:43:03.879794+00:00, run_duration=3.715542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:42:00+00:00, data_interval_end=2024-04-14 22:43:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:43:03.892078651Z [2024-04-14T22:43:03.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:43:00+00:00, run_after=2024-04-14T22:44:00+00:00 2024-04-14T22:43:03.900102221Z [2024-04-14T22:43:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:43:03.901019307Z [2024-04-14T22:43:03.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:42:00+00:00, run_id=scheduled__2024-04-14T22:42:00+00:00, run_start_date=2024-04-14 22:43:00.167754+00:00, run_end_date=2024-04-14 22:43:03.900299+00:00, run_duration=3.732545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:42:00+00:00, data_interval_end=2024-04-14 22:43:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:43:03.924893533Z [2024-04-14T22:43:03.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:43:00+00:00, run_after=2024-04-14T22:44:00+00:00 2024-04-14T22:43:03.963517416Z [2024-04-14T22:43:03.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status success for try_number 1 2024-04-14T22:43:03.963916728Z [2024-04-14T22:43:03.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status success for try_number 1 2024-04-14T22:43:03.973603708Z [2024-04-14T22:43:03.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:42:00+00:00, map_index=-1, run_start_date=2024-04-14 22:43:01.846075+00:00, run_end_date=2024-04-14 22:43:03.402545+00:00, run_duration=1.55647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:43:00.221062+00:00, queued_by_job_id=1, pid=814 2024-04-14T22:43:03.974153612Z [2024-04-14T22:43:03.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:42:00+00:00, map_index=-1, run_start_date=2024-04-14 22:43:01.814453+00:00, run_end_date=2024-04-14 22:43:02.985758+00:00, run_duration=1.171305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:43:00.221062+00:00, queued_by_job_id=1, pid=813 2024-04-14T22:44:00.048538100Z [2024-04-14T22:44:00.048+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:44:00.059355700Z [2024-04-14T22:44:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:44:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:44:00.069228248Z [2024-04-14T22:44:00.068+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:44:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:44:00.074164630Z [2024-04-14T22:44:00.073+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:44:00.125623778Z [2024-04-14T22:44:00.125+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T22:44:00.125641743Z 2024-04-14T22:44:00.125657833Z 2024-04-14T22:44:00.125660826Z 2024-04-14T22:44:00.125663831Z 2024-04-14T22:44:00.126024848Z [2024-04-14T22:44:00.125+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:44:00.126245512Z [2024-04-14T22:44:00.126+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:44:00.126437390Z [2024-04-14T22:44:00.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:44:00.126632474Z [2024-04-14T22:44:00.126+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:44:00.127170509Z [2024-04-14T22:44:00.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:44:00.127181241Z 2024-04-14T22:44:00.127184331Z 2024-04-14T22:44:00.127187048Z 2024-04-14T22:44:00.127189870Z 2024-04-14T22:44:00.129638310Z [2024-04-14T22:44:00.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:44:00.129853316Z [2024-04-14T22:44:00.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:44:00.130194400Z [2024-04-14T22:44:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:44:00.130394916Z [2024-04-14T22:44:00.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:44:00.130693016Z [2024-04-14T22:44:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:44:00.130868533Z [2024-04-14T22:44:00.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:44:00.131169688Z [2024-04-14T22:44:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:44:00.131346087Z [2024-04-14T22:44:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:44:00.822262273Z [2024-04-14T22:44:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status queued for try_number 1 2024-04-14T22:44:00.822504154Z [2024-04-14T22:44:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:43:00+00:00 exited with status queued for try_number 1 2024-04-14T22:44:00.822509934Z [2024-04-14T22:44:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:43:00+00:00 exited with status queued for try_number 1 2024-04-14T22:44:00.822513224Z [2024-04-14T22:44:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:43:00+00:00 exited with status queued for try_number 1 2024-04-14T22:44:00.835091489Z [2024-04-14T22:44:00.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7530fbc7-d0e6-4f1f-b382-50a99cc970c1 2024-04-14T22:44:00.835144967Z [2024-04-14T22:44:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb9a2d55-e0e7-4f44-8aea-721d1c67501c 2024-04-14T22:44:00.835275773Z [2024-04-14T22:44:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to f71ca4e3-db40-4da0-936a-a8ac510b8a2c 2024-04-14T22:44:00.835392610Z [2024-04-14T22:44:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 036c2d20-ba28-4352-b21f-53b925d05f6c 2024-04-14T22:44:03.015766146Z [2024-04-14T22:44:03.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:44:03.016126394Z [2024-04-14T22:44:03.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:42:00+00:00, run_id=scheduled__2024-04-14T22:42:00+00:00, run_start_date=2024-04-14 22:44:00.081667+00:00, run_end_date=2024-04-14 22:44:03.015687+00:00, run_duration=2.93402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:42:00+00:00, data_interval_end=2024-04-14 22:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:44:03.023052156Z [2024-04-14T22:44:03.022+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:44:00+00:00, run_after=2024-04-14T22:46:00+00:00 2024-04-14T22:44:03.031251147Z [2024-04-14T22:44:03.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:44:03.031471038Z [2024-04-14T22:44:03.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:43:00+00:00, run_id=scheduled__2024-04-14T22:43:00+00:00, run_start_date=2024-04-14 22:44:00.084375+00:00, run_end_date=2024-04-14 22:44:03.031188+00:00, run_duration=2.946813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:43:00+00:00, data_interval_end=2024-04-14 22:44:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:44:03.045861719Z [2024-04-14T22:44:03.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:44:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:44:03.120176068Z [2024-04-14T22:44:03.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:42:00+00:00 exited with status success for try_number 1 2024-04-14T22:44:03.120200372Z [2024-04-14T22:44:03.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:43:00+00:00 exited with status success for try_number 1 2024-04-14T22:44:03.129208397Z [2024-04-14T22:44:03.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:42:00+00:00, map_index=-1, run_start_date=2024-04-14 22:44:01.494290+00:00, run_end_date=2024-04-14 22:44:02.557977+00:00, run_duration=1.063687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:44:00.127840+00:00, queued_by_job_id=1, pid=847 2024-04-14T22:44:03.131002235Z [2024-04-14T22:44:03.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:43:00+00:00, map_index=-1, run_start_date=2024-04-14 22:44:01.654565+00:00, run_end_date=2024-04-14 22:44:02.622562+00:00, run_duration=0.967997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:44:00.127840+00:00, queued_by_job_id=1, pid=848 2024-04-14T22:44:05.263051055Z [2024-04-14T22:44:05.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:44:05.263064869Z [2024-04-14T22:44:05.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:43:00+00:00, run_id=scheduled__2024-04-14T22:43:00+00:00, run_start_date=2024-04-14 22:44:00.083536+00:00, run_end_date=2024-04-14 22:44:05.259057+00:00, run_duration=5.175521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:43:00+00:00, data_interval_end=2024-04-14 22:44:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:44:05.268714256Z [2024-04-14T22:44:05.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:44:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:44:05.320951073Z [2024-04-14T22:44:05.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:43:00+00:00 exited with status success for try_number 1 2024-04-14T22:44:05.324550858Z [2024-04-14T22:44:05.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:43:00+00:00, map_index=-1, run_start_date=2024-04-14 22:44:03.771613+00:00, run_end_date=2024-04-14 22:44:05.018524+00:00, run_duration=1.246911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:44:00.127840+00:00, queued_by_job_id=1, pid=872 2024-04-14T22:44:06.363010179Z [2024-04-14T22:44:06.362+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:44:06.363374935Z [2024-04-14T22:44:06.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:43:00+00:00, run_id=scheduled__2024-04-14T22:43:00+00:00, run_start_date=2024-04-14 22:44:00.082661+00:00, run_end_date=2024-04-14 22:44:06.362916+00:00, run_duration=6.280255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:43:00+00:00, data_interval_end=2024-04-14 22:44:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:44:06.372501108Z [2024-04-14T22:44:06.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:44:00+00:00, run_after=2024-04-14T22:45:00+00:00 2024-04-14T22:44:06.394542004Z [2024-04-14T22:44:06.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:43:00+00:00 exited with status success for try_number 1 2024-04-14T22:44:06.399783556Z [2024-04-14T22:44:06.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:43:00+00:00, map_index=-1, run_start_date=2024-04-14 22:44:03.664471+00:00, run_end_date=2024-04-14 22:44:05.274380+00:00, run_duration=1.609909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:44:00.127840+00:00, queued_by_job_id=1, pid=871 2024-04-14T22:45:00.904491587Z [2024-04-14T22:45:00.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:45:00+00:00, run_after=2024-04-14T22:46:00+00:00 2024-04-14T22:45:00.913159475Z [2024-04-14T22:45:00.912+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:45:00.925965831Z [2024-04-14T22:45:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:45:00+00:00, run_after=2024-04-14T22:46:00+00:00 2024-04-14T22:45:00.939327082Z [2024-04-14T22:45:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:45:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:45:01.026529453Z [2024-04-14T22:45:01.026+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T22:45:01.026558392Z 2024-04-14T22:45:01.026562423Z 2024-04-14T22:45:01.026565550Z 2024-04-14T22:45:01.026568633Z 2024-04-14T22:45:01.026605649Z [2024-04-14T22:45:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:45:01.026682897Z [2024-04-14T22:45:01.026+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:45:01.026940264Z [2024-04-14T22:45:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:45:01.027034352Z [2024-04-14T22:45:01.026+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:45:01.027558851Z [2024-04-14T22:45:01.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:45:01.027566341Z 2024-04-14T22:45:01.027569446Z 2024-04-14T22:45:01.027572336Z 2024-04-14T22:45:01.027575117Z 2024-04-14T22:45:01.030930539Z [2024-04-14T22:45:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:45:01.031048931Z [2024-04-14T22:45:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:45:01.031300054Z [2024-04-14T22:45:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:45:01.031395191Z [2024-04-14T22:45:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:45:01.031558573Z [2024-04-14T22:45:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:45:01.031630125Z [2024-04-14T22:45:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:45:01.031785343Z [2024-04-14T22:45:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:45:01.031852570Z [2024-04-14T22:45:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:45:01.265722597Z [2024-04-14T22:45:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:45:01.265901493Z [2024-04-14T22:45:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status queued for try_number 1 2024-04-14T22:45:01.266030995Z [2024-04-14T22:45:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status queued for try_number 1 2024-04-14T22:45:01.266108444Z [2024-04-14T22:45:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status queued for try_number 1 2024-04-14T22:45:01.273592905Z [2024-04-14T22:45:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1aaf23fb-91c2-429d-b77a-c1c423244b9c 2024-04-14T22:45:01.273744662Z [2024-04-14T22:45:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61b395a1-7e0a-40d7-8eb3-dd4ad822cd7f 2024-04-14T22:45:01.273887442Z [2024-04-14T22:45:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to b52cee01-26ad-41c1-b67d-54664da25767 2024-04-14T22:45:01.274029373Z [2024-04-14T22:45:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a48977c-be46-4a12-b8e4-5f880e28dbdc 2024-04-14T22:45:02.471265932Z [2024-04-14T22:45:02.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:45:02.471596364Z [2024-04-14T22:45:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:44:00+00:00, run_id=scheduled__2024-04-14T22:44:00+00:00, run_start_date=2024-04-14 22:45:00.955252+00:00, run_end_date=2024-04-14 22:45:02.471195+00:00, run_duration=1.515943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:44:00+00:00, data_interval_end=2024-04-14 22:45:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:45:02.482068329Z [2024-04-14T22:45:02.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:45:00+00:00, run_after=2024-04-14T22:46:00+00:00 2024-04-14T22:45:02.533180349Z [2024-04-14T22:45:02.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status success for try_number 1 2024-04-14T22:45:02.541267705Z [2024-04-14T22:45:02.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:44:00+00:00, map_index=-1, run_start_date=2024-04-14 22:45:01.994271+00:00, run_end_date=2024-04-14 22:45:02.329434+00:00, run_duration=0.335163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:45:01.028263+00:00, queued_by_job_id=1, pid=905 2024-04-14T22:45:03.423039784Z [2024-04-14T22:45:03.422+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:45:03.423092378Z 2024-04-14T22:45:03.423314351Z [2024-04-14T22:45:03.423+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:45:03.424124106Z [2024-04-14T22:45:03.423+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:45:03.424189367Z 2024-04-14T22:45:03.427308844Z [2024-04-14T22:45:03.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:45:03.427465435Z [2024-04-14T22:45:03.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:45:03.501530908Z [2024-04-14T22:45:03.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:45:03.503390170Z [2024-04-14T22:45:03.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:45:03.510481731Z [2024-04-14T22:45:03.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e6f1dde-85b0-4f1a-b17b-701bc06bfd04 2024-04-14T22:45:03.510992681Z [2024-04-14T22:45:03.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=2024-04-14 22:45:02.897718+00:00, run_end_date=2024-04-14 22:45:03.215756+00:00, run_duration=0.318038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:45:01.028263+00:00, queued_by_job_id=1, pid=929 2024-04-14T22:45:05.213751017Z [2024-04-14T22:45:05.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:45:05.214171101Z [2024-04-14T22:45:05.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:44:00+00:00, run_id=scheduled__2024-04-14T22:44:00+00:00, run_start_date=2024-04-14 22:45:00.952828+00:00, run_end_date=2024-04-14 22:45:05.213769+00:00, run_duration=4.260941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:44:00+00:00, data_interval_end=2024-04-14 22:45:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:45:05.224546266Z [2024-04-14T22:45:05.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:45:00+00:00, run_after=2024-04-14T22:46:00+00:00 2024-04-14T22:45:05.231654127Z [2024-04-14T22:45:05.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:45:05.231965486Z [2024-04-14T22:45:05.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:44:00+00:00, run_id=scheduled__2024-04-14T22:44:00+00:00, run_start_date=2024-04-14 22:45:00.954137+00:00, run_end_date=2024-04-14 22:45:05.231693+00:00, run_duration=4.277556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:44:00+00:00, data_interval_end=2024-04-14 22:45:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:45:05.241514111Z [2024-04-14T22:45:05.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:45:00+00:00, run_after=2024-04-14T22:46:00+00:00 2024-04-14T22:45:05.293270654Z [2024-04-14T22:45:05.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status success for try_number 1 2024-04-14T22:45:05.293546405Z [2024-04-14T22:45:05.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status success for try_number 1 2024-04-14T22:45:05.300311226Z [2024-04-14T22:45:05.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:44:00+00:00, map_index=-1, run_start_date=2024-04-14 22:45:02.932981+00:00, run_end_date=2024-04-14 22:45:04.234579+00:00, run_duration=1.301598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:45:01.028263+00:00, queued_by_job_id=1, pid=931 2024-04-14T22:45:05.300670117Z [2024-04-14T22:45:05.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:44:00+00:00, map_index=-1, run_start_date=2024-04-14 22:45:02.891846+00:00, run_end_date=2024-04-14 22:45:04.407995+00:00, run_duration=1.516149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:45:01.028263+00:00, queued_by_job_id=1, pid=930 2024-04-14T22:45:05.687726252Z [2024-04-14T22:45:05.687+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:45:05.687761915Z 2024-04-14T22:45:05.687843934Z [2024-04-14T22:45:05.687+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:45:05.688555900Z [2024-04-14T22:45:05.688+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:45:05.688592437Z 2024-04-14T22:45:05.691317511Z [2024-04-14T22:45:05.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:45:05.691442614Z [2024-04-14T22:45:05.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:45:05.742783467Z [2024-04-14T22:45:05.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:45:05.743141374Z [2024-04-14T22:45:05.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:45:05.750558454Z [2024-04-14T22:45:05.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=2024-04-14 22:45:05.085169+00:00, run_end_date=2024-04-14 22:45:05.472334+00:00, run_duration=0.387165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:45:03.424574+00:00, queued_by_job_id=1, pid=954 2024-04-14T22:45:05.751333503Z [2024-04-14T22:45:05.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35864042-8e75-41b6-ac1a-6c8b8b276d0a 2024-04-14T22:45:07.999003319Z [2024-04-14T22:45:07.998+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:45:07.999030835Z 2024-04-14T22:45:07.999055315Z [2024-04-14T22:45:07.998+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:45:07.999531489Z [2024-04-14T22:45:07.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:45:07.999561237Z 2024-04-14T22:45:08.001554868Z [2024-04-14T22:45:08.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:45:08.001848046Z [2024-04-14T22:45:08.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:45:08.067476108Z [2024-04-14T22:45:08.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status queued for try_number 1 2024-04-14T22:45:08.067638390Z [2024-04-14T22:45:08.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:45:08.072441316Z [2024-04-14T22:45:08.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=0, run_start_date=2024-04-14 22:45:07.153039+00:00, run_end_date=2024-04-14 22:45:07.476179+00:00, run_duration=0.32314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:45:05.689008+00:00, queued_by_job_id=1, pid=962 2024-04-14T22:45:08.072744851Z [2024-04-14T22:45:08.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88d1f5d1-b063-4471-82b9-d8f6acb6cb8a 2024-04-14T22:45:10.320632386Z [2024-04-14T22:45:10.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:45:10.320847938Z [2024-04-14T22:45:10.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:40:00+00:00, run_id=scheduled__2024-04-14T22:40:00+00:00, run_start_date=2024-04-14 22:45:00.951569+00:00, run_end_date=2024-04-14 22:45:10.320414+00:00, run_duration=9.368845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:40:00+00:00, data_interval_end=2024-04-14 22:45:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T22:45:10.333961268Z [2024-04-14T22:45:10.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:45:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:45:10.403095235Z [2024-04-14T22:45:10.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:40:00+00:00 exited with status success for try_number 1 2024-04-14T22:45:10.412086904Z [2024-04-14T22:45:10.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:40:00+00:00, map_index=-1, run_start_date=2024-04-14 22:45:09.445961+00:00, run_end_date=2024-04-14 22:45:09.835035+00:00, run_duration=0.389074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:45:07.999766+00:00, queued_by_job_id=1, pid=970 2024-04-14T22:45:59.606523946Z [2024-04-14T22:45:59.605+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T22:46:01.079471284Z [2024-04-14T22:46:01.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:46:00+00:00, run_after=2024-04-14T22:47:00+00:00 2024-04-14T22:46:01.089104705Z [2024-04-14T22:46:01.088+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:46:01.096447936Z [2024-04-14T22:46:01.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:46:01.109029950Z [2024-04-14T22:46:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:46:00+00:00, run_after=2024-04-14T22:47:00+00:00 2024-04-14T22:46:01.205070611Z [2024-04-14T22:46:01.204+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T22:46:01.205102137Z 2024-04-14T22:46:01.205112457Z 2024-04-14T22:46:01.205118517Z 2024-04-14T22:46:01.205124403Z 2024-04-14T22:46:01.205637385Z [2024-04-14T22:46:01.204+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:46:01.205958712Z [2024-04-14T22:46:01.205+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:46:01.206260424Z [2024-04-14T22:46:01.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:46:01.206657091Z [2024-04-14T22:46:01.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:46:01.207826547Z [2024-04-14T22:46:01.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:46:01.207847646Z 2024-04-14T22:46:01.207854878Z 2024-04-14T22:46:01.207860896Z 2024-04-14T22:46:01.207866723Z 2024-04-14T22:46:01.213324557Z [2024-04-14T22:46:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:46:01.213871385Z [2024-04-14T22:46:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:46:01.214385185Z [2024-04-14T22:46:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:46:01.214718174Z [2024-04-14T22:46:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:46:01.215266309Z [2024-04-14T22:46:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:46:01.215579067Z [2024-04-14T22:46:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:46:01.216028984Z [2024-04-14T22:46:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:46:01.216338739Z [2024-04-14T22:46:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:46:01.557894385Z [2024-04-14T22:46:01.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status queued for try_number 1 2024-04-14T22:46:01.558090691Z [2024-04-14T22:46:01.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:46:01.558337573Z [2024-04-14T22:46:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:46:01.558573973Z [2024-04-14T22:46:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:46:01.566229223Z [2024-04-14T22:46:01.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c1801c6-424c-41ec-8a77-40ff88862723 2024-04-14T22:46:01.566426866Z [2024-04-14T22:46:01.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe1454e-6f43-4aa9-9a93-846dda7564b6 2024-04-14T22:46:01.566625303Z [2024-04-14T22:46:01.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b73d8b3-c734-48d7-9e23-f326eddf77ee 2024-04-14T22:46:01.566789092Z [2024-04-14T22:46:01.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f3a3632-1c58-4062-99aa-a905192d26eb 2024-04-14T22:46:02.807728903Z [2024-04-14T22:46:02.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:46:02.807928446Z [2024-04-14T22:46:02.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:44:00+00:00, run_id=scheduled__2024-04-14T22:44:00+00:00, run_start_date=2024-04-14 22:46:01.121439+00:00, run_end_date=2024-04-14 22:46:02.807635+00:00, run_duration=1.686196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:44:00+00:00, data_interval_end=2024-04-14 22:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:46:02.815364209Z [2024-04-14T22:46:02.815+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:46:00+00:00, run_after=2024-04-14T22:48:00+00:00 2024-04-14T22:46:02.831059297Z [2024-04-14T22:46:02.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:46:02.831160684Z [2024-04-14T22:46:02.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:45:00+00:00, run_id=scheduled__2024-04-14T22:45:00+00:00, run_start_date=2024-04-14 22:46:01.126473+00:00, run_end_date=2024-04-14 22:46:02.830949+00:00, run_duration=1.704476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:45:00+00:00, data_interval_end=2024-04-14 22:46:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:46:02.842348516Z [2024-04-14T22:46:02.842+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:46:00+00:00, run_after=2024-04-14T22:47:00+00:00 2024-04-14T22:46:02.910411781Z [2024-04-14T22:46:02.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:44:00+00:00 exited with status success for try_number 1 2024-04-14T22:46:02.910532715Z [2024-04-14T22:46:02.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:46:02.918165605Z [2024-04-14T22:46:02.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:44:00+00:00, map_index=-1, run_start_date=2024-04-14 22:46:01.921843+00:00, run_end_date=2024-04-14 22:46:02.213334+00:00, run_duration=0.291491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:46:01.209393+00:00, queued_by_job_id=1, pid=993 2024-04-14T22:46:02.918417393Z [2024-04-14T22:46:02.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:46:02.054048+00:00, run_end_date=2024-04-14 22:46:02.417263+00:00, run_duration=0.363215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:46:01.209393+00:00, queued_by_job_id=1, pid=994 2024-04-14T22:46:04.841893276Z [2024-04-14T22:46:04.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:46:04.842330547Z [2024-04-14T22:46:04.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:45:00+00:00, run_id=scheduled__2024-04-14T22:45:00+00:00, run_start_date=2024-04-14 22:46:01.122664+00:00, run_end_date=2024-04-14 22:46:04.841983+00:00, run_duration=3.719319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:45:00+00:00, data_interval_end=2024-04-14 22:46:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:46:04.857424017Z [2024-04-14T22:46:04.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:46:00+00:00, run_after=2024-04-14T22:47:00+00:00 2024-04-14T22:46:05.102226782Z [2024-04-14T22:46:05.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:46:05.107866884Z [2024-04-14T22:46:05.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:46:03.178306+00:00, run_end_date=2024-04-14 22:46:04.796585+00:00, run_duration=1.618279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:46:01.209393+00:00, queued_by_job_id=1, pid=1023 2024-04-14T22:46:06.067263602Z [2024-04-14T22:46:06.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:46:06.067461920Z [2024-04-14T22:46:06.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:45:00+00:00, run_id=scheduled__2024-04-14T22:45:00+00:00, run_start_date=2024-04-14 22:46:01.124007+00:00, run_end_date=2024-04-14 22:46:06.067157+00:00, run_duration=4.94315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:45:00+00:00, data_interval_end=2024-04-14 22:46:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:46:06.075343372Z [2024-04-14T22:46:06.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:46:00+00:00, run_after=2024-04-14T22:47:00+00:00 2024-04-14T22:46:06.104491205Z [2024-04-14T22:46:06.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:46:06.108485424Z [2024-04-14T22:46:06.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:46:02.846245+00:00, run_end_date=2024-04-14 22:46:05.172380+00:00, run_duration=2.326135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:46:01.209393+00:00, queued_by_job_id=1, pid=1012 2024-04-14T22:47:00.662368920Z [2024-04-14T22:47:00.661+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:47:00.678296252Z [2024-04-14T22:47:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:47:00+00:00, run_after=2024-04-14T22:48:00+00:00 2024-04-14T22:47:00.692431421Z [2024-04-14T22:47:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:47:00+00:00, run_after=2024-04-14T22:48:00+00:00 2024-04-14T22:47:00.759281433Z [2024-04-14T22:47:00.758+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T22:47:00.759325731Z 2024-04-14T22:47:00.759335690Z 2024-04-14T22:47:00.759344422Z 2024-04-14T22:47:00.759377188Z [2024-04-14T22:47:00.759+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:47:00.759422774Z [2024-04-14T22:47:00.759+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:47:00.759581066Z [2024-04-14T22:47:00.759+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:47:00.760382635Z [2024-04-14T22:47:00.760+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:47:00.760404920Z 2024-04-14T22:47:00.760414379Z 2024-04-14T22:47:00.760423416Z 2024-04-14T22:47:00.764926494Z [2024-04-14T22:47:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:47:00.764969764Z [2024-04-14T22:47:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:47:00.765333792Z [2024-04-14T22:47:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:47:00.765463526Z [2024-04-14T22:47:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:47:00.765743530Z [2024-04-14T22:47:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:47:00.765875583Z [2024-04-14T22:47:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:47:00.942835168Z [2024-04-14T22:47:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status queued for try_number 1 2024-04-14T22:47:00.942963174Z [2024-04-14T22:47:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status queued for try_number 1 2024-04-14T22:47:00.943051266Z [2024-04-14T22:47:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status queued for try_number 1 2024-04-14T22:47:00.949856658Z [2024-04-14T22:47:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3978ef34-a160-4148-ad05-1145a48e2e9e 2024-04-14T22:47:00.950023327Z [2024-04-14T22:47:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b0daa73-5400-4766-93e0-592cc130cc91 2024-04-14T22:47:00.950240564Z [2024-04-14T22:47:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cbc86ea-0ea8-49bf-8804-5980665f1194 2024-04-14T22:47:02.744708941Z [2024-04-14T22:47:02.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:47:02.745004848Z [2024-04-14T22:47:02.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:46:00+00:00, run_id=scheduled__2024-04-14T22:46:00+00:00, run_start_date=2024-04-14 22:47:00.704301+00:00, run_end_date=2024-04-14 22:47:02.744634+00:00, run_duration=2.040333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:46:00+00:00, data_interval_end=2024-04-14 22:47:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:47:02.752754383Z [2024-04-14T22:47:02.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:47:00+00:00, run_after=2024-04-14T22:48:00+00:00 2024-04-14T22:47:02.790704615Z [2024-04-14T22:47:02.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status success for try_number 1 2024-04-14T22:47:02.798711572Z [2024-04-14T22:47:02.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:46:00+00:00, map_index=-1, run_start_date=2024-04-14 22:47:01.431351+00:00, run_end_date=2024-04-14 22:47:01.771881+00:00, run_duration=0.34053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:47:00.761176+00:00, queued_by_job_id=1, pid=1050 2024-04-14T22:47:03.857869298Z [2024-04-14T22:47:03.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:47:03.858009362Z [2024-04-14T22:47:03.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:46:00+00:00, run_id=scheduled__2024-04-14T22:46:00+00:00, run_start_date=2024-04-14 22:47:00.703245+00:00, run_end_date=2024-04-14 22:47:03.857755+00:00, run_duration=3.15451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:46:00+00:00, data_interval_end=2024-04-14 22:47:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:47:03.869170016Z [2024-04-14T22:47:03.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:47:00+00:00, run_after=2024-04-14T22:48:00+00:00 2024-04-14T22:47:04.058160200Z [2024-04-14T22:47:04.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:47:04.058459518Z [2024-04-14T22:47:04.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:46:00+00:00, run_id=scheduled__2024-04-14T22:46:00+00:00, run_start_date=2024-04-14 22:47:00.702126+00:00, run_end_date=2024-04-14 22:47:04.058085+00:00, run_duration=3.355959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:46:00+00:00, data_interval_end=2024-04-14 22:47:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:47:04.068705025Z [2024-04-14T22:47:04.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:47:00+00:00, run_after=2024-04-14T22:48:00+00:00 2024-04-14T22:47:04.095639463Z [2024-04-14T22:47:04.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status success for try_number 1 2024-04-14T22:47:04.095834932Z [2024-04-14T22:47:04.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status success for try_number 1 2024-04-14T22:47:04.115912283Z [2024-04-14T22:47:04.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:46:00+00:00, map_index=-1, run_start_date=2024-04-14 22:47:02.464544+00:00, run_end_date=2024-04-14 22:47:03.779424+00:00, run_duration=1.31488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:47:00.761176+00:00, queued_by_job_id=1, pid=1069 2024-04-14T22:47:04.116142553Z [2024-04-14T22:47:04.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:46:00+00:00, map_index=-1, run_start_date=2024-04-14 22:47:02.372385+00:00, run_end_date=2024-04-14 22:47:03.848412+00:00, run_duration=1.476027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:47:00.761176+00:00, queued_by_job_id=1, pid=1068 2024-04-14T22:48:01.000901118Z [2024-04-14T22:48:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:48:00+00:00, run_after=2024-04-14T22:49:00+00:00 2024-04-14T22:48:01.023888916Z [2024-04-14T22:48:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:48:00+00:00, run_after=2024-04-14T22:49:00+00:00 2024-04-14T22:48:01.029527268Z [2024-04-14T22:48:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:48:01.034451505Z [2024-04-14T22:48:01.034+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:48:01.120095870Z [2024-04-14T22:48:01.119+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T22:48:01.120117307Z 2024-04-14T22:48:01.120121255Z 2024-04-14T22:48:01.120124208Z 2024-04-14T22:48:01.120127063Z 2024-04-14T22:48:01.120135735Z [2024-04-14T22:48:01.120+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:48:01.120286622Z [2024-04-14T22:48:01.120+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:48:01.120371723Z [2024-04-14T22:48:01.120+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:48:01.120444177Z [2024-04-14T22:48:01.120+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:48:01.120920674Z [2024-04-14T22:48:01.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:48:01.120929588Z 2024-04-14T22:48:01.120933528Z 2024-04-14T22:48:01.120936710Z 2024-04-14T22:48:01.120958015Z 2024-04-14T22:48:01.123589573Z [2024-04-14T22:48:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:48:01.125114899Z [2024-04-14T22:48:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:48:01.125314235Z [2024-04-14T22:48:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:48:01.125424236Z [2024-04-14T22:48:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:48:01.125575965Z [2024-04-14T22:48:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:48:01.125643823Z [2024-04-14T22:48:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:48:01.125790759Z [2024-04-14T22:48:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:48:01.125852077Z [2024-04-14T22:48:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:48:01.522941389Z [2024-04-14T22:48:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status queued for try_number 1 2024-04-14T22:48:01.527497972Z [2024-04-14T22:48:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:47:00+00:00 exited with status queued for try_number 1 2024-04-14T22:48:01.531303793Z [2024-04-14T22:48:01.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:47:00+00:00 exited with status queued for try_number 1 2024-04-14T22:48:01.531578252Z [2024-04-14T22:48:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:47:00+00:00 exited with status queued for try_number 1 2024-04-14T22:48:01.552190090Z [2024-04-14T22:48:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to f020c5f5-9316-4351-bbbb-f9445f668119 2024-04-14T22:48:01.552427442Z [2024-04-14T22:48:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 848b1d39-9881-46c0-969e-61ad7913cb19 2024-04-14T22:48:01.552647722Z [2024-04-14T22:48:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58331985-6210-4865-a72c-e767245f8cea 2024-04-14T22:48:01.552872569Z [2024-04-14T22:48:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd1c20fb-25cc-46be-aebb-083c83ad50f1 2024-04-14T22:48:03.087358605Z [2024-04-14T22:48:03.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:48:03.091352683Z [2024-04-14T22:48:03.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:46:00+00:00, run_id=scheduled__2024-04-14T22:46:00+00:00, run_start_date=2024-04-14 22:48:01.045570+00:00, run_end_date=2024-04-14 22:48:03.090971+00:00, run_duration=2.045401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:46:00+00:00, data_interval_end=2024-04-14 22:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:48:03.105838102Z [2024-04-14T22:48:03.105+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:48:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:48:03.117277500Z [2024-04-14T22:48:03.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:48:03.117658786Z [2024-04-14T22:48:03.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:47:00+00:00, run_id=scheduled__2024-04-14T22:47:00+00:00, run_start_date=2024-04-14 22:48:01.046910+00:00, run_end_date=2024-04-14 22:48:03.117336+00:00, run_duration=2.070426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:47:00+00:00, data_interval_end=2024-04-14 22:48:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:48:03.133174564Z [2024-04-14T22:48:03.132+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:48:00+00:00, run_after=2024-04-14T22:49:00+00:00 2024-04-14T22:48:03.261065998Z [2024-04-14T22:48:03.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:46:00+00:00 exited with status success for try_number 1 2024-04-14T22:48:03.276068986Z [2024-04-14T22:48:03.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:46:00+00:00, map_index=-1, run_start_date=2024-04-14 22:48:02.196438+00:00, run_end_date=2024-04-14 22:48:02.580625+00:00, run_duration=0.384187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:48:01.121559+00:00, queued_by_job_id=1, pid=1097 2024-04-14T22:48:04.487851274Z [2024-04-14T22:48:04.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:47:00+00:00 exited with status success for try_number 1 2024-04-14T22:48:04.498119395Z [2024-04-14T22:48:04.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:47:00+00:00, map_index=-1, run_start_date=2024-04-14 22:48:02.538477+00:00, run_end_date=2024-04-14 22:48:03.085493+00:00, run_duration=0.547016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:48:01.121559+00:00, queued_by_job_id=1, pid=1108 2024-04-14T22:48:05.646158385Z [2024-04-14T22:48:05.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:48:05.646452403Z [2024-04-14T22:48:05.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:47:00+00:00, run_id=scheduled__2024-04-14T22:47:00+00:00, run_start_date=2024-04-14 22:48:01.047978+00:00, run_end_date=2024-04-14 22:48:05.646117+00:00, run_duration=4.598139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:47:00+00:00, data_interval_end=2024-04-14 22:48:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:48:05.691919521Z [2024-04-14T22:48:05.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:48:00+00:00, run_after=2024-04-14T22:49:00+00:00 2024-04-14T22:48:05.719622468Z [2024-04-14T22:48:05.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:48:05.720401128Z [2024-04-14T22:48:05.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:47:00+00:00, run_id=scheduled__2024-04-14T22:47:00+00:00, run_start_date=2024-04-14 22:48:01.048854+00:00, run_end_date=2024-04-14 22:48:05.719561+00:00, run_duration=4.670707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:47:00+00:00, data_interval_end=2024-04-14 22:48:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:48:05.730897383Z [2024-04-14T22:48:05.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:48:00+00:00, run_after=2024-04-14T22:49:00+00:00 2024-04-14T22:48:05.764073691Z [2024-04-14T22:48:05.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:47:00+00:00 exited with status success for try_number 1 2024-04-14T22:48:05.764226148Z [2024-04-14T22:48:05.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:47:00+00:00 exited with status success for try_number 1 2024-04-14T22:48:05.769460550Z [2024-04-14T22:48:05.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:47:00+00:00, map_index=-1, run_start_date=2024-04-14 22:48:03.856043+00:00, run_end_date=2024-04-14 22:48:05.157466+00:00, run_duration=1.301423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:48:01.121559+00:00, queued_by_job_id=1, pid=1132 2024-04-14T22:48:05.770355056Z [2024-04-14T22:48:05.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:47:00+00:00, map_index=-1, run_start_date=2024-04-14 22:48:03.528576+00:00, run_end_date=2024-04-14 22:48:05.366449+00:00, run_duration=1.837873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:48:01.121559+00:00, queued_by_job_id=1, pid=1121 2024-04-14T22:49:01.028124147Z [2024-04-14T22:49:01.027+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:49:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:49:01.036792078Z [2024-04-14T22:49:01.036+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:49:01.049489737Z [2024-04-14T22:49:01.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:49:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:49:01.132517745Z [2024-04-14T22:49:01.131+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T22:49:01.132556141Z 2024-04-14T22:49:01.132565919Z 2024-04-14T22:49:01.132574454Z 2024-04-14T22:49:01.132670994Z [2024-04-14T22:49:01.132+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:49:01.132991748Z [2024-04-14T22:49:01.132+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:49:01.133206653Z [2024-04-14T22:49:01.132+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:49:01.134520906Z [2024-04-14T22:49:01.134+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:49:01.134550329Z 2024-04-14T22:49:01.134565933Z 2024-04-14T22:49:01.134575332Z 2024-04-14T22:49:01.139410997Z [2024-04-14T22:49:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:49:01.139726115Z [2024-04-14T22:49:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:49:01.140241718Z [2024-04-14T22:49:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:49:01.140530491Z [2024-04-14T22:49:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:49:01.141027665Z [2024-04-14T22:49:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:49:01.141316271Z [2024-04-14T22:49:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:49:01.324439164Z [2024-04-14T22:49:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status queued for try_number 1 2024-04-14T22:49:01.324569792Z [2024-04-14T22:49:01.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status queued for try_number 1 2024-04-14T22:49:01.324715007Z [2024-04-14T22:49:01.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status queued for try_number 1 2024-04-14T22:49:01.335219997Z [2024-04-14T22:49:01.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to db017228-6c81-4e02-9146-fd40db4f6d13 2024-04-14T22:49:01.335486722Z [2024-04-14T22:49:01.335+0000] {scheduler_job.py:635} INFO - Setting external_id for to b75f455e-fc6d-4b9f-938a-f215752ee3fd 2024-04-14T22:49:01.335654334Z [2024-04-14T22:49:01.335+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e584b11-b101-41f8-935a-c0c17322c9b3 2024-04-14T22:49:02.898705653Z [2024-04-14T22:49:02.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:49:02.899072532Z [2024-04-14T22:49:02.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:48:00+00:00, run_id=scheduled__2024-04-14T22:48:00+00:00, run_start_date=2024-04-14 22:49:01.060559+00:00, run_end_date=2024-04-14 22:49:02.898656+00:00, run_duration=1.838097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:48:00+00:00, data_interval_end=2024-04-14 22:49:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:49:02.909328704Z [2024-04-14T22:49:02.909+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:49:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:49:02.956450177Z [2024-04-14T22:49:02.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status success for try_number 1 2024-04-14T22:49:02.966073834Z [2024-04-14T22:49:02.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:48:00+00:00, map_index=-1, run_start_date=2024-04-14 22:49:01.790268+00:00, run_end_date=2024-04-14 22:49:02.155160+00:00, run_duration=0.364892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:49:01.135678+00:00, queued_by_job_id=1, pid=1158 2024-04-14T22:49:04.737122597Z [2024-04-14T22:49:04.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:49:04.737652397Z [2024-04-14T22:49:04.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:48:00+00:00, run_id=scheduled__2024-04-14T22:48:00+00:00, run_start_date=2024-04-14 22:49:01.061780+00:00, run_end_date=2024-04-14 22:49:04.737007+00:00, run_duration=3.675227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:48:00+00:00, data_interval_end=2024-04-14 22:49:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:49:04.755481047Z [2024-04-14T22:49:04.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:49:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:49:04.766675120Z [2024-04-14T22:49:04.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:49:04.767111478Z [2024-04-14T22:49:04.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:48:00+00:00, run_id=scheduled__2024-04-14T22:48:00+00:00, run_start_date=2024-04-14 22:49:01.062779+00:00, run_end_date=2024-04-14 22:49:04.766544+00:00, run_duration=3.703765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:48:00+00:00, data_interval_end=2024-04-14 22:49:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:49:04.779593253Z [2024-04-14T22:49:04.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:49:00+00:00, run_after=2024-04-14T22:50:00+00:00 2024-04-14T22:49:04.812043828Z [2024-04-14T22:49:04.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status success for try_number 1 2024-04-14T22:49:04.812285345Z [2024-04-14T22:49:04.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status success for try_number 1 2024-04-14T22:49:04.821518520Z [2024-04-14T22:49:04.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:48:00+00:00, map_index=-1, run_start_date=2024-04-14 22:49:02.661460+00:00, run_end_date=2024-04-14 22:49:04.280668+00:00, run_duration=1.619208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:49:01.135678+00:00, queued_by_job_id=1, pid=1176 2024-04-14T22:49:04.821713599Z [2024-04-14T22:49:04.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:48:00+00:00, map_index=-1, run_start_date=2024-04-14 22:49:02.703340+00:00, run_end_date=2024-04-14 22:49:03.920321+00:00, run_duration=1.216981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:49:01.135678+00:00, queued_by_job_id=1, pid=1177 2024-04-14T22:50:00.845678464Z [2024-04-14T22:50:00.844+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:50:00.857224310Z [2024-04-14T22:50:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:50:00.870075109Z [2024-04-14T22:50:00.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:51:00+00:00 2024-04-14T22:50:00.877358377Z [2024-04-14T22:50:00.876+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:50:00.888786356Z [2024-04-14T22:50:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:51:00+00:00 2024-04-14T22:50:01.042994574Z [2024-04-14T22:50:01.042+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T22:50:01.043018973Z 2024-04-14T22:50:01.043023278Z 2024-04-14T22:50:01.043027257Z 2024-04-14T22:50:01.043030591Z 2024-04-14T22:50:01.043033853Z 2024-04-14T22:50:01.043036974Z [2024-04-14T22:50:01.042+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:50:01.043107398Z [2024-04-14T22:50:01.042+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:50:01.043288004Z [2024-04-14T22:50:01.043+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:50:01.043566013Z [2024-04-14T22:50:01.043+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:50:01.043700990Z [2024-04-14T22:50:01.043+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:50:01.044233308Z [2024-04-14T22:50:01.044+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:50:01.044247228Z 2024-04-14T22:50:01.044252552Z 2024-04-14T22:50:01.044258115Z 2024-04-14T22:50:01.044262531Z 2024-04-14T22:50:01.044267595Z 2024-04-14T22:50:01.048500034Z [2024-04-14T22:50:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:50:01.048680322Z [2024-04-14T22:50:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:50:01.048898819Z [2024-04-14T22:50:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:50:01.049014597Z [2024-04-14T22:50:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:50:01.049188651Z [2024-04-14T22:50:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:50:01.049273365Z [2024-04-14T22:50:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:50:01.049482557Z [2024-04-14T22:50:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:50:01.049548776Z [2024-04-14T22:50:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:50:01.049677250Z [2024-04-14T22:50:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:50:01.049748619Z [2024-04-14T22:50:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:50:01.356089287Z [2024-04-14T22:50:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:01.356381244Z [2024-04-14T22:50:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:01.356543835Z [2024-04-14T22:50:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:49:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:01.356898161Z [2024-04-14T22:50:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:49:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:01.357091888Z [2024-04-14T22:50:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:49:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:01.379928028Z [2024-04-14T22:50:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bf9079b-d069-45db-94df-5c07239805c8 2024-04-14T22:50:01.380210135Z [2024-04-14T22:50:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfa7af3c-d5dc-48ab-a6eb-903d43d186a5 2024-04-14T22:50:01.380407476Z [2024-04-14T22:50:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1c3973d-21fc-49ee-a475-eccf9f697f7f 2024-04-14T22:50:01.380589272Z [2024-04-14T22:50:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 970fc7ac-db7c-4899-a586-bfbc9f0a6f02 2024-04-14T22:50:01.380755272Z [2024-04-14T22:50:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6697433-118a-404f-b3ac-84a6e77a2e39 2024-04-14T22:50:03.080691823Z [2024-04-14T22:50:03.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:50:03.081830834Z [2024-04-14T22:50:03.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:49:00+00:00, run_id=scheduled__2024-04-14T22:49:00+00:00, run_start_date=2024-04-14 22:50:00.935156+00:00, run_end_date=2024-04-14 22:50:03.081422+00:00, run_duration=2.146266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:49:00+00:00, data_interval_end=2024-04-14 22:50:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:50:03.095338262Z [2024-04-14T22:50:03.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:51:00+00:00 2024-04-14T22:50:03.119514414Z [2024-04-14T22:50:03.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:50:03.120194139Z [2024-04-14T22:50:03.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:48:00+00:00, run_id=scheduled__2024-04-14T22:48:00+00:00, run_start_date=2024-04-14 22:50:00.929957+00:00, run_end_date=2024-04-14 22:50:03.119814+00:00, run_duration=2.189857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:48:00+00:00, data_interval_end=2024-04-14 22:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:50:03.130915490Z [2024-04-14T22:50:03.130+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:52:00+00:00 2024-04-14T22:50:03.214896991Z [2024-04-14T22:50:03.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:48:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:03.214994800Z [2024-04-14T22:50:03.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:49:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:03.224193429Z [2024-04-14T22:50:03.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:49:00+00:00, map_index=-1, run_start_date=2024-04-14 22:50:01.941992+00:00, run_end_date=2024-04-14 22:50:02.362060+00:00, run_duration=0.420068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:01.045249+00:00, queued_by_job_id=1, pid=1212 2024-04-14T22:50:03.224212369Z [2024-04-14T22:50:03.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:48:00+00:00, map_index=-1, run_start_date=2024-04-14 22:50:01.844858+00:00, run_end_date=2024-04-14 22:50:02.274637+00:00, run_duration=0.429779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:01.045249+00:00, queued_by_job_id=1, pid=1211 2024-04-14T22:50:03.806369850Z [2024-04-14T22:50:03.805+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:50:03.806395025Z 2024-04-14T22:50:03.806674241Z [2024-04-14T22:50:03.806+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:50:03.807416568Z [2024-04-14T22:50:03.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:50:03.807430878Z 2024-04-14T22:50:03.810217542Z [2024-04-14T22:50:03.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:50:03.810494554Z [2024-04-14T22:50:03.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:50:03.883028848Z [2024-04-14T22:50:03.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:03.883068684Z [2024-04-14T22:50:03.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:03.891116567Z [2024-04-14T22:50:03.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:50:02.989636+00:00, run_end_date=2024-04-14 22:50:03.361626+00:00, run_duration=0.37199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:01.045249+00:00, queued_by_job_id=1, pid=1236 2024-04-14T22:50:03.891931619Z [2024-04-14T22:50:03.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebf3ea06-7d6e-4be9-90c1-0aadb68f1183 2024-04-14T22:50:05.098513439Z [2024-04-14T22:50:05.098+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:50:05.098946077Z [2024-04-14T22:50:05.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:49:00+00:00, run_id=scheduled__2024-04-14T22:49:00+00:00, run_start_date=2024-04-14 22:50:00.933866+00:00, run_end_date=2024-04-14 22:50:05.098385+00:00, run_duration=4.164519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:49:00+00:00, data_interval_end=2024-04-14 22:50:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:50:05.117417053Z [2024-04-14T22:50:05.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:51:00+00:00 2024-04-14T22:50:05.192103313Z [2024-04-14T22:50:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:49:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:05.200216366Z [2024-04-14T22:50:05.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:49:00+00:00, map_index=-1, run_start_date=2024-04-14 22:50:03.256285+00:00, run_end_date=2024-04-14 22:50:04.406321+00:00, run_duration=1.150036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:01.045249+00:00, queued_by_job_id=1, pid=1243 2024-04-14T22:50:06.261230113Z [2024-04-14T22:50:06.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:50:06.261923666Z [2024-04-14T22:50:06.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:49:00+00:00, run_id=scheduled__2024-04-14T22:49:00+00:00, run_start_date=2024-04-14 22:50:00.931514+00:00, run_end_date=2024-04-14 22:50:06.261456+00:00, run_duration=5.329942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:49:00+00:00, data_interval_end=2024-04-14 22:50:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:50:06.274294958Z [2024-04-14T22:50:06.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:51:00+00:00 2024-04-14T22:50:06.308264869Z [2024-04-14T22:50:06.307+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:50:06.308310954Z 2024-04-14T22:50:06.308670912Z [2024-04-14T22:50:06.308+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:50:06.309524743Z [2024-04-14T22:50:06.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:50:06.309539363Z 2024-04-14T22:50:06.312601642Z [2024-04-14T22:50:06.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:50:06.312962409Z [2024-04-14T22:50:06.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:50:06.375799820Z [2024-04-14T22:50:06.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:06.376004708Z [2024-04-14T22:50:06.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:49:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:06.376266565Z [2024-04-14T22:50:06.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:06.386305262Z [2024-04-14T22:50:06.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:49:00+00:00, map_index=-1, run_start_date=2024-04-14 22:50:03.154282+00:00, run_end_date=2024-04-14 22:50:05.600682+00:00, run_duration=2.4464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:01.045249+00:00, queued_by_job_id=1, pid=1242 2024-04-14T22:50:06.386553419Z [2024-04-14T22:50:06.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:50:05.284228+00:00, run_end_date=2024-04-14 22:50:05.642654+00:00, run_duration=0.358426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:03.807905+00:00, queued_by_job_id=1, pid=1266 2024-04-14T22:50:06.386824310Z [2024-04-14T22:50:06.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6afd0038-f366-4a70-aaf0-64140439707a 2024-04-14T22:50:08.727600004Z [2024-04-14T22:50:08.727+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:50:08.727650671Z 2024-04-14T22:50:08.727695676Z [2024-04-14T22:50:08.727+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:50:08.728402527Z [2024-04-14T22:50:08.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:50:08.728423655Z 2024-04-14T22:50:08.732316295Z [2024-04-14T22:50:08.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:50:08.732553622Z [2024-04-14T22:50:08.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:50:08.818543179Z [2024-04-14T22:50:08.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:50:08.818673465Z [2024-04-14T22:50:08.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:08.828600968Z [2024-04-14T22:50:08.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=0, run_start_date=2024-04-14 22:50:07.894374+00:00, run_end_date=2024-04-14 22:50:08.222848+00:00, run_duration=0.328474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:06.310014+00:00, queued_by_job_id=1, pid=1274 2024-04-14T22:50:08.828825312Z [2024-04-14T22:50:08.828+0000] {scheduler_job.py:635} INFO - Setting external_id for to 678bfbb5-40c5-4ac4-bce3-2108ffaacbe7 2024-04-14T22:50:11.064228596Z [2024-04-14T22:50:11.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:50:11.064979709Z [2024-04-14T22:50:11.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:45:00+00:00, run_id=scheduled__2024-04-14T22:45:00+00:00, run_start_date=2024-04-14 22:50:00.928629+00:00, run_end_date=2024-04-14 22:50:11.064571+00:00, run_duration=10.135942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:45:00+00:00, data_interval_end=2024-04-14 22:50:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T22:50:11.072340930Z [2024-04-14T22:50:11.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:50:11.107871778Z [2024-04-14T22:50:11.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:50:11.111515400Z [2024-04-14T22:50:11.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:50:10.297419+00:00, run_end_date=2024-04-14 22:50:10.664004+00:00, run_duration=0.366585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:50:08.728957+00:00, queued_by_job_id=1, pid=1282 2024-04-14T22:50:59.703829607Z [2024-04-14T22:50:59.702+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T22:51:00.744491480Z [2024-04-14T22:51:00.743+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:51:00.759065017Z [2024-04-14T22:51:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:51:00+00:00, run_after=2024-04-14T22:52:00+00:00 2024-04-14T22:51:00.770260979Z [2024-04-14T22:51:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:51:00+00:00, run_after=2024-04-14T22:52:00+00:00 2024-04-14T22:51:00.816886787Z [2024-04-14T22:51:00.816+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T22:51:00.816909450Z 2024-04-14T22:51:00.816912711Z 2024-04-14T22:51:00.816915474Z 2024-04-14T22:51:00.816927805Z [2024-04-14T22:51:00.816+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:51:00.816974026Z [2024-04-14T22:51:00.816+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:51:00.817080920Z [2024-04-14T22:51:00.816+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:51:00.817680902Z [2024-04-14T22:51:00.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:51:00.817691008Z 2024-04-14T22:51:00.817694562Z 2024-04-14T22:51:00.817697678Z 2024-04-14T22:51:00.819906824Z [2024-04-14T22:51:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:51:00.819921973Z [2024-04-14T22:51:00.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:51:00.820193860Z [2024-04-14T22:51:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:51:00.820201944Z [2024-04-14T22:51:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:51:00.820449790Z [2024-04-14T22:51:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:51:00.820455767Z [2024-04-14T22:51:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:51:01.063588097Z [2024-04-14T22:51:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:01.063640149Z [2024-04-14T22:51:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:01.063744286Z [2024-04-14T22:51:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:01.079886638Z [2024-04-14T22:51:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ad60513-4e9c-41dd-82bb-b7b1fd1ae485 2024-04-14T22:51:01.079992377Z [2024-04-14T22:51:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0e3e076-7bb0-43db-a298-b435f92eb451 2024-04-14T22:51:01.080121870Z [2024-04-14T22:51:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43c243f5-930e-4749-a584-e1fba647686e 2024-04-14T22:51:03.189362819Z [2024-04-14T22:51:03.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:51:03.189706186Z [2024-04-14T22:51:03.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:50:00+00:00, run_id=scheduled__2024-04-14T22:50:00+00:00, run_start_date=2024-04-14 22:51:00.779880+00:00, run_end_date=2024-04-14 22:51:03.189279+00:00, run_duration=2.409399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:50:00+00:00, data_interval_end=2024-04-14 22:51:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:51:03.198157268Z [2024-04-14T22:51:03.197+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:51:00+00:00, run_after=2024-04-14T22:52:00+00:00 2024-04-14T22:51:03.241093089Z [2024-04-14T22:51:03.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:03.245895373Z [2024-04-14T22:51:03.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:51:01.704262+00:00, run_end_date=2024-04-14 22:51:02.150706+00:00, run_duration=0.446444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:00.818234+00:00, queued_by_job_id=1, pid=1305 2024-04-14T22:51:04.743763982Z [2024-04-14T22:51:04.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:51:04.744091713Z [2024-04-14T22:51:04.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:50:00+00:00, run_id=scheduled__2024-04-14T22:50:00+00:00, run_start_date=2024-04-14 22:51:00.779022+00:00, run_end_date=2024-04-14 22:51:04.743590+00:00, run_duration=3.964568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:50:00+00:00, data_interval_end=2024-04-14 22:51:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:51:04.751327997Z [2024-04-14T22:51:04.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:51:00+00:00, run_after=2024-04-14T22:52:00+00:00 2024-04-14T22:51:04.786708614Z [2024-04-14T22:51:04.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:04.791405542Z [2024-04-14T22:51:04.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:51:02.785627+00:00, run_end_date=2024-04-14 22:51:04.393751+00:00, run_duration=1.608124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:00.818234+00:00, queued_by_job_id=1, pid=1323 2024-04-14T22:51:05.503869656Z [2024-04-14T22:51:05.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:51:05.503898038Z [2024-04-14T22:51:05.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:50:00+00:00, run_id=scheduled__2024-04-14T22:50:00+00:00, run_start_date=2024-04-14 22:51:00.777967+00:00, run_end_date=2024-04-14 22:51:05.500307+00:00, run_duration=4.72234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:50:00+00:00, data_interval_end=2024-04-14 22:51:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:51:05.508906548Z [2024-04-14T22:51:05.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:51:00+00:00, run_after=2024-04-14T22:52:00+00:00 2024-04-14T22:51:05.533033400Z [2024-04-14T22:51:05.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:05.537557313Z [2024-04-14T22:51:05.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:51:02.949660+00:00, run_end_date=2024-04-14 22:51:04.746246+00:00, run_duration=1.796586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:00.818234+00:00, queued_by_job_id=1, pid=1324 2024-04-14T22:51:34.427537241Z [2024-04-14T22:51:34.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:51:34.463927738Z [2024-04-14T22:51:34.463+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:51:34.463956965Z 2024-04-14T22:51:34.464121691Z [2024-04-14T22:51:34.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:51:34.464687740Z [2024-04-14T22:51:34.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:51:34.464700664Z 2024-04-14T22:51:34.466735353Z [2024-04-14T22:51:34.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:51:34.466974349Z [2024-04-14T22:51:34.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:51:34.519974846Z [2024-04-14T22:51:34.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:34.525681397Z [2024-04-14T22:51:34.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8cbbeb2-3e5a-4d29-aa80-f29e2ceb9fc7 2024-04-14T22:51:37.827824734Z [2024-04-14T22:51:37.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:51:37.828342865Z [2024-04-14T22:51:37.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:50:00+00:00, run_id=scheduled__2024-04-14T22:50:00+00:00, run_start_date=2024-04-14 22:51:34.439372+00:00, run_end_date=2024-04-14 22:51:37.828036+00:00, run_duration=3.388664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:50:00+00:00, data_interval_end=2024-04-14 22:51:00+00:00, dag_hash=53c96e42c82eac6317dc94fb4b71324e 2024-04-14T22:51:37.837341345Z [2024-04-14T22:51:37.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:51:00+00:00, run_after=2024-04-14T22:52:00+00:00 2024-04-14T22:51:37.863638753Z [2024-04-14T22:51:37.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:37.868157028Z [2024-04-14T22:51:37.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:51:36.090379+00:00, run_end_date=2024-04-14 22:51:37.676885+00:00, run_duration=1.586506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:34.465019+00:00, queued_by_job_id=1, pid=1342 2024-04-14T22:51:45.399266928Z [2024-04-14T22:51:45.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:51:45.432015891Z [2024-04-14T22:51:45.431+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:51:45.432075529Z 2024-04-14T22:51:45.432209824Z [2024-04-14T22:51:45.432+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:51:45.432953744Z [2024-04-14T22:51:45.432+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:51:45.432987897Z 2024-04-14T22:51:45.435089885Z [2024-04-14T22:51:45.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:51:45.435249559Z [2024-04-14T22:51:45.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:51:45.484947096Z [2024-04-14T22:51:45.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:45.489342590Z [2024-04-14T22:51:45.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to 058e529b-d0e3-4a88-97c0-91d16ebec25a 2024-04-14T22:51:47.676074753Z [2024-04-14T22:51:47.675+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:51:47.676114058Z 2024-04-14T22:51:47.676226804Z [2024-04-14T22:51:47.675+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:51:47.677435274Z [2024-04-14T22:51:47.677+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:51:47.677453264Z 2024-04-14T22:51:47.681347491Z [2024-04-14T22:51:47.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='split_metrics', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:51:47.681629417Z [2024-04-14T22:51:47.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'split_metrics', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:51:47.746336622Z [2024-04-14T22:51:47.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.split_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:47.746362652Z [2024-04-14T22:51:47.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:47.753980158Z [2024-04-14T22:51:47.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:51:47.008167+00:00, run_end_date=2024-04-14 22:51:47.419249+00:00, run_duration=0.411082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:45.433263+00:00, queued_by_job_id=1, pid=1368 2024-04-14T22:51:47.754075136Z [2024-04-14T22:51:47.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to b65e0863-625b-4d1a-b6d9-d9356791a240 2024-04-14T22:51:50.524892950Z [2024-04-14T22:51:50.524+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:51:50.524931172Z 2024-04-14T22:51:50.524936565Z [2024-04-14T22:51:50.524+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:51:50.525698224Z [2024-04-14T22:51:50.525+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:51:50.525717605Z 2024-04-14T22:51:50.527606921Z [2024-04-14T22:51:50.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:51:50.527750145Z [2024-04-14T22:51:50.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'collect_metrics', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:51:50.588269638Z [2024-04-14T22:51:50.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.collect_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:50.588620609Z [2024-04-14T22:51:50.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.split_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:50.599816900Z [2024-04-14T22:51:50.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=split_metrics, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:51:49.181283+00:00, run_end_date=2024-04-14 22:51:49.535573+00:00, run_duration=0.35429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:47.678088+00:00, queued_by_job_id=1, pid=1381 2024-04-14T22:51:50.600002930Z [2024-04-14T22:51:50.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 657ba0cf-91f8-4b30-a679-198484e33eac 2024-04-14T22:51:52.889083847Z [2024-04-14T22:51:52.888+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:51:52.889127091Z 2024-04-14T22:51:52.889370830Z [2024-04-14T22:51:52.889+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:51:52.891112536Z [2024-04-14T22:51:52.890+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:51:52.891148605Z 2024-04-14T22:51:52.894960176Z [2024-04-14T22:51:52.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:51:52.894980050Z [2024-04-14T22:51:52.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'send_prometheus', 'scheduled__2024-04-14T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:51:52.939614942Z [2024-04-14T22:51:52.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.send_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status queued for try_number 1 2024-04-14T22:51:52.939704381Z [2024-04-14T22:51:52.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.collect_metrics run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:52.945127508Z [2024-04-14T22:51:52.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c6e1738-3558-4cea-98ed-e367bdd94daf 2024-04-14T22:51:52.945201602Z [2024-04-14T22:51:52.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=0, run_start_date=2024-04-14 22:51:51.938816+00:00, run_end_date=2024-04-14 22:51:52.306409+00:00, run_duration=0.367593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:50.525974+00:00, queued_by_job_id=1, pid=1389 2024-04-14T22:51:55.139816186Z [2024-04-14T22:51:55.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:51:55.140333159Z [2024-04-14T22:51:55.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:45:00+00:00, run_id=scheduled__2024-04-14T22:45:00+00:00, run_start_date=2024-04-14 22:51:45.406646+00:00, run_end_date=2024-04-14 22:51:55.139805+00:00, run_duration=9.733159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:45:00+00:00, data_interval_end=2024-04-14 22:50:00+00:00, dag_hash=38162cbf5666d3654bc19301e8bd4327 2024-04-14T22:51:55.148527120Z [2024-04-14T22:51:55.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:50:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:51:55.185538267Z [2024-04-14T22:51:55.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.send_prometheus run_id=scheduled__2024-04-14T22:45:00+00:00 exited with status success for try_number 1 2024-04-14T22:51:55.195215940Z [2024-04-14T22:51:55.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:45:00+00:00, map_index=-1, run_start_date=2024-04-14 22:51:54.366619+00:00, run_end_date=2024-04-14 22:51:54.702611+00:00, run_duration=0.335992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:51:52.891282+00:00, queued_by_job_id=1, pid=1397 2024-04-14T22:52:00.524182080Z [2024-04-14T22:52:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:00.533154330Z [2024-04-14T22:52:00.532+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:52:00.539518061Z [2024-04-14T22:52:00.539+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:52:00.546538281Z [2024-04-14T22:52:00.546+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:52:00.559383427Z [2024-04-14T22:52:00.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:00.662896797Z [2024-04-14T22:52:00.662+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T22:52:00.662932998Z 2024-04-14T22:52:00.662941872Z 2024-04-14T22:52:00.662949388Z 2024-04-14T22:52:00.662957163Z 2024-04-14T22:52:00.662964167Z 2024-04-14T22:52:00.662985917Z [2024-04-14T22:52:00.662+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:52:00.663092016Z [2024-04-14T22:52:00.662+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:52:00.663202479Z [2024-04-14T22:52:00.663+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:52:00.663394063Z [2024-04-14T22:52:00.663+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:52:00.663463352Z [2024-04-14T22:52:00.663+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:52:00.664302174Z [2024-04-14T22:52:00.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:52:00.664330337Z 2024-04-14T22:52:00.664368636Z 2024-04-14T22:52:00.664377641Z 2024-04-14T22:52:00.664385973Z 2024-04-14T22:52:00.664394270Z 2024-04-14T22:52:00.669764688Z [2024-04-14T22:52:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:52:00.670006911Z [2024-04-14T22:52:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:52:00.670262319Z [2024-04-14T22:52:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:52:00.670389272Z [2024-04-14T22:52:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:52:00.670650783Z [2024-04-14T22:52:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:52:00.670771362Z [2024-04-14T22:52:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:52:00.671019266Z [2024-04-14T22:52:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:52:00.671106224Z [2024-04-14T22:52:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:52:00.671405357Z [2024-04-14T22:52:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:52:00.671602002Z [2024-04-14T22:52:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:52:01.119730926Z [2024-04-14T22:52:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:52:01.119760318Z [2024-04-14T22:52:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status queued for try_number 1 2024-04-14T22:52:01.119818754Z [2024-04-14T22:52:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status queued for try_number 1 2024-04-14T22:52:01.119872341Z [2024-04-14T22:52:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status queued for try_number 1 2024-04-14T22:52:01.119921501Z [2024-04-14T22:52:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status queued for try_number 1 2024-04-14T22:52:01.136417390Z [2024-04-14T22:52:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6280e36b-8759-41e9-b2fc-c33b88356bb6 2024-04-14T22:52:01.136489263Z [2024-04-14T22:52:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef5bd3cd-574c-48f4-81dd-552c080d921b 2024-04-14T22:52:01.136547454Z [2024-04-14T22:52:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b7bd8a4-0c54-44a2-8ceb-dba5fddb7e36 2024-04-14T22:52:01.136625270Z [2024-04-14T22:52:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65a4b8a9-324f-4bdd-8e7c-84c7a14e1e90 2024-04-14T22:52:01.136742711Z [2024-04-14T22:52:01.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 756197fe-3b5f-4a7c-a81e-e542423d0f0f 2024-04-14T22:52:02.182799678Z [2024-04-14T22:52:02.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:52:02.187108558Z [2024-04-14T22:52:02.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:50:00+00:00, run_id=scheduled__2024-04-14T22:50:00+00:00, run_start_date=2024-04-14 22:52:00.571582+00:00, run_end_date=2024-04-14 22:52:02.182741+00:00, run_duration=1.611159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:50:00+00:00, data_interval_end=2024-04-14 22:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:52:02.197750296Z [2024-04-14T22:52:02.197+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:52:02.205203991Z [2024-04-14T22:52:02.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:52:02.205428814Z [2024-04-14T22:52:02.205+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:51:00+00:00, run_id=scheduled__2024-04-14T22:51:00+00:00, run_start_date=2024-04-14 22:52:00.572866+00:00, run_end_date=2024-04-14 22:52:02.205111+00:00, run_duration=1.632245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:51:00+00:00, data_interval_end=2024-04-14 22:52:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:52:02.215809838Z [2024-04-14T22:52:02.215+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:02.266445761Z [2024-04-14T22:52:02.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:52:02.266472994Z [2024-04-14T22:52:02.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status success for try_number 1 2024-04-14T22:52:02.271881754Z [2024-04-14T22:52:02.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:52:01.348815+00:00, run_end_date=2024-04-14 22:52:01.651751+00:00, run_duration=0.302936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:52:00.665918+00:00, queued_by_job_id=1, pid=1408 2024-04-14T22:52:02.271977317Z [2024-04-14T22:52:02.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:51:00+00:00, map_index=-1, run_start_date=2024-04-14 22:52:01.458137+00:00, run_end_date=2024-04-14 22:52:01.920268+00:00, run_duration=0.462131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:52:00.665918+00:00, queued_by_job_id=1, pid=1409 2024-04-14T22:52:04.431015149Z [2024-04-14T22:52:04.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:52:04.431289611Z [2024-04-14T22:52:04.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:51:00+00:00, run_id=scheduled__2024-04-14T22:51:00+00:00, run_start_date=2024-04-14 22:52:00.576185+00:00, run_end_date=2024-04-14 22:52:04.430950+00:00, run_duration=3.854765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:51:00+00:00, data_interval_end=2024-04-14 22:52:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:52:04.445377201Z [2024-04-14T22:52:04.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:04.544487173Z [2024-04-14T22:52:04.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status success for try_number 1 2024-04-14T22:52:04.551590362Z [2024-04-14T22:52:04.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:51:00+00:00, map_index=-1, run_start_date=2024-04-14 22:52:02.724437+00:00, run_end_date=2024-04-14 22:52:04.072052+00:00, run_duration=1.347615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:52:00.665918+00:00, queued_by_job_id=1, pid=1438 2024-04-14T22:52:05.603328176Z [2024-04-14T22:52:05.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:05.628818070Z [2024-04-14T22:52:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:52:05.628940921Z [2024-04-14T22:52:05.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:51:00+00:00, run_id=scheduled__2024-04-14T22:51:00+00:00, run_start_date=2024-04-14 22:52:00.574034+00:00, run_end_date=2024-04-14 22:52:05.628637+00:00, run_duration=5.054603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:51:00+00:00, data_interval_end=2024-04-14 22:52:00+00:00, dag_hash=53c96e42c82eac6317dc94fb4b71324e 2024-04-14T22:52:05.640895214Z [2024-04-14T22:52:05.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:05.647305268Z [2024-04-14T22:52:05.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:52:05.647422560Z [2024-04-14T22:52:05.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:51:00+00:00, run_id=scheduled__2024-04-14T22:51:00+00:00, run_start_date=2024-04-14 22:52:00.575083+00:00, run_end_date=2024-04-14 22:52:05.647107+00:00, run_duration=5.072024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:51:00+00:00, data_interval_end=2024-04-14 22:52:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:52:05.655723273Z [2024-04-14T22:52:05.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:05.668248596Z [2024-04-14T22:52:05.667+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:52:05.668286408Z 2024-04-14T22:52:05.668295975Z [2024-04-14T22:52:05.668+0000] {scheduler_job.py:425} INFO - DAG vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:52:05.668717705Z [2024-04-14T22:52:05.668+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:52:05.668736659Z 2024-04-14T22:52:05.670586010Z [2024-04-14T22:52:05.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:52:05.670774418Z [2024-04-14T22:52:05.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:52:05.749416594Z [2024-04-14T22:52:05.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status queued for try_number 1 2024-04-14T22:52:05.749581101Z [2024-04-14T22:52:05.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status success for try_number 1 2024-04-14T22:52:05.750348580Z [2024-04-14T22:52:05.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status success for try_number 1 2024-04-14T22:52:05.756232044Z [2024-04-14T22:52:05.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:51:00+00:00, map_index=-1, run_start_date=2024-04-14 22:52:02.730843+00:00, run_end_date=2024-04-14 22:52:04.415673+00:00, run_duration=1.68483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:52:00.665918+00:00, queued_by_job_id=1, pid=1439 2024-04-14T22:52:05.756466962Z [2024-04-14T22:52:05.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbfc9f4d-004e-4292-9f69-c59c9a3ccc6c 2024-04-14T22:52:05.756717531Z [2024-04-14T22:52:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:51:00+00:00, map_index=-1, run_start_date=2024-04-14 22:52:02.880570+00:00, run_end_date=2024-04-14 22:52:05.010602+00:00, run_duration=2.130032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:52:00.665918+00:00, queued_by_job_id=1, pid=1440 2024-04-14T22:52:09.513498489Z [2024-04-14T22:52:09.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:52:09.513971435Z [2024-04-14T22:52:09.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:51:00+00:00, run_id=scheduled__2024-04-14T22:51:00+00:00, run_start_date=2024-04-14 22:52:05.611181+00:00, run_end_date=2024-04-14 22:52:09.513290+00:00, run_duration=3.902109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:51:00+00:00, data_interval_end=2024-04-14 22:52:00+00:00, dag_hash=afb09b92e405f964a4522196eb9acd39 2024-04-14T22:52:09.525615087Z [2024-04-14T22:52:09.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:52:00+00:00, run_after=2024-04-14T22:53:00+00:00 2024-04-14T22:52:09.561672190Z [2024-04-14T22:52:09.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:51:00+00:00 exited with status success for try_number 1 2024-04-14T22:52:09.570584549Z [2024-04-14T22:52:09.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:51:00+00:00, map_index=-1, run_start_date=2024-04-14 22:52:07.193771+00:00, run_end_date=2024-04-14 22:52:08.424511+00:00, run_duration=1.23074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:52:05.668966+00:00, queued_by_job_id=1, pid=1463 2024-04-14T22:53:00.940253005Z [2024-04-14T22:53:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:00.950272721Z [2024-04-14T22:53:00.949+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:53:00.958367264Z [2024-04-14T22:53:00.957+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:53:00.972199517Z [2024-04-14T22:53:00.971+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:00.986320930Z [2024-04-14T22:53:00.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:01.099188783Z [2024-04-14T22:53:01.098+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T22:53:01.099233508Z 2024-04-14T22:53:01.099243532Z 2024-04-14T22:53:01.099253230Z 2024-04-14T22:53:01.099262655Z 2024-04-14T22:53:01.099271304Z 2024-04-14T22:53:01.099408660Z [2024-04-14T22:53:01.098+0000] {scheduler_job.py:425} INFO - DAG vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:53:01.099841349Z [2024-04-14T22:53:01.099+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:53:01.100253352Z [2024-04-14T22:53:01.099+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:53:01.100687594Z [2024-04-14T22:53:01.100+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:53:01.101139903Z [2024-04-14T22:53:01.100+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:53:01.102656189Z [2024-04-14T22:53:01.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:53:01.102671525Z 2024-04-14T22:53:01.102694827Z 2024-04-14T22:53:01.102703685Z 2024-04-14T22:53:01.102712159Z 2024-04-14T22:53:01.102720541Z 2024-04-14T22:53:01.109909426Z [2024-04-14T22:53:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:53:01.109940293Z [2024-04-14T22:53:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:53:01.110428049Z [2024-04-14T22:53:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:53:01.110736876Z [2024-04-14T22:53:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:53:01.111309573Z [2024-04-14T22:53:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:53:01.111569660Z [2024-04-14T22:53:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:53:01.111996683Z [2024-04-14T22:53:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:53:01.112276301Z [2024-04-14T22:53:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:53:01.112714827Z [2024-04-14T22:53:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:53:01.112957242Z [2024-04-14T22:53:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:53:01.607496581Z [2024-04-14T22:53:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status queued for try_number 1 2024-04-14T22:53:01.607767617Z [2024-04-14T22:53:01.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status queued for try_number 1 2024-04-14T22:53:01.607965725Z [2024-04-14T22:53:01.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status queued for try_number 1 2024-04-14T22:53:01.608171897Z [2024-04-14T22:53:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status queued for try_number 1 2024-04-14T22:53:01.608333656Z [2024-04-14T22:53:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status queued for try_number 1 2024-04-14T22:53:01.616214762Z [2024-04-14T22:53:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to a202cd37-f1f3-4f18-b7b3-b05cba8a503d 2024-04-14T22:53:01.616464155Z [2024-04-14T22:53:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to db3fb6a8-ee9b-4e57-8ad6-2cf586f49b4e 2024-04-14T22:53:01.616679604Z [2024-04-14T22:53:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3fc7f02-cd40-4e04-80f1-2e9408fcf3fa 2024-04-14T22:53:01.616877489Z [2024-04-14T22:53:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92786540-ae15-408f-968d-ab0a5c763777 2024-04-14T22:53:01.617077341Z [2024-04-14T22:53:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd341ab7-18cf-4f59-920e-af86e829370e 2024-04-14T22:53:03.406855016Z [2024-04-14T22:53:03.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:53:03.407233568Z [2024-04-14T22:53:03.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:52:00+00:00, run_id=scheduled__2024-04-14T22:52:00+00:00, run_start_date=2024-04-14 22:53:01.006114+00:00, run_end_date=2024-04-14 22:53:03.406774+00:00, run_duration=2.40066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:52:00+00:00, data_interval_end=2024-04-14 22:53:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:53:03.418656095Z [2024-04-14T22:53:03.418+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:03.523664398Z [2024-04-14T22:53:03.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status success for try_number 1 2024-04-14T22:53:03.534448022Z [2024-04-14T22:53:03.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:52:00+00:00, map_index=-1, run_start_date=2024-04-14 22:53:01.936000+00:00, run_end_date=2024-04-14 22:53:02.518253+00:00, run_duration=0.582253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:53:01.104975+00:00, queued_by_job_id=1, pid=1492 2024-04-14T22:53:05.747941707Z [2024-04-14T22:53:05.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:53:05.748446998Z [2024-04-14T22:53:05.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:52:00+00:00, run_id=scheduled__2024-04-14T22:52:00+00:00, run_start_date=2024-04-14 22:53:01.003874+00:00, run_end_date=2024-04-14 22:53:05.748117+00:00, run_duration=4.744243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:52:00+00:00, data_interval_end=2024-04-14 22:53:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:53:05.757170797Z [2024-04-14T22:53:05.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:05.763415229Z [2024-04-14T22:53:05.763+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:53:05.763872046Z [2024-04-14T22:53:05.763+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:52:00+00:00, run_id=scheduled__2024-04-14T22:52:00+00:00, run_start_date=2024-04-14 22:53:01.007317+00:00, run_end_date=2024-04-14 22:53:05.763564+00:00, run_duration=4.756247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:52:00+00:00, data_interval_end=2024-04-14 22:53:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:53:05.775479971Z [2024-04-14T22:53:05.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:05.793577910Z [2024-04-14T22:53:05.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:53:05.794204798Z [2024-04-14T22:53:05.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:52:00+00:00, run_id=scheduled__2024-04-14T22:52:00+00:00, run_start_date=2024-04-14 22:53:00.999999+00:00, run_end_date=2024-04-14 22:53:05.793450+00:00, run_duration=4.793451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:52:00+00:00, data_interval_end=2024-04-14 22:53:00+00:00, dag_hash=afb09b92e405f964a4522196eb9acd39 2024-04-14T22:53:05.823374549Z [2024-04-14T22:53:05.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:05.832056172Z [2024-04-14T22:53:05.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:53:05.832353492Z [2024-04-14T22:53:05.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:52:00+00:00, run_id=scheduled__2024-04-14T22:52:00+00:00, run_start_date=2024-04-14 22:53:01.004970+00:00, run_end_date=2024-04-14 22:53:05.831954+00:00, run_duration=4.826984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:52:00+00:00, data_interval_end=2024-04-14 22:53:00+00:00, dag_hash=53c96e42c82eac6317dc94fb4b71324e 2024-04-14T22:53:05.840972009Z [2024-04-14T22:53:05.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:53:00+00:00, run_after=2024-04-14T22:54:00+00:00 2024-04-14T22:53:05.904173336Z [2024-04-14T22:53:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status success for try_number 1 2024-04-14T22:53:05.904444702Z [2024-04-14T22:53:05.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status success for try_number 1 2024-04-14T22:53:05.904738442Z [2024-04-14T22:53:05.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status success for try_number 1 2024-04-14T22:53:05.905056390Z [2024-04-14T22:53:05.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status success for try_number 1 2024-04-14T22:53:05.925119973Z [2024-04-14T22:53:05.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:52:00+00:00, map_index=-1, run_start_date=2024-04-14 22:53:03.306473+00:00, run_end_date=2024-04-14 22:53:05.182399+00:00, run_duration=1.875926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:53:01.104975+00:00, queued_by_job_id=1, pid=1517 2024-04-14T22:53:05.925661807Z [2024-04-14T22:53:05.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:52:00+00:00, map_index=-1, run_start_date=2024-04-14 22:53:03.624378+00:00, run_end_date=2024-04-14 22:53:05.019337+00:00, run_duration=1.394959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:53:01.104975+00:00, queued_by_job_id=1, pid=1530 2024-04-14T22:53:05.925964087Z [2024-04-14T22:53:05.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:52:00+00:00, map_index=-1, run_start_date=2024-04-14 22:53:03.399852+00:00, run_end_date=2024-04-14 22:53:05.011575+00:00, run_duration=1.611723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:53:01.104975+00:00, queued_by_job_id=1, pid=1518 2024-04-14T22:53:05.926047780Z [2024-04-14T22:53:05.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:52:00+00:00, map_index=-1, run_start_date=2024-04-14 22:53:03.482648+00:00, run_end_date=2024-04-14 22:53:04.859517+00:00, run_duration=1.376869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:53:01.104975+00:00, queued_by_job_id=1, pid=1524 2024-04-14T22:54:00.270537961Z [2024-04-14T22:54:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:00.276618703Z [2024-04-14T22:54:00.276+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:54:00.288639706Z [2024-04-14T22:54:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:00.295140736Z [2024-04-14T22:54:00.294+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:54:00.300427154Z [2024-04-14T22:54:00.300+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:54:00.310407722Z [2024-04-14T22:54:00.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:00.463033986Z [2024-04-14T22:54:00.462+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-14T22:54:00.463068432Z 2024-04-14T22:54:00.463076235Z 2024-04-14T22:54:00.463079515Z 2024-04-14T22:54:00.463094612Z 2024-04-14T22:54:00.463097626Z 2024-04-14T22:54:00.463100419Z 2024-04-14T22:54:00.463451663Z [2024-04-14T22:54:00.463+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:54:00.463626478Z [2024-04-14T22:54:00.463+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:54:00.463756974Z [2024-04-14T22:54:00.463+0000] {scheduler_job.py:425} INFO - DAG vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:54:00.463861404Z [2024-04-14T22:54:00.463+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:54:00.463938908Z [2024-04-14T22:54:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:54:00.464037496Z [2024-04-14T22:54:00.463+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:54:00.464583576Z [2024-04-14T22:54:00.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:54:00.464593035Z 2024-04-14T22:54:00.464596093Z 2024-04-14T22:54:00.464598635Z 2024-04-14T22:54:00.464601163Z 2024-04-14T22:54:00.464603690Z 2024-04-14T22:54:00.464606377Z 2024-04-14T22:54:00.470739102Z [2024-04-14T22:54:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:54:00.471017939Z [2024-04-14T22:54:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:54:00.471287295Z [2024-04-14T22:54:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:54:00.471662409Z [2024-04-14T22:54:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:54:00.472037284Z [2024-04-14T22:54:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:54:00.472278143Z [2024-04-14T22:54:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:54:00.472749882Z [2024-04-14T22:54:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:54:00.473049633Z [2024-04-14T22:54:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:54:00.473507306Z [2024-04-14T22:54:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:54:00.473761675Z [2024-04-14T22:54:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:54:00.474189044Z [2024-04-14T22:54:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:54:00.474445714Z [2024-04-14T22:54:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:54:01.082934565Z [2024-04-14T22:54:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status queued for try_number 1 2024-04-14T22:54:01.083039091Z [2024-04-14T22:54:01.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status queued for try_number 1 2024-04-14T22:54:01.083115025Z [2024-04-14T22:54:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status queued for try_number 1 2024-04-14T22:54:01.083221430Z [2024-04-14T22:54:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status queued for try_number 1 2024-04-14T22:54:01.083292567Z [2024-04-14T22:54:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status queued for try_number 1 2024-04-14T22:54:01.083375471Z [2024-04-14T22:54:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status queued for try_number 1 2024-04-14T22:54:01.094898105Z [2024-04-14T22:54:01.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3612d82-13e7-44d8-a8f4-f49f09b037ee 2024-04-14T22:54:01.099315593Z [2024-04-14T22:54:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 349b85d2-394a-4293-99ce-3bf3aa84b8d8 2024-04-14T22:54:01.099463260Z [2024-04-14T22:54:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f77c3c4-00a2-47d8-a3ae-587df5a0733c 2024-04-14T22:54:01.099614041Z [2024-04-14T22:54:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19a43bd4-e1bb-4f30-9574-996ca20c1b55 2024-04-14T22:54:01.099765083Z [2024-04-14T22:54:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02a75dba-7bdc-495b-a9ee-bd6ba6f92d4d 2024-04-14T22:54:01.099902317Z [2024-04-14T22:54:01.099+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5b7b935-70c5-4993-bc7f-cd1aacb92ab9 2024-04-14T22:54:02.316174690Z [2024-04-14T22:54:02.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:54:02.316834671Z [2024-04-14T22:54:02.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:52:00+00:00, run_id=scheduled__2024-04-14T22:52:00+00:00, run_start_date=2024-04-14 22:54:00.331909+00:00, run_end_date=2024-04-14 22:54:02.316106+00:00, run_duration=1.984197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:52:00+00:00, data_interval_end=2024-04-14 22:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:54:02.330009053Z [2024-04-14T22:54:02.329+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:54:02.356475959Z [2024-04-14T22:54:02.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:54:02.356685290Z [2024-04-14T22:54:02.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:53:00+00:00, run_id=scheduled__2024-04-14T22:53:00+00:00, run_start_date=2024-04-14 22:54:00.339718+00:00, run_end_date=2024-04-14 22:54:02.356389+00:00, run_duration=2.016671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:53:00+00:00, data_interval_end=2024-04-14 22:54:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:54:02.366677224Z [2024-04-14T22:54:02.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:02.457510998Z [2024-04-14T22:54:02.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status success for try_number 1 2024-04-14T22:54:02.463233559Z [2024-04-14T22:54:02.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:53:00+00:00, map_index=-1, run_start_date=2024-04-14 22:54:01.639031+00:00, run_end_date=2024-04-14 22:54:02.048468+00:00, run_duration=0.409437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:54:00.465595+00:00, queued_by_job_id=1, pid=1571 2024-04-14T22:54:03.291749310Z [2024-04-14T22:54:03.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:52:00+00:00 exited with status success for try_number 1 2024-04-14T22:54:03.298130296Z [2024-04-14T22:54:03.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:52:00+00:00, map_index=-1, run_start_date=2024-04-14 22:54:01.831735+00:00, run_end_date=2024-04-14 22:54:02.209261+00:00, run_duration=0.377526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:54:00.465595+00:00, queued_by_job_id=1, pid=1574 2024-04-14T22:54:04.371811956Z [2024-04-14T22:54:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:54:04.372100663Z [2024-04-14T22:54:04.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:53:00+00:00, run_id=scheduled__2024-04-14T22:53:00+00:00, run_start_date=2024-04-14 22:54:00.336994+00:00, run_end_date=2024-04-14 22:54:04.371685+00:00, run_duration=4.034691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:53:00+00:00, data_interval_end=2024-04-14 22:54:00+00:00, dag_hash=afb09b92e405f964a4522196eb9acd39 2024-04-14T22:54:04.383385775Z [2024-04-14T22:54:04.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:04.395085482Z [2024-04-14T22:54:04.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:54:04.395118683Z [2024-04-14T22:54:04.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:53:00+00:00, run_id=scheduled__2024-04-14T22:53:00+00:00, run_start_date=2024-04-14 22:54:00.351013+00:00, run_end_date=2024-04-14 22:54:04.389951+00:00, run_duration=4.038938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:53:00+00:00, data_interval_end=2024-04-14 22:54:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:54:04.405424629Z [2024-04-14T22:54:04.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:04.465460338Z [2024-04-14T22:54:04.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status success for try_number 1 2024-04-14T22:54:04.465558271Z [2024-04-14T22:54:04.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status success for try_number 1 2024-04-14T22:54:04.472150474Z [2024-04-14T22:54:04.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:53:00+00:00, map_index=-1, run_start_date=2024-04-14 22:54:02.628175+00:00, run_end_date=2024-04-14 22:54:03.880399+00:00, run_duration=1.252224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:54:00.465595+00:00, queued_by_job_id=1, pid=1597 2024-04-14T22:54:04.472708051Z [2024-04-14T22:54:04.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:53:00+00:00, map_index=-1, run_start_date=2024-04-14 22:54:02.731711+00:00, run_end_date=2024-04-14 22:54:04.197452+00:00, run_duration=1.465741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:54:00.465595+00:00, queued_by_job_id=1, pid=1598 2024-04-14T22:54:05.527549002Z [2024-04-14T22:54:05.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:54:05.528071394Z [2024-04-14T22:54:05.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:53:00+00:00, run_id=scheduled__2024-04-14T22:53:00+00:00, run_start_date=2024-04-14 22:54:00.347592+00:00, run_end_date=2024-04-14 22:54:05.527376+00:00, run_duration=5.179784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:53:00+00:00, data_interval_end=2024-04-14 22:54:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:54:05.540943639Z [2024-04-14T22:54:05.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:05.549496998Z [2024-04-14T22:54:05.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:54:05.549835027Z [2024-04-14T22:54:05.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:53:00+00:00, run_id=scheduled__2024-04-14T22:53:00+00:00, run_start_date=2024-04-14 22:54:00.349445+00:00, run_end_date=2024-04-14 22:54:05.549334+00:00, run_duration=5.199889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:53:00+00:00, data_interval_end=2024-04-14 22:54:00+00:00, dag_hash=53c96e42c82eac6317dc94fb4b71324e 2024-04-14T22:54:05.559858511Z [2024-04-14T22:54:05.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:54:00+00:00, run_after=2024-04-14T22:55:00+00:00 2024-04-14T22:54:05.599516508Z [2024-04-14T22:54:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status success for try_number 1 2024-04-14T22:54:05.599878497Z [2024-04-14T22:54:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:53:00+00:00 exited with status success for try_number 1 2024-04-14T22:54:05.609617034Z [2024-04-14T22:54:05.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:53:00+00:00, map_index=-1, run_start_date=2024-04-14 22:54:02.966879+00:00, run_end_date=2024-04-14 22:54:04.522312+00:00, run_duration=1.555433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:54:00.465595+00:00, queued_by_job_id=1, pid=1611 2024-04-14T22:54:05.610060456Z [2024-04-14T22:54:05.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:53:00+00:00, map_index=-1, run_start_date=2024-04-14 22:54:03.028644+00:00, run_end_date=2024-04-14 22:54:05.016512+00:00, run_duration=1.987868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:54:00.465595+00:00, queued_by_job_id=1, pid=1615 2024-04-14T22:55:00.698847919Z [2024-04-14T22:55:00.698+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:55:00.716712599Z [2024-04-14T22:55:00.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:00.732042409Z [2024-04-14T22:55:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:55:00.744368054Z [2024-04-14T22:55:00.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:55:00.751575395Z [2024-04-14T22:55:00.751+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:55:00.764218568Z [2024-04-14T22:55:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:00.775763186Z [2024-04-14T22:55:00.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:00.928282508Z [2024-04-14T22:55:00.927+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-14T22:55:00.928321868Z 2024-04-14T22:55:00.928331797Z 2024-04-14T22:55:00.928341487Z 2024-04-14T22:55:00.928357909Z 2024-04-14T22:55:00.928366818Z 2024-04-14T22:55:00.928375935Z 2024-04-14T22:55:00.928384693Z 2024-04-14T22:55:00.928409048Z [2024-04-14T22:55:00.928+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:55:00.928515873Z [2024-04-14T22:55:00.928+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:55:00.928787632Z [2024-04-14T22:55:00.928+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:55:00.928977570Z [2024-04-14T22:55:00.928+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:55:00.929373475Z [2024-04-14T22:55:00.928+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:55:00.929411187Z [2024-04-14T22:55:00.928+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:55:00.929481043Z [2024-04-14T22:55:00.929+0000] {scheduler_job.py:425} INFO - DAG vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:55:00.930230254Z [2024-04-14T22:55:00.929+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:55:00.930252910Z 2024-04-14T22:55:00.930263325Z 2024-04-14T22:55:00.930272444Z 2024-04-14T22:55:00.930280928Z 2024-04-14T22:55:00.930289521Z 2024-04-14T22:55:00.930298094Z 2024-04-14T22:55:00.930330372Z 2024-04-14T22:55:00.937549401Z [2024-04-14T22:55:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:55:00.937598615Z [2024-04-14T22:55:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:55:00.937984943Z [2024-04-14T22:55:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:55:00.938071285Z [2024-04-14T22:55:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:55:00.938409813Z [2024-04-14T22:55:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:00.938510847Z [2024-04-14T22:55:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:55:00.938806685Z [2024-04-14T22:55:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:00.938858318Z [2024-04-14T22:55:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:55:00.939194934Z [2024-04-14T22:55:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:00.939278602Z [2024-04-14T22:55:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:55:00.939545977Z [2024-04-14T22:55:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:00.939632252Z [2024-04-14T22:55:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:55:00.939852879Z [2024-04-14T22:55:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:00.939938790Z [2024-04-14T22:55:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:55:01.888012919Z [2024-04-14T22:55:01.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:01.888096427Z [2024-04-14T22:55:01.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:01.888100765Z [2024-04-14T22:55:01.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:01.888136555Z [2024-04-14T22:55:01.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:01.888175853Z [2024-04-14T22:55:01.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:01.888238162Z [2024-04-14T22:55:01.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:01.888273443Z [2024-04-14T22:55:01.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:01.908121902Z [2024-04-14T22:55:01.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 922f1e65-f0a6-4960-8d7f-64dade886dee 2024-04-14T22:55:01.908143344Z [2024-04-14T22:55:01.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47619f4f-0b67-4365-9e2f-832dc903b5fa 2024-04-14T22:55:01.908227052Z [2024-04-14T22:55:01.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f4f4ad2-d0a3-4d56-a1bf-484e90594731 2024-04-14T22:55:01.908295491Z [2024-04-14T22:55:01.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d573cb4-1588-48e5-afc9-b0be3b02392b 2024-04-14T22:55:01.908377747Z [2024-04-14T22:55:01.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dcd8fc6-5cb2-40cc-8522-f8706ad0b8f5 2024-04-14T22:55:01.908458189Z [2024-04-14T22:55:01.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to f22b946a-411b-46c1-9ec7-f442a1885c1b 2024-04-14T22:55:02.547082251Z [2024-04-14T22:55:02.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:55:02.547363695Z [2024-04-14T22:55:02.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:54:00+00:00, run_id=scheduled__2024-04-14T22:54:00+00:00, run_start_date=2024-04-14 22:55:00.792747+00:00, run_end_date=2024-04-14 22:55:02.546959+00:00, run_duration=1.754212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:54:00+00:00, data_interval_end=2024-04-14 22:55:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:55:02.556888538Z [2024-04-14T22:55:02.556+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:03.768632268Z [2024-04-14T22:55:03.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status failed for try_number 1 2024-04-14T22:55:03.768671947Z [2024-04-14T22:55:03.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status success for try_number 1 2024-04-14T22:55:03.768749764Z [2024-04-14T22:55:03.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status failed for try_number 1 2024-04-14T22:55:03.768830536Z [2024-04-14T22:55:03.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status failed for try_number 1 2024-04-14T22:55:03.775619844Z [2024-04-14T22:55:03.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=2024-04-14 22:55:01.868874+00:00, run_end_date=2024-04-14 22:55:02.497440+00:00, run_duration=0.628566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:00.932267+00:00, queued_by_job_id=1, pid=1656 2024-04-14T22:55:03.775711455Z [2024-04-14T22:55:03.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:00.932267+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:55:03.776225008Z [2024-04-14T22:55:03.775+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:03.778099718Z [2024-04-14T22:55:03.777+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:03.789288292Z [2024-04-14T22:55:03.789+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240414T225400, start_date=, end_date=20240414T225503 2024-04-14T22:55:03.795956863Z [2024-04-14T22:55:03.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:00.932267+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:55:03.796227045Z [2024-04-14T22:55:03.796+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:03.798178094Z [2024-04-14T22:55:03.797+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:03.814266469Z [2024-04-14T22:55:03.813+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=extract_metrics_from_vnfrs, execution_date=20240414T225000, start_date=, end_date=20240414T225503 2024-04-14T22:55:03.820501110Z [2024-04-14T22:55:03.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:00.932267+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:55:03.820766498Z [2024-04-14T22:55:03.820+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:03.822557538Z [2024-04-14T22:55:03.822+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:03.832200821Z [2024-04-14T22:55:03.831+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240414T225400, start_date=, end_date=20240414T225503 2024-04-14T22:55:04.272994474Z [2024-04-14T22:55:04.272+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:55:04.273030495Z 2024-04-14T22:55:04.273268339Z [2024-04-14T22:55:04.273+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:55:04.273955582Z [2024-04-14T22:55:04.273+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:55:04.273969102Z 2024-04-14T22:55:04.276376171Z [2024-04-14T22:55:04.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T22:55:04.276779952Z [2024-04-14T22:55:04.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:55:04.416888183Z [2024-04-14T22:55:04.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:04.417320444Z [2024-04-14T22:55:04.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:55:04.436216398Z [2024-04-14T22:55:04.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99779e91-2606-4633-a27d-c73a6efef014 2024-04-14T22:55:04.437030201Z [2024-04-14T22:55:04.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:55:03.796520+00:00, run_end_date=2024-04-14 22:55:04.165271+00:00, run_duration=0.368751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:00.932267+00:00, queued_by_job_id=1, pid=1714 2024-04-14T22:55:05.646742996Z [2024-04-14T22:55:05.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:55:05.647165819Z [2024-04-14T22:55:05.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:54:00+00:00, run_id=scheduled__2024-04-14T22:54:00+00:00, run_start_date=2024-04-14 22:55:00.796156+00:00, run_end_date=2024-04-14 22:55:05.646533+00:00, run_duration=4.850377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:54:00+00:00, data_interval_end=2024-04-14 22:55:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:55:05.656763242Z [2024-04-14T22:55:05.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:05.752761601Z [2024-04-14T22:55:05.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status success for try_number 1 2024-04-14T22:55:05.757404635Z [2024-04-14T22:55:05.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=2024-04-14 22:55:03.317580+00:00, run_end_date=2024-04-14 22:55:04.888385+00:00, run_duration=1.570805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:00.932267+00:00, queued_by_job_id=1, pid=1692 2024-04-14T22:55:06.494415959Z [2024-04-14T22:55:06.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:55:06.494640617Z [2024-04-14T22:55:06.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:54:00+00:00, run_id=scheduled__2024-04-14T22:54:00+00:00, run_start_date=2024-04-14 22:55:00.799650+00:00, run_end_date=2024-04-14 22:55:06.494371+00:00, run_duration=5.694721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:54:00+00:00, data_interval_end=2024-04-14 22:55:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:55:06.504197277Z [2024-04-14T22:55:06.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:06.589187175Z [2024-04-14T22:55:06.588+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:55:06.589242564Z 2024-04-14T22:55:06.589249084Z [2024-04-14T22:55:06.588+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:55:06.589360432Z [2024-04-14T22:55:06.589+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:55:06.589368108Z 2024-04-14T22:55:06.591345238Z [2024-04-14T22:55:06.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T22:55:06.591452046Z [2024-04-14T22:55:06.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T22:55:06.651678443Z [2024-04-14T22:55:06.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:06.651701135Z [2024-04-14T22:55:06.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:55:06.657204361Z [2024-04-14T22:55:06.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to abcc40a5-e306-4087-939e-01521cd8e07e 2024-04-14T22:55:06.657328876Z [2024-04-14T22:55:06.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:55:05.882822+00:00, run_end_date=2024-04-14 22:55:06.303323+00:00, run_duration=0.420501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:04.274457+00:00, queued_by_job_id=1, pid=1738 2024-04-14T22:55:06.758361534Z [2024-04-14T22:55:06.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status success for try_number 1 2024-04-14T22:55:06.766914545Z [2024-04-14T22:55:06.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=2024-04-14 22:55:04.295407+00:00, run_end_date=2024-04-14 22:55:06.468433+00:00, run_duration=2.173026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:00.932267+00:00, queued_by_job_id=1, pid=1726 2024-04-14T22:55:09.599899044Z [2024-04-14T22:55:09.599+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T22:55:09.599961698Z 2024-04-14T22:55:09.600133236Z [2024-04-14T22:55:09.599+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:55:09.600750561Z [2024-04-14T22:55:09.600+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:55:09.600756408Z 2024-04-14T22:55:09.603388419Z [2024-04-14T22:55:09.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:09.603484131Z [2024-04-14T22:55:09.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:55:09.661955720Z [2024-04-14T22:55:09.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 1 2024-04-14T22:55:09.662314402Z [2024-04-14T22:55:09.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:55:09.668514613Z [2024-04-14T22:55:09.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66b1c8bf-e130-4273-8a2d-e3c93652fcdf 2024-04-14T22:55:09.668872272Z [2024-04-14T22:55:09.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=0, run_start_date=2024-04-14 22:55:08.177235+00:00, run_end_date=2024-04-14 22:55:09.423217+00:00, run_duration=1.245982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:06.589588+00:00, queued_by_job_id=1, pid=1746 2024-04-14T22:55:11.973503710Z [2024-04-14T22:55:11.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:55:11.973710511Z [2024-04-14T22:55:11.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:50:00+00:00, run_id=scheduled__2024-04-14T22:50:00+00:00, run_start_date=2024-04-14 22:55:00.787667+00:00, run_end_date=2024-04-14 22:55:11.973156+00:00, run_duration=11.185489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:50:00+00:00, data_interval_end=2024-04-14 22:55:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T22:55:11.982452161Z [2024-04-14T22:55:11.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:55:12.074584424Z [2024-04-14T22:55:12.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status success for try_number 1 2024-04-14T22:55:12.083073871Z [2024-04-14T22:55:12.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=2024-04-14 22:55:11.000281+00:00, run_end_date=2024-04-14 22:55:11.344531+00:00, run_duration=0.34425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:09.601184+00:00, queued_by_job_id=1, pid=1759 2024-04-14T22:55:14.283549744Z [2024-04-14T22:55:14.283+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T22:55:14.283573926Z 2024-04-14T22:55:14.283578378Z 2024-04-14T22:55:14.283581684Z 2024-04-14T22:55:14.283705374Z [2024-04-14T22:55:14.283+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:55:14.283841161Z [2024-04-14T22:55:14.283+0000] {scheduler_job.py:425} INFO - DAG vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:55:14.283931174Z [2024-04-14T22:55:14.283+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:55:14.284497650Z [2024-04-14T22:55:14.284+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:55:14.284508582Z 2024-04-14T22:55:14.284512217Z 2024-04-14T22:55:14.284515208Z 2024-04-14T22:55:14.287167146Z [2024-04-14T22:55:14.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:50:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-14T22:55:14.287330913Z [2024-04-14T22:55:14.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T22:55:14.287670029Z [2024-04-14T22:55:14.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:14.287777155Z [2024-04-14T22:55:14.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:55:14.287998547Z [2024-04-14T22:55:14.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:55:14.288099312Z [2024-04-14T22:55:14.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:55:14.783794173Z [2024-04-14T22:55:14.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status queued for try_number 2 2024-04-14T22:55:14.783987143Z [2024-04-14T22:55:14.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 2 2024-04-14T22:55:14.784155063Z [2024-04-14T22:55:14.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 2 2024-04-14T22:55:14.802254710Z [2024-04-14T22:55:14.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 982fef01-9c76-425d-898e-b5b36bea0fbb 2024-04-14T22:55:14.807261591Z [2024-04-14T22:55:14.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0afe895b-5943-4401-9744-b6581aae24f3 2024-04-14T22:55:14.807524113Z [2024-04-14T22:55:14.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7db44f0-906f-479e-8095-483498f6362a 2024-04-14T22:55:17.184335647Z [2024-04-14T22:55:17.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:50:00+00:00 exited with status failed for try_number 2 2024-04-14T22:55:17.184606519Z [2024-04-14T22:55:17.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status failed for try_number 2 2024-04-14T22:55:17.184825933Z [2024-04-14T22:55:17.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status failed for try_number 2 2024-04-14T22:55:17.190619431Z [2024-04-14T22:55:17.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-14 22:55:03.780053+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:14.285233+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:55:17.191230473Z [2024-04-14T22:55:17.191+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:17.208815659Z [2024-04-14T22:55:17.208+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:17.242024469Z [2024-04-14T22:55:17.240+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240414T225400, start_date=, end_date=20240414T225517 2024-04-14T22:55:17.250968309Z [2024-04-14T22:55:17.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-14 22:55:03.799935+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:14.285233+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:55:17.250993018Z [2024-04-14T22:55:17.249+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:17.253258808Z [2024-04-14T22:55:17.251+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:17.263034790Z [2024-04-14T22:55:17.260+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=extract_metrics_from_vnfrs, execution_date=20240414T225000, start_date=, end_date=20240414T225517 2024-04-14T22:55:17.267227904Z [2024-04-14T22:55:17.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-14 22:55:03.824221+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:55:14.285233+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:55:17.267240809Z [2024-04-14T22:55:17.266+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:17.269764970Z [2024-04-14T22:55:17.268+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:55:17.290986122Z [2024-04-14T22:55:17.286+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240414T225400, start_date=, end_date=20240414T225517 2024-04-14T22:55:18.350122590Z [2024-04-14T22:55:18.349+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-14T22:55:18.350290453Z [2024-04-14T22:55:18.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:54:00+00:00, run_id=scheduled__2024-04-14T22:54:00+00:00, run_start_date=2024-04-14 22:55:00.797858+00:00, run_end_date=2024-04-14 22:55:18.349970+00:00, run_duration=17.552112, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:54:00+00:00, data_interval_end=2024-04-14 22:55:00+00:00, dag_hash=53c96e42c82eac6317dc94fb4b71324e 2024-04-14T22:55:18.359725625Z [2024-04-14T22:55:18.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:18.364430086Z [2024-04-14T22:55:18.364+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-14T22:55:18.364596486Z [2024-04-14T22:55:18.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:54:00+00:00, run_id=scheduled__2024-04-14T22:54:00+00:00, run_start_date=2024-04-14 22:55:00.804370+00:00, run_end_date=2024-04-14 22:55:18.364356+00:00, run_duration=17.559986, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:54:00+00:00, data_interval_end=2024-04-14 22:55:00+00:00, dag_hash=afb09b92e405f964a4522196eb9acd39 2024-04-14T22:55:18.384147533Z [2024-04-14T22:55:18.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T22:56:00+00:00 2024-04-14T22:55:19.922976977Z [2024-04-14T22:55:19.922+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-14T22:55:19.923579241Z [2024-04-14T22:55:19.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, execution_date=2024-04-14 22:50:00+00:00, run_id=scheduled__2024-04-14T22:50:00+00:00, run_start_date=2024-04-14 22:55:00.790033+00:00, run_end_date=2024-04-14 22:55:19.923101+00:00, run_duration=19.133068, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:50:00+00:00, data_interval_end=2024-04-14 22:55:00+00:00, dag_hash=38162cbf5666d3654bc19301e8bd4327 2024-04-14T22:55:19.931809857Z [2024-04-14T22:55:19.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:55:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:55:59.773732881Z [2024-04-14T22:55:59.773+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T22:56:00.510843697Z [2024-04-14T22:56:00.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:56:00+00:00, run_after=2024-04-14T22:57:00+00:00 2024-04-14T22:56:00.516933975Z [2024-04-14T22:56:00.516+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:56:00.523231617Z [2024-04-14T22:56:00.522+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:56:00.528601712Z [2024-04-14T22:56:00.528+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:56:00.539086009Z [2024-04-14T22:56:00.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 to 2024-04-14T22:56:00+00:00, run_after=2024-04-14T22:57:00+00:00 2024-04-14T22:56:00.549019638Z [2024-04-14T22:56:00.548+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:56:00+00:00, run_after=2024-04-14T22:57:00+00:00 2024-04-14T22:56:00.689573761Z [2024-04-14T22:56:00.689+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-14T22:56:00.689615150Z 2024-04-14T22:56:00.689652704Z 2024-04-14T22:56:00.689662075Z 2024-04-14T22:56:00.689670588Z 2024-04-14T22:56:00.689679000Z 2024-04-14T22:56:00.689687550Z 2024-04-14T22:56:00.689727786Z [2024-04-14T22:56:00.689+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:56:00.689881056Z [2024-04-14T22:56:00.689+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:56:00.690082498Z [2024-04-14T22:56:00.689+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:56:00.690262122Z [2024-04-14T22:56:00.690+0000] {scheduler_job.py:425} INFO - DAG vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5 has 0/16 running and queued tasks 2024-04-14T22:56:00.690513292Z [2024-04-14T22:56:00.690+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:56:00.690639590Z [2024-04-14T22:56:00.690+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:56:00.691601567Z [2024-04-14T22:56:00.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:56:00.691620052Z 2024-04-14T22:56:00.691629796Z 2024-04-14T22:56:00.691638327Z 2024-04-14T22:56:00.691646928Z 2024-04-14T22:56:00.691655853Z 2024-04-14T22:56:00.691664882Z 2024-04-14T22:56:00.698171676Z [2024-04-14T22:56:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:56:00.698340674Z [2024-04-14T22:56:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:56:00.698667040Z [2024-04-14T22:56:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:56:00.698835326Z [2024-04-14T22:56:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:56:00.699267811Z [2024-04-14T22:56:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:56:00.699328558Z [2024-04-14T22:56:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:56:00.699686029Z [2024-04-14T22:56:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:56:00.700003929Z [2024-04-14T22:56:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:56:00.700321283Z [2024-04-14T22:56:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:56:00.700612253Z [2024-04-14T22:56:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:56:00.700983665Z [2024-04-14T22:56:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:56:00.701308103Z [2024-04-14T22:56:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:56:01.384795200Z [2024-04-14T22:56:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status queued for try_number 1 2024-04-14T22:56:01.386617908Z [2024-04-14T22:56:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T22:56:01.386743876Z [2024-04-14T22:56:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T22:56:01.386902664Z [2024-04-14T22:56:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T22:56:01.387088175Z [2024-04-14T22:56:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T22:56:01.387222394Z [2024-04-14T22:56:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T22:56:01.397967091Z [2024-04-14T22:56:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fdf1f48-1289-4b70-b273-e9d9dc41f571 2024-04-14T22:56:01.398170314Z [2024-04-14T22:56:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55b807d6-9cb3-4633-b76a-3ae38a1f509b 2024-04-14T22:56:01.398397643Z [2024-04-14T22:56:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f057703-9bef-41bf-a10e-a583c5a4245e 2024-04-14T22:56:01.398612870Z [2024-04-14T22:56:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f7335ef-0efc-411e-8312-d18d85d7807d 2024-04-14T22:56:01.398761894Z [2024-04-14T22:56:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 949f0224-056b-4261-9309-31e43d66b635 2024-04-14T22:56:01.398975625Z [2024-04-14T22:56:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6d88cd0-9c55-4dfb-af1c-c9423894263e 2024-04-14T22:56:02.704424658Z [2024-04-14T22:56:02.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:56:02.705034949Z [2024-04-14T22:56:02.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:54:00+00:00, run_id=scheduled__2024-04-14T22:54:00+00:00, run_start_date=2024-04-14 22:56:00.560053+00:00, run_end_date=2024-04-14 22:56:02.704352+00:00, run_duration=2.144299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:54:00+00:00, data_interval_end=2024-04-14 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:56:02.712856852Z [2024-04-14T22:56:02.712+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:56:00+00:00, run_after=2024-04-14T22:58:00+00:00 2024-04-14T22:56:02.720275001Z [2024-04-14T22:56:02.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:56:02.723253862Z [2024-04-14T22:56:02.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:55:00+00:00, run_id=scheduled__2024-04-14T22:55:00+00:00, run_start_date=2024-04-14 22:56:00.572221+00:00, run_end_date=2024-04-14 22:56:02.720192+00:00, run_duration=2.147971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:55:00+00:00, data_interval_end=2024-04-14 22:56:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:56:02.735573164Z [2024-04-14T22:56:02.735+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:56:00+00:00, run_after=2024-04-14T22:57:00+00:00 2024-04-14T22:56:02.810730122Z [2024-04-14T22:56:02.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:54:00+00:00 exited with status success for try_number 1 2024-04-14T22:56:02.813011825Z [2024-04-14T22:56:02.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status failed for try_number 1 2024-04-14T22:56:02.813218173Z [2024-04-14T22:56:02.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status success for try_number 1 2024-04-14T22:56:02.820800177Z [2024-04-14T22:56:02.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:54:00+00:00, map_index=-1, run_start_date=2024-04-14 22:56:01.636836+00:00, run_end_date=2024-04-14 22:56:02.142529+00:00, run_duration=0.505693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:56:00.693633+00:00, queued_by_job_id=1, pid=1820 2024-04-14T22:56:02.821965096Z [2024-04-14T22:56:02.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=2024-04-14 22:56:01.760944+00:00, run_end_date=2024-04-14 22:56:02.273859+00:00, run_duration=0.512915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:56:00.693633+00:00, queued_by_job_id=1, pid=1822 2024-04-14T22:56:02.822267445Z [2024-04-14T22:56:02.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:56:00.693633+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:56:02.822716754Z [2024-04-14T22:56:02.822+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:56:02.824500729Z [2024-04-14T22:56:02.824+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:56:02.837306857Z [2024-04-14T22:56:02.837+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240414T225500, start_date=, end_date=20240414T225602 2024-04-14T22:56:03.994714904Z [2024-04-14T22:56:03.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status failed for try_number 1 2024-04-14T22:56:04.002052895Z [2024-04-14T22:56:04.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:56:00.693633+00:00, queued_by_job_id=1, pid=None 2024-04-14T22:56:04.002549768Z [2024-04-14T22:56:04.002+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:56:04.007666592Z [2024-04-14T22:56:04.007+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-14T22:56:04.018250935Z [2024-04-14T22:56:04.018+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_6725432f-f277-4e73-ada1-2c7f32e430e5, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240414T225500, start_date=, end_date=20240414T225604 2024-04-14T22:56:05.069467276Z [2024-04-14T22:56:05.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:56:05.070204195Z [2024-04-14T22:56:05.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:55:00+00:00, run_id=scheduled__2024-04-14T22:55:00+00:00, run_start_date=2024-04-14 22:56:00.567347+00:00, run_end_date=2024-04-14 22:56:05.069625+00:00, run_duration=4.502278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:55:00+00:00, data_interval_end=2024-04-14 22:56:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:56:05.088185537Z [2024-04-14T22:56:05.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:56:00+00:00, run_after=2024-04-14T22:57:00+00:00 2024-04-14T22:56:05.096382355Z [2024-04-14T22:56:05.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:56:05.096659907Z [2024-04-14T22:56:05.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:55:00+00:00, run_id=scheduled__2024-04-14T22:55:00+00:00, run_start_date=2024-04-14 22:56:00.562538+00:00, run_end_date=2024-04-14 22:56:05.096292+00:00, run_duration=4.533754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:55:00+00:00, data_interval_end=2024-04-14 22:56:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:56:05.107134230Z [2024-04-14T22:56:05.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:56:00+00:00, run_after=2024-04-14T22:57:00+00:00 2024-04-14T22:56:05.157197088Z [2024-04-14T22:56:05.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status success for try_number 1 2024-04-14T22:56:05.164132736Z [2024-04-14T22:56:05.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=2024-04-14 22:56:02.796482+00:00, run_end_date=2024-04-14 22:56:03.928521+00:00, run_duration=1.132039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:56:00.693633+00:00, queued_by_job_id=1, pid=1861 2024-04-14T22:56:06.257402311Z [2024-04-14T22:56:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status success for try_number 1 2024-04-14T22:56:06.262604946Z [2024-04-14T22:56:06.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=2024-04-14 22:56:03.069332+00:00, run_end_date=2024-04-14 22:56:05.012736+00:00, run_duration=1.943404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:56:00.693633+00:00, queued_by_job_id=1, pid=1872 2024-04-14T22:57:00.416815456Z [2024-04-14T22:57:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:57:00+00:00, run_after=2024-04-14T22:58:00+00:00 2024-04-14T22:57:00.431819502Z [2024-04-14T22:57:00.431+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:57:00.458803677Z [2024-04-14T22:57:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:57:00+00:00, run_after=2024-04-14T22:58:00+00:00 2024-04-14T22:57:00.514240780Z [2024-04-14T22:57:00.513+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T22:57:00.514280650Z 2024-04-14T22:57:00.514284471Z 2024-04-14T22:57:00.514287894Z 2024-04-14T22:57:00.514297851Z [2024-04-14T22:57:00.514+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:57:00.514364771Z [2024-04-14T22:57:00.514+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:57:00.514441351Z [2024-04-14T22:57:00.514+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:57:00.514992512Z [2024-04-14T22:57:00.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:57:00.515005810Z 2024-04-14T22:57:00.515011677Z 2024-04-14T22:57:00.515027574Z 2024-04-14T22:57:00.517660488Z [2024-04-14T22:57:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:57:00.517761139Z [2024-04-14T22:57:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:57:00.517886605Z [2024-04-14T22:57:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:57:00.517965089Z [2024-04-14T22:57:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:57:00.518084781Z [2024-04-14T22:57:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:57:00.518143891Z [2024-04-14T22:57:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:57:00.875962344Z [2024-04-14T22:57:00.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status queued for try_number 1 2024-04-14T22:57:00.876262950Z [2024-04-14T22:57:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status queued for try_number 1 2024-04-14T22:57:00.876441728Z [2024-04-14T22:57:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status queued for try_number 1 2024-04-14T22:57:00.895023827Z [2024-04-14T22:57:00.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23d50d34-3353-4088-b5c7-8458ea517cdb 2024-04-14T22:57:00.895316007Z [2024-04-14T22:57:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42469ab3-4680-4509-96d1-98599478b73e 2024-04-14T22:57:00.895518345Z [2024-04-14T22:57:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5f02192-d407-4392-80ad-9dfbced49464 2024-04-14T22:57:02.131663404Z [2024-04-14T22:57:02.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:57:02.131958959Z [2024-04-14T22:57:02.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:56:00+00:00, run_id=scheduled__2024-04-14T22:56:00+00:00, run_start_date=2024-04-14 22:57:00.470869+00:00, run_end_date=2024-04-14 22:57:02.131569+00:00, run_duration=1.6607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:56:00+00:00, data_interval_end=2024-04-14 22:57:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:57:02.144469160Z [2024-04-14T22:57:02.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:57:00+00:00, run_after=2024-04-14T22:58:00+00:00 2024-04-14T22:57:02.176360504Z [2024-04-14T22:57:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status success for try_number 1 2024-04-14T22:57:02.182074402Z [2024-04-14T22:57:02.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:56:00+00:00, map_index=-1, run_start_date=2024-04-14 22:57:01.285750+00:00, run_end_date=2024-04-14 22:57:01.638325+00:00, run_duration=0.352575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:57:00.515534+00:00, queued_by_job_id=1, pid=1899 2024-04-14T22:57:03.966185429Z [2024-04-14T22:57:03.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:57:03.966621796Z [2024-04-14T22:57:03.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:56:00+00:00, run_id=scheduled__2024-04-14T22:56:00+00:00, run_start_date=2024-04-14 22:57:00.469988+00:00, run_end_date=2024-04-14 22:57:03.966050+00:00, run_duration=3.496062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:56:00+00:00, data_interval_end=2024-04-14 22:57:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:57:03.980539702Z [2024-04-14T22:57:03.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:57:00+00:00, run_after=2024-04-14T22:58:00+00:00 2024-04-14T22:57:03.988382066Z [2024-04-14T22:57:03.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:57:03.988855115Z [2024-04-14T22:57:03.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:56:00+00:00, run_id=scheduled__2024-04-14T22:56:00+00:00, run_start_date=2024-04-14 22:57:00.468729+00:00, run_end_date=2024-04-14 22:57:03.988475+00:00, run_duration=3.519746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:56:00+00:00, data_interval_end=2024-04-14 22:57:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:57:04.000894011Z [2024-04-14T22:57:04.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:57:00+00:00, run_after=2024-04-14T22:58:00+00:00 2024-04-14T22:57:04.041127389Z [2024-04-14T22:57:04.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status success for try_number 1 2024-04-14T22:57:04.041916546Z [2024-04-14T22:57:04.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status success for try_number 1 2024-04-14T22:57:04.058028735Z [2024-04-14T22:57:04.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:56:00+00:00, map_index=-1, run_start_date=2024-04-14 22:57:02.167047+00:00, run_end_date=2024-04-14 22:57:03.794102+00:00, run_duration=1.627055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:57:00.515534+00:00, queued_by_job_id=1, pid=1918 2024-04-14T22:57:04.058465891Z [2024-04-14T22:57:04.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:56:00+00:00, map_index=-1, run_start_date=2024-04-14 22:57:02.071140+00:00, run_end_date=2024-04-14 22:57:03.301029+00:00, run_duration=1.229889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:57:00.515534+00:00, queued_by_job_id=1, pid=1917 2024-04-14T22:58:00.383813690Z [2024-04-14T22:58:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:58:00+00:00, run_after=2024-04-14T22:59:00+00:00 2024-04-14T22:58:00.399294481Z [2024-04-14T22:58:00.398+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:58:00+00:00, run_after=2024-04-14T22:59:00+00:00 2024-04-14T22:58:00.406566107Z [2024-04-14T22:58:00.406+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:58:00.412313090Z [2024-04-14T22:58:00.412+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:58:00.484634421Z [2024-04-14T22:58:00.484+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T22:58:00.484674918Z 2024-04-14T22:58:00.484679524Z 2024-04-14T22:58:00.484682574Z 2024-04-14T22:58:00.484685545Z 2024-04-14T22:58:00.484785500Z [2024-04-14T22:58:00.484+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T22:58:00.485022083Z [2024-04-14T22:58:00.484+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:58:00.485232702Z [2024-04-14T22:58:00.485+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:58:00.485429672Z [2024-04-14T22:58:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:58:00.486103596Z [2024-04-14T22:58:00.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:58:00.486112921Z 2024-04-14T22:58:00.486118059Z 2024-04-14T22:58:00.486122267Z 2024-04-14T22:58:00.486126459Z 2024-04-14T22:58:00.490043599Z [2024-04-14T22:58:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:58:00.490254356Z [2024-04-14T22:58:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T22:58:00.490600115Z [2024-04-14T22:58:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:58:00.490837281Z [2024-04-14T22:58:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:58:00.491153227Z [2024-04-14T22:58:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:58:00.491359432Z [2024-04-14T22:58:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:58:00.491772689Z [2024-04-14T22:58:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:58:00.491987240Z [2024-04-14T22:58:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:58:01.057894008Z [2024-04-14T22:58:01.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status queued for try_number 1 2024-04-14T22:58:01.058072072Z [2024-04-14T22:58:01.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:57:00+00:00 exited with status queued for try_number 1 2024-04-14T22:58:01.058316573Z [2024-04-14T22:58:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:57:00+00:00 exited with status queued for try_number 1 2024-04-14T22:58:01.058465093Z [2024-04-14T22:58:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:57:00+00:00 exited with status queued for try_number 1 2024-04-14T22:58:01.069964647Z [2024-04-14T22:58:01.069+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4486064-8c65-49d8-acf4-be6b0048e313 2024-04-14T22:58:01.070130247Z [2024-04-14T22:58:01.069+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2264c3ce-2707-46a1-934a-c227ed5be772 2024-04-14T22:58:01.070442146Z [2024-04-14T22:58:01.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to e544f1bb-db39-4a34-92b7-ef3e0375b88f 2024-04-14T22:58:01.070645876Z [2024-04-14T22:58:01.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a528a31-dc68-4102-bab4-44098b9e7749 2024-04-14T22:58:02.331834820Z [2024-04-14T22:58:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:58:02.332121355Z [2024-04-14T22:58:02.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:56:00+00:00, run_id=scheduled__2024-04-14T22:56:00+00:00, run_start_date=2024-04-14 22:58:00.421001+00:00, run_end_date=2024-04-14 22:58:02.331822+00:00, run_duration=1.910821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:56:00+00:00, data_interval_end=2024-04-14 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T22:58:02.338844156Z [2024-04-14T22:58:02.338+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T22:58:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:58:02.344817342Z [2024-04-14T22:58:02.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:58:02.345066845Z [2024-04-14T22:58:02.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:57:00+00:00, run_id=scheduled__2024-04-14T22:57:00+00:00, run_start_date=2024-04-14 22:58:00.423892+00:00, run_end_date=2024-04-14 22:58:02.344828+00:00, run_duration=1.920936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:57:00+00:00, data_interval_end=2024-04-14 22:58:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:58:02.354038476Z [2024-04-14T22:58:02.353+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:58:00+00:00, run_after=2024-04-14T22:59:00+00:00 2024-04-14T22:58:02.392530735Z [2024-04-14T22:58:02.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:56:00+00:00 exited with status success for try_number 1 2024-04-14T22:58:02.392615584Z [2024-04-14T22:58:02.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:57:00+00:00 exited with status success for try_number 1 2024-04-14T22:58:02.398033025Z [2024-04-14T22:58:02.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:56:00+00:00, map_index=-1, run_start_date=2024-04-14 22:58:01.235941+00:00, run_end_date=2024-04-14 22:58:01.612103+00:00, run_duration=0.376162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:58:00.487134+00:00, queued_by_job_id=1, pid=1951 2024-04-14T22:58:02.398228734Z [2024-04-14T22:58:02.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:57:00+00:00, map_index=-1, run_start_date=2024-04-14 22:58:01.262266+00:00, run_end_date=2024-04-14 22:58:01.587865+00:00, run_duration=0.325599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:58:00.487134+00:00, queued_by_job_id=1, pid=1952 2024-04-14T22:58:04.401384490Z [2024-04-14T22:58:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:58:04.401799647Z [2024-04-14T22:58:04.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:57:00+00:00, run_id=scheduled__2024-04-14T22:57:00+00:00, run_start_date=2024-04-14 22:58:00.424854+00:00, run_end_date=2024-04-14 22:58:04.401210+00:00, run_duration=3.976356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:57:00+00:00, data_interval_end=2024-04-14 22:58:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:58:04.411477817Z [2024-04-14T22:58:04.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:58:00+00:00, run_after=2024-04-14T22:59:00+00:00 2024-04-14T22:58:04.420875353Z [2024-04-14T22:58:04.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:58:04.421389377Z [2024-04-14T22:58:04.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:57:00+00:00, run_id=scheduled__2024-04-14T22:57:00+00:00, run_start_date=2024-04-14 22:58:00.422076+00:00, run_end_date=2024-04-14 22:58:04.420749+00:00, run_duration=3.998673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:57:00+00:00, data_interval_end=2024-04-14 22:58:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:58:04.436612574Z [2024-04-14T22:58:04.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:58:00+00:00, run_after=2024-04-14T22:59:00+00:00 2024-04-14T22:58:04.486967626Z [2024-04-14T22:58:04.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:57:00+00:00 exited with status success for try_number 1 2024-04-14T22:58:04.487479219Z [2024-04-14T22:58:04.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:57:00+00:00 exited with status success for try_number 1 2024-04-14T22:58:04.503760068Z [2024-04-14T22:58:04.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:57:00+00:00, map_index=-1, run_start_date=2024-04-14 22:58:02.384461+00:00, run_end_date=2024-04-14 22:58:03.988478+00:00, run_duration=1.604017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:58:00.487134+00:00, queued_by_job_id=1, pid=1976 2024-04-14T22:58:04.504450822Z [2024-04-14T22:58:04.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:57:00+00:00, map_index=-1, run_start_date=2024-04-14 22:58:02.311923+00:00, run_end_date=2024-04-14 22:58:03.575936+00:00, run_duration=1.264013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:58:00.487134+00:00, queued_by_job_id=1, pid=1975 2024-04-14T22:59:00.121379802Z [2024-04-14T22:59:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:59:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:59:00.146627958Z [2024-04-14T22:59:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:59:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:59:00.155266648Z [2024-04-14T22:59:00.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T22:59:00.232510970Z [2024-04-14T22:59:00.232+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T22:59:00.232536444Z 2024-04-14T22:59:00.232556431Z 2024-04-14T22:59:00.232560376Z 2024-04-14T22:59:00.232735515Z [2024-04-14T22:59:00.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:59:00.232992486Z [2024-04-14T22:59:00.232+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T22:59:00.233224034Z [2024-04-14T22:59:00.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T22:59:00.233845455Z [2024-04-14T22:59:00.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T22:59:00.233851240Z 2024-04-14T22:59:00.233859338Z 2024-04-14T22:59:00.233862674Z 2024-04-14T22:59:00.237970296Z [2024-04-14T22:59:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:59:00.238149902Z [2024-04-14T22:59:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T22:59:00.238508119Z [2024-04-14T22:59:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:59:00.238737336Z [2024-04-14T22:59:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T22:59:00.239129258Z [2024-04-14T22:59:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T22:59:00.239348214Z [2024-04-14T22:59:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T22:59:00.500526632Z [2024-04-14T22:59:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status queued for try_number 1 2024-04-14T22:59:00.500569178Z [2024-04-14T22:59:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status queued for try_number 1 2024-04-14T22:59:00.500611014Z [2024-04-14T22:59:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status queued for try_number 1 2024-04-14T22:59:00.516401064Z [2024-04-14T22:59:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33cc2de0-33b1-4047-a539-82b753d16b9e 2024-04-14T22:59:00.516486130Z [2024-04-14T22:59:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to e66b2837-282c-457d-b5b3-9b1d2866f00b 2024-04-14T22:59:00.516592187Z [2024-04-14T22:59:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80d2b446-0054-4c57-bad7-8fc465bf7d0c 2024-04-14T22:59:01.625995860Z [2024-04-14T22:59:01.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:59:01.626178647Z [2024-04-14T22:59:01.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:58:00+00:00, run_id=scheduled__2024-04-14T22:58:00+00:00, run_start_date=2024-04-14 22:59:00.165882+00:00, run_end_date=2024-04-14 22:59:01.625836+00:00, run_duration=1.459954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:58:00+00:00, data_interval_end=2024-04-14 22:59:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T22:59:01.635978256Z [2024-04-14T22:59:01.635+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T22:59:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:59:01.673192889Z [2024-04-14T22:59:01.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status success for try_number 1 2024-04-14T22:59:01.677352124Z [2024-04-14T22:59:01.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:58:00+00:00, map_index=-1, run_start_date=2024-04-14 22:59:00.972274+00:00, run_end_date=2024-04-14 22:59:01.294076+00:00, run_duration=0.321802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:59:00.234831+00:00, queued_by_job_id=1, pid=2007 2024-04-14T22:59:04.125296102Z [2024-04-14T22:59:04.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:59:04.125660709Z [2024-04-14T22:59:04.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:58:00+00:00, run_id=scheduled__2024-04-14T22:58:00+00:00, run_start_date=2024-04-14 22:59:00.166994+00:00, run_end_date=2024-04-14 22:59:04.125131+00:00, run_duration=3.958137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:58:00+00:00, data_interval_end=2024-04-14 22:59:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T22:59:04.134695540Z [2024-04-14T22:59:04.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:59:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:59:04.147860477Z [2024-04-14T22:59:04.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T22:59:04.148200471Z [2024-04-14T22:59:04.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:58:00+00:00, run_id=scheduled__2024-04-14T22:58:00+00:00, run_start_date=2024-04-14 22:59:00.167890+00:00, run_end_date=2024-04-14 22:59:04.147822+00:00, run_duration=3.979932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:58:00+00:00, data_interval_end=2024-04-14 22:59:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T22:59:04.166428466Z [2024-04-14T22:59:04.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T22:59:00+00:00, run_after=2024-04-14T23:00:00+00:00 2024-04-14T22:59:04.208004608Z [2024-04-14T22:59:04.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status success for try_number 1 2024-04-14T22:59:04.208290022Z [2024-04-14T22:59:04.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status success for try_number 1 2024-04-14T22:59:04.223009195Z [2024-04-14T22:59:04.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:58:00+00:00, map_index=-1, run_start_date=2024-04-14 22:59:01.929137+00:00, run_end_date=2024-04-14 22:59:03.197870+00:00, run_duration=1.268733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:59:00.234831+00:00, queued_by_job_id=1, pid=2026 2024-04-14T22:59:04.224536935Z [2024-04-14T22:59:04.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:58:00+00:00, map_index=-1, run_start_date=2024-04-14 22:59:01.831509+00:00, run_end_date=2024-04-14 22:59:03.337777+00:00, run_duration=1.506268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 22:59:00.234831+00:00, queued_by_job_id=1, pid=2025 2024-04-14T23:00:00.067161242Z [2024-04-14T23:00:00.066+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:00:00.086134995Z [2024-04-14T23:00:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:00:00.105786514Z [2024-04-14T23:00:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:01:00+00:00 2024-04-14T23:00:00.117113230Z [2024-04-14T23:00:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:01:00+00:00 2024-04-14T23:00:00.125868518Z [2024-04-14T23:00:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:05:00+00:00 2024-04-14T23:00:00.193766800Z [2024-04-14T23:00:00.193+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T23:00:00.193799763Z 2024-04-14T23:00:00.193807893Z 2024-04-14T23:00:00.193816109Z 2024-04-14T23:00:00.193823058Z 2024-04-14T23:00:00.193829608Z 2024-04-14T23:00:00.194078449Z [2024-04-14T23:00:00.193+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:00:00.194442755Z [2024-04-14T23:00:00.194+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:00:00.194950134Z [2024-04-14T23:00:00.194+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:00:00.195371060Z [2024-04-14T23:00:00.195+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:00:00.195579623Z [2024-04-14T23:00:00.195+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:00:00.196958495Z [2024-04-14T23:00:00.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:00:00.196977785Z 2024-04-14T23:00:00.196987897Z 2024-04-14T23:00:00.196997280Z 2024-04-14T23:00:00.197005785Z 2024-04-14T23:00:00.197014266Z 2024-04-14T23:00:00.204357389Z [2024-04-14T23:00:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:00:00.204515243Z [2024-04-14T23:00:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:00:00.205005543Z [2024-04-14T23:00:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:00:00.205166291Z [2024-04-14T23:00:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:00:00.205486720Z [2024-04-14T23:00:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:00:00.205641480Z [2024-04-14T23:00:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:00:00.205985819Z [2024-04-14T23:00:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:00:00.206145203Z [2024-04-14T23:00:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:00:00.206466181Z [2024-04-14T23:00:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:00:00.206590626Z [2024-04-14T23:00:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:00:00.706496937Z [2024-04-14T23:00:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:00.706752057Z [2024-04-14T23:00:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:00.706918702Z [2024-04-14T23:00:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:59:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:00.707093328Z [2024-04-14T23:00:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:59:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:00.707223193Z [2024-04-14T23:00:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:59:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:00.717346477Z [2024-04-14T23:00:00.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45970446-fc39-4c29-88f0-5a463ae83f14 2024-04-14T23:00:00.719671826Z [2024-04-14T23:00:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb72a271-42ab-4aa3-a7f2-a19781d61a68 2024-04-14T23:00:00.719890941Z [2024-04-14T23:00:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b510552-bd28-41b1-8998-fc992b1202c9 2024-04-14T23:00:00.720142457Z [2024-04-14T23:00:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 033c44d0-fc71-42a9-b82e-7437ba80666a 2024-04-14T23:00:00.720378697Z [2024-04-14T23:00:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to b486e683-19a2-4879-b113-1d55525c6213 2024-04-14T23:00:01.932266151Z [2024-04-14T23:00:01.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:00:01.932694259Z [2024-04-14T23:00:01.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 22:58:00+00:00, run_id=scheduled__2024-04-14T22:58:00+00:00, run_start_date=2024-04-14 23:00:00.135273+00:00, run_end_date=2024-04-14 23:00:01.932344+00:00, run_duration=1.797071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:58:00+00:00, data_interval_end=2024-04-14 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:00:01.948229667Z [2024-04-14T23:00:01.947+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:02:00+00:00 2024-04-14T23:00:01.963971769Z [2024-04-14T23:00:01.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:00:01.964227434Z [2024-04-14T23:00:01.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 22:59:00+00:00, run_id=scheduled__2024-04-14T22:59:00+00:00, run_start_date=2024-04-14 23:00:00.136163+00:00, run_end_date=2024-04-14 23:00:01.963886+00:00, run_duration=1.827723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:59:00+00:00, data_interval_end=2024-04-14 23:00:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:00:01.973322046Z [2024-04-14T23:00:01.973+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:01:00+00:00 2024-04-14T23:00:02.005306589Z [2024-04-14T23:00:02.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T22:58:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:02.019976236Z [2024-04-14T23:00:02.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T22:58:00+00:00, map_index=-1, run_start_date=2024-04-14 23:00:01.081765+00:00, run_end_date=2024-04-14 23:00:01.510792+00:00, run_duration=0.429027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:00.199313+00:00, queued_by_job_id=1, pid=2055 2024-04-14T23:00:03.128421033Z [2024-04-14T23:00:03.127+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:00:03.128469883Z 2024-04-14T23:00:03.128474945Z [2024-04-14T23:00:03.127+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:00:03.128478955Z [2024-04-14T23:00:03.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:00:03.128482417Z 2024-04-14T23:00:03.131919589Z [2024-04-14T23:00:03.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:00:03.132102366Z [2024-04-14T23:00:03.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:00:03.202552521Z [2024-04-14T23:00:03.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:03.203041242Z [2024-04-14T23:00:03.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:03.203373278Z [2024-04-14T23:00:03.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:59:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:03.215873289Z [2024-04-14T23:00:03.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:59:00+00:00, map_index=-1, run_start_date=2024-04-14 23:00:01.471125+00:00, run_end_date=2024-04-14 23:00:01.911153+00:00, run_duration=0.440028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:00.199313+00:00, queued_by_job_id=1, pid=2068 2024-04-14T23:00:03.216260242Z [2024-04-14T23:00:03.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to 120e0f76-938c-4ea4-9d53-e9f81e32abec 2024-04-14T23:00:03.216655733Z [2024-04-14T23:00:03.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=2024-04-14 23:00:02.265727+00:00, run_end_date=2024-04-14 23:00:02.590037+00:00, run_duration=0.32431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:00.199313+00:00, queued_by_job_id=1, pid=2091 2024-04-14T23:00:04.375630630Z [2024-04-14T23:00:04.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:00:04.375654915Z [2024-04-14T23:00:04.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:59:00+00:00, run_id=scheduled__2024-04-14T22:59:00+00:00, run_start_date=2024-04-14 23:00:00.138122+00:00, run_end_date=2024-04-14 23:00:04.374057+00:00, run_duration=4.235935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:59:00+00:00, data_interval_end=2024-04-14 23:00:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:00:04.393916383Z [2024-04-14T23:00:04.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:01:00+00:00 2024-04-14T23:00:04.408933591Z [2024-04-14T23:00:04.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:00:04.409630573Z [2024-04-14T23:00:04.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:59:00+00:00, run_id=scheduled__2024-04-14T22:59:00+00:00, run_start_date=2024-04-14 23:00:00.137252+00:00, run_end_date=2024-04-14 23:00:04.409153+00:00, run_duration=4.271901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:59:00+00:00, data_interval_end=2024-04-14 23:00:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:00:04.424785912Z [2024-04-14T23:00:04.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:01:00+00:00 2024-04-14T23:00:04.505528953Z [2024-04-14T23:00:04.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:59:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:04.505611454Z [2024-04-14T23:00:04.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T22:59:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:04.514953693Z [2024-04-14T23:00:04.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:59:00+00:00, map_index=-1, run_start_date=2024-04-14 23:00:02.365093+00:00, run_end_date=2024-04-14 23:00:03.966099+00:00, run_duration=1.601006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:00.199313+00:00, queued_by_job_id=1, pid=2092 2024-04-14T23:00:04.515496949Z [2024-04-14T23:00:04.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T22:59:00+00:00, map_index=-1, run_start_date=2024-04-14 23:00:02.230008+00:00, run_end_date=2024-04-14 23:00:03.507021+00:00, run_duration=1.277013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:00.199313+00:00, queued_by_job_id=1, pid=2090 2024-04-14T23:00:05.572925051Z [2024-04-14T23:00:05.572+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:00:05.572948718Z 2024-04-14T23:00:05.573150632Z [2024-04-14T23:00:05.572+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:00:05.574394270Z [2024-04-14T23:00:05.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:00:05.574403248Z 2024-04-14T23:00:05.578757439Z [2024-04-14T23:00:05.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:00:05.579112316Z [2024-04-14T23:00:05.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:00:05.652091597Z [2024-04-14T23:00:05.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:05.652597658Z [2024-04-14T23:00:05.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:05.659839583Z [2024-04-14T23:00:05.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb70dbd0-4e84-471c-ae8c-b410b50aa70c 2024-04-14T23:00:05.660150297Z [2024-04-14T23:00:05.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=2024-04-14 23:00:04.671618+00:00, run_end_date=2024-04-14 23:00:05.035094+00:00, run_duration=0.363476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:03.128673+00:00, queued_by_job_id=1, pid=2115 2024-04-14T23:00:07.948822924Z [2024-04-14T23:00:07.948+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:00:07.948871061Z 2024-04-14T23:00:07.949013804Z [2024-04-14T23:00:07.948+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:00:07.949868393Z [2024-04-14T23:00:07.949+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:00:07.949890805Z 2024-04-14T23:00:07.953775394Z [2024-04-14T23:00:07.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:00:07.953992437Z [2024-04-14T23:00:07.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:00:08.043497146Z [2024-04-14T23:00:08.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status queued for try_number 1 2024-04-14T23:00:08.043799968Z [2024-04-14T23:00:08.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:08.056890652Z [2024-04-14T23:00:08.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6d56541-3a68-4f98-b412-21b8fd0cbeac 2024-04-14T23:00:08.057400808Z [2024-04-14T23:00:08.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=0, run_start_date=2024-04-14 23:00:07.077785+00:00, run_end_date=2024-04-14 23:00:07.489201+00:00, run_duration=0.411416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:05.575222+00:00, queued_by_job_id=1, pid=2123 2024-04-14T23:00:10.291099626Z [2024-04-14T23:00:10.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:00:10.291468988Z [2024-04-14T23:00:10.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 22:55:00+00:00, run_id=scheduled__2024-04-14T22:55:00+00:00, run_start_date=2024-04-14 23:00:00.134351+00:00, run_end_date=2024-04-14 23:00:10.290926+00:00, run_duration=10.156575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 22:55:00+00:00, data_interval_end=2024-04-14 23:00:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:00:10.297706350Z [2024-04-14T23:00:10.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:00:00+00:00, run_after=2024-04-14T23:05:00+00:00 2024-04-14T23:00:10.349620937Z [2024-04-14T23:00:10.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T22:55:00+00:00 exited with status success for try_number 1 2024-04-14T23:00:10.357695239Z [2024-04-14T23:00:10.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T22:55:00+00:00, map_index=-1, run_start_date=2024-04-14 23:00:09.463089+00:00, run_end_date=2024-04-14 23:00:09.870850+00:00, run_duration=0.407761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:00:07.950276+00:00, queued_by_job_id=1, pid=2131 2024-04-14T23:00:59.868528376Z [2024-04-14T23:00:59.867+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:01:00.944795098Z [2024-04-14T23:01:00.944+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:01:00+00:00, run_after=2024-04-14T23:02:00+00:00 2024-04-14T23:01:00.959351085Z [2024-04-14T23:01:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:01:00+00:00, run_after=2024-04-14T23:02:00+00:00 2024-04-14T23:01:00.966310855Z [2024-04-14T23:01:00.966+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:01:01.051422646Z [2024-04-14T23:01:01.050+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:01:01.051460860Z 2024-04-14T23:01:01.051468845Z 2024-04-14T23:01:01.051475708Z 2024-04-14T23:01:01.051772805Z [2024-04-14T23:01:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:01:01.052064345Z [2024-04-14T23:01:01.051+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:01:01.052354755Z [2024-04-14T23:01:01.052+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:01:01.053373030Z [2024-04-14T23:01:01.053+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:01:01.053382752Z 2024-04-14T23:01:01.053386446Z 2024-04-14T23:01:01.053389648Z 2024-04-14T23:01:01.057511595Z [2024-04-14T23:01:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:01:01.057828959Z [2024-04-14T23:01:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:01:01.058254707Z [2024-04-14T23:01:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:01:01.058540021Z [2024-04-14T23:01:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:01:01.059017253Z [2024-04-14T23:01:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:01:01.059310151Z [2024-04-14T23:01:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:01:01.281870713Z [2024-04-14T23:01:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:01:01.281908226Z [2024-04-14T23:01:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:01:01.282079950Z [2024-04-14T23:01:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:01:01.293917987Z [2024-04-14T23:01:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78e9d294-8535-460d-b734-d868f053e2a0 2024-04-14T23:01:01.293972032Z [2024-04-14T23:01:01.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 782d360b-1b1b-4053-ae78-1d8c11c6b7bf 2024-04-14T23:01:01.294162025Z [2024-04-14T23:01:01.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8a646f8-1391-49b9-9756-e6cc826181eb 2024-04-14T23:01:03.285676323Z [2024-04-14T23:01:03.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:01:03.286023783Z [2024-04-14T23:01:03.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:00:00+00:00, run_id=scheduled__2024-04-14T23:00:00+00:00, run_start_date=2024-04-14 23:01:00.977150+00:00, run_end_date=2024-04-14 23:01:03.285678+00:00, run_duration=2.308528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:00:00+00:00, data_interval_end=2024-04-14 23:01:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:01:03.295549410Z [2024-04-14T23:01:03.294+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:01:00+00:00, run_after=2024-04-14T23:02:00+00:00 2024-04-14T23:01:03.332835314Z [2024-04-14T23:01:03.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:01:03.339027911Z [2024-04-14T23:01:03.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=-1, run_start_date=2024-04-14 23:01:01.938513+00:00, run_end_date=2024-04-14 23:01:02.402694+00:00, run_duration=0.464181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:01:01.054479+00:00, queued_by_job_id=1, pid=2153 2024-04-14T23:01:05.521884352Z [2024-04-14T23:01:05.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:01:05.521936462Z [2024-04-14T23:01:05.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:00:00+00:00, run_id=scheduled__2024-04-14T23:00:00+00:00, run_start_date=2024-04-14 23:01:00.978312+00:00, run_end_date=2024-04-14 23:01:05.521474+00:00, run_duration=4.543162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:00:00+00:00, data_interval_end=2024-04-14 23:01:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:01:05.532864055Z [2024-04-14T23:01:05.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:01:00+00:00, run_after=2024-04-14T23:02:00+00:00 2024-04-14T23:01:05.542266751Z [2024-04-14T23:01:05.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:01:05.542306657Z [2024-04-14T23:01:05.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:00:00+00:00, run_id=scheduled__2024-04-14T23:00:00+00:00, run_start_date=2024-04-14 23:01:00.979527+00:00, run_end_date=2024-04-14 23:01:05.541887+00:00, run_duration=4.56236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:00:00+00:00, data_interval_end=2024-04-14 23:01:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:01:05.551172247Z [2024-04-14T23:01:05.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:01:00+00:00, run_after=2024-04-14T23:02:00+00:00 2024-04-14T23:01:05.589705315Z [2024-04-14T23:01:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:01:05.589745566Z [2024-04-14T23:01:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:01:05.600252726Z [2024-04-14T23:01:05.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=-1, run_start_date=2024-04-14 23:01:02.959916+00:00, run_end_date=2024-04-14 23:01:04.570195+00:00, run_duration=1.610279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:01:01.054479+00:00, queued_by_job_id=1, pid=2171 2024-04-14T23:01:05.600806962Z [2024-04-14T23:01:05.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=-1, run_start_date=2024-04-14 23:01:02.967942+00:00, run_end_date=2024-04-14 23:01:05.148093+00:00, run_duration=2.180151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:01:01.054479+00:00, queued_by_job_id=1, pid=2172 2024-04-14T23:02:00.428964025Z [2024-04-14T23:02:00.428+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:02:00+00:00, run_after=2024-04-14T23:03:00+00:00 2024-04-14T23:02:00.439744941Z [2024-04-14T23:02:00.439+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:02:00.446567169Z [2024-04-14T23:02:00.446+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:02:00.459786134Z [2024-04-14T23:02:00.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:02:00+00:00, run_after=2024-04-14T23:03:00+00:00 2024-04-14T23:02:00.546372243Z [2024-04-14T23:02:00.546+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:02:00.546393665Z 2024-04-14T23:02:00.546397589Z 2024-04-14T23:02:00.546400711Z 2024-04-14T23:02:00.546403701Z 2024-04-14T23:02:00.546465344Z [2024-04-14T23:02:00.546+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:02:00.546501423Z [2024-04-14T23:02:00.546+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:02:00.546573694Z [2024-04-14T23:02:00.546+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:02:00.546652460Z [2024-04-14T23:02:00.546+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:02:00.547300708Z [2024-04-14T23:02:00.547+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:02:00.547311866Z 2024-04-14T23:02:00.547326834Z 2024-04-14T23:02:00.547329787Z 2024-04-14T23:02:00.547332555Z 2024-04-14T23:02:00.550767487Z [2024-04-14T23:02:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:02:00.550955977Z [2024-04-14T23:02:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:02:00.551129525Z [2024-04-14T23:02:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:02:00.551213497Z [2024-04-14T23:02:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:02:00.551397067Z [2024-04-14T23:02:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:02:00.551474761Z [2024-04-14T23:02:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:02:00.551651928Z [2024-04-14T23:02:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:02:00.551724094Z [2024-04-14T23:02:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:02:00.929593780Z [2024-04-14T23:02:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:02:00.929675976Z [2024-04-14T23:02:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:01:00+00:00 exited with status queued for try_number 1 2024-04-14T23:02:00.929680717Z [2024-04-14T23:02:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:01:00+00:00 exited with status queued for try_number 1 2024-04-14T23:02:00.929739470Z [2024-04-14T23:02:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:01:00+00:00 exited with status queued for try_number 1 2024-04-14T23:02:00.947930695Z [2024-04-14T23:02:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bd007b6-be44-4ae4-ad0d-7343bbd7e8e3 2024-04-14T23:02:00.948010426Z [2024-04-14T23:02:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to e278bbb4-3212-477e-9291-fd05bd9708b9 2024-04-14T23:02:00.948059166Z [2024-04-14T23:02:00.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17336d93-3036-4162-9691-6cea71319254 2024-04-14T23:02:00.948148142Z [2024-04-14T23:02:00.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d6ff4e4-2119-45e9-8a80-c29a4b10aa63 2024-04-14T23:02:02.228905831Z [2024-04-14T23:02:02.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:02:02.229506991Z [2024-04-14T23:02:02.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:00:00+00:00, run_id=scheduled__2024-04-14T23:00:00+00:00, run_start_date=2024-04-14 23:02:00.478867+00:00, run_end_date=2024-04-14 23:02:02.229053+00:00, run_duration=1.750186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:00:00+00:00, data_interval_end=2024-04-14 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:02:02.242058872Z [2024-04-14T23:02:02.241+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:02:00+00:00, run_after=2024-04-14T23:04:00+00:00 2024-04-14T23:02:02.247047160Z [2024-04-14T23:02:02.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:02:02.251705952Z [2024-04-14T23:02:02.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:01:00+00:00, run_id=scheduled__2024-04-14T23:01:00+00:00, run_start_date=2024-04-14 23:02:00.480141+00:00, run_end_date=2024-04-14 23:02:02.247126+00:00, run_duration=1.766985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:01:00+00:00, data_interval_end=2024-04-14 23:02:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:02:02.265963806Z [2024-04-14T23:02:02.264+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:02:00+00:00, run_after=2024-04-14T23:03:00+00:00 2024-04-14T23:02:02.313941944Z [2024-04-14T23:02:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:02:02.314047919Z [2024-04-14T23:02:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:01:00+00:00 exited with status success for try_number 1 2024-04-14T23:02:02.318618447Z [2024-04-14T23:02:02.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:01:00+00:00, map_index=-1, run_start_date=2024-04-14 23:02:01.535740+00:00, run_end_date=2024-04-14 23:02:01.908445+00:00, run_duration=0.372705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:02:00.548092+00:00, queued_by_job_id=1, pid=2211 2024-04-14T23:02:02.318779579Z [2024-04-14T23:02:02.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=-1, run_start_date=2024-04-14 23:02:01.220690+00:00, run_end_date=2024-04-14 23:02:01.507556+00:00, run_duration=0.286866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:02:00.548092+00:00, queued_by_job_id=1, pid=2200 2024-04-14T23:02:04.477117812Z [2024-04-14T23:02:04.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:02:04.477579944Z [2024-04-14T23:02:04.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:01:00+00:00, run_id=scheduled__2024-04-14T23:01:00+00:00, run_start_date=2024-04-14 23:02:00.481234+00:00, run_end_date=2024-04-14 23:02:04.477255+00:00, run_duration=3.996021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:01:00+00:00, data_interval_end=2024-04-14 23:02:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:02:04.486133704Z [2024-04-14T23:02:04.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:02:00+00:00, run_after=2024-04-14T23:03:00+00:00 2024-04-14T23:02:04.493425528Z [2024-04-14T23:02:04.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:02:04.493909175Z [2024-04-14T23:02:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:01:00+00:00, run_id=scheduled__2024-04-14T23:01:00+00:00, run_start_date=2024-04-14 23:02:00.482199+00:00, run_end_date=2024-04-14 23:02:04.493518+00:00, run_duration=4.011319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:01:00+00:00, data_interval_end=2024-04-14 23:02:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:02:04.503948125Z [2024-04-14T23:02:04.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:02:00+00:00, run_after=2024-04-14T23:03:00+00:00 2024-04-14T23:02:04.547680950Z [2024-04-14T23:02:04.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:01:00+00:00 exited with status success for try_number 1 2024-04-14T23:02:04.548179826Z [2024-04-14T23:02:04.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:01:00+00:00 exited with status success for try_number 1 2024-04-14T23:02:04.557560132Z [2024-04-14T23:02:04.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:01:00+00:00, map_index=-1, run_start_date=2024-04-14 23:02:02.377373+00:00, run_end_date=2024-04-14 23:02:03.995161+00:00, run_duration=1.617788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:02:00.548092+00:00, queued_by_job_id=1, pid=2230 2024-04-14T23:02:04.558090599Z [2024-04-14T23:02:04.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:01:00+00:00, map_index=-1, run_start_date=2024-04-14 23:02:02.334375+00:00, run_end_date=2024-04-14 23:02:03.452278+00:00, run_duration=1.117903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:02:00.548092+00:00, queued_by_job_id=1, pid=2229 2024-04-14T23:03:00.369584816Z [2024-04-14T23:03:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:03:00+00:00, run_after=2024-04-14T23:04:00+00:00 2024-04-14T23:03:00.378695123Z [2024-04-14T23:03:00.374+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:03:00.397374759Z [2024-04-14T23:03:00.395+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:03:00+00:00, run_after=2024-04-14T23:04:00+00:00 2024-04-14T23:03:00.547671992Z [2024-04-14T23:03:00.547+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:03:00.547703986Z 2024-04-14T23:03:00.547707296Z 2024-04-14T23:03:00.547710091Z 2024-04-14T23:03:00.547765596Z [2024-04-14T23:03:00.547+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:03:00.547803249Z [2024-04-14T23:03:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:03:00.547921212Z [2024-04-14T23:03:00.547+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:03:00.548415968Z [2024-04-14T23:03:00.548+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:03:00.548423894Z 2024-04-14T23:03:00.548427072Z 2024-04-14T23:03:00.548433169Z 2024-04-14T23:03:00.551240824Z [2024-04-14T23:03:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:03:00.551631845Z [2024-04-14T23:03:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:03:00.551936483Z [2024-04-14T23:03:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:03:00.552046526Z [2024-04-14T23:03:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:03:00.552243446Z [2024-04-14T23:03:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:03:00.552342185Z [2024-04-14T23:03:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:03:01.213734770Z [2024-04-14T23:03:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status queued for try_number 1 2024-04-14T23:03:01.213891639Z [2024-04-14T23:03:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status queued for try_number 1 2024-04-14T23:03:01.217849947Z [2024-04-14T23:03:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status queued for try_number 1 2024-04-14T23:03:01.230083746Z [2024-04-14T23:03:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27e160a4-95a7-4f43-a1c4-b110e549a733 2024-04-14T23:03:01.233612244Z [2024-04-14T23:03:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2de5fcc-3c08-4a67-902e-86d8d2a22f1e 2024-04-14T23:03:01.233798364Z [2024-04-14T23:03:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 813ed15e-3935-4cda-a2f7-322dbcd874d6 2024-04-14T23:03:02.436646785Z [2024-04-14T23:03:02.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:03:02.439815151Z [2024-04-14T23:03:02.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:02:00+00:00, run_id=scheduled__2024-04-14T23:02:00+00:00, run_start_date=2024-04-14 23:03:00.449302+00:00, run_end_date=2024-04-14 23:03:02.436561+00:00, run_duration=1.987259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:02:00+00:00, data_interval_end=2024-04-14 23:03:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:03:02.452203832Z [2024-04-14T23:03:02.451+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:03:00+00:00, run_after=2024-04-14T23:04:00+00:00 2024-04-14T23:03:02.489358174Z [2024-04-14T23:03:02.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status success for try_number 1 2024-04-14T23:03:02.499709734Z [2024-04-14T23:03:02.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:02:00+00:00, map_index=-1, run_start_date=2024-04-14 23:03:01.732944+00:00, run_end_date=2024-04-14 23:03:02.194119+00:00, run_duration=0.461175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:03:00.549001+00:00, queued_by_job_id=1, pid=2263 2024-04-14T23:03:05.811282797Z [2024-04-14T23:03:05.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:03:05.811554142Z [2024-04-14T23:03:05.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:02:00+00:00, run_id=scheduled__2024-04-14T23:02:00+00:00, run_start_date=2024-04-14 23:03:00.446285+00:00, run_end_date=2024-04-14 23:03:05.811198+00:00, run_duration=5.364913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:02:00+00:00, data_interval_end=2024-04-14 23:03:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:03:05.822814818Z [2024-04-14T23:03:05.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:03:00+00:00, run_after=2024-04-14T23:04:00+00:00 2024-04-14T23:03:05.830663354Z [2024-04-14T23:03:05.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:03:05.830899031Z [2024-04-14T23:03:05.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:02:00+00:00, run_id=scheduled__2024-04-14T23:02:00+00:00, run_start_date=2024-04-14 23:03:00.448411+00:00, run_end_date=2024-04-14 23:03:05.830564+00:00, run_duration=5.382153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:02:00+00:00, data_interval_end=2024-04-14 23:03:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:03:05.838863357Z [2024-04-14T23:03:05.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:03:00+00:00, run_after=2024-04-14T23:04:00+00:00 2024-04-14T23:03:05.871993151Z [2024-04-14T23:03:05.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status success for try_number 1 2024-04-14T23:03:05.872183225Z [2024-04-14T23:03:05.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status success for try_number 1 2024-04-14T23:03:05.879353316Z [2024-04-14T23:03:05.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:02:00+00:00, map_index=-1, run_start_date=2024-04-14 23:03:03.179398+00:00, run_end_date=2024-04-14 23:03:05.101979+00:00, run_duration=1.922581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:03:00.549001+00:00, queued_by_job_id=1, pid=2276 2024-04-14T23:03:05.879562438Z [2024-04-14T23:03:05.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:02:00+00:00, map_index=-1, run_start_date=2024-04-14 23:03:03.794684+00:00, run_end_date=2024-04-14 23:03:05.678364+00:00, run_duration=1.88368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:03:00.549001+00:00, queued_by_job_id=1, pid=2284 2024-04-14T23:04:00.407294647Z [2024-04-14T23:04:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:04:00+00:00, run_after=2024-04-14T23:05:00+00:00 2024-04-14T23:04:00.426229983Z [2024-04-14T23:04:00.425+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:04:00+00:00, run_after=2024-04-14T23:05:00+00:00 2024-04-14T23:04:00.431695794Z [2024-04-14T23:04:00.431+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:04:00.439057632Z [2024-04-14T23:04:00.438+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:04:00.505817302Z [2024-04-14T23:04:00.505+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:04:00.505837340Z 2024-04-14T23:04:00.505841322Z 2024-04-14T23:04:00.505844294Z 2024-04-14T23:04:00.505847355Z 2024-04-14T23:04:00.506182135Z [2024-04-14T23:04:00.505+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:04:00.506391494Z [2024-04-14T23:04:00.506+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:04:00.506924239Z [2024-04-14T23:04:00.506+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:04:00.507420675Z [2024-04-14T23:04:00.507+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:04:00.512145354Z [2024-04-14T23:04:00.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:04:00.512159954Z 2024-04-14T23:04:00.512163533Z 2024-04-14T23:04:00.512166284Z 2024-04-14T23:04:00.512169123Z 2024-04-14T23:04:00.523280286Z [2024-04-14T23:04:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:04:00.523668069Z [2024-04-14T23:04:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:04:00.523953449Z [2024-04-14T23:04:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:04:00.524267732Z [2024-04-14T23:04:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:04:00.524598547Z [2024-04-14T23:04:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:04:00.524821643Z [2024-04-14T23:04:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:04:00.525188313Z [2024-04-14T23:04:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:04:00.525431342Z [2024-04-14T23:04:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:04:00.791428034Z [2024-04-14T23:04:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status queued for try_number 1 2024-04-14T23:04:00.791522697Z [2024-04-14T23:04:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:03:00+00:00 exited with status queued for try_number 1 2024-04-14T23:04:00.791711350Z [2024-04-14T23:04:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:03:00+00:00 exited with status queued for try_number 1 2024-04-14T23:04:00.791848788Z [2024-04-14T23:04:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:03:00+00:00 exited with status queued for try_number 1 2024-04-14T23:04:00.802806102Z [2024-04-14T23:04:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ffab611-392b-4a39-866f-ba8806027b9f 2024-04-14T23:04:00.802914315Z [2024-04-14T23:04:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5572c5aa-d385-45fd-b64a-fb7e3874229f 2024-04-14T23:04:00.806185107Z [2024-04-14T23:04:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9aadeaa-008e-4885-a6b6-70f4c08d70a9 2024-04-14T23:04:00.806334391Z [2024-04-14T23:04:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99943d6a-98f6-4824-949a-5b33df450c29 2024-04-14T23:04:01.982037409Z [2024-04-14T23:04:01.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:04:01.982436041Z [2024-04-14T23:04:01.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:02:00+00:00, run_id=scheduled__2024-04-14T23:02:00+00:00, run_start_date=2024-04-14 23:04:00.448757+00:00, run_end_date=2024-04-14 23:04:01.981950+00:00, run_duration=1.533193, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:02:00+00:00, data_interval_end=2024-04-14 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:04:01.989246714Z [2024-04-14T23:04:01.988+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:04:00+00:00, run_after=2024-04-14T23:06:00+00:00 2024-04-14T23:04:01.999839207Z [2024-04-14T23:04:01.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:04:02.000157196Z [2024-04-14T23:04:01.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:03:00+00:00, run_id=scheduled__2024-04-14T23:03:00+00:00, run_start_date=2024-04-14 23:04:00.450194+00:00, run_end_date=2024-04-14 23:04:01.999779+00:00, run_duration=1.549585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:03:00+00:00, data_interval_end=2024-04-14 23:04:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:04:02.012464263Z [2024-04-14T23:04:02.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:04:00+00:00, run_after=2024-04-14T23:05:00+00:00 2024-04-14T23:04:02.044541258Z [2024-04-14T23:04:02.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:02:00+00:00 exited with status success for try_number 1 2024-04-14T23:04:02.050661140Z [2024-04-14T23:04:02.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:02:00+00:00, map_index=-1, run_start_date=2024-04-14 23:04:01.520903+00:00, run_end_date=2024-04-14 23:04:01.871877+00:00, run_duration=0.350974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:04:00.513980+00:00, queued_by_job_id=1, pid=2315 2024-04-14T23:04:03.165528433Z [2024-04-14T23:04:03.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:03:00+00:00 exited with status success for try_number 1 2024-04-14T23:04:03.173325272Z [2024-04-14T23:04:03.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:03:00+00:00, map_index=-1, run_start_date=2024-04-14 23:04:01.556402+00:00, run_end_date=2024-04-14 23:04:01.922603+00:00, run_duration=0.366201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:04:00.513980+00:00, queued_by_job_id=1, pid=2316 2024-04-14T23:04:04.407107734Z [2024-04-14T23:04:04.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:04:04.407464206Z [2024-04-14T23:04:04.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:03:00+00:00, run_id=scheduled__2024-04-14T23:03:00+00:00, run_start_date=2024-04-14 23:04:00.451097+00:00, run_end_date=2024-04-14 23:04:04.407048+00:00, run_duration=3.955951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:03:00+00:00, data_interval_end=2024-04-14 23:04:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:04:04.430981524Z [2024-04-14T23:04:04.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:04:00+00:00, run_after=2024-04-14T23:05:00+00:00 2024-04-14T23:04:04.441882894Z [2024-04-14T23:04:04.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:04:04.442379288Z [2024-04-14T23:04:04.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:03:00+00:00, run_id=scheduled__2024-04-14T23:03:00+00:00, run_start_date=2024-04-14 23:04:00.451949+00:00, run_end_date=2024-04-14 23:04:04.441810+00:00, run_duration=3.989861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:03:00+00:00, data_interval_end=2024-04-14 23:04:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:04:04.456510710Z [2024-04-14T23:04:04.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:04:00+00:00, run_after=2024-04-14T23:05:00+00:00 2024-04-14T23:04:04.511895529Z [2024-04-14T23:04:04.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:03:00+00:00 exited with status success for try_number 1 2024-04-14T23:04:04.512924254Z [2024-04-14T23:04:04.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:03:00+00:00 exited with status success for try_number 1 2024-04-14T23:04:04.521041232Z [2024-04-14T23:04:04.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:03:00+00:00, map_index=-1, run_start_date=2024-04-14 23:04:02.566456+00:00, run_end_date=2024-04-14 23:04:03.908220+00:00, run_duration=1.341764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:04:00.513980+00:00, queued_by_job_id=1, pid=2339 2024-04-14T23:04:04.521267109Z [2024-04-14T23:04:04.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:03:00+00:00, map_index=-1, run_start_date=2024-04-14 23:04:02.591437+00:00, run_end_date=2024-04-14 23:04:04.249342+00:00, run_duration=1.657905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:04:00.513980+00:00, queued_by_job_id=1, pid=2340 2024-04-14T23:05:00.402088014Z [2024-04-14T23:05:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:05:00+00:00, run_after=2024-04-14T23:06:00+00:00 2024-04-14T23:05:00.412157017Z [2024-04-14T23:05:00.411+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:05:00.443583506Z [2024-04-14T23:05:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:05:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:05:00.463546658Z [2024-04-14T23:05:00.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:05:00+00:00, run_after=2024-04-14T23:06:00+00:00 2024-04-14T23:05:00.572634268Z [2024-04-14T23:05:00.572+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:05:00.572671632Z 2024-04-14T23:05:00.572676506Z 2024-04-14T23:05:00.572680148Z 2024-04-14T23:05:00.572683412Z 2024-04-14T23:05:00.572686521Z [2024-04-14T23:05:00.572+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:05:00.572991604Z [2024-04-14T23:05:00.572+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:05:00.573015439Z [2024-04-14T23:05:00.572+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:05:00.573183926Z [2024-04-14T23:05:00.572+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:05:00.573727152Z [2024-04-14T23:05:00.573+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:05:00.573738980Z 2024-04-14T23:05:00.573742873Z 2024-04-14T23:05:00.573745932Z 2024-04-14T23:05:00.573749024Z 2024-04-14T23:05:00.577008542Z [2024-04-14T23:05:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:05:00.577232751Z [2024-04-14T23:05:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:05:00.577485184Z [2024-04-14T23:05:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:05:00.577713576Z [2024-04-14T23:05:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:05:00.577970586Z [2024-04-14T23:05:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:05:00.578147753Z [2024-04-14T23:05:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:05:00.578402595Z [2024-04-14T23:05:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:05:00.578587402Z [2024-04-14T23:05:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:05:00.819782992Z [2024-04-14T23:05:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:05:00.819813355Z [2024-04-14T23:05:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status queued for try_number 1 2024-04-14T23:05:00.819819412Z [2024-04-14T23:05:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status queued for try_number 1 2024-04-14T23:05:00.819892968Z [2024-04-14T23:05:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status queued for try_number 1 2024-04-14T23:05:00.827263032Z [2024-04-14T23:05:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 944bb387-af35-4c81-b1b6-927901710d11 2024-04-14T23:05:00.827288913Z [2024-04-14T23:05:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e13c50c-1053-4851-87a5-835a4a47ac2b 2024-04-14T23:05:00.827405685Z [2024-04-14T23:05:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97feb14f-eb24-459e-8fac-c9036cadea3b 2024-04-14T23:05:00.827476603Z [2024-04-14T23:05:00.827+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fbd2ea2-18fe-4d11-92ad-d296b166cdae 2024-04-14T23:05:02.115221459Z [2024-04-14T23:05:02.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:05:02.115260390Z [2024-04-14T23:05:02.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:04:00+00:00, run_id=scheduled__2024-04-14T23:04:00+00:00, run_start_date=2024-04-14 23:05:00.479798+00:00, run_end_date=2024-04-14 23:05:02.114070+00:00, run_duration=1.634272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:04:00+00:00, data_interval_end=2024-04-14 23:05:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:05:02.127733356Z [2024-04-14T23:05:02.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:05:00+00:00, run_after=2024-04-14T23:06:00+00:00 2024-04-14T23:05:02.189344299Z [2024-04-14T23:05:02.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status success for try_number 1 2024-04-14T23:05:02.195182870Z [2024-04-14T23:05:02.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:04:00+00:00, map_index=-1, run_start_date=2024-04-14 23:05:01.250518+00:00, run_end_date=2024-04-14 23:05:01.539812+00:00, run_duration=0.289294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:05:00.574450+00:00, queued_by_job_id=1, pid=2373 2024-04-14T23:05:03.303074063Z [2024-04-14T23:05:03.302+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:05:03.303132950Z 2024-04-14T23:05:03.303244111Z [2024-04-14T23:05:03.302+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:05:03.304012328Z [2024-04-14T23:05:03.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:05:03.304051695Z 2024-04-14T23:05:03.306971732Z [2024-04-14T23:05:03.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:05:03.307157465Z [2024-04-14T23:05:03.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:05:03.369796567Z [2024-04-14T23:05:03.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:05:03.370049734Z [2024-04-14T23:05:03.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:05:03.376517910Z [2024-04-14T23:05:03.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1af0bbeb-2865-452c-83c0-2d32d95db399 2024-04-14T23:05:03.376827475Z [2024-04-14T23:05:03.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=-1, run_start_date=2024-04-14 23:05:02.415236+00:00, run_end_date=2024-04-14 23:05:02.788015+00:00, run_duration=0.372779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:05:00.574450+00:00, queued_by_job_id=1, pid=2399 2024-04-14T23:05:03.806647304Z [2024-04-14T23:05:03.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:05:03.806715645Z [2024-04-14T23:05:03.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:04:00+00:00, run_id=scheduled__2024-04-14T23:04:00+00:00, run_start_date=2024-04-14 23:05:00.480869+00:00, run_end_date=2024-04-14 23:05:03.805817+00:00, run_duration=3.324948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:04:00+00:00, data_interval_end=2024-04-14 23:05:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:05:03.819690566Z [2024-04-14T23:05:03.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:05:00+00:00, run_after=2024-04-14T23:06:00+00:00 2024-04-14T23:05:03.904981245Z [2024-04-14T23:05:03.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status success for try_number 1 2024-04-14T23:05:03.924317221Z [2024-04-14T23:05:03.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:04:00+00:00, map_index=-1, run_start_date=2024-04-14 23:05:02.220558+00:00, run_end_date=2024-04-14 23:05:03.523938+00:00, run_duration=1.30338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:05:00.574450+00:00, queued_by_job_id=1, pid=2392 2024-04-14T23:05:04.412808255Z [2024-04-14T23:05:04.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:05:04.413037759Z [2024-04-14T23:05:04.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:04:00+00:00, run_id=scheduled__2024-04-14T23:04:00+00:00, run_start_date=2024-04-14 23:05:00.482782+00:00, run_end_date=2024-04-14 23:05:04.412689+00:00, run_duration=3.929907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:04:00+00:00, data_interval_end=2024-04-14 23:05:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:05:04.421888128Z [2024-04-14T23:05:04.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:05:00+00:00, run_after=2024-04-14T23:06:00+00:00 2024-04-14T23:05:04.497626581Z [2024-04-14T23:05:04.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status success for try_number 1 2024-04-14T23:05:04.508496196Z [2024-04-14T23:05:04.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:04:00+00:00, map_index=-1, run_start_date=2024-04-14 23:05:02.332181+00:00, run_end_date=2024-04-14 23:05:04.078579+00:00, run_duration=1.746398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:05:00.574450+00:00, queued_by_job_id=1, pid=2398 2024-04-14T23:05:05.574072262Z [2024-04-14T23:05:05.573+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:05:05.574115158Z 2024-04-14T23:05:05.574122121Z [2024-04-14T23:05:05.573+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:05:05.574604907Z [2024-04-14T23:05:05.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:05:05.574628371Z 2024-04-14T23:05:05.577303389Z [2024-04-14T23:05:05.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:05:05.577406877Z [2024-04-14T23:05:05.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:05:05.642417891Z [2024-04-14T23:05:05.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:05:05.642650836Z [2024-04-14T23:05:05.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:05:05.647516633Z [2024-04-14T23:05:05.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03762051-739a-414b-88a5-85209f275f56 2024-04-14T23:05:05.647755276Z [2024-04-14T23:05:05.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=-1, run_start_date=2024-04-14 23:05:04.926561+00:00, run_end_date=2024-04-14 23:05:05.328732+00:00, run_duration=0.402171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:05:03.304370+00:00, queued_by_job_id=1, pid=2422 2024-04-14T23:05:08.285203218Z [2024-04-14T23:05:08.284+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:05:08.285230779Z 2024-04-14T23:05:08.285596609Z [2024-04-14T23:05:08.285+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:05:08.286377376Z [2024-04-14T23:05:08.286+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:05:08.286386411Z 2024-04-14T23:05:08.290256829Z [2024-04-14T23:05:08.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:05:08.290619346Z [2024-04-14T23:05:08.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:05:08.385478241Z [2024-04-14T23:05:08.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status queued for try_number 1 2024-04-14T23:05:08.385506655Z [2024-04-14T23:05:08.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:05:08.397981565Z [2024-04-14T23:05:08.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61000108-cfb4-411c-88a7-5623d09176ff 2024-04-14T23:05:08.398007133Z [2024-04-14T23:05:08.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=0, run_start_date=2024-04-14 23:05:06.984666+00:00, run_end_date=2024-04-14 23:05:07.456465+00:00, run_duration=0.471799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:05:05.574863+00:00, queued_by_job_id=1, pid=2430 2024-04-14T23:05:10.525773769Z [2024-04-14T23:05:10.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:05:10.526018029Z [2024-04-14T23:05:10.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:00:00+00:00, run_id=scheduled__2024-04-14T23:00:00+00:00, run_start_date=2024-04-14 23:05:00.478708+00:00, run_end_date=2024-04-14 23:05:10.525655+00:00, run_duration=10.046947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:00:00+00:00, data_interval_end=2024-04-14 23:05:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:05:10.531253647Z [2024-04-14T23:05:10.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:05:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:05:10.566535122Z [2024-04-14T23:05:10.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:00:00+00:00 exited with status success for try_number 1 2024-04-14T23:05:10.570869488Z [2024-04-14T23:05:10.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:00:00+00:00, map_index=-1, run_start_date=2024-04-14 23:05:09.838500+00:00, run_end_date=2024-04-14 23:05:10.219340+00:00, run_duration=0.38084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:05:08.286870+00:00, queued_by_job_id=1, pid=2438 2024-04-14T23:05:59.936119247Z [2024-04-14T23:05:59.935+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:06:00.985517736Z [2024-04-14T23:06:00.984+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:06:00.998059494Z [2024-04-14T23:06:00.997+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:06:01.020692420Z [2024-04-14T23:06:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:06:00+00:00, run_after=2024-04-14T23:07:00+00:00 2024-04-14T23:06:01.044435694Z [2024-04-14T23:06:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:06:00+00:00, run_after=2024-04-14T23:07:00+00:00 2024-04-14T23:06:01.149327892Z [2024-04-14T23:06:01.148+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:06:01.149360939Z 2024-04-14T23:06:01.149369897Z 2024-04-14T23:06:01.149413443Z 2024-04-14T23:06:01.149505054Z 2024-04-14T23:06:01.149513689Z [2024-04-14T23:06:01.149+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:06:01.149537133Z [2024-04-14T23:06:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:06:01.149544852Z [2024-04-14T23:06:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:06:01.149638646Z [2024-04-14T23:06:01.149+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:06:01.150308578Z [2024-04-14T23:06:01.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:06:01.150322992Z 2024-04-14T23:06:01.150331044Z 2024-04-14T23:06:01.150370408Z 2024-04-14T23:06:01.150377837Z 2024-04-14T23:06:01.155155624Z [2024-04-14T23:06:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:06:01.155181122Z [2024-04-14T23:06:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:06:01.155187238Z [2024-04-14T23:06:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:06:01.155192541Z [2024-04-14T23:06:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:06:01.155216246Z [2024-04-14T23:06:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:06:01.155220752Z [2024-04-14T23:06:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:06:01.155470627Z [2024-04-14T23:06:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:06:01.155515774Z [2024-04-14T23:06:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:06:01.431911812Z [2024-04-14T23:06:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status queued for try_number 1 2024-04-14T23:06:01.432158041Z [2024-04-14T23:06:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status queued for try_number 1 2024-04-14T23:06:01.432344868Z [2024-04-14T23:06:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status queued for try_number 1 2024-04-14T23:06:01.432789999Z [2024-04-14T23:06:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status queued for try_number 1 2024-04-14T23:06:01.450860815Z [2024-04-14T23:06:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to f729d62c-a775-4cd1-887a-bea1608c9876 2024-04-14T23:06:01.451011128Z [2024-04-14T23:06:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87a1f717-6d67-4f71-a9d1-96741404d09c 2024-04-14T23:06:01.451205199Z [2024-04-14T23:06:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80c52760-bc37-47f9-b3dd-76332c5a70ea 2024-04-14T23:06:01.451330170Z [2024-04-14T23:06:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5195b079-0d01-429a-9748-e4fa5d549eda 2024-04-14T23:06:03.001691481Z [2024-04-14T23:06:03.001+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:06:03.002081280Z [2024-04-14T23:06:03.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:04:00+00:00, run_id=scheduled__2024-04-14T23:04:00+00:00, run_start_date=2024-04-14 23:06:01.063843+00:00, run_end_date=2024-04-14 23:06:03.001594+00:00, run_duration=1.937751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:04:00+00:00, data_interval_end=2024-04-14 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:06:03.015793019Z [2024-04-14T23:06:03.015+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:06:00+00:00, run_after=2024-04-14T23:08:00+00:00 2024-04-14T23:06:03.052032208Z [2024-04-14T23:06:03.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:06:03.052343343Z [2024-04-14T23:06:03.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:05:00+00:00, run_id=scheduled__2024-04-14T23:05:00+00:00, run_start_date=2024-04-14 23:06:01.075748+00:00, run_end_date=2024-04-14 23:06:03.051904+00:00, run_duration=1.976156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:05:00+00:00, data_interval_end=2024-04-14 23:06:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:06:03.075800276Z [2024-04-14T23:06:03.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:06:00+00:00, run_after=2024-04-14T23:07:00+00:00 2024-04-14T23:06:03.131972690Z [2024-04-14T23:06:03.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:04:00+00:00 exited with status success for try_number 1 2024-04-14T23:06:03.132146706Z [2024-04-14T23:06:03.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status success for try_number 1 2024-04-14T23:06:03.141481827Z [2024-04-14T23:06:03.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:04:00+00:00, map_index=-1, run_start_date=2024-04-14 23:06:01.955230+00:00, run_end_date=2024-04-14 23:06:02.292477+00:00, run_duration=0.337247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:06:01.151574+00:00, queued_by_job_id=1, pid=2461 2024-04-14T23:06:03.141759988Z [2024-04-14T23:06:03.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:05:00+00:00, map_index=-1, run_start_date=2024-04-14 23:06:02.119466+00:00, run_end_date=2024-04-14 23:06:02.546376+00:00, run_duration=0.42691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:06:01.151574+00:00, queued_by_job_id=1, pid=2462 2024-04-14T23:06:06.000847292Z [2024-04-14T23:06:05.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:06:06.001199961Z [2024-04-14T23:06:06.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:05:00+00:00, run_id=scheduled__2024-04-14T23:05:00+00:00, run_start_date=2024-04-14 23:06:01.073907+00:00, run_end_date=2024-04-14 23:06:06.000611+00:00, run_duration=4.926704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:05:00+00:00, data_interval_end=2024-04-14 23:06:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:06:06.014962764Z [2024-04-14T23:06:06.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:06:00+00:00, run_after=2024-04-14T23:07:00+00:00 2024-04-14T23:06:06.050044987Z [2024-04-14T23:06:06.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status success for try_number 1 2024-04-14T23:06:06.060582617Z [2024-04-14T23:06:06.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:05:00+00:00, map_index=-1, run_start_date=2024-04-14 23:06:03.008262+00:00, run_end_date=2024-04-14 23:06:04.887176+00:00, run_duration=1.878914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:06:01.151574+00:00, queued_by_job_id=1, pid=2485 2024-04-14T23:06:07.001268036Z [2024-04-14T23:06:07.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:06:07.001308436Z [2024-04-14T23:06:07.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:05:00+00:00, run_id=scheduled__2024-04-14T23:05:00+00:00, run_start_date=2024-04-14 23:06:01.070423+00:00, run_end_date=2024-04-14 23:06:07.000719+00:00, run_duration=5.930296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:05:00+00:00, data_interval_end=2024-04-14 23:06:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:06:07.019360842Z [2024-04-14T23:06:07.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:06:00+00:00, run_after=2024-04-14T23:07:00+00:00 2024-04-14T23:06:07.061767702Z [2024-04-14T23:06:07.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status success for try_number 1 2024-04-14T23:06:07.067230753Z [2024-04-14T23:06:07.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:05:00+00:00, map_index=-1, run_start_date=2024-04-14 23:06:03.069433+00:00, run_end_date=2024-04-14 23:06:06.312138+00:00, run_duration=3.242705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:06:01.151574+00:00, queued_by_job_id=1, pid=2486 2024-04-14T23:07:01.008934665Z [2024-04-14T23:07:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:07:00+00:00, run_after=2024-04-14T23:08:00+00:00 2024-04-14T23:07:01.020368085Z [2024-04-14T23:07:01.019+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:07:01.037146720Z [2024-04-14T23:07:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:07:00+00:00, run_after=2024-04-14T23:08:00+00:00 2024-04-14T23:07:01.131962075Z [2024-04-14T23:07:01.131+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:07:01.131982449Z 2024-04-14T23:07:01.131985598Z 2024-04-14T23:07:01.131988356Z 2024-04-14T23:07:01.132173452Z [2024-04-14T23:07:01.132+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:07:01.132347766Z [2024-04-14T23:07:01.132+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:07:01.134945014Z [2024-04-14T23:07:01.132+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:07:01.134962136Z [2024-04-14T23:07:01.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:07:01.134965739Z 2024-04-14T23:07:01.134969248Z 2024-04-14T23:07:01.134972826Z 2024-04-14T23:07:01.135938976Z [2024-04-14T23:07:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:07:01.136224808Z [2024-04-14T23:07:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:07:01.136565205Z [2024-04-14T23:07:01.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:07:01.136794832Z [2024-04-14T23:07:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:07:01.137158964Z [2024-04-14T23:07:01.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:07:01.137648215Z [2024-04-14T23:07:01.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:07:01.447849386Z [2024-04-14T23:07:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status queued for try_number 1 2024-04-14T23:07:01.447872986Z [2024-04-14T23:07:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status queued for try_number 1 2024-04-14T23:07:01.447941960Z [2024-04-14T23:07:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status queued for try_number 1 2024-04-14T23:07:01.462236160Z [2024-04-14T23:07:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to e332dc08-3617-4a50-acc0-b03fe5366260 2024-04-14T23:07:01.462286772Z [2024-04-14T23:07:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0819cae2-0acd-4be7-97b9-873fb1648078 2024-04-14T23:07:01.462372814Z [2024-04-14T23:07:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16d61f23-22e9-426f-88bc-9cb5d49ab367 2024-04-14T23:07:02.579479288Z [2024-04-14T23:07:02.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:07:02.579804778Z [2024-04-14T23:07:02.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:06:00+00:00, run_id=scheduled__2024-04-14T23:06:00+00:00, run_start_date=2024-04-14 23:07:01.051297+00:00, run_end_date=2024-04-14 23:07:02.579385+00:00, run_duration=1.528088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:06:00+00:00, data_interval_end=2024-04-14 23:07:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:07:02.588275756Z [2024-04-14T23:07:02.588+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:07:00+00:00, run_after=2024-04-14T23:08:00+00:00 2024-04-14T23:07:02.643653969Z [2024-04-14T23:07:02.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status success for try_number 1 2024-04-14T23:07:02.651110722Z [2024-04-14T23:07:02.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:06:00+00:00, map_index=-1, run_start_date=2024-04-14 23:07:01.961554+00:00, run_end_date=2024-04-14 23:07:02.318132+00:00, run_duration=0.356578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:07:01.133593+00:00, queued_by_job_id=1, pid=2518 2024-04-14T23:07:05.236442022Z [2024-04-14T23:07:05.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:07:05.236580113Z [2024-04-14T23:07:05.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:06:00+00:00, run_id=scheduled__2024-04-14T23:06:00+00:00, run_start_date=2024-04-14 23:07:01.054270+00:00, run_end_date=2024-04-14 23:07:05.236234+00:00, run_duration=4.181964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:06:00+00:00, data_interval_end=2024-04-14 23:07:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:07:05.246813114Z [2024-04-14T23:07:05.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:07:00+00:00, run_after=2024-04-14T23:08:00+00:00 2024-04-14T23:07:05.255353357Z [2024-04-14T23:07:05.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:07:05.255478676Z [2024-04-14T23:07:05.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:06:00+00:00, run_id=scheduled__2024-04-14T23:06:00+00:00, run_start_date=2024-04-14 23:07:01.052821+00:00, run_end_date=2024-04-14 23:07:05.255186+00:00, run_duration=4.202365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:06:00+00:00, data_interval_end=2024-04-14 23:07:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:07:05.264165981Z [2024-04-14T23:07:05.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:07:00+00:00, run_after=2024-04-14T23:08:00+00:00 2024-04-14T23:07:05.301941612Z [2024-04-14T23:07:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status success for try_number 1 2024-04-14T23:07:05.302098055Z [2024-04-14T23:07:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status success for try_number 1 2024-04-14T23:07:05.315771585Z [2024-04-14T23:07:05.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:06:00+00:00, map_index=-1, run_start_date=2024-04-14 23:07:02.786482+00:00, run_end_date=2024-04-14 23:07:04.705788+00:00, run_duration=1.919306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:07:01.133593+00:00, queued_by_job_id=1, pid=2536 2024-04-14T23:07:05.316101335Z [2024-04-14T23:07:05.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:06:00+00:00, map_index=-1, run_start_date=2024-04-14 23:07:02.948030+00:00, run_end_date=2024-04-14 23:07:04.450180+00:00, run_duration=1.50215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:07:01.133593+00:00, queued_by_job_id=1, pid=2537 2024-04-14T23:08:00.812575529Z [2024-04-14T23:08:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:08:00+00:00, run_after=2024-04-14T23:09:00+00:00 2024-04-14T23:08:00.819013389Z [2024-04-14T23:08:00.818+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:08:00.823916482Z [2024-04-14T23:08:00.823+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:08:00.833460397Z [2024-04-14T23:08:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:08:00+00:00, run_after=2024-04-14T23:09:00+00:00 2024-04-14T23:08:00.900831982Z [2024-04-14T23:08:00.900+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:08:00.900861494Z 2024-04-14T23:08:00.900867993Z 2024-04-14T23:08:00.900873298Z 2024-04-14T23:08:00.900878539Z 2024-04-14T23:08:00.901023744Z [2024-04-14T23:08:00.900+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:08:00.901353961Z [2024-04-14T23:08:00.901+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:08:00.901623717Z [2024-04-14T23:08:00.901+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:08:00.901875936Z [2024-04-14T23:08:00.901+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:08:00.902711903Z [2024-04-14T23:08:00.902+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:08:00.902720741Z 2024-04-14T23:08:00.902724232Z 2024-04-14T23:08:00.902727039Z 2024-04-14T23:08:00.902729810Z 2024-04-14T23:08:00.907489280Z [2024-04-14T23:08:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:08:00.907739532Z [2024-04-14T23:08:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:08:00.908081945Z [2024-04-14T23:08:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:08:00.908283231Z [2024-04-14T23:08:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:08:00.908564847Z [2024-04-14T23:08:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:08:00.908750778Z [2024-04-14T23:08:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:08:00.909041228Z [2024-04-14T23:08:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:08:00.909253893Z [2024-04-14T23:08:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:08:01.301284157Z [2024-04-14T23:08:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status queued for try_number 1 2024-04-14T23:08:01.301348609Z [2024-04-14T23:08:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:07:00+00:00 exited with status queued for try_number 1 2024-04-14T23:08:01.301409739Z [2024-04-14T23:08:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:07:00+00:00 exited with status queued for try_number 1 2024-04-14T23:08:01.301561470Z [2024-04-14T23:08:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:07:00+00:00 exited with status queued for try_number 1 2024-04-14T23:08:01.308535857Z [2024-04-14T23:08:01.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1785b651-b27a-4afc-b4d2-1ccc1ef7a458 2024-04-14T23:08:01.308713339Z [2024-04-14T23:08:01.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46fab7d3-d5ae-4ae0-96af-dde6d9e613e5 2024-04-14T23:08:01.308905606Z [2024-04-14T23:08:01.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c3a33c9-2e94-4eb1-a2ba-39f7b77b93a0 2024-04-14T23:08:01.309167844Z [2024-04-14T23:08:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31dea4b4-6644-40af-95a5-d57680b5a8c7 2024-04-14T23:08:02.435804824Z [2024-04-14T23:08:02.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:08:02.436429799Z [2024-04-14T23:08:02.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:06:00+00:00, run_id=scheduled__2024-04-14T23:06:00+00:00, run_start_date=2024-04-14 23:08:00.841771+00:00, run_end_date=2024-04-14 23:08:02.435720+00:00, run_duration=1.593949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:06:00+00:00, data_interval_end=2024-04-14 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:08:02.442845046Z [2024-04-14T23:08:02.442+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:08:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:08:02.448194457Z [2024-04-14T23:08:02.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:08:02.448456567Z [2024-04-14T23:08:02.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:07:00+00:00, run_id=scheduled__2024-04-14T23:07:00+00:00, run_start_date=2024-04-14 23:08:00.842861+00:00, run_end_date=2024-04-14 23:08:02.448144+00:00, run_duration=1.605283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:07:00+00:00, data_interval_end=2024-04-14 23:08:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:08:02.456479716Z [2024-04-14T23:08:02.456+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:08:00+00:00, run_after=2024-04-14T23:09:00+00:00 2024-04-14T23:08:02.499381773Z [2024-04-14T23:08:02.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:06:00+00:00 exited with status success for try_number 1 2024-04-14T23:08:02.500089575Z [2024-04-14T23:08:02.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:07:00+00:00 exited with status success for try_number 1 2024-04-14T23:08:02.507456426Z [2024-04-14T23:08:02.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:07:00+00:00, map_index=-1, run_start_date=2024-04-14 23:08:01.745497+00:00, run_end_date=2024-04-14 23:08:02.090506+00:00, run_duration=0.345009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:08:00.903983+00:00, queued_by_job_id=1, pid=2571 2024-04-14T23:08:02.507832749Z [2024-04-14T23:08:02.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:06:00+00:00, map_index=-1, run_start_date=2024-04-14 23:08:01.610824+00:00, run_end_date=2024-04-14 23:08:01.940132+00:00, run_duration=0.329308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:08:00.903983+00:00, queued_by_job_id=1, pid=2570 2024-04-14T23:08:04.232725519Z [2024-04-14T23:08:04.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:08:04.233145237Z [2024-04-14T23:08:04.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:07:00+00:00, run_id=scheduled__2024-04-14T23:07:00+00:00, run_start_date=2024-04-14 23:08:00.843914+00:00, run_end_date=2024-04-14 23:08:04.232628+00:00, run_duration=3.388714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:07:00+00:00, data_interval_end=2024-04-14 23:08:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:08:04.249599246Z [2024-04-14T23:08:04.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:08:00+00:00, run_after=2024-04-14T23:09:00+00:00 2024-04-14T23:08:05.382221359Z [2024-04-14T23:08:05.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:08:05.382811925Z [2024-04-14T23:08:05.382+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:07:00+00:00, run_id=scheduled__2024-04-14T23:07:00+00:00, run_start_date=2024-04-14 23:08:00.844707+00:00, run_end_date=2024-04-14 23:08:05.382073+00:00, run_duration=4.537366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:07:00+00:00, data_interval_end=2024-04-14 23:08:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:08:05.397492723Z [2024-04-14T23:08:05.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:08:00+00:00, run_after=2024-04-14T23:09:00+00:00 2024-04-14T23:08:05.440945723Z [2024-04-14T23:08:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:07:00+00:00 exited with status success for try_number 1 2024-04-14T23:08:05.440976950Z [2024-04-14T23:08:05.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:07:00+00:00 exited with status success for try_number 1 2024-04-14T23:08:05.449748395Z [2024-04-14T23:08:05.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:07:00+00:00, map_index=-1, run_start_date=2024-04-14 23:08:02.736066+00:00, run_end_date=2024-04-14 23:08:04.185161+00:00, run_duration=1.449095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:08:00.903983+00:00, queued_by_job_id=1, pid=2595 2024-04-14T23:08:05.450207867Z [2024-04-14T23:08:05.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:07:00+00:00, map_index=-1, run_start_date=2024-04-14 23:08:02.680629+00:00, run_end_date=2024-04-14 23:08:04.870806+00:00, run_duration=2.190177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:08:00.903983+00:00, queued_by_job_id=1, pid=2594 2024-04-14T23:09:00.570575440Z [2024-04-14T23:09:00.569+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:09:00.590017715Z [2024-04-14T23:09:00.589+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:09:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:09:00.616083642Z [2024-04-14T23:09:00.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:09:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:09:00.675968094Z [2024-04-14T23:09:00.675+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:09:00.675991252Z 2024-04-14T23:09:00.675994439Z 2024-04-14T23:09:00.675997197Z 2024-04-14T23:09:00.676238889Z [2024-04-14T23:09:00.676+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:09:00.676433435Z [2024-04-14T23:09:00.676+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:09:00.676612153Z [2024-04-14T23:09:00.676+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:09:00.677191706Z [2024-04-14T23:09:00.676+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:09:00.677202146Z 2024-04-14T23:09:00.677205308Z 2024-04-14T23:09:00.677208260Z 2024-04-14T23:09:00.680361005Z [2024-04-14T23:09:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:09:00.680873463Z [2024-04-14T23:09:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:09:00.681278775Z [2024-04-14T23:09:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:09:00.681607881Z [2024-04-14T23:09:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:09:00.681981862Z [2024-04-14T23:09:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:09:00.682191401Z [2024-04-14T23:09:00.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:09:00.867530278Z [2024-04-14T23:09:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status queued for try_number 1 2024-04-14T23:09:00.867605298Z [2024-04-14T23:09:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status queued for try_number 1 2024-04-14T23:09:00.867609236Z [2024-04-14T23:09:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status queued for try_number 1 2024-04-14T23:09:00.874155779Z [2024-04-14T23:09:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1495cf5b-3d6d-4dff-9a64-83f186312aa3 2024-04-14T23:09:00.874209785Z [2024-04-14T23:09:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8af9cf14-53a9-44da-a567-26c09374914f 2024-04-14T23:09:00.874313579Z [2024-04-14T23:09:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34ee7f28-b817-4c07-ab38-6451db7fe866 2024-04-14T23:09:02.013711257Z [2024-04-14T23:09:02.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:09:02.013894097Z [2024-04-14T23:09:02.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:08:00+00:00, run_id=scheduled__2024-04-14T23:08:00+00:00, run_start_date=2024-04-14 23:09:00.629486+00:00, run_end_date=2024-04-14 23:09:02.013632+00:00, run_duration=1.384146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:08:00+00:00, data_interval_end=2024-04-14 23:09:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:09:02.021815815Z [2024-04-14T23:09:02.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:09:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:09:02.055280966Z [2024-04-14T23:09:02.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status success for try_number 1 2024-04-14T23:09:02.060933891Z [2024-04-14T23:09:02.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:08:00+00:00, map_index=-1, run_start_date=2024-04-14 23:09:01.334551+00:00, run_end_date=2024-04-14 23:09:01.772115+00:00, run_duration=0.437564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:09:00.677856+00:00, queued_by_job_id=1, pid=2627 2024-04-14T23:09:04.228505307Z [2024-04-14T23:09:04.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:09:04.229288691Z [2024-04-14T23:09:04.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:08:00+00:00, run_id=scheduled__2024-04-14T23:08:00+00:00, run_start_date=2024-04-14 23:09:00.630671+00:00, run_end_date=2024-04-14 23:09:04.228249+00:00, run_duration=3.597578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:08:00+00:00, data_interval_end=2024-04-14 23:09:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:09:04.250172994Z [2024-04-14T23:09:04.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:09:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:09:04.304629051Z [2024-04-14T23:09:04.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status success for try_number 1 2024-04-14T23:09:04.334991897Z [2024-04-14T23:09:04.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:08:00+00:00, map_index=-1, run_start_date=2024-04-14 23:09:02.289073+00:00, run_end_date=2024-04-14 23:09:03.892260+00:00, run_duration=1.603187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:09:00.677856+00:00, queued_by_job_id=1, pid=2646 2024-04-14T23:09:04.573555367Z [2024-04-14T23:09:04.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:09:04.573668609Z [2024-04-14T23:09:04.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:08:00+00:00, run_id=scheduled__2024-04-14T23:08:00+00:00, run_start_date=2024-04-14 23:09:00.631554+00:00, run_end_date=2024-04-14 23:09:04.573392+00:00, run_duration=3.941838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:08:00+00:00, data_interval_end=2024-04-14 23:09:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:09:04.582216216Z [2024-04-14T23:09:04.581+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:09:00+00:00, run_after=2024-04-14T23:10:00+00:00 2024-04-14T23:09:05.694941746Z [2024-04-14T23:09:05.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status success for try_number 1 2024-04-14T23:09:05.704236666Z [2024-04-14T23:09:05.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:08:00+00:00, map_index=-1, run_start_date=2024-04-14 23:09:02.204064+00:00, run_end_date=2024-04-14 23:09:04.539882+00:00, run_duration=2.335818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:09:00.677856+00:00, queued_by_job_id=1, pid=2645 2024-04-14T23:10:00.459900653Z [2024-04-14T23:10:00.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:11:00+00:00 2024-04-14T23:10:00.466060990Z [2024-04-14T23:10:00.465+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:10:00.471278248Z [2024-04-14T23:10:00.471+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:10:00.484226982Z [2024-04-14T23:10:00.483+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:11:00+00:00 2024-04-14T23:10:00.496162729Z [2024-04-14T23:10:00.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:15:00+00:00 2024-04-14T23:10:00.600917927Z [2024-04-14T23:10:00.600+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T23:10:00.601220031Z 2024-04-14T23:10:00.601233205Z 2024-04-14T23:10:00.601243024Z 2024-04-14T23:10:00.601251699Z 2024-04-14T23:10:00.601336901Z 2024-04-14T23:10:00.601417724Z [2024-04-14T23:10:00.600+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:10:00.601465973Z [2024-04-14T23:10:00.600+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:10:00.601535688Z [2024-04-14T23:10:00.601+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:10:00.601604142Z [2024-04-14T23:10:00.601+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:10:00.601708017Z [2024-04-14T23:10:00.601+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:10:00.602777451Z [2024-04-14T23:10:00.602+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:10:00.602838994Z 2024-04-14T23:10:00.602848831Z 2024-04-14T23:10:00.602858106Z 2024-04-14T23:10:00.602866689Z 2024-04-14T23:10:00.602916898Z 2024-04-14T23:10:00.609736517Z [2024-04-14T23:10:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:10:00.610051638Z [2024-04-14T23:10:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:10:00.610675077Z [2024-04-14T23:10:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:10:00.610965878Z [2024-04-14T23:10:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:10:00.611629968Z [2024-04-14T23:10:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:10:00.611877256Z [2024-04-14T23:10:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:10:00.612511646Z [2024-04-14T23:10:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:10:00.613010901Z [2024-04-14T23:10:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:10:00.614176856Z [2024-04-14T23:10:00.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:10:00.614429284Z [2024-04-14T23:10:00.614+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:10:01.003050378Z [2024-04-14T23:10:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:01.003077076Z [2024-04-14T23:10:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:01.003080916Z [2024-04-14T23:10:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:09:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:01.003083799Z [2024-04-14T23:10:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:09:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:01.003086524Z [2024-04-14T23:10:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:09:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:01.013546580Z [2024-04-14T23:10:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09cb2662-a9a0-4294-bf28-1c8a36cf4ee0 2024-04-14T23:10:01.013686808Z [2024-04-14T23:10:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed2cd72b-83dd-4105-bc27-6a06a806ccac 2024-04-14T23:10:01.013836783Z [2024-04-14T23:10:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcbd5b07-67c6-4a9d-8a8e-d0c9a1083eb3 2024-04-14T23:10:01.013961745Z [2024-04-14T23:10:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2fc5a93-1814-4459-a1ee-0d56a8f1666b 2024-04-14T23:10:01.014074318Z [2024-04-14T23:10:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 390d44b9-eba1-49f1-b884-aa5be083942e 2024-04-14T23:10:02.231251815Z [2024-04-14T23:10:02.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:10:02.231644898Z [2024-04-14T23:10:02.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:08:00+00:00, run_id=scheduled__2024-04-14T23:08:00+00:00, run_start_date=2024-04-14 23:10:00.504958+00:00, run_end_date=2024-04-14 23:10:02.231283+00:00, run_duration=1.726325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:08:00+00:00, data_interval_end=2024-04-14 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:10:02.244913511Z [2024-04-14T23:10:02.244+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:12:00+00:00 2024-04-14T23:10:02.269302748Z [2024-04-14T23:10:02.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:10:02.269533017Z [2024-04-14T23:10:02.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:09:00+00:00, run_id=scheduled__2024-04-14T23:09:00+00:00, run_start_date=2024-04-14 23:10:00.505855+00:00, run_end_date=2024-04-14 23:10:02.269265+00:00, run_duration=1.76341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:09:00+00:00, data_interval_end=2024-04-14 23:10:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:10:02.282474416Z [2024-04-14T23:10:02.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:11:00+00:00 2024-04-14T23:10:02.314992852Z [2024-04-14T23:10:02.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:09:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:02.320969371Z [2024-04-14T23:10:02.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:09:00+00:00, map_index=-1, run_start_date=2024-04-14 23:10:01.415166+00:00, run_end_date=2024-04-14 23:10:01.795894+00:00, run_duration=0.380728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:00.604254+00:00, queued_by_job_id=1, pid=2680 2024-04-14T23:10:03.411228661Z [2024-04-14T23:10:03.410+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:10:03.411278117Z 2024-04-14T23:10:03.411462053Z [2024-04-14T23:10:03.411+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:10:03.412017243Z [2024-04-14T23:10:03.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:10:03.412028235Z 2024-04-14T23:10:03.413872977Z [2024-04-14T23:10:03.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:10:03.414178881Z [2024-04-14T23:10:03.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:10:03.475038674Z [2024-04-14T23:10:03.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:03.475271053Z [2024-04-14T23:10:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:08:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:03.487291484Z [2024-04-14T23:10:03.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:08:00+00:00, map_index=-1, run_start_date=2024-04-14 23:10:01.772959+00:00, run_end_date=2024-04-14 23:10:02.132308+00:00, run_duration=0.359349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:00.604254+00:00, queued_by_job_id=1, pid=2687 2024-04-14T23:10:03.487547493Z [2024-04-14T23:10:03.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2816e0fc-5b2d-4d6c-b79b-d972649c263c 2024-04-14T23:10:03.617159334Z [2024-04-14T23:10:03.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:03.622132736Z [2024-04-14T23:10:03.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:05:00+00:00, map_index=-1, run_start_date=2024-04-14 23:10:02.811841+00:00, run_end_date=2024-04-14 23:10:03.324738+00:00, run_duration=0.512897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:00.604254+00:00, queued_by_job_id=1, pid=2710 2024-04-14T23:10:04.416184626Z [2024-04-14T23:10:04.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:10:04.416425894Z [2024-04-14T23:10:04.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:09:00+00:00, run_id=scheduled__2024-04-14T23:09:00+00:00, run_start_date=2024-04-14 23:10:00.506702+00:00, run_end_date=2024-04-14 23:10:04.416187+00:00, run_duration=3.909485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:09:00+00:00, data_interval_end=2024-04-14 23:10:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:10:04.425962212Z [2024-04-14T23:10:04.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:11:00+00:00 2024-04-14T23:10:04.496514617Z [2024-04-14T23:10:04.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:09:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:04.506147873Z [2024-04-14T23:10:04.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:09:00+00:00, map_index=-1, run_start_date=2024-04-14 23:10:02.880378+00:00, run_end_date=2024-04-14 23:10:04.193004+00:00, run_duration=1.312626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:00.604254+00:00, queued_by_job_id=1, pid=2711 2024-04-14T23:10:05.576418652Z [2024-04-14T23:10:05.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:10:05.576717086Z [2024-04-14T23:10:05.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:09:00+00:00, run_id=scheduled__2024-04-14T23:09:00+00:00, run_start_date=2024-04-14 23:10:00.507751+00:00, run_end_date=2024-04-14 23:10:05.576213+00:00, run_duration=5.068462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:09:00+00:00, data_interval_end=2024-04-14 23:10:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:10:05.588336402Z [2024-04-14T23:10:05.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:11:00+00:00 2024-04-14T23:10:05.623083186Z [2024-04-14T23:10:05.622+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:10:05.623124456Z 2024-04-14T23:10:05.623145215Z [2024-04-14T23:10:05.622+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:10:05.623685125Z [2024-04-14T23:10:05.623+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:10:05.623698303Z 2024-04-14T23:10:05.627977285Z [2024-04-14T23:10:05.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:10:05.629542956Z [2024-04-14T23:10:05.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:10:05.699477594Z [2024-04-14T23:10:05.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:05.699599347Z [2024-04-14T23:10:05.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:09:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:05.699723008Z [2024-04-14T23:10:05.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:05.709843730Z [2024-04-14T23:10:05.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:09:00+00:00, map_index=-1, run_start_date=2024-04-14 23:10:03.143191+00:00, run_end_date=2024-04-14 23:10:04.748355+00:00, run_duration=1.605164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:00.604254+00:00, queued_by_job_id=1, pid=2712 2024-04-14T23:10:05.710178804Z [2024-04-14T23:10:05.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a864f8e-9675-42aa-a080-c3581aaeff7c 2024-04-14T23:10:05.710423777Z [2024-04-14T23:10:05.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:05:00+00:00, map_index=-1, run_start_date=2024-04-14 23:10:04.956884+00:00, run_end_date=2024-04-14 23:10:05.357971+00:00, run_duration=0.401087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:03.412298+00:00, queued_by_job_id=1, pid=2735 2024-04-14T23:10:07.614681958Z [2024-04-14T23:10:07.614+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:10:07.614716235Z 2024-04-14T23:10:07.614951982Z [2024-04-14T23:10:07.614+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:10:07.615705233Z [2024-04-14T23:10:07.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:10:07.615722154Z 2024-04-14T23:10:07.618552808Z [2024-04-14T23:10:07.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:10:07.618769371Z [2024-04-14T23:10:07.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:10:07.707333601Z [2024-04-14T23:10:07.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status queued for try_number 1 2024-04-14T23:10:07.707582581Z [2024-04-14T23:10:07.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:07.714205868Z [2024-04-14T23:10:07.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e6f652c-862a-43b5-8699-52ea42218cc8 2024-04-14T23:10:07.714456404Z [2024-04-14T23:10:07.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:05:00+00:00, map_index=0, run_start_date=2024-04-14 23:10:07.082281+00:00, run_end_date=2024-04-14 23:10:07.398026+00:00, run_duration=0.315745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:05.623979+00:00, queued_by_job_id=1, pid=2743 2024-04-14T23:10:09.947574347Z [2024-04-14T23:10:09.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:10:09.948183927Z [2024-04-14T23:10:09.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:05:00+00:00, run_id=scheduled__2024-04-14T23:05:00+00:00, run_start_date=2024-04-14 23:10:00.503956+00:00, run_end_date=2024-04-14 23:10:09.947710+00:00, run_duration=9.443754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:05:00+00:00, data_interval_end=2024-04-14 23:10:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:10:09.954364003Z [2024-04-14T23:10:09.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:10:00+00:00, run_after=2024-04-14T23:15:00+00:00 2024-04-14T23:10:09.995038751Z [2024-04-14T23:10:09.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:05:00+00:00 exited with status success for try_number 1 2024-04-14T23:10:10.007590634Z [2024-04-14T23:10:10.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:05:00+00:00, map_index=-1, run_start_date=2024-04-14 23:10:09.058613+00:00, run_end_date=2024-04-14 23:10:09.433931+00:00, run_duration=0.375318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:10:07.616205+00:00, queued_by_job_id=1, pid=2751 2024-04-14T23:11:00.010115831Z [2024-04-14T23:11:00.009+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:11:01.040262848Z [2024-04-14T23:11:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:11:00+00:00, run_after=2024-04-14T23:12:00+00:00 2024-04-14T23:11:01.051658525Z [2024-04-14T23:11:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:11:00+00:00, run_after=2024-04-14T23:12:00+00:00 2024-04-14T23:11:01.057029238Z [2024-04-14T23:11:01.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:11:01.105196853Z [2024-04-14T23:11:01.104+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:11:01.105210119Z 2024-04-14T23:11:01.105213331Z 2024-04-14T23:11:01.105216273Z 2024-04-14T23:11:01.105400069Z [2024-04-14T23:11:01.105+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:11:01.105570312Z [2024-04-14T23:11:01.105+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:11:01.105743087Z [2024-04-14T23:11:01.105+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:11:01.106292196Z [2024-04-14T23:11:01.106+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:11:01.106301842Z 2024-04-14T23:11:01.106314008Z 2024-04-14T23:11:01.106317088Z 2024-04-14T23:11:01.108762831Z [2024-04-14T23:11:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:11:01.108932636Z [2024-04-14T23:11:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:11:01.109280719Z [2024-04-14T23:11:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:11:01.109431978Z [2024-04-14T23:11:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:11:01.109682379Z [2024-04-14T23:11:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:11:01.109831617Z [2024-04-14T23:11:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:11:01.347357897Z [2024-04-14T23:11:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:11:01.348390574Z [2024-04-14T23:11:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:11:01.348562237Z [2024-04-14T23:11:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:11:01.355697371Z [2024-04-14T23:11:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to d511a3ee-24fc-4331-9a62-897340bbb56c 2024-04-14T23:11:01.355905327Z [2024-04-14T23:11:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to b363c320-0a09-4f40-a57c-3dac732cf66b 2024-04-14T23:11:01.356011865Z [2024-04-14T23:11:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2d73fad-5312-492a-acfa-4063664504f2 2024-04-14T23:11:03.040760350Z [2024-04-14T23:11:03.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:11:03.041159963Z [2024-04-14T23:11:03.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:10:00+00:00, run_id=scheduled__2024-04-14T23:10:00+00:00, run_start_date=2024-04-14 23:11:01.066051+00:00, run_end_date=2024-04-14 23:11:03.040657+00:00, run_duration=1.974606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:10:00+00:00, data_interval_end=2024-04-14 23:11:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:11:03.048836626Z [2024-04-14T23:11:03.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:11:00+00:00, run_after=2024-04-14T23:12:00+00:00 2024-04-14T23:11:03.093461087Z [2024-04-14T23:11:03.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:11:03.100296160Z [2024-04-14T23:11:03.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=-1, run_start_date=2024-04-14 23:11:01.784894+00:00, run_end_date=2024-04-14 23:11:02.136846+00:00, run_duration=0.351952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:11:01.106988+00:00, queued_by_job_id=1, pid=2774 2024-04-14T23:11:04.161280203Z [2024-04-14T23:11:04.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:11:04.162102860Z [2024-04-14T23:11:04.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:10:00+00:00, run_id=scheduled__2024-04-14T23:10:00+00:00, run_start_date=2024-04-14 23:11:01.067071+00:00, run_end_date=2024-04-14 23:11:04.161479+00:00, run_duration=3.094408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:10:00+00:00, data_interval_end=2024-04-14 23:11:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:11:04.174115756Z [2024-04-14T23:11:04.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:11:00+00:00, run_after=2024-04-14T23:12:00+00:00 2024-04-14T23:11:04.208625940Z [2024-04-14T23:11:04.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:11:04.213145062Z [2024-04-14T23:11:04.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=-1, run_start_date=2024-04-14 23:11:02.827373+00:00, run_end_date=2024-04-14 23:11:04.028114+00:00, run_duration=1.200741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:11:01.106988+00:00, queued_by_job_id=1, pid=2793 2024-04-14T23:11:04.570747337Z [2024-04-14T23:11:04.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:11:04.571144762Z [2024-04-14T23:11:04.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:10:00+00:00, run_id=scheduled__2024-04-14T23:10:00+00:00, run_start_date=2024-04-14 23:11:01.068004+00:00, run_end_date=2024-04-14 23:11:04.570696+00:00, run_duration=3.502692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:10:00+00:00, data_interval_end=2024-04-14 23:11:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:11:04.580469779Z [2024-04-14T23:11:04.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:11:00+00:00, run_after=2024-04-14T23:12:00+00:00 2024-04-14T23:11:05.685489009Z [2024-04-14T23:11:05.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:11:05.693460402Z [2024-04-14T23:11:05.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=-1, run_start_date=2024-04-14 23:11:02.814213+00:00, run_end_date=2024-04-14 23:11:04.488551+00:00, run_duration=1.674338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:11:01.106988+00:00, queued_by_job_id=1, pid=2792 2024-04-14T23:12:00.922829697Z [2024-04-14T23:12:00.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:12:00+00:00, run_after=2024-04-14T23:13:00+00:00 2024-04-14T23:12:00.932270626Z [2024-04-14T23:12:00.931+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:12:00.948455539Z [2024-04-14T23:12:00.947+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:12:00+00:00, run_after=2024-04-14T23:13:00+00:00 2024-04-14T23:12:00.956162752Z [2024-04-14T23:12:00.955+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:12:01.070617837Z [2024-04-14T23:12:01.070+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:12:01.070659442Z 2024-04-14T23:12:01.070670861Z 2024-04-14T23:12:01.070690334Z 2024-04-14T23:12:01.070716910Z 2024-04-14T23:12:01.070824440Z [2024-04-14T23:12:01.070+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:12:01.070920891Z [2024-04-14T23:12:01.070+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:12:01.071105807Z [2024-04-14T23:12:01.070+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:12:01.071246271Z [2024-04-14T23:12:01.071+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:12:01.071785097Z [2024-04-14T23:12:01.071+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:12:01.071803572Z 2024-04-14T23:12:01.071817202Z 2024-04-14T23:12:01.071826687Z 2024-04-14T23:12:01.071835534Z 2024-04-14T23:12:01.075416685Z [2024-04-14T23:12:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:12:01.075723405Z [2024-04-14T23:12:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:12:01.076085813Z [2024-04-14T23:12:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:12:01.076295098Z [2024-04-14T23:12:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:12:01.076674643Z [2024-04-14T23:12:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:12:01.076943983Z [2024-04-14T23:12:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:12:01.077543708Z [2024-04-14T23:12:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:12:01.077854335Z [2024-04-14T23:12:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:12:01.614118804Z [2024-04-14T23:12:01.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:12:01.614332008Z [2024-04-14T23:12:01.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:11:00+00:00 exited with status queued for try_number 1 2024-04-14T23:12:01.615036490Z [2024-04-14T23:12:01.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:11:00+00:00 exited with status queued for try_number 1 2024-04-14T23:12:01.615199459Z [2024-04-14T23:12:01.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:11:00+00:00 exited with status queued for try_number 1 2024-04-14T23:12:01.630085919Z [2024-04-14T23:12:01.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76e07639-e228-4894-8ac6-b54bb04d6fa9 2024-04-14T23:12:01.630336737Z [2024-04-14T23:12:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to be223c59-1acf-4cb8-88ed-748294c8ba8b 2024-04-14T23:12:01.630467753Z [2024-04-14T23:12:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba81deb4-b19c-4030-a7c7-757a3c5cc093 2024-04-14T23:12:01.630578267Z [2024-04-14T23:12:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42a7266b-4754-4cb5-962a-cae3d51b28b8 2024-04-14T23:12:02.796443469Z [2024-04-14T23:12:02.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:12:02.797447366Z [2024-04-14T23:12:02.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:10:00+00:00, run_id=scheduled__2024-04-14T23:10:00+00:00, run_start_date=2024-04-14 23:12:00.981507+00:00, run_end_date=2024-04-14 23:12:02.796584+00:00, run_duration=1.815077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:10:00+00:00, data_interval_end=2024-04-14 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:12:02.814800197Z [2024-04-14T23:12:02.812+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:12:00+00:00, run_after=2024-04-14T23:14:00+00:00 2024-04-14T23:12:02.854504854Z [2024-04-14T23:12:02.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:12:02.854521612Z [2024-04-14T23:12:02.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:11:00+00:00, run_id=scheduled__2024-04-14T23:11:00+00:00, run_start_date=2024-04-14 23:12:00.983911+00:00, run_end_date=2024-04-14 23:12:02.851566+00:00, run_duration=1.867655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:11:00+00:00, data_interval_end=2024-04-14 23:12:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:12:02.872293840Z [2024-04-14T23:12:02.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:12:00+00:00, run_after=2024-04-14T23:13:00+00:00 2024-04-14T23:12:02.941058527Z [2024-04-14T23:12:02.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:12:02.946437270Z [2024-04-14T23:12:02.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:11:00+00:00 exited with status success for try_number 1 2024-04-14T23:12:02.951982928Z [2024-04-14T23:12:02.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:11:00+00:00, map_index=-1, run_start_date=2024-04-14 23:12:01.965911+00:00, run_end_date=2024-04-14 23:12:02.395251+00:00, run_duration=0.42934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:12:01.072503+00:00, queued_by_job_id=1, pid=2827 2024-04-14T23:12:02.952516840Z [2024-04-14T23:12:02.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=-1, run_start_date=2024-04-14 23:12:01.762869+00:00, run_end_date=2024-04-14 23:12:02.146477+00:00, run_duration=0.383608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:12:01.072503+00:00, queued_by_job_id=1, pid=2826 2024-04-14T23:12:05.772600721Z [2024-04-14T23:12:05.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:12:05.773289937Z [2024-04-14T23:12:05.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:11:00+00:00, run_id=scheduled__2024-04-14T23:11:00+00:00, run_start_date=2024-04-14 23:12:00.986106+00:00, run_end_date=2024-04-14 23:12:05.772408+00:00, run_duration=4.786302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:11:00+00:00, data_interval_end=2024-04-14 23:12:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:12:05.789712558Z [2024-04-14T23:12:05.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:12:00+00:00, run_after=2024-04-14T23:13:00+00:00 2024-04-14T23:12:05.798939562Z [2024-04-14T23:12:05.798+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:12:05.799379417Z [2024-04-14T23:12:05.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:11:00+00:00, run_id=scheduled__2024-04-14T23:11:00+00:00, run_start_date=2024-04-14 23:12:00.987868+00:00, run_end_date=2024-04-14 23:12:05.798755+00:00, run_duration=4.810887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:11:00+00:00, data_interval_end=2024-04-14 23:12:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:12:05.809854795Z [2024-04-14T23:12:05.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:12:00+00:00, run_after=2024-04-14T23:13:00+00:00 2024-04-14T23:12:05.848970754Z [2024-04-14T23:12:05.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:11:00+00:00 exited with status success for try_number 1 2024-04-14T23:12:05.849005058Z [2024-04-14T23:12:05.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:11:00+00:00 exited with status success for try_number 1 2024-04-14T23:12:05.857273347Z [2024-04-14T23:12:05.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:11:00+00:00, map_index=-1, run_start_date=2024-04-14 23:12:02.743252+00:00, run_end_date=2024-04-14 23:12:04.900879+00:00, run_duration=2.157627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:12:01.072503+00:00, queued_by_job_id=1, pid=2850 2024-04-14T23:12:05.857543846Z [2024-04-14T23:12:05.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:11:00+00:00, map_index=-1, run_start_date=2024-04-14 23:12:02.769397+00:00, run_end_date=2024-04-14 23:12:05.283436+00:00, run_duration=2.514039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:12:01.072503+00:00, queued_by_job_id=1, pid=2851 2024-04-14T23:13:00.874653427Z [2024-04-14T23:13:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:13:00+00:00, run_after=2024-04-14T23:14:00+00:00 2024-04-14T23:13:00.888835002Z [2024-04-14T23:13:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:13:00+00:00, run_after=2024-04-14T23:14:00+00:00 2024-04-14T23:13:00.897081940Z [2024-04-14T23:13:00.896+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:13:00.974608207Z [2024-04-14T23:13:00.974+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:13:00.974648931Z 2024-04-14T23:13:00.974690931Z 2024-04-14T23:13:00.974696567Z 2024-04-14T23:13:00.975045431Z [2024-04-14T23:13:00.974+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:13:00.975561920Z [2024-04-14T23:13:00.974+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:13:00.975975749Z [2024-04-14T23:13:00.975+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:13:00.977167676Z [2024-04-14T23:13:00.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:13:00.977189393Z 2024-04-14T23:13:00.977196691Z 2024-04-14T23:13:00.977203565Z 2024-04-14T23:13:00.982710678Z [2024-04-14T23:13:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:13:00.983181374Z [2024-04-14T23:13:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:13:00.983733045Z [2024-04-14T23:13:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:13:00.984106549Z [2024-04-14T23:13:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:13:00.984594139Z [2024-04-14T23:13:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:13:00.984940487Z [2024-04-14T23:13:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:13:01.199952782Z [2024-04-14T23:13:01.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status queued for try_number 1 2024-04-14T23:13:01.200142669Z [2024-04-14T23:13:01.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status queued for try_number 1 2024-04-14T23:13:01.200332876Z [2024-04-14T23:13:01.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status queued for try_number 1 2024-04-14T23:13:01.208182589Z [2024-04-14T23:13:01.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1868f064-26a5-40de-b30b-6fc6f20a93a6 2024-04-14T23:13:01.208395397Z [2024-04-14T23:13:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f484d66-1601-467f-a501-510d9240b8e6 2024-04-14T23:13:01.208596334Z [2024-04-14T23:13:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to f61f1d8b-fcbf-46b5-9913-babf21fb89bb 2024-04-14T23:13:02.347896859Z [2024-04-14T23:13:02.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:13:02.348576319Z [2024-04-14T23:13:02.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:12:00+00:00, run_id=scheduled__2024-04-14T23:12:00+00:00, run_start_date=2024-04-14 23:13:00.909363+00:00, run_end_date=2024-04-14 23:13:02.348204+00:00, run_duration=1.438841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:12:00+00:00, data_interval_end=2024-04-14 23:13:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:13:02.357573596Z [2024-04-14T23:13:02.357+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:13:00+00:00, run_after=2024-04-14T23:14:00+00:00 2024-04-14T23:13:02.400594832Z [2024-04-14T23:13:02.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status success for try_number 1 2024-04-14T23:13:02.408400365Z [2024-04-14T23:13:02.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:12:00+00:00, map_index=-1, run_start_date=2024-04-14 23:13:01.678105+00:00, run_end_date=2024-04-14 23:13:02.036379+00:00, run_duration=0.358274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:13:00.978485+00:00, queued_by_job_id=1, pid=2883 2024-04-14T23:13:04.748350843Z [2024-04-14T23:13:04.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:13:04.748813365Z [2024-04-14T23:13:04.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:12:00+00:00, run_id=scheduled__2024-04-14T23:12:00+00:00, run_start_date=2024-04-14 23:13:00.911799+00:00, run_end_date=2024-04-14 23:13:04.748481+00:00, run_duration=3.836682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:12:00+00:00, data_interval_end=2024-04-14 23:13:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:13:04.761586446Z [2024-04-14T23:13:04.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:13:00+00:00, run_after=2024-04-14T23:14:00+00:00 2024-04-14T23:13:05.868280790Z [2024-04-14T23:13:05.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:13:05.868508754Z [2024-04-14T23:13:05.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:12:00+00:00, run_id=scheduled__2024-04-14T23:12:00+00:00, run_start_date=2024-04-14 23:13:00.910702+00:00, run_end_date=2024-04-14 23:13:05.868084+00:00, run_duration=4.957382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:12:00+00:00, data_interval_end=2024-04-14 23:13:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:13:05.881642276Z [2024-04-14T23:13:05.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:13:00+00:00, run_after=2024-04-14T23:14:00+00:00 2024-04-14T23:13:05.938994886Z [2024-04-14T23:13:05.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status success for try_number 1 2024-04-14T23:13:05.939037913Z [2024-04-14T23:13:05.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status success for try_number 1 2024-04-14T23:13:05.950555710Z [2024-04-14T23:13:05.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:12:00+00:00, map_index=-1, run_start_date=2024-04-14 23:13:02.540616+00:00, run_end_date=2024-04-14 23:13:04.714666+00:00, run_duration=2.17405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:13:00.978485+00:00, queued_by_job_id=1, pid=2896 2024-04-14T23:13:05.951007003Z [2024-04-14T23:13:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:12:00+00:00, map_index=-1, run_start_date=2024-04-14 23:13:02.836534+00:00, run_end_date=2024-04-14 23:13:04.650531+00:00, run_duration=1.813997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:13:00.978485+00:00, queued_by_job_id=1, pid=2907 2024-04-14T23:14:00.801121817Z [2024-04-14T23:14:00.800+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:14:00.811294944Z [2024-04-14T23:14:00.810+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:14:00.829742662Z [2024-04-14T23:14:00.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:14:00+00:00, run_after=2024-04-14T23:15:00+00:00 2024-04-14T23:14:00.843384300Z [2024-04-14T23:14:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:14:00+00:00, run_after=2024-04-14T23:15:00+00:00 2024-04-14T23:14:00.928450413Z [2024-04-14T23:14:00.927+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:14:00.928555158Z 2024-04-14T23:14:00.928595812Z 2024-04-14T23:14:00.928602646Z 2024-04-14T23:14:00.928608717Z 2024-04-14T23:14:00.928969081Z [2024-04-14T23:14:00.928+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:14:00.929578565Z [2024-04-14T23:14:00.929+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:14:00.930087911Z [2024-04-14T23:14:00.929+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:14:00.930697397Z [2024-04-14T23:14:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:14:00.932740163Z [2024-04-14T23:14:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:14:00.932760680Z 2024-04-14T23:14:00.932767472Z 2024-04-14T23:14:00.932773471Z 2024-04-14T23:14:00.932779369Z 2024-04-14T23:14:00.940426220Z [2024-04-14T23:14:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:14:00.940906617Z [2024-04-14T23:14:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:14:00.941623901Z [2024-04-14T23:14:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:14:00.942019960Z [2024-04-14T23:14:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:14:00.942410413Z [2024-04-14T23:14:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:14:00.942652558Z [2024-04-14T23:14:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:14:00.943209682Z [2024-04-14T23:14:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:14:00.943453686Z [2024-04-14T23:14:00.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:14:01.408331104Z [2024-04-14T23:14:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status queued for try_number 1 2024-04-14T23:14:01.408421014Z [2024-04-14T23:14:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:13:00+00:00 exited with status queued for try_number 1 2024-04-14T23:14:01.408519236Z [2024-04-14T23:14:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:13:00+00:00 exited with status queued for try_number 1 2024-04-14T23:14:01.408596715Z [2024-04-14T23:14:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:13:00+00:00 exited with status queued for try_number 1 2024-04-14T23:14:01.421071099Z [2024-04-14T23:14:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2f38442-8144-413b-93d3-b1ecee6b107d 2024-04-14T23:14:01.421144883Z [2024-04-14T23:14:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to 274bb1cd-4447-453a-83f8-078ff2baae2b 2024-04-14T23:14:01.421274836Z [2024-04-14T23:14:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b625724-442f-4e6f-892a-b7f2a4568d96 2024-04-14T23:14:01.421390264Z [2024-04-14T23:14:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecd0f5b4-3dd4-4e5f-983d-94faaf8d9399 2024-04-14T23:14:02.554428788Z [2024-04-14T23:14:02.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:14:02.554645940Z [2024-04-14T23:14:02.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:12:00+00:00, run_id=scheduled__2024-04-14T23:12:00+00:00, run_start_date=2024-04-14 23:14:00.855653+00:00, run_end_date=2024-04-14 23:14:02.554299+00:00, run_duration=1.698646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:12:00+00:00, data_interval_end=2024-04-14 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:14:02.561239195Z [2024-04-14T23:14:02.560+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:14:00+00:00, run_after=2024-04-14T23:16:00+00:00 2024-04-14T23:14:02.575941552Z [2024-04-14T23:14:02.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:14:02.576938208Z [2024-04-14T23:14:02.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:13:00+00:00, run_id=scheduled__2024-04-14T23:13:00+00:00, run_start_date=2024-04-14 23:14:00.856820+00:00, run_end_date=2024-04-14 23:14:02.576445+00:00, run_duration=1.719625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:13:00+00:00, data_interval_end=2024-04-14 23:14:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:14:02.586293090Z [2024-04-14T23:14:02.586+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:14:00+00:00, run_after=2024-04-14T23:15:00+00:00 2024-04-14T23:14:02.615380417Z [2024-04-14T23:14:02.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:12:00+00:00 exited with status success for try_number 1 2024-04-14T23:14:02.615425718Z [2024-04-14T23:14:02.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:13:00+00:00 exited with status success for try_number 1 2024-04-14T23:14:02.620429141Z [2024-04-14T23:14:02.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:12:00+00:00, map_index=-1, run_start_date=2024-04-14 23:14:01.639985+00:00, run_end_date=2024-04-14 23:14:02.082708+00:00, run_duration=0.442723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:14:00.934847+00:00, queued_by_job_id=1, pid=2935 2024-04-14T23:14:02.620572764Z [2024-04-14T23:14:02.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:13:00+00:00, map_index=-1, run_start_date=2024-04-14 23:14:01.817363+00:00, run_end_date=2024-04-14 23:14:02.243703+00:00, run_duration=0.42634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:14:00.934847+00:00, queued_by_job_id=1, pid=2936 2024-04-14T23:14:04.759220693Z [2024-04-14T23:14:04.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:14:04.759682959Z [2024-04-14T23:14:04.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:13:00+00:00, run_id=scheduled__2024-04-14T23:13:00+00:00, run_start_date=2024-04-14 23:14:00.857840+00:00, run_end_date=2024-04-14 23:14:04.759070+00:00, run_duration=3.90123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:13:00+00:00, data_interval_end=2024-04-14 23:14:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:14:04.768442784Z [2024-04-14T23:14:04.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:14:00+00:00, run_after=2024-04-14T23:15:00+00:00 2024-04-14T23:14:04.822048526Z [2024-04-14T23:14:04.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:13:00+00:00 exited with status success for try_number 1 2024-04-14T23:14:04.827391106Z [2024-04-14T23:14:04.827+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:13:00+00:00, map_index=-1, run_start_date=2024-04-14 23:14:03.089500+00:00, run_end_date=2024-04-14 23:14:04.402377+00:00, run_duration=1.312877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:14:00.934847+00:00, queued_by_job_id=1, pid=2960 2024-04-14T23:14:05.902516566Z [2024-04-14T23:14:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:14:05.903092024Z [2024-04-14T23:14:05.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:13:00+00:00, run_id=scheduled__2024-04-14T23:13:00+00:00, run_start_date=2024-04-14 23:14:00.858937+00:00, run_end_date=2024-04-14 23:14:05.902340+00:00, run_duration=5.043403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:13:00+00:00, data_interval_end=2024-04-14 23:14:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:14:05.912365858Z [2024-04-14T23:14:05.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:14:00+00:00, run_after=2024-04-14T23:15:00+00:00 2024-04-14T23:14:05.948000640Z [2024-04-14T23:14:05.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:13:00+00:00 exited with status success for try_number 1 2024-04-14T23:14:05.954489244Z [2024-04-14T23:14:05.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:13:00+00:00, map_index=-1, run_start_date=2024-04-14 23:14:02.925850+00:00, run_end_date=2024-04-14 23:14:04.752089+00:00, run_duration=1.826239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:14:00.934847+00:00, queued_by_job_id=1, pid=2959 2024-04-14T23:15:00.469304379Z [2024-04-14T23:15:00.468+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:15:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:15:00.478929220Z [2024-04-14T23:15:00.478+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:15:00.492535808Z [2024-04-14T23:15:00.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:15:00+00:00, run_after=2024-04-14T23:16:00+00:00 2024-04-14T23:15:00.503825966Z [2024-04-14T23:15:00.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:15:00+00:00, run_after=2024-04-14T23:16:00+00:00 2024-04-14T23:15:00.592175792Z [2024-04-14T23:15:00.591+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:15:00.592198696Z 2024-04-14T23:15:00.592203282Z 2024-04-14T23:15:00.592206937Z 2024-04-14T23:15:00.592210442Z 2024-04-14T23:15:00.592355980Z [2024-04-14T23:15:00.592+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:15:00.592560761Z [2024-04-14T23:15:00.592+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:15:00.592712310Z [2024-04-14T23:15:00.592+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:15:00.592869197Z [2024-04-14T23:15:00.592+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:15:00.593534120Z [2024-04-14T23:15:00.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:15:00.593551043Z 2024-04-14T23:15:00.593555845Z 2024-04-14T23:15:00.593559381Z 2024-04-14T23:15:00.593562642Z 2024-04-14T23:15:00.598039747Z [2024-04-14T23:15:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:15:00.598356333Z [2024-04-14T23:15:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:15:00.598743685Z [2024-04-14T23:15:00.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:15:00.599062173Z [2024-04-14T23:15:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:15:00.599449029Z [2024-04-14T23:15:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:15:00.599701269Z [2024-04-14T23:15:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:15:00.600068481Z [2024-04-14T23:15:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:15:00.600368657Z [2024-04-14T23:15:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:15:00.979928526Z [2024-04-14T23:15:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:15:00.979957460Z [2024-04-14T23:15:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status queued for try_number 1 2024-04-14T23:15:00.980091266Z [2024-04-14T23:15:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status queued for try_number 1 2024-04-14T23:15:00.980173537Z [2024-04-14T23:15:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status queued for try_number 1 2024-04-14T23:15:00.993435980Z [2024-04-14T23:15:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 651db062-21db-41e4-b52a-2d0fe8a070ef 2024-04-14T23:15:00.997627872Z [2024-04-14T23:15:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4da821f9-9889-4e14-8125-99ebd5633c6c 2024-04-14T23:15:00.997807410Z [2024-04-14T23:15:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1aa0022-1a90-44c1-b68b-5c7dffa3b03e 2024-04-14T23:15:00.997956275Z [2024-04-14T23:15:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76869cf1-aa15-4493-a3a9-5df838572945 2024-04-14T23:15:02.319467219Z [2024-04-14T23:15:02.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:15:02.320219503Z [2024-04-14T23:15:02.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:14:00+00:00, run_id=scheduled__2024-04-14T23:14:00+00:00, run_start_date=2024-04-14 23:15:00.515413+00:00, run_end_date=2024-04-14 23:15:02.319405+00:00, run_duration=1.803992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:14:00+00:00, data_interval_end=2024-04-14 23:15:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:15:02.330108699Z [2024-04-14T23:15:02.329+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:15:00+00:00, run_after=2024-04-14T23:16:00+00:00 2024-04-14T23:15:02.364116131Z [2024-04-14T23:15:02.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status success for try_number 1 2024-04-14T23:15:02.372199246Z [2024-04-14T23:15:02.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:14:00+00:00, map_index=-1, run_start_date=2024-04-14 23:15:01.424611+00:00, run_end_date=2024-04-14 23:15:01.779341+00:00, run_duration=0.35473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:15:00.594577+00:00, queued_by_job_id=1, pid=2993 2024-04-14T23:15:03.473411550Z [2024-04-14T23:15:03.472+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:15:03.473472558Z 2024-04-14T23:15:03.473522200Z [2024-04-14T23:15:03.473+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:15:03.474357950Z [2024-04-14T23:15:03.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:15:03.474381657Z 2024-04-14T23:15:03.478211221Z [2024-04-14T23:15:03.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:15:03.478422170Z [2024-04-14T23:15:03.478+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:15:03.571464033Z [2024-04-14T23:15:03.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:15:03.571496202Z [2024-04-14T23:15:03.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:15:03.577187266Z [2024-04-14T23:15:03.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f31187a-ee17-4f1b-b65c-3b549738491c 2024-04-14T23:15:03.577346384Z [2024-04-14T23:15:03.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=-1, run_start_date=2024-04-14 23:15:02.446499+00:00, run_end_date=2024-04-14 23:15:02.784538+00:00, run_duration=0.338039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:15:00.594577+00:00, queued_by_job_id=1, pid=3019 2024-04-14T23:15:03.617238375Z [2024-04-14T23:15:03.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:15:03.617403146Z [2024-04-14T23:15:03.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:14:00+00:00, run_id=scheduled__2024-04-14T23:14:00+00:00, run_start_date=2024-04-14 23:15:00.516453+00:00, run_end_date=2024-04-14 23:15:03.617081+00:00, run_duration=3.100628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:14:00+00:00, data_interval_end=2024-04-14 23:15:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:15:03.627976873Z [2024-04-14T23:15:03.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:15:00+00:00, run_after=2024-04-14T23:16:00+00:00 2024-04-14T23:15:04.743586700Z [2024-04-14T23:15:04.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:15:04.744121978Z [2024-04-14T23:15:04.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:14:00+00:00, run_id=scheduled__2024-04-14T23:14:00+00:00, run_start_date=2024-04-14 23:15:00.517437+00:00, run_end_date=2024-04-14 23:15:04.743623+00:00, run_duration=4.226186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:14:00+00:00, data_interval_end=2024-04-14 23:15:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:15:04.755733527Z [2024-04-14T23:15:04.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:15:00+00:00, run_after=2024-04-14T23:16:00+00:00 2024-04-14T23:15:04.810311843Z [2024-04-14T23:15:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status success for try_number 1 2024-04-14T23:15:04.810641019Z [2024-04-14T23:15:04.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status success for try_number 1 2024-04-14T23:15:04.818423431Z [2024-04-14T23:15:04.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:14:00+00:00, map_index=-1, run_start_date=2024-04-14 23:15:02.299947+00:00, run_end_date=2024-04-14 23:15:03.908176+00:00, run_duration=1.608229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:15:00.594577+00:00, queued_by_job_id=1, pid=3017 2024-04-14T23:15:04.818856718Z [2024-04-14T23:15:04.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:14:00+00:00, map_index=-1, run_start_date=2024-04-14 23:15:02.411260+00:00, run_end_date=2024-04-14 23:15:03.535445+00:00, run_duration=1.124185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:15:00.594577+00:00, queued_by_job_id=1, pid=3018 2024-04-14T23:15:06.049003838Z [2024-04-14T23:15:06.047+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:15:06.049021087Z 2024-04-14T23:15:06.049024026Z [2024-04-14T23:15:06.048+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:15:06.050228332Z [2024-04-14T23:15:06.050+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:15:06.050242675Z 2024-04-14T23:15:06.054067259Z [2024-04-14T23:15:06.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:15:06.055420396Z [2024-04-14T23:15:06.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:15:06.108663431Z [2024-04-14T23:15:06.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:15:06.109237491Z [2024-04-14T23:15:06.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:15:06.116731929Z [2024-04-14T23:15:06.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd2743c0-6401-48e6-a701-0e7eb0eaf115 2024-04-14T23:15:06.117195211Z [2024-04-14T23:15:06.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=-1, run_start_date=2024-04-14 23:15:05.006709+00:00, run_end_date=2024-04-14 23:15:05.360514+00:00, run_duration=0.353805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:15:03.474707+00:00, queued_by_job_id=1, pid=3042 2024-04-14T23:15:08.352693718Z [2024-04-14T23:15:08.352+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:15:08.352727618Z 2024-04-14T23:15:08.353092410Z [2024-04-14T23:15:08.352+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:15:08.353886146Z [2024-04-14T23:15:08.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:15:08.353901215Z 2024-04-14T23:15:08.373236469Z [2024-04-14T23:15:08.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:15:08.373257778Z [2024-04-14T23:15:08.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:15:08.456709921Z [2024-04-14T23:15:08.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status queued for try_number 1 2024-04-14T23:15:08.456759223Z [2024-04-14T23:15:08.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:15:08.461993694Z [2024-04-14T23:15:08.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa29bf03-0c2d-4c53-a0c1-1b84c9fa987c 2024-04-14T23:15:08.462249828Z [2024-04-14T23:15:08.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=0, run_start_date=2024-04-14 23:15:07.467150+00:00, run_end_date=2024-04-14 23:15:07.776073+00:00, run_duration=0.308923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:15:06.051075+00:00, queued_by_job_id=1, pid=3050 2024-04-14T23:15:10.712601999Z [2024-04-14T23:15:10.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:15:10.713172248Z [2024-04-14T23:15:10.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:10:00+00:00, run_id=scheduled__2024-04-14T23:10:00+00:00, run_start_date=2024-04-14 23:15:00.514046+00:00, run_end_date=2024-04-14 23:15:10.712417+00:00, run_duration=10.198371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:10:00+00:00, data_interval_end=2024-04-14 23:15:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:15:10.724228808Z [2024-04-14T23:15:10.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:15:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:15:10.767083601Z [2024-04-14T23:15:10.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:10:00+00:00 exited with status success for try_number 1 2024-04-14T23:15:10.771735836Z [2024-04-14T23:15:10.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:10:00+00:00, map_index=-1, run_start_date=2024-04-14 23:15:09.850928+00:00, run_end_date=2024-04-14 23:15:10.229732+00:00, run_duration=0.378804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:15:08.354718+00:00, queued_by_job_id=1, pid=3058 2024-04-14T23:16:00.041640442Z [2024-04-14T23:16:00.041+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:16:00.055091816Z [2024-04-14T23:16:00.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:16:00+00:00, run_after=2024-04-14T23:17:00+00:00 2024-04-14T23:16:00.068285351Z [2024-04-14T23:16:00.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:16:00+00:00, run_after=2024-04-14T23:17:00+00:00 2024-04-14T23:16:00.075718899Z [2024-04-14T23:16:00.075+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:16:00.181721766Z [2024-04-14T23:16:00.181+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:16:00.181757423Z 2024-04-14T23:16:00.181767670Z 2024-04-14T23:16:00.181776140Z 2024-04-14T23:16:00.181784061Z 2024-04-14T23:16:00.182112865Z [2024-04-14T23:16:00.181+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:16:00.182513216Z [2024-04-14T23:16:00.182+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:16:00.182805978Z [2024-04-14T23:16:00.182+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:16:00.183178928Z [2024-04-14T23:16:00.182+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:16:00.184528372Z [2024-04-14T23:16:00.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:16:00.184549029Z 2024-04-14T23:16:00.184558154Z 2024-04-14T23:16:00.184566091Z 2024-04-14T23:16:00.184573674Z 2024-04-14T23:16:00.190673545Z [2024-04-14T23:16:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:16:00.191059884Z [2024-04-14T23:16:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:16:00.191634281Z [2024-04-14T23:16:00.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:16:00.191944570Z [2024-04-14T23:16:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:16:00.192451193Z [2024-04-14T23:16:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:16:00.192752508Z [2024-04-14T23:16:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:16:00.193308800Z [2024-04-14T23:16:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:16:00.193581911Z [2024-04-14T23:16:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:16:00.662100267Z [2024-04-14T23:16:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status queued for try_number 1 2024-04-14T23:16:00.662276934Z [2024-04-14T23:16:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status queued for try_number 1 2024-04-14T23:16:00.662439624Z [2024-04-14T23:16:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status queued for try_number 1 2024-04-14T23:16:00.662582917Z [2024-04-14T23:16:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status queued for try_number 1 2024-04-14T23:16:00.679185102Z [2024-04-14T23:16:00.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76893068-09d4-4253-9e6a-647b5a615581 2024-04-14T23:16:00.679484314Z [2024-04-14T23:16:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80335376-1d1d-48e2-aa6c-ebdcf98de138 2024-04-14T23:16:00.679758530Z [2024-04-14T23:16:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba70377d-607a-47d6-a26a-b6332bce78a3 2024-04-14T23:16:00.679903555Z [2024-04-14T23:16:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40fdb488-c671-4905-9577-e381103002d6 2024-04-14T23:16:00.699401484Z [2024-04-14T23:16:00.699+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:16:01.887014654Z [2024-04-14T23:16:01.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:16:01.887472796Z [2024-04-14T23:16:01.887+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:14:00+00:00, run_id=scheduled__2024-04-14T23:14:00+00:00, run_start_date=2024-04-14 23:16:00.089494+00:00, run_end_date=2024-04-14 23:16:01.886861+00:00, run_duration=1.797367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:14:00+00:00, data_interval_end=2024-04-14 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:16:01.914231721Z [2024-04-14T23:16:01.913+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:16:00+00:00, run_after=2024-04-14T23:18:00+00:00 2024-04-14T23:16:01.936756978Z [2024-04-14T23:16:01.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:16:01.938368223Z [2024-04-14T23:16:01.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:15:00+00:00, run_id=scheduled__2024-04-14T23:15:00+00:00, run_start_date=2024-04-14 23:16:00.090686+00:00, run_end_date=2024-04-14 23:16:01.938041+00:00, run_duration=1.847355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:15:00+00:00, data_interval_end=2024-04-14 23:16:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:16:01.948134568Z [2024-04-14T23:16:01.947+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:16:00+00:00, run_after=2024-04-14T23:17:00+00:00 2024-04-14T23:16:01.976658323Z [2024-04-14T23:16:01.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:14:00+00:00 exited with status success for try_number 1 2024-04-14T23:16:01.979832304Z [2024-04-14T23:16:01.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status success for try_number 1 2024-04-14T23:16:01.985161953Z [2024-04-14T23:16:01.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:15:00+00:00, map_index=-1, run_start_date=2024-04-14 23:16:01.134976+00:00, run_end_date=2024-04-14 23:16:01.517375+00:00, run_duration=0.382399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:16:00.186369+00:00, queued_by_job_id=1, pid=3081 2024-04-14T23:16:01.985429438Z [2024-04-14T23:16:01.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:14:00+00:00, map_index=-1, run_start_date=2024-04-14 23:16:00.920621+00:00, run_end_date=2024-04-14 23:16:01.236516+00:00, run_duration=0.315895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:16:00.186369+00:00, queued_by_job_id=1, pid=3080 2024-04-14T23:16:04.149255606Z [2024-04-14T23:16:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:16:04.149626584Z [2024-04-14T23:16:04.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:15:00+00:00, run_id=scheduled__2024-04-14T23:15:00+00:00, run_start_date=2024-04-14 23:16:00.093041+00:00, run_end_date=2024-04-14 23:16:04.149105+00:00, run_duration=4.056064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:15:00+00:00, data_interval_end=2024-04-14 23:16:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:16:04.157397540Z [2024-04-14T23:16:04.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:16:00+00:00, run_after=2024-04-14T23:17:00+00:00 2024-04-14T23:16:04.162853250Z [2024-04-14T23:16:04.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:16:04.163252944Z [2024-04-14T23:16:04.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:15:00+00:00, run_id=scheduled__2024-04-14T23:15:00+00:00, run_start_date=2024-04-14 23:16:00.091966+00:00, run_end_date=2024-04-14 23:16:04.162767+00:00, run_duration=4.070801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:15:00+00:00, data_interval_end=2024-04-14 23:16:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:16:04.171527136Z [2024-04-14T23:16:04.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:16:00+00:00, run_after=2024-04-14T23:17:00+00:00 2024-04-14T23:16:04.214651969Z [2024-04-14T23:16:04.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status success for try_number 1 2024-04-14T23:16:04.215109655Z [2024-04-14T23:16:04.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status success for try_number 1 2024-04-14T23:16:04.225332989Z [2024-04-14T23:16:04.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:15:00+00:00, map_index=-1, run_start_date=2024-04-14 23:16:01.960314+00:00, run_end_date=2024-04-14 23:16:03.498423+00:00, run_duration=1.538109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:16:00.186369+00:00, queued_by_job_id=1, pid=3104 2024-04-14T23:16:04.225880500Z [2024-04-14T23:16:04.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:15:00+00:00, map_index=-1, run_start_date=2024-04-14 23:16:02.006133+00:00, run_end_date=2024-04-14 23:16:03.161313+00:00, run_duration=1.15518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:16:00.186369+00:00, queued_by_job_id=1, pid=3105 2024-04-14T23:17:00.302324864Z [2024-04-14T23:17:00.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:17:00+00:00, run_after=2024-04-14T23:18:00+00:00 2024-04-14T23:17:00.315391744Z [2024-04-14T23:17:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:17:00+00:00, run_after=2024-04-14T23:18:00+00:00 2024-04-14T23:17:00.320398143Z [2024-04-14T23:17:00.319+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:17:00.385517752Z [2024-04-14T23:17:00.383+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:17:00.385553570Z 2024-04-14T23:17:00.385559101Z 2024-04-14T23:17:00.385563536Z 2024-04-14T23:17:00.385568115Z [2024-04-14T23:17:00.383+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:17:00.385572419Z [2024-04-14T23:17:00.383+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:17:00.385576461Z [2024-04-14T23:17:00.383+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:17:00.385582656Z [2024-04-14T23:17:00.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:17:00.385586796Z 2024-04-14T23:17:00.385590822Z 2024-04-14T23:17:00.385594895Z 2024-04-14T23:17:00.387303527Z [2024-04-14T23:17:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:17:00.387403201Z [2024-04-14T23:17:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:17:00.387585443Z [2024-04-14T23:17:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:17:00.387657620Z [2024-04-14T23:17:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:17:00.387814062Z [2024-04-14T23:17:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:17:00.387887860Z [2024-04-14T23:17:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:17:00.629984014Z [2024-04-14T23:17:00.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status queued for try_number 1 2024-04-14T23:17:00.630218424Z [2024-04-14T23:17:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status queued for try_number 1 2024-04-14T23:17:00.631038359Z [2024-04-14T23:17:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status queued for try_number 1 2024-04-14T23:17:00.637279074Z [2024-04-14T23:17:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9eb6f4cf-2f3b-458d-ba60-19632dd093d3 2024-04-14T23:17:00.637443492Z [2024-04-14T23:17:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95bd24f0-f894-4337-aea3-e26b75da26aa 2024-04-14T23:17:00.637622072Z [2024-04-14T23:17:00.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e385c4d-d4ba-4853-a8b1-9eaa1c4ddfc4 2024-04-14T23:17:01.768906356Z [2024-04-14T23:17:01.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:17:01.769772109Z [2024-04-14T23:17:01.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:16:00+00:00, run_id=scheduled__2024-04-14T23:16:00+00:00, run_start_date=2024-04-14 23:17:00.329019+00:00, run_end_date=2024-04-14 23:17:01.768830+00:00, run_duration=1.439811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:16:00+00:00, data_interval_end=2024-04-14 23:17:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:17:01.793608651Z [2024-04-14T23:17:01.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:17:00+00:00, run_after=2024-04-14T23:18:00+00:00 2024-04-14T23:17:01.849161606Z [2024-04-14T23:17:01.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status success for try_number 1 2024-04-14T23:17:01.856807868Z [2024-04-14T23:17:01.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:16:00+00:00, map_index=-1, run_start_date=2024-04-14 23:17:01.085863+00:00, run_end_date=2024-04-14 23:17:01.444676+00:00, run_duration=0.358813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:17:00.384745+00:00, queued_by_job_id=1, pid=3138 2024-04-14T23:17:03.913368624Z [2024-04-14T23:17:03.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:17:03.913992354Z [2024-04-14T23:17:03.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:16:00+00:00, run_id=scheduled__2024-04-14T23:16:00+00:00, run_start_date=2024-04-14 23:17:00.329999+00:00, run_end_date=2024-04-14 23:17:03.913281+00:00, run_duration=3.583282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:16:00+00:00, data_interval_end=2024-04-14 23:17:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:17:03.924890696Z [2024-04-14T23:17:03.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:17:00+00:00, run_after=2024-04-14T23:18:00+00:00 2024-04-14T23:17:03.932321642Z [2024-04-14T23:17:03.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:17:03.932672848Z [2024-04-14T23:17:03.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:16:00+00:00, run_id=scheduled__2024-04-14T23:16:00+00:00, run_start_date=2024-04-14 23:17:00.330932+00:00, run_end_date=2024-04-14 23:17:03.932393+00:00, run_duration=3.601461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:16:00+00:00, data_interval_end=2024-04-14 23:17:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:17:03.942066513Z [2024-04-14T23:17:03.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:17:00+00:00, run_after=2024-04-14T23:18:00+00:00 2024-04-14T23:17:03.992802081Z [2024-04-14T23:17:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status success for try_number 1 2024-04-14T23:17:03.992831326Z [2024-04-14T23:17:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status success for try_number 1 2024-04-14T23:17:03.998552513Z [2024-04-14T23:17:03.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:16:00+00:00, map_index=-1, run_start_date=2024-04-14 23:17:01.907781+00:00, run_end_date=2024-04-14 23:17:03.147992+00:00, run_duration=1.240211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:17:00.384745+00:00, queued_by_job_id=1, pid=3156 2024-04-14T23:17:03.998768588Z [2024-04-14T23:17:03.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:16:00+00:00, map_index=-1, run_start_date=2024-04-14 23:17:01.937166+00:00, run_end_date=2024-04-14 23:17:03.496751+00:00, run_duration=1.559585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:17:00.384745+00:00, queued_by_job_id=1, pid=3157 2024-04-14T23:18:00.670739940Z [2024-04-14T23:18:00.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:18:00+00:00, run_after=2024-04-14T23:19:00+00:00 2024-04-14T23:18:00.678389617Z [2024-04-14T23:18:00.678+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:18:00.690626989Z [2024-04-14T23:18:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:18:00+00:00, run_after=2024-04-14T23:19:00+00:00 2024-04-14T23:18:00.698455629Z [2024-04-14T23:18:00.698+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:18:00.769157901Z [2024-04-14T23:18:00.768+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:18:00.769176427Z 2024-04-14T23:18:00.769180842Z 2024-04-14T23:18:00.769184294Z 2024-04-14T23:18:00.769188005Z 2024-04-14T23:18:00.769236882Z [2024-04-14T23:18:00.769+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:18:00.769379801Z [2024-04-14T23:18:00.769+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:18:00.769506887Z [2024-04-14T23:18:00.769+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:18:00.769632570Z [2024-04-14T23:18:00.769+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:18:00.770206370Z [2024-04-14T23:18:00.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:18:00.770216878Z 2024-04-14T23:18:00.770234993Z 2024-04-14T23:18:00.770238213Z 2024-04-14T23:18:00.770241128Z 2024-04-14T23:18:00.772983179Z [2024-04-14T23:18:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:18:00.773163702Z [2024-04-14T23:18:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:18:00.773406450Z [2024-04-14T23:18:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:18:00.773536243Z [2024-04-14T23:18:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:18:00.773739790Z [2024-04-14T23:18:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:18:00.773867672Z [2024-04-14T23:18:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:18:00.774074255Z [2024-04-14T23:18:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:18:00.774194262Z [2024-04-14T23:18:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:18:01.297805781Z [2024-04-14T23:18:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status queued for try_number 1 2024-04-14T23:18:01.297942524Z [2024-04-14T23:18:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:17:00+00:00 exited with status queued for try_number 1 2024-04-14T23:18:01.297948273Z [2024-04-14T23:18:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:17:00+00:00 exited with status queued for try_number 1 2024-04-14T23:18:01.297969844Z [2024-04-14T23:18:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:17:00+00:00 exited with status queued for try_number 1 2024-04-14T23:18:01.308146179Z [2024-04-14T23:18:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02de6dbd-7aa9-474e-92c5-d398019c3347 2024-04-14T23:18:01.310045340Z [2024-04-14T23:18:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f88b4de-0c84-4a2b-bcf9-0f4eca7eade5 2024-04-14T23:18:01.310235556Z [2024-04-14T23:18:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89f942ca-7123-420f-89eb-92eb047a9ee1 2024-04-14T23:18:01.310457356Z [2024-04-14T23:18:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cbc2bbc-287f-4036-b353-313050cd232b 2024-04-14T23:18:02.546485364Z [2024-04-14T23:18:02.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:18:02.547272111Z [2024-04-14T23:18:02.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:16:00+00:00, run_id=scheduled__2024-04-14T23:16:00+00:00, run_start_date=2024-04-14 23:18:00.709294+00:00, run_end_date=2024-04-14 23:18:02.546383+00:00, run_duration=1.837089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:16:00+00:00, data_interval_end=2024-04-14 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:18:02.556793393Z [2024-04-14T23:18:02.556+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:18:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:18:02.571711442Z [2024-04-14T23:18:02.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:18:02.572026412Z [2024-04-14T23:18:02.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:17:00+00:00, run_id=scheduled__2024-04-14T23:17:00+00:00, run_start_date=2024-04-14 23:18:00.710393+00:00, run_end_date=2024-04-14 23:18:02.571636+00:00, run_duration=1.861243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:17:00+00:00, data_interval_end=2024-04-14 23:18:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:18:02.582247324Z [2024-04-14T23:18:02.581+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:18:00+00:00, run_after=2024-04-14T23:19:00+00:00 2024-04-14T23:18:02.615386160Z [2024-04-14T23:18:02.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:16:00+00:00 exited with status success for try_number 1 2024-04-14T23:18:02.615659020Z [2024-04-14T23:18:02.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:17:00+00:00 exited with status success for try_number 1 2024-04-14T23:18:02.622847367Z [2024-04-14T23:18:02.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:16:00+00:00, map_index=-1, run_start_date=2024-04-14 23:18:01.609241+00:00, run_end_date=2024-04-14 23:18:01.994185+00:00, run_duration=0.384944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:18:00.770837+00:00, queued_by_job_id=1, pid=3190 2024-04-14T23:18:02.623161777Z [2024-04-14T23:18:02.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:17:00+00:00, map_index=-1, run_start_date=2024-04-14 23:18:01.657252+00:00, run_end_date=2024-04-14 23:18:01.943968+00:00, run_duration=0.286716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:18:00.770837+00:00, queued_by_job_id=1, pid=3191 2024-04-14T23:18:04.772714531Z [2024-04-14T23:18:04.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:18:04.772815133Z [2024-04-14T23:18:04.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:17:00+00:00, run_id=scheduled__2024-04-14T23:17:00+00:00, run_start_date=2024-04-14 23:18:00.711826+00:00, run_end_date=2024-04-14 23:18:04.772524+00:00, run_duration=4.060698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:17:00+00:00, data_interval_end=2024-04-14 23:18:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:18:04.781284341Z [2024-04-14T23:18:04.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:18:00+00:00, run_after=2024-04-14T23:19:00+00:00 2024-04-14T23:18:04.786747546Z [2024-04-14T23:18:04.786+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:18:04.786781621Z [2024-04-14T23:18:04.786+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:17:00+00:00, run_id=scheduled__2024-04-14T23:17:00+00:00, run_start_date=2024-04-14 23:18:00.712714+00:00, run_end_date=2024-04-14 23:18:04.786471+00:00, run_duration=4.073757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:17:00+00:00, data_interval_end=2024-04-14 23:18:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:18:04.794947208Z [2024-04-14T23:18:04.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:18:00+00:00, run_after=2024-04-14T23:19:00+00:00 2024-04-14T23:18:04.828789693Z [2024-04-14T23:18:04.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:17:00+00:00 exited with status success for try_number 1 2024-04-14T23:18:04.834047002Z [2024-04-14T23:18:04.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:17:00+00:00, map_index=-1, run_start_date=2024-04-14 23:18:02.629502+00:00, run_end_date=2024-04-14 23:18:03.915542+00:00, run_duration=1.28604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:18:00.770837+00:00, queued_by_job_id=1, pid=3214 2024-04-14T23:18:05.151388098Z [2024-04-14T23:18:05.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:17:00+00:00 exited with status success for try_number 1 2024-04-14T23:18:05.160359332Z [2024-04-14T23:18:05.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:17:00+00:00, map_index=-1, run_start_date=2024-04-14 23:18:02.753628+00:00, run_end_date=2024-04-14 23:18:04.714845+00:00, run_duration=1.961217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:18:00.770837+00:00, queued_by_job_id=1, pid=3215 2024-04-14T23:19:01.108330184Z [2024-04-14T23:19:01.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:19:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:19:01.123043512Z [2024-04-14T23:19:01.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:19:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:19:01.130272409Z [2024-04-14T23:19:01.129+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:19:01.191273990Z [2024-04-14T23:19:01.190+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:19:01.191403427Z 2024-04-14T23:19:01.191415152Z 2024-04-14T23:19:01.191424141Z 2024-04-14T23:19:01.191499335Z [2024-04-14T23:19:01.190+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:19:01.191573453Z [2024-04-14T23:19:01.191+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:19:01.191724706Z [2024-04-14T23:19:01.191+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:19:01.192927036Z [2024-04-14T23:19:01.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:19:01.192946490Z 2024-04-14T23:19:01.192955946Z 2024-04-14T23:19:01.192964989Z 2024-04-14T23:19:01.197945883Z [2024-04-14T23:19:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:19:01.197981823Z [2024-04-14T23:19:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:19:01.198389646Z [2024-04-14T23:19:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:19:01.198571739Z [2024-04-14T23:19:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:19:01.198855108Z [2024-04-14T23:19:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:19:01.199041110Z [2024-04-14T23:19:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:19:01.467509356Z [2024-04-14T23:19:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status queued for try_number 1 2024-04-14T23:19:01.467671872Z [2024-04-14T23:19:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status queued for try_number 1 2024-04-14T23:19:01.467817473Z [2024-04-14T23:19:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status queued for try_number 1 2024-04-14T23:19:01.475147956Z [2024-04-14T23:19:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to f07ca5d8-90d2-4425-b61a-76ed36da237a 2024-04-14T23:19:01.475337105Z [2024-04-14T23:19:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to a05275ea-1a3d-467a-ac60-a40acec8a90f 2024-04-14T23:19:01.475494264Z [2024-04-14T23:19:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcfcbf7f-0ec5-4e84-bddf-d6bd6f69cff5 2024-04-14T23:19:02.593053899Z [2024-04-14T23:19:02.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:19:02.593507002Z [2024-04-14T23:19:02.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:18:00+00:00, run_id=scheduled__2024-04-14T23:18:00+00:00, run_start_date=2024-04-14 23:19:01.141549+00:00, run_end_date=2024-04-14 23:19:02.593149+00:00, run_duration=1.4516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:18:00+00:00, data_interval_end=2024-04-14 23:19:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:19:02.603140195Z [2024-04-14T23:19:02.602+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:19:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:19:02.689733300Z [2024-04-14T23:19:02.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status success for try_number 1 2024-04-14T23:19:02.698655143Z [2024-04-14T23:19:02.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:18:00+00:00, map_index=-1, run_start_date=2024-04-14 23:19:01.851320+00:00, run_end_date=2024-04-14 23:19:02.224916+00:00, run_duration=0.373596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:19:01.194406+00:00, queued_by_job_id=1, pid=3247 2024-04-14T23:19:04.552396771Z [2024-04-14T23:19:04.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:19:04.552670889Z [2024-04-14T23:19:04.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:18:00+00:00, run_id=scheduled__2024-04-14T23:18:00+00:00, run_start_date=2024-04-14 23:19:01.142732+00:00, run_end_date=2024-04-14 23:19:04.552273+00:00, run_duration=3.409541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:18:00+00:00, data_interval_end=2024-04-14 23:19:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:19:04.561694769Z [2024-04-14T23:19:04.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:19:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:19:04.636146920Z [2024-04-14T23:19:04.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status success for try_number 1 2024-04-14T23:19:04.640640334Z [2024-04-14T23:19:04.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:18:00+00:00, map_index=-1, run_start_date=2024-04-14 23:19:02.756120+00:00, run_end_date=2024-04-14 23:19:04.204359+00:00, run_duration=1.448239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:19:01.194406+00:00, queued_by_job_id=1, pid=3265 2024-04-14T23:19:05.229647427Z [2024-04-14T23:19:05.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:19:05.229825117Z [2024-04-14T23:19:05.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:18:00+00:00, run_id=scheduled__2024-04-14T23:18:00+00:00, run_start_date=2024-04-14 23:19:01.143840+00:00, run_end_date=2024-04-14 23:19:05.229519+00:00, run_duration=4.085679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:18:00+00:00, data_interval_end=2024-04-14 23:19:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:19:05.241710574Z [2024-04-14T23:19:05.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:19:00+00:00, run_after=2024-04-14T23:20:00+00:00 2024-04-14T23:19:05.280588442Z [2024-04-14T23:19:05.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status success for try_number 1 2024-04-14T23:19:05.289036329Z [2024-04-14T23:19:05.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:18:00+00:00, map_index=-1, run_start_date=2024-04-14 23:19:02.972658+00:00, run_end_date=2024-04-14 23:19:04.544351+00:00, run_duration=1.571693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:19:01.194406+00:00, queued_by_job_id=1, pid=3266 2024-04-14T23:20:00.409226374Z [2024-04-14T23:20:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:25:00+00:00 2024-04-14T23:20:00.422744064Z [2024-04-14T23:20:00.422+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:21:00+00:00 2024-04-14T23:20:00.436476926Z [2024-04-14T23:20:00.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:21:00+00:00 2024-04-14T23:20:00.443985239Z [2024-04-14T23:20:00.443+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:20:00.449360113Z [2024-04-14T23:20:00.449+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:20:00.546222276Z [2024-04-14T23:20:00.545+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T23:20:00.546255111Z 2024-04-14T23:20:00.546260314Z 2024-04-14T23:20:00.546265464Z 2024-04-14T23:20:00.546269723Z 2024-04-14T23:20:00.546273981Z 2024-04-14T23:20:00.546317954Z [2024-04-14T23:20:00.546+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:20:00.546438713Z [2024-04-14T23:20:00.546+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:20:00.546591954Z [2024-04-14T23:20:00.546+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:20:00.546716365Z [2024-04-14T23:20:00.546+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:20:00.546837974Z [2024-04-14T23:20:00.546+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:20:00.547800964Z [2024-04-14T23:20:00.547+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:20:00.547838269Z 2024-04-14T23:20:00.547846195Z 2024-04-14T23:20:00.547859563Z 2024-04-14T23:20:00.547865652Z 2024-04-14T23:20:00.547871834Z 2024-04-14T23:20:00.553845054Z [2024-04-14T23:20:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:20:00.553883849Z [2024-04-14T23:20:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:20:00.554162475Z [2024-04-14T23:20:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:20:00.554281065Z [2024-04-14T23:20:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:20:00.554493823Z [2024-04-14T23:20:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:20:00.554597535Z [2024-04-14T23:20:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:20:00.554800936Z [2024-04-14T23:20:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:20:00.554949994Z [2024-04-14T23:20:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:20:00.555145435Z [2024-04-14T23:20:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:20:00.555267064Z [2024-04-14T23:20:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:20:00.863471768Z [2024-04-14T23:20:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:00.863491654Z [2024-04-14T23:20:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:00.863527018Z [2024-04-14T23:20:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:19:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:00.863600869Z [2024-04-14T23:20:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:19:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:00.863652917Z [2024-04-14T23:20:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:19:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:00.876431492Z [2024-04-14T23:20:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8896d07-3d49-4743-b1cd-09e0a367aaa4 2024-04-14T23:20:00.876491452Z [2024-04-14T23:20:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 368eb076-9913-46c2-a840-e256ca8f9cac 2024-04-14T23:20:00.876580523Z [2024-04-14T23:20:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b908ebb-10bc-45f8-a9fe-f86182e32873 2024-04-14T23:20:00.876657142Z [2024-04-14T23:20:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a1a5385-a455-46f6-b1d4-8986cf70ecbe 2024-04-14T23:20:00.876733880Z [2024-04-14T23:20:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to b78623fc-01bc-4a73-a665-d1450f09d023 2024-04-14T23:20:02.106265515Z [2024-04-14T23:20:02.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:20:02.106650865Z [2024-04-14T23:20:02.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:18:00+00:00, run_id=scheduled__2024-04-14T23:18:00+00:00, run_start_date=2024-04-14 23:20:00.459843+00:00, run_end_date=2024-04-14 23:20:02.106187+00:00, run_duration=1.646344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:18:00+00:00, data_interval_end=2024-04-14 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:20:02.113575029Z [2024-04-14T23:20:02.113+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:22:00+00:00 2024-04-14T23:20:02.118788268Z [2024-04-14T23:20:02.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:20:02.119107735Z [2024-04-14T23:20:02.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:19:00+00:00, run_id=scheduled__2024-04-14T23:19:00+00:00, run_start_date=2024-04-14 23:20:00.460892+00:00, run_end_date=2024-04-14 23:20:02.118727+00:00, run_duration=1.657835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:19:00+00:00, data_interval_end=2024-04-14 23:20:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:20:02.127749179Z [2024-04-14T23:20:02.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:21:00+00:00 2024-04-14T23:20:02.197255531Z [2024-04-14T23:20:02.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:19:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:02.206561983Z [2024-04-14T23:20:02.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:19:00+00:00, map_index=-1, run_start_date=2024-04-14 23:20:01.574755+00:00, run_end_date=2024-04-14 23:20:01.955487+00:00, run_duration=0.380732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:00.549834+00:00, queued_by_job_id=1, pid=3301 2024-04-14T23:20:03.322925510Z [2024-04-14T23:20:03.322+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:20:03.322956883Z 2024-04-14T23:20:03.322962326Z [2024-04-14T23:20:03.322+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:20:03.323991397Z [2024-04-14T23:20:03.323+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:20:03.324018932Z 2024-04-14T23:20:03.327638456Z [2024-04-14T23:20:03.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:20:03.327911303Z [2024-04-14T23:20:03.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:20:03.382053120Z [2024-04-14T23:20:03.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:03.384608300Z [2024-04-14T23:20:03.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:03.384794865Z [2024-04-14T23:20:03.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:18:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:03.394971885Z [2024-04-14T23:20:03.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:15:00+00:00, map_index=-1, run_start_date=2024-04-14 23:20:02.381560+00:00, run_end_date=2024-04-14 23:20:02.683441+00:00, run_duration=0.301881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:00.549834+00:00, queued_by_job_id=1, pid=3320 2024-04-14T23:20:03.395286326Z [2024-04-14T23:20:03.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to a87637e9-927b-47b5-a173-6fb274c6e5eb 2024-04-14T23:20:03.395515090Z [2024-04-14T23:20:03.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:18:00+00:00, map_index=-1, run_start_date=2024-04-14 23:20:01.685318+00:00, run_end_date=2024-04-14 23:20:02.025837+00:00, run_duration=0.340519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:00.549834+00:00, queued_by_job_id=1, pid=3302 2024-04-14T23:20:04.559970655Z [2024-04-14T23:20:04.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:20:04.560629290Z [2024-04-14T23:20:04.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:19:00+00:00, run_id=scheduled__2024-04-14T23:19:00+00:00, run_start_date=2024-04-14 23:20:00.462164+00:00, run_end_date=2024-04-14 23:20:04.559855+00:00, run_duration=4.097691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:19:00+00:00, data_interval_end=2024-04-14 23:20:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:20:04.577199058Z [2024-04-14T23:20:04.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:21:00+00:00 2024-04-14T23:20:04.590462134Z [2024-04-14T23:20:04.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:20:04.591111251Z [2024-04-14T23:20:04.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:19:00+00:00, run_id=scheduled__2024-04-14T23:19:00+00:00, run_start_date=2024-04-14 23:20:00.463044+00:00, run_end_date=2024-04-14 23:20:04.590574+00:00, run_duration=4.12753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:19:00+00:00, data_interval_end=2024-04-14 23:20:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:20:04.606536644Z [2024-04-14T23:20:04.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:21:00+00:00 2024-04-14T23:20:04.648476354Z [2024-04-14T23:20:04.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:19:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:04.648780581Z [2024-04-14T23:20:04.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:19:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:04.654447380Z [2024-04-14T23:20:04.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:19:00+00:00, map_index=-1, run_start_date=2024-04-14 23:20:02.695742+00:00, run_end_date=2024-04-14 23:20:03.897393+00:00, run_duration=1.201651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:00.549834+00:00, queued_by_job_id=1, pid=3337 2024-04-14T23:20:04.654857136Z [2024-04-14T23:20:04.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:19:00+00:00, map_index=-1, run_start_date=2024-04-14 23:20:02.602373+00:00, run_end_date=2024-04-14 23:20:04.138157+00:00, run_duration=1.535784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:00.549834+00:00, queued_by_job_id=1, pid=3331 2024-04-14T23:20:06.029230596Z [2024-04-14T23:20:06.028+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:20:06.029272097Z 2024-04-14T23:20:06.029697849Z [2024-04-14T23:20:06.029+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:20:06.030813467Z [2024-04-14T23:20:06.030+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:20:06.030825060Z 2024-04-14T23:20:06.035553701Z [2024-04-14T23:20:06.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:20:06.036296637Z [2024-04-14T23:20:06.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:20:06.084470651Z [2024-04-14T23:20:06.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:06.084753908Z [2024-04-14T23:20:06.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:06.091904936Z [2024-04-14T23:20:06.091+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e3f01d2-a13d-4eb7-a2b6-8bd6179095b5 2024-04-14T23:20:06.092261683Z [2024-04-14T23:20:06.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:15:00+00:00, map_index=-1, run_start_date=2024-04-14 23:20:05.070334+00:00, run_end_date=2024-04-14 23:20:05.428878+00:00, run_duration=0.358544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:03.324556+00:00, queued_by_job_id=1, pid=3355 2024-04-14T23:20:08.341476192Z [2024-04-14T23:20:08.341+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:20:08.341505345Z 2024-04-14T23:20:08.341514263Z [2024-04-14T23:20:08.341+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:20:08.342093593Z [2024-04-14T23:20:08.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:20:08.342183107Z 2024-04-14T23:20:08.344568429Z [2024-04-14T23:20:08.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:20:08.344867533Z [2024-04-14T23:20:08.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:20:08.421660281Z [2024-04-14T23:20:08.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status queued for try_number 1 2024-04-14T23:20:08.421685406Z [2024-04-14T23:20:08.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:08.427495129Z [2024-04-14T23:20:08.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16323fc2-409f-44be-a59c-fd03aad4b511 2024-04-14T23:20:08.427636149Z [2024-04-14T23:20:08.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:15:00+00:00, map_index=0, run_start_date=2024-04-14 23:20:07.595930+00:00, run_end_date=2024-04-14 23:20:07.941913+00:00, run_duration=0.345983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:06.031615+00:00, queued_by_job_id=1, pid=3363 2024-04-14T23:20:10.632216458Z [2024-04-14T23:20:10.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:20:10.632654983Z [2024-04-14T23:20:10.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:15:00+00:00, run_id=scheduled__2024-04-14T23:15:00+00:00, run_start_date=2024-04-14 23:20:00.458504+00:00, run_end_date=2024-04-14 23:20:10.632092+00:00, run_duration=10.173588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:15:00+00:00, data_interval_end=2024-04-14 23:20:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:20:10.639080960Z [2024-04-14T23:20:10.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:20:00+00:00, run_after=2024-04-14T23:25:00+00:00 2024-04-14T23:20:10.672063050Z [2024-04-14T23:20:10.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:15:00+00:00 exited with status success for try_number 1 2024-04-14T23:20:10.678238608Z [2024-04-14T23:20:10.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:15:00+00:00, map_index=-1, run_start_date=2024-04-14 23:20:09.752413+00:00, run_end_date=2024-04-14 23:20:10.123193+00:00, run_duration=0.37078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:20:08.342152+00:00, queued_by_job_id=1, pid=3371 2024-04-14T23:21:00.672032982Z [2024-04-14T23:21:00.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:21:00+00:00, run_after=2024-04-14T23:22:00+00:00 2024-04-14T23:21:00.685067001Z [2024-04-14T23:21:00.684+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:21:00+00:00, run_after=2024-04-14T23:22:00+00:00 2024-04-14T23:21:00.690066605Z [2024-04-14T23:21:00.689+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:21:00.737029517Z [2024-04-14T23:21:00.736+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:21:00.737069027Z 2024-04-14T23:21:00.737079214Z 2024-04-14T23:21:00.737114153Z 2024-04-14T23:21:00.737608545Z [2024-04-14T23:21:00.736+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:21:00.738196657Z [2024-04-14T23:21:00.737+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:21:00.738653331Z [2024-04-14T23:21:00.738+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:21:00.740309481Z [2024-04-14T23:21:00.739+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:21:00.740344720Z 2024-04-14T23:21:00.740354452Z 2024-04-14T23:21:00.740363727Z 2024-04-14T23:21:00.746746897Z [2024-04-14T23:21:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:21:00.746960671Z [2024-04-14T23:21:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:21:00.747377230Z [2024-04-14T23:21:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:21:00.747798354Z [2024-04-14T23:21:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:21:00.748241249Z [2024-04-14T23:21:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:21:00.748481756Z [2024-04-14T23:21:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:21:00.981062237Z [2024-04-14T23:21:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:21:00.981253922Z [2024-04-14T23:21:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:21:00.981459086Z [2024-04-14T23:21:00.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:21:00.988154417Z [2024-04-14T23:21:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc561843-cd20-40de-9fa1-69d3894c14ed 2024-04-14T23:21:00.988380241Z [2024-04-14T23:21:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3990a26b-e569-4951-8443-9116e196ba01 2024-04-14T23:21:00.988617678Z [2024-04-14T23:21:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79a7f2ee-b6dc-436c-88d7-c1f1215106bd 2024-04-14T23:21:01.006120665Z [2024-04-14T23:21:01.005+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:21:01.932788511Z [2024-04-14T23:21:01.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:21:01.938785079Z [2024-04-14T23:21:01.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=-1, run_start_date=2024-04-14 23:21:01.419449+00:00, run_end_date=2024-04-14 23:21:01.791068+00:00, run_duration=0.371619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:21:00.742912+00:00, queued_by_job_id=1, pid=3393 2024-04-14T23:21:03.012109940Z [2024-04-14T23:21:03.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:21:03.012759177Z [2024-04-14T23:21:03.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:20:00+00:00, run_id=scheduled__2024-04-14T23:20:00+00:00, run_start_date=2024-04-14 23:21:00.697704+00:00, run_end_date=2024-04-14 23:21:03.012011+00:00, run_duration=2.314307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:20:00+00:00, data_interval_end=2024-04-14 23:21:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:21:03.023815098Z [2024-04-14T23:21:03.023+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:21:00+00:00, run_after=2024-04-14T23:22:00+00:00 2024-04-14T23:21:04.139075276Z [2024-04-14T23:21:04.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:21:04.139580610Z [2024-04-14T23:21:04.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:20:00+00:00, run_id=scheduled__2024-04-14T23:20:00+00:00, run_start_date=2024-04-14 23:21:00.698621+00:00, run_end_date=2024-04-14 23:21:04.139023+00:00, run_duration=3.440402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:20:00+00:00, data_interval_end=2024-04-14 23:21:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:21:04.154381948Z [2024-04-14T23:21:04.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:21:00+00:00, run_after=2024-04-14T23:22:00+00:00 2024-04-14T23:21:04.197476296Z [2024-04-14T23:21:04.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:21:04.205915814Z [2024-04-14T23:21:04.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=-1, run_start_date=2024-04-14 23:21:02.316106+00:00, run_end_date=2024-04-14 23:21:03.570591+00:00, run_duration=1.254485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:21:00.742912+00:00, queued_by_job_id=1, pid=3411 2024-04-14T23:21:05.265316687Z [2024-04-14T23:21:05.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:21:05.265817277Z [2024-04-14T23:21:05.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:20:00+00:00, run_id=scheduled__2024-04-14T23:20:00+00:00, run_start_date=2024-04-14 23:21:00.699504+00:00, run_end_date=2024-04-14 23:21:05.265230+00:00, run_duration=4.565726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:20:00+00:00, data_interval_end=2024-04-14 23:21:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:21:05.274386989Z [2024-04-14T23:21:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:21:00+00:00, run_after=2024-04-14T23:22:00+00:00 2024-04-14T23:21:05.314536684Z [2024-04-14T23:21:05.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:21:05.323097687Z [2024-04-14T23:21:05.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=-1, run_start_date=2024-04-14 23:21:02.456676+00:00, run_end_date=2024-04-14 23:21:04.249227+00:00, run_duration=1.792551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:21:00.742912+00:00, queued_by_job_id=1, pid=3412 2024-04-14T23:22:00.936368608Z [2024-04-14T23:22:00.935+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:22:00.959940520Z [2024-04-14T23:22:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:22:00+00:00, run_after=2024-04-14T23:23:00+00:00 2024-04-14T23:22:00.971448001Z [2024-04-14T23:22:00.971+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:22:00.986370548Z [2024-04-14T23:22:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:22:00+00:00, run_after=2024-04-14T23:23:00+00:00 2024-04-14T23:22:01.041812229Z [2024-04-14T23:22:01.041+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:22:01.041848170Z 2024-04-14T23:22:01.041858663Z 2024-04-14T23:22:01.041867950Z 2024-04-14T23:22:01.041876984Z 2024-04-14T23:22:01.042008814Z [2024-04-14T23:22:01.041+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:22:01.042311388Z [2024-04-14T23:22:01.042+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:22:01.042550548Z [2024-04-14T23:22:01.042+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:22:01.042965639Z [2024-04-14T23:22:01.042+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:22:01.044198169Z [2024-04-14T23:22:01.043+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:22:01.044219678Z 2024-04-14T23:22:01.044229542Z 2024-04-14T23:22:01.044238108Z 2024-04-14T23:22:01.044246804Z 2024-04-14T23:22:01.050156765Z [2024-04-14T23:22:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:22:01.050202251Z [2024-04-14T23:22:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:22:01.050603819Z [2024-04-14T23:22:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:22:01.050689584Z [2024-04-14T23:22:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:22:01.051095804Z [2024-04-14T23:22:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:22:01.051227653Z [2024-04-14T23:22:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:22:01.051548603Z [2024-04-14T23:22:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:22:01.051678913Z [2024-04-14T23:22:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:22:01.449868763Z [2024-04-14T23:22:01.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:22:01.450036813Z [2024-04-14T23:22:01.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:21:00+00:00 exited with status queued for try_number 1 2024-04-14T23:22:01.450170209Z [2024-04-14T23:22:01.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:21:00+00:00 exited with status queued for try_number 1 2024-04-14T23:22:01.450291894Z [2024-04-14T23:22:01.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:21:00+00:00 exited with status queued for try_number 1 2024-04-14T23:22:01.461377372Z [2024-04-14T23:22:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84c7c81e-5499-4cb9-8680-3dc2adcaf494 2024-04-14T23:22:01.461585732Z [2024-04-14T23:22:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 807f1410-ae09-4647-ba13-b5033534c03a 2024-04-14T23:22:01.461776932Z [2024-04-14T23:22:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06ac677e-5951-4d6f-8499-eee801b87aa1 2024-04-14T23:22:01.461957426Z [2024-04-14T23:22:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55bff4ac-83ad-41ef-872c-1ce96469ea0d 2024-04-14T23:22:02.776208357Z [2024-04-14T23:22:02.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:22:02.776404748Z [2024-04-14T23:22:02.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:20:00+00:00, run_id=scheduled__2024-04-14T23:20:00+00:00, run_start_date=2024-04-14 23:22:00.993175+00:00, run_end_date=2024-04-14 23:22:02.776142+00:00, run_duration=1.782967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:20:00+00:00, data_interval_end=2024-04-14 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:22:02.783003252Z [2024-04-14T23:22:02.782+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:22:00+00:00, run_after=2024-04-14T23:24:00+00:00 2024-04-14T23:22:02.826928714Z [2024-04-14T23:22:02.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:22:02.827269738Z [2024-04-14T23:22:02.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:21:00+00:00, run_id=scheduled__2024-04-14T23:21:00+00:00, run_start_date=2024-04-14 23:22:00.994911+00:00, run_end_date=2024-04-14 23:22:02.827011+00:00, run_duration=1.8321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:21:00+00:00, data_interval_end=2024-04-14 23:22:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:22:02.838969892Z [2024-04-14T23:22:02.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:22:00+00:00, run_after=2024-04-14T23:23:00+00:00 2024-04-14T23:22:02.870985872Z [2024-04-14T23:22:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:22:02.871005141Z [2024-04-14T23:22:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:21:00+00:00 exited with status success for try_number 1 2024-04-14T23:22:02.876308433Z [2024-04-14T23:22:02.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=-1, run_start_date=2024-04-14 23:22:01.641940+00:00, run_end_date=2024-04-14 23:22:02.034155+00:00, run_duration=0.392215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:22:01.046107+00:00, queued_by_job_id=1, pid=3440 2024-04-14T23:22:02.876625808Z [2024-04-14T23:22:02.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:21:00+00:00, map_index=-1, run_start_date=2024-04-14 23:22:02.022171+00:00, run_end_date=2024-04-14 23:22:02.360501+00:00, run_duration=0.33833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:22:01.046107+00:00, queued_by_job_id=1, pid=3452 2024-04-14T23:22:05.046937305Z [2024-04-14T23:22:05.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:22:05.047563782Z [2024-04-14T23:22:05.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:21:00+00:00, run_id=scheduled__2024-04-14T23:21:00+00:00, run_start_date=2024-04-14 23:22:00.995826+00:00, run_end_date=2024-04-14 23:22:05.047060+00:00, run_duration=4.051234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:21:00+00:00, data_interval_end=2024-04-14 23:22:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:22:05.060180060Z [2024-04-14T23:22:05.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:22:00+00:00, run_after=2024-04-14T23:23:00+00:00 2024-04-14T23:22:05.067794533Z [2024-04-14T23:22:05.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:22:05.068093181Z [2024-04-14T23:22:05.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:21:00+00:00, run_id=scheduled__2024-04-14T23:21:00+00:00, run_start_date=2024-04-14 23:22:00.996648+00:00, run_end_date=2024-04-14 23:22:05.067748+00:00, run_duration=4.0711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:21:00+00:00, data_interval_end=2024-04-14 23:22:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:22:05.076654648Z [2024-04-14T23:22:05.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:22:00+00:00, run_after=2024-04-14T23:23:00+00:00 2024-04-14T23:22:05.119792084Z [2024-04-14T23:22:05.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:21:00+00:00 exited with status success for try_number 1 2024-04-14T23:22:05.120234882Z [2024-04-14T23:22:05.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:21:00+00:00 exited with status success for try_number 1 2024-04-14T23:22:05.130684363Z [2024-04-14T23:22:05.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:21:00+00:00, map_index=-1, run_start_date=2024-04-14 23:22:02.856935+00:00, run_end_date=2024-04-14 23:22:04.229460+00:00, run_duration=1.372525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:22:01.046107+00:00, queued_by_job_id=1, pid=3470 2024-04-14T23:22:05.131312032Z [2024-04-14T23:22:05.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:21:00+00:00, map_index=-1, run_start_date=2024-04-14 23:22:02.729639+00:00, run_end_date=2024-04-14 23:22:04.513400+00:00, run_duration=1.783761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:22:01.046107+00:00, queued_by_job_id=1, pid=3469 2024-04-14T23:23:00.145051970Z [2024-04-14T23:23:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:23:00+00:00, run_after=2024-04-14T23:24:00+00:00 2024-04-14T23:23:00.150933584Z [2024-04-14T23:23:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:23:00.162632795Z [2024-04-14T23:23:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:23:00+00:00, run_after=2024-04-14T23:24:00+00:00 2024-04-14T23:23:00.231344071Z [2024-04-14T23:23:00.230+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:23:00.231369563Z 2024-04-14T23:23:00.231372966Z 2024-04-14T23:23:00.231375777Z 2024-04-14T23:23:00.231551686Z [2024-04-14T23:23:00.231+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:23:00.231766461Z [2024-04-14T23:23:00.231+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:23:00.231962650Z [2024-04-14T23:23:00.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:23:00.233184167Z [2024-04-14T23:23:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:23:00.233193237Z 2024-04-14T23:23:00.233196232Z 2024-04-14T23:23:00.233199010Z 2024-04-14T23:23:00.239269932Z [2024-04-14T23:23:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:23:00.239443428Z [2024-04-14T23:23:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:23:00.239719175Z [2024-04-14T23:23:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:23:00.239874101Z [2024-04-14T23:23:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:23:00.240109317Z [2024-04-14T23:23:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:23:00.240255873Z [2024-04-14T23:23:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:23:00.558887414Z [2024-04-14T23:23:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status queued for try_number 1 2024-04-14T23:23:00.558916738Z [2024-04-14T23:23:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status queued for try_number 1 2024-04-14T23:23:00.559089185Z [2024-04-14T23:23:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status queued for try_number 1 2024-04-14T23:23:00.566236117Z [2024-04-14T23:23:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 004ed691-3f0c-47a6-874b-6d865fff20eb 2024-04-14T23:23:00.566349374Z [2024-04-14T23:23:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1ff1347-3d48-4c6b-9046-fdfc69674e53 2024-04-14T23:23:00.566449052Z [2024-04-14T23:23:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60e587dc-a95f-4379-b346-535869180475 2024-04-14T23:23:01.708740870Z [2024-04-14T23:23:01.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:23:01.709093302Z [2024-04-14T23:23:01.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:22:00+00:00, run_id=scheduled__2024-04-14T23:22:00+00:00, run_start_date=2024-04-14 23:23:00.173700+00:00, run_end_date=2024-04-14 23:23:01.708580+00:00, run_duration=1.53488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:22:00+00:00, data_interval_end=2024-04-14 23:23:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:23:01.717622467Z [2024-04-14T23:23:01.717+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:23:00+00:00, run_after=2024-04-14T23:24:00+00:00 2024-04-14T23:23:01.757067300Z [2024-04-14T23:23:01.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status success for try_number 1 2024-04-14T23:23:01.762095013Z [2024-04-14T23:23:01.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:22:00+00:00, map_index=-1, run_start_date=2024-04-14 23:23:00.961562+00:00, run_end_date=2024-04-14 23:23:01.312665+00:00, run_duration=0.351103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:23:00.235401+00:00, queued_by_job_id=1, pid=3502 2024-04-14T23:23:03.248149973Z [2024-04-14T23:23:03.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:23:03.248568432Z [2024-04-14T23:23:03.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:22:00+00:00, run_id=scheduled__2024-04-14T23:22:00+00:00, run_start_date=2024-04-14 23:23:00.174978+00:00, run_end_date=2024-04-14 23:23:03.248107+00:00, run_duration=3.073129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:22:00+00:00, data_interval_end=2024-04-14 23:23:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:23:03.260750007Z [2024-04-14T23:23:03.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:23:00+00:00, run_after=2024-04-14T23:24:00+00:00 2024-04-14T23:23:03.311820206Z [2024-04-14T23:23:03.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status success for try_number 1 2024-04-14T23:23:03.321022138Z [2024-04-14T23:23:03.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:22:00+00:00, map_index=-1, run_start_date=2024-04-14 23:23:01.830133+00:00, run_end_date=2024-04-14 23:23:03.070449+00:00, run_duration=1.240316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:23:00.235401+00:00, queued_by_job_id=1, pid=3520 2024-04-14T23:23:03.877003206Z [2024-04-14T23:23:03.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:23:03.877023081Z [2024-04-14T23:23:03.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:22:00+00:00, run_id=scheduled__2024-04-14T23:22:00+00:00, run_start_date=2024-04-14 23:23:00.176093+00:00, run_end_date=2024-04-14 23:23:03.876666+00:00, run_duration=3.700573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:22:00+00:00, data_interval_end=2024-04-14 23:23:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:23:03.888315044Z [2024-04-14T23:23:03.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:23:00+00:00, run_after=2024-04-14T23:24:00+00:00 2024-04-14T23:23:03.921643987Z [2024-04-14T23:23:03.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status success for try_number 1 2024-04-14T23:23:03.925983092Z [2024-04-14T23:23:03.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:22:00+00:00, map_index=-1, run_start_date=2024-04-14 23:23:01.956354+00:00, run_end_date=2024-04-14 23:23:03.600389+00:00, run_duration=1.644035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:23:00.235401+00:00, queued_by_job_id=1, pid=3521 2024-04-14T23:24:00.843000888Z [2024-04-14T23:24:00.842+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:24:00.852749460Z [2024-04-14T23:24:00.852+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:24:00.870448958Z [2024-04-14T23:24:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:24:00+00:00, run_after=2024-04-14T23:25:00+00:00 2024-04-14T23:24:00.883236438Z [2024-04-14T23:24:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:24:00+00:00, run_after=2024-04-14T23:25:00+00:00 2024-04-14T23:24:00.972719441Z [2024-04-14T23:24:00.972+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:24:00.972749234Z 2024-04-14T23:24:00.972755554Z 2024-04-14T23:24:00.972760880Z 2024-04-14T23:24:00.972766176Z 2024-04-14T23:24:00.973095588Z [2024-04-14T23:24:00.972+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:24:00.973396075Z [2024-04-14T23:24:00.973+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:24:00.973691511Z [2024-04-14T23:24:00.973+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:24:00.973918526Z [2024-04-14T23:24:00.973+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:24:00.975098568Z [2024-04-14T23:24:00.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:24:00.975132514Z 2024-04-14T23:24:00.975139585Z 2024-04-14T23:24:00.975144725Z 2024-04-14T23:24:00.975149944Z 2024-04-14T23:24:00.979737493Z [2024-04-14T23:24:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:24:00.979952059Z [2024-04-14T23:24:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:24:00.980307048Z [2024-04-14T23:24:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:24:00.980596692Z [2024-04-14T23:24:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:24:00.980975078Z [2024-04-14T23:24:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:24:00.981219953Z [2024-04-14T23:24:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:24:00.981608970Z [2024-04-14T23:24:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:24:00.981856026Z [2024-04-14T23:24:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:24:01.333616482Z [2024-04-14T23:24:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status queued for try_number 1 2024-04-14T23:24:01.333921715Z [2024-04-14T23:24:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:23:00+00:00 exited with status queued for try_number 1 2024-04-14T23:24:01.334090058Z [2024-04-14T23:24:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:23:00+00:00 exited with status queued for try_number 1 2024-04-14T23:24:01.334266077Z [2024-04-14T23:24:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:23:00+00:00 exited with status queued for try_number 1 2024-04-14T23:24:01.352266853Z [2024-04-14T23:24:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96692b21-92b9-4a3a-9ec7-05307e9abc8f 2024-04-14T23:24:01.352569637Z [2024-04-14T23:24:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfe9aa59-bdf4-42db-a179-bc44fb51d843 2024-04-14T23:24:01.352910695Z [2024-04-14T23:24:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 562e4a2e-3a1d-48c4-af01-c95df41c0be7 2024-04-14T23:24:01.353231873Z [2024-04-14T23:24:01.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to be50a7fb-d432-4401-b771-33602bb58411 2024-04-14T23:24:02.597694910Z [2024-04-14T23:24:02.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:24:02.598088497Z [2024-04-14T23:24:02.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:22:00+00:00, run_id=scheduled__2024-04-14T23:22:00+00:00, run_start_date=2024-04-14 23:24:00.895488+00:00, run_end_date=2024-04-14 23:24:02.597516+00:00, run_duration=1.702028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:22:00+00:00, data_interval_end=2024-04-14 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:24:02.608349169Z [2024-04-14T23:24:02.608+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:24:00+00:00, run_after=2024-04-14T23:26:00+00:00 2024-04-14T23:24:02.634751058Z [2024-04-14T23:24:02.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:24:02.635111375Z [2024-04-14T23:24:02.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:23:00+00:00, run_id=scheduled__2024-04-14T23:23:00+00:00, run_start_date=2024-04-14 23:24:00.896997+00:00, run_end_date=2024-04-14 23:24:02.634629+00:00, run_duration=1.737632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:23:00+00:00, data_interval_end=2024-04-14 23:24:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:24:02.649731993Z [2024-04-14T23:24:02.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:24:00+00:00, run_after=2024-04-14T23:25:00+00:00 2024-04-14T23:24:02.702751898Z [2024-04-14T23:24:02.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:22:00+00:00 exited with status success for try_number 1 2024-04-14T23:24:02.703375932Z [2024-04-14T23:24:02.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:23:00+00:00 exited with status success for try_number 1 2024-04-14T23:24:02.714039229Z [2024-04-14T23:24:02.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:22:00+00:00, map_index=-1, run_start_date=2024-04-14 23:24:01.746316+00:00, run_end_date=2024-04-14 23:24:02.131921+00:00, run_duration=0.385605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:24:00.976424+00:00, queued_by_job_id=1, pid=3554 2024-04-14T23:24:02.714288050Z [2024-04-14T23:24:02.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:23:00+00:00, map_index=-1, run_start_date=2024-04-14 23:24:01.717823+00:00, run_end_date=2024-04-14 23:24:02.137347+00:00, run_duration=0.419524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:24:00.976424+00:00, queued_by_job_id=1, pid=3555 2024-04-14T23:24:04.866091450Z [2024-04-14T23:24:04.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:24:04.866446950Z [2024-04-14T23:24:04.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:23:00+00:00, run_id=scheduled__2024-04-14T23:23:00+00:00, run_start_date=2024-04-14 23:24:00.899032+00:00, run_end_date=2024-04-14 23:24:04.865997+00:00, run_duration=3.966965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:23:00+00:00, data_interval_end=2024-04-14 23:24:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:24:04.886052965Z [2024-04-14T23:24:04.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:24:00+00:00, run_after=2024-04-14T23:25:00+00:00 2024-04-14T23:24:04.893668906Z [2024-04-14T23:24:04.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:24:04.895217978Z [2024-04-14T23:24:04.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:23:00+00:00, run_id=scheduled__2024-04-14T23:23:00+00:00, run_start_date=2024-04-14 23:24:00.898032+00:00, run_end_date=2024-04-14 23:24:04.893533+00:00, run_duration=3.995501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:23:00+00:00, data_interval_end=2024-04-14 23:24:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:24:04.911116845Z [2024-04-14T23:24:04.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:24:00+00:00, run_after=2024-04-14T23:25:00+00:00 2024-04-14T23:24:04.940327774Z [2024-04-14T23:24:04.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:23:00+00:00 exited with status success for try_number 1 2024-04-14T23:24:04.940349334Z [2024-04-14T23:24:04.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:23:00+00:00 exited with status success for try_number 1 2024-04-14T23:24:04.951634865Z [2024-04-14T23:24:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:23:00+00:00, map_index=-1, run_start_date=2024-04-14 23:24:02.856980+00:00, run_end_date=2024-04-14 23:24:04.626831+00:00, run_duration=1.769851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:24:00.976424+00:00, queued_by_job_id=1, pid=3579 2024-04-14T23:24:04.951760733Z [2024-04-14T23:24:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:23:00+00:00, map_index=-1, run_start_date=2024-04-14 23:24:02.794186+00:00, run_end_date=2024-04-14 23:24:04.152214+00:00, run_duration=1.358028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:24:00.976424+00:00, queued_by_job_id=1, pid=3578 2024-04-14T23:25:00.627685161Z [2024-04-14T23:25:00.626+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:25:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:25:00.646164682Z [2024-04-14T23:25:00.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:25:00+00:00, run_after=2024-04-14T23:26:00+00:00 2024-04-14T23:25:00.656818821Z [2024-04-14T23:25:00.656+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:25:00+00:00, run_after=2024-04-14T23:26:00+00:00 2024-04-14T23:25:00.661727454Z [2024-04-14T23:25:00.661+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:25:00.740918765Z [2024-04-14T23:25:00.740+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:25:00.740937039Z 2024-04-14T23:25:00.740941296Z 2024-04-14T23:25:00.740944545Z 2024-04-14T23:25:00.740947896Z 2024-04-14T23:25:00.741328245Z [2024-04-14T23:25:00.741+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:25:00.741912714Z [2024-04-14T23:25:00.741+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:25:00.742368273Z [2024-04-14T23:25:00.742+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:25:00.742747834Z [2024-04-14T23:25:00.742+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:25:00.743667921Z [2024-04-14T23:25:00.743+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:25:00.743678441Z 2024-04-14T23:25:00.743683068Z 2024-04-14T23:25:00.743687640Z 2024-04-14T23:25:00.743691980Z 2024-04-14T23:25:00.750352376Z [2024-04-14T23:25:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:25:00.750734243Z [2024-04-14T23:25:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:25:00.751330797Z [2024-04-14T23:25:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:25:00.751675893Z [2024-04-14T23:25:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:25:00.752161217Z [2024-04-14T23:25:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:25:00.752585336Z [2024-04-14T23:25:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:25:00.752986838Z [2024-04-14T23:25:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:25:00.753222753Z [2024-04-14T23:25:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:25:00.979670184Z [2024-04-14T23:25:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:25:00.979705491Z [2024-04-14T23:25:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status queued for try_number 1 2024-04-14T23:25:00.979731339Z [2024-04-14T23:25:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status queued for try_number 1 2024-04-14T23:25:00.979786931Z [2024-04-14T23:25:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status queued for try_number 1 2024-04-14T23:25:00.991857345Z [2024-04-14T23:25:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9749522e-2860-438b-afb2-d3bac0b54faa 2024-04-14T23:25:00.991885867Z [2024-04-14T23:25:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca1f13b2-0c89-4bdf-af27-235d057c9a1d 2024-04-14T23:25:00.991996100Z [2024-04-14T23:25:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0743ee62-ad39-4b8d-b005-7df2d5d45d6e 2024-04-14T23:25:00.992081009Z [2024-04-14T23:25:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5737431b-881e-4dd0-be3d-24907a042c6e 2024-04-14T23:25:02.321393608Z [2024-04-14T23:25:02.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:25:02.321639114Z [2024-04-14T23:25:02.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:24:00+00:00, run_id=scheduled__2024-04-14T23:24:00+00:00, run_start_date=2024-04-14 23:25:00.670282+00:00, run_end_date=2024-04-14 23:25:02.321310+00:00, run_duration=1.651028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:24:00+00:00, data_interval_end=2024-04-14 23:25:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:25:02.332360071Z [2024-04-14T23:25:02.332+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:25:00+00:00, run_after=2024-04-14T23:26:00+00:00 2024-04-14T23:25:02.365149392Z [2024-04-14T23:25:02.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status success for try_number 1 2024-04-14T23:25:02.379190265Z [2024-04-14T23:25:02.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:24:00+00:00, map_index=-1, run_start_date=2024-04-14 23:25:01.673263+00:00, run_end_date=2024-04-14 23:25:02.060431+00:00, run_duration=0.387168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:25:00.745297+00:00, queued_by_job_id=1, pid=3612 2024-04-14T23:25:03.101707995Z [2024-04-14T23:25:03.101+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:25:03.101729065Z 2024-04-14T23:25:03.101770869Z [2024-04-14T23:25:03.101+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:25:03.102189379Z [2024-04-14T23:25:03.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:25:03.102197300Z 2024-04-14T23:25:03.103999192Z [2024-04-14T23:25:03.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:25:03.104104202Z [2024-04-14T23:25:03.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:25:03.173054870Z [2024-04-14T23:25:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:25:03.173248861Z [2024-04-14T23:25:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:25:03.179212298Z [2024-04-14T23:25:03.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97a741b5-9d00-4c63-b150-4e76e6cbfbb5 2024-04-14T23:25:03.179508610Z [2024-04-14T23:25:03.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=-1, run_start_date=2024-04-14 23:25:02.556310+00:00, run_end_date=2024-04-14 23:25:02.907987+00:00, run_duration=0.351677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:25:00.745297+00:00, queued_by_job_id=1, pid=3631 2024-04-14T23:25:04.356281626Z [2024-04-14T23:25:04.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:25:04.356669802Z [2024-04-14T23:25:04.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:24:00+00:00, run_id=scheduled__2024-04-14T23:24:00+00:00, run_start_date=2024-04-14 23:25:00.671156+00:00, run_end_date=2024-04-14 23:25:04.356195+00:00, run_duration=3.685039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:24:00+00:00, data_interval_end=2024-04-14 23:25:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:25:04.364840748Z [2024-04-14T23:25:04.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:25:00+00:00, run_after=2024-04-14T23:26:00+00:00 2024-04-14T23:25:04.421979887Z [2024-04-14T23:25:04.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status success for try_number 1 2024-04-14T23:25:04.428644448Z [2024-04-14T23:25:04.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:24:00+00:00, map_index=-1, run_start_date=2024-04-14 23:25:02.674813+00:00, run_end_date=2024-04-14 23:25:03.898763+00:00, run_duration=1.22395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:25:00.745297+00:00, queued_by_job_id=1, pid=3637 2024-04-14T23:25:05.499164167Z [2024-04-14T23:25:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:25:05.499699519Z [2024-04-14T23:25:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:24:00+00:00, run_id=scheduled__2024-04-14T23:24:00+00:00, run_start_date=2024-04-14 23:25:00.671959+00:00, run_end_date=2024-04-14 23:25:05.499220+00:00, run_duration=4.827261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:24:00+00:00, data_interval_end=2024-04-14 23:25:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:25:05.511899008Z [2024-04-14T23:25:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:25:00+00:00, run_after=2024-04-14T23:26:00+00:00 2024-04-14T23:25:05.549031744Z [2024-04-14T23:25:05.548+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:25:05.549072963Z 2024-04-14T23:25:05.549267190Z [2024-04-14T23:25:05.549+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:25:05.550037718Z [2024-04-14T23:25:05.549+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:25:05.550053835Z 2024-04-14T23:25:05.552777607Z [2024-04-14T23:25:05.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:25:05.553102589Z [2024-04-14T23:25:05.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:25:05.618822944Z [2024-04-14T23:25:05.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:25:05.619262695Z [2024-04-14T23:25:05.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status success for try_number 1 2024-04-14T23:25:05.619596520Z [2024-04-14T23:25:05.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:25:05.635390837Z [2024-04-14T23:25:05.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:24:00+00:00, map_index=-1, run_start_date=2024-04-14 23:25:02.781333+00:00, run_end_date=2024-04-14 23:25:04.342155+00:00, run_duration=1.560822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:25:00.745297+00:00, queued_by_job_id=1, pid=3638 2024-04-14T23:25:05.635798804Z [2024-04-14T23:25:05.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=-1, run_start_date=2024-04-14 23:25:04.583696+00:00, run_end_date=2024-04-14 23:25:04.982621+00:00, run_duration=0.398925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:25:03.102442+00:00, queued_by_job_id=1, pid=3661 2024-04-14T23:25:05.636132682Z [2024-04-14T23:25:05.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3858b9b6-1585-4b84-b732-bcdeb799953b 2024-04-14T23:25:08.354916919Z [2024-04-14T23:25:08.354+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:25:08.354948073Z 2024-04-14T23:25:08.355011544Z [2024-04-14T23:25:08.354+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:25:08.355647159Z [2024-04-14T23:25:08.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:25:08.355662350Z 2024-04-14T23:25:08.358595411Z [2024-04-14T23:25:08.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:25:08.358746199Z [2024-04-14T23:25:08.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:25:08.402227814Z [2024-04-14T23:25:08.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status queued for try_number 1 2024-04-14T23:25:08.402245729Z [2024-04-14T23:25:08.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:25:08.408077074Z [2024-04-14T23:25:08.407+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77709eb6-a0fd-48ea-b90e-f4b9b0f1701f 2024-04-14T23:25:08.408179150Z [2024-04-14T23:25:08.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=0, run_start_date=2024-04-14 23:25:06.980936+00:00, run_end_date=2024-04-14 23:25:07.333081+00:00, run_duration=0.352145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:25:05.550508+00:00, queued_by_job_id=1, pid=3669 2024-04-14T23:25:10.625716511Z [2024-04-14T23:25:10.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:25:10.626029717Z [2024-04-14T23:25:10.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:20:00+00:00, run_id=scheduled__2024-04-14T23:20:00+00:00, run_start_date=2024-04-14 23:25:00.669424+00:00, run_end_date=2024-04-14 23:25:10.625507+00:00, run_duration=9.956083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:20:00+00:00, data_interval_end=2024-04-14 23:25:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:25:10.634719488Z [2024-04-14T23:25:10.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:25:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:25:10.667265605Z [2024-04-14T23:25:10.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:20:00+00:00 exited with status success for try_number 1 2024-04-14T23:25:10.673205974Z [2024-04-14T23:25:10.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:20:00+00:00, map_index=-1, run_start_date=2024-04-14 23:25:09.705008+00:00, run_end_date=2024-04-14 23:25:10.061412+00:00, run_duration=0.356404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:25:08.355815+00:00, queued_by_job_id=1, pid=3677 2024-04-14T23:26:00.907377605Z [2024-04-14T23:26:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:26:00+00:00, run_after=2024-04-14T23:27:00+00:00 2024-04-14T23:26:00.922083139Z [2024-04-14T23:26:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:26:00+00:00, run_after=2024-04-14T23:27:00+00:00 2024-04-14T23:26:00.929047915Z [2024-04-14T23:26:00.928+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:26:00.935700302Z [2024-04-14T23:26:00.935+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:26:01.024632260Z [2024-04-14T23:26:01.024+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:26:01.024672613Z 2024-04-14T23:26:01.024682525Z 2024-04-14T23:26:01.024691309Z 2024-04-14T23:26:01.024704978Z 2024-04-14T23:26:01.024782760Z [2024-04-14T23:26:01.024+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:26:01.024952952Z [2024-04-14T23:26:01.024+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:26:01.025208078Z [2024-04-14T23:26:01.025+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:26:01.025463447Z [2024-04-14T23:26:01.025+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:26:01.026305616Z [2024-04-14T23:26:01.026+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:26:01.026324943Z 2024-04-14T23:26:01.026334510Z 2024-04-14T23:26:01.026343202Z 2024-04-14T23:26:01.026351682Z 2024-04-14T23:26:01.030570936Z [2024-04-14T23:26:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:26:01.030786571Z [2024-04-14T23:26:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:26:01.031115488Z [2024-04-14T23:26:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:26:01.031293479Z [2024-04-14T23:26:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:26:01.031680760Z [2024-04-14T23:26:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:26:01.032022733Z [2024-04-14T23:26:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:26:01.032408221Z [2024-04-14T23:26:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:26:01.032741518Z [2024-04-14T23:26:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:26:01.294439041Z [2024-04-14T23:26:01.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status queued for try_number 1 2024-04-14T23:26:01.296363134Z [2024-04-14T23:26:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status queued for try_number 1 2024-04-14T23:26:01.296462535Z [2024-04-14T23:26:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status queued for try_number 1 2024-04-14T23:26:01.296624008Z [2024-04-14T23:26:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status queued for try_number 1 2024-04-14T23:26:01.303611343Z [2024-04-14T23:26:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 382daf42-aa47-4e31-ab9d-b69066aed657 2024-04-14T23:26:01.303740490Z [2024-04-14T23:26:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1460e0d-f926-46a6-947e-7f1a247f3b91 2024-04-14T23:26:01.303863378Z [2024-04-14T23:26:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to eea8b460-5384-412b-90fe-50b8d879a48e 2024-04-14T23:26:01.303983531Z [2024-04-14T23:26:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f0cba00-a804-4ecf-a763-5a98978aca35 2024-04-14T23:26:01.323576597Z [2024-04-14T23:26:01.323+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:26:03.037099922Z [2024-04-14T23:26:03.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:26:03.037415227Z [2024-04-14T23:26:03.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:25:00+00:00, run_id=scheduled__2024-04-14T23:25:00+00:00, run_start_date=2024-04-14 23:26:00.950163+00:00, run_end_date=2024-04-14 23:26:03.037095+00:00, run_duration=2.086932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:25:00+00:00, data_interval_end=2024-04-14 23:26:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:26:03.045490466Z [2024-04-14T23:26:03.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:26:00+00:00, run_after=2024-04-14T23:27:00+00:00 2024-04-14T23:26:03.051525993Z [2024-04-14T23:26:03.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:26:03.051788610Z [2024-04-14T23:26:03.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:24:00+00:00, run_id=scheduled__2024-04-14T23:24:00+00:00, run_start_date=2024-04-14 23:26:00.948772+00:00, run_end_date=2024-04-14 23:26:03.051557+00:00, run_duration=2.102785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:24:00+00:00, data_interval_end=2024-04-14 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:26:03.058531040Z [2024-04-14T23:26:03.058+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:26:00+00:00, run_after=2024-04-14T23:28:00+00:00 2024-04-14T23:26:03.101702700Z [2024-04-14T23:26:03.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:24:00+00:00 exited with status success for try_number 1 2024-04-14T23:26:03.101872661Z [2024-04-14T23:26:03.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status success for try_number 1 2024-04-14T23:26:03.108055920Z [2024-04-14T23:26:03.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:25:00+00:00, map_index=-1, run_start_date=2024-04-14 23:26:01.991265+00:00, run_end_date=2024-04-14 23:26:02.367692+00:00, run_duration=0.376427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:26:01.027335+00:00, queued_by_job_id=1, pid=3700 2024-04-14T23:26:03.108268230Z [2024-04-14T23:26:03.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:24:00+00:00, map_index=-1, run_start_date=2024-04-14 23:26:02.217320+00:00, run_end_date=2024-04-14 23:26:02.522078+00:00, run_duration=0.304758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:26:01.027335+00:00, queued_by_job_id=1, pid=3702 2024-04-14T23:26:04.707224041Z [2024-04-14T23:26:04.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:26:04.707445256Z [2024-04-14T23:26:04.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:25:00+00:00, run_id=scheduled__2024-04-14T23:25:00+00:00, run_start_date=2024-04-14 23:26:00.951360+00:00, run_end_date=2024-04-14 23:26:04.707064+00:00, run_duration=3.755704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:25:00+00:00, data_interval_end=2024-04-14 23:26:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:26:04.720513673Z [2024-04-14T23:26:04.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:26:00+00:00, run_after=2024-04-14T23:27:00+00:00 2024-04-14T23:26:04.782914491Z [2024-04-14T23:26:04.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status success for try_number 1 2024-04-14T23:26:04.792307838Z [2024-04-14T23:26:04.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:25:00+00:00, map_index=-1, run_start_date=2024-04-14 23:26:03.078196+00:00, run_end_date=2024-04-14 23:26:04.489192+00:00, run_duration=1.410996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:26:01.027335+00:00, queued_by_job_id=1, pid=3725 2024-04-14T23:26:05.798531933Z [2024-04-14T23:26:05.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:26:05.799157851Z [2024-04-14T23:26:05.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:25:00+00:00, run_id=scheduled__2024-04-14T23:25:00+00:00, run_start_date=2024-04-14 23:26:00.952520+00:00, run_end_date=2024-04-14 23:26:05.798329+00:00, run_duration=4.845809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:25:00+00:00, data_interval_end=2024-04-14 23:26:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:26:05.815817674Z [2024-04-14T23:26:05.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:26:00+00:00, run_after=2024-04-14T23:27:00+00:00 2024-04-14T23:26:05.860029037Z [2024-04-14T23:26:05.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status success for try_number 1 2024-04-14T23:26:05.869064903Z [2024-04-14T23:26:05.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:25:00+00:00, map_index=-1, run_start_date=2024-04-14 23:26:02.823139+00:00, run_end_date=2024-04-14 23:26:04.878239+00:00, run_duration=2.0551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:26:01.027335+00:00, queued_by_job_id=1, pid=3719 2024-04-14T23:27:00.071297185Z [2024-04-14T23:27:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:27:00+00:00, run_after=2024-04-14T23:28:00+00:00 2024-04-14T23:27:00.079347948Z [2024-04-14T23:27:00.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:27:00.096121819Z [2024-04-14T23:27:00.095+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:27:00+00:00, run_after=2024-04-14T23:28:00+00:00 2024-04-14T23:27:00.208560362Z [2024-04-14T23:27:00.208+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:27:00.208591133Z 2024-04-14T23:27:00.208606659Z 2024-04-14T23:27:00.208610073Z 2024-04-14T23:27:00.208976052Z [2024-04-14T23:27:00.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:27:00.209269684Z [2024-04-14T23:27:00.209+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:27:00.209522198Z [2024-04-14T23:27:00.209+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:27:00.210383032Z [2024-04-14T23:27:00.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:27:00.210393590Z 2024-04-14T23:27:00.210409846Z 2024-04-14T23:27:00.210413182Z 2024-04-14T23:27:00.215326720Z [2024-04-14T23:27:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:27:00.215611863Z [2024-04-14T23:27:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:27:00.215955325Z [2024-04-14T23:27:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:27:00.216145536Z [2024-04-14T23:27:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:27:00.216443363Z [2024-04-14T23:27:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:27:00.216645266Z [2024-04-14T23:27:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:27:00.633706917Z [2024-04-14T23:27:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status queued for try_number 1 2024-04-14T23:27:00.634191558Z [2024-04-14T23:27:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status queued for try_number 1 2024-04-14T23:27:00.634741331Z [2024-04-14T23:27:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status queued for try_number 1 2024-04-14T23:27:00.653536385Z [2024-04-14T23:27:00.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7853ecc-f69e-4ad4-8c7e-566d7b7893d2 2024-04-14T23:27:00.653990930Z [2024-04-14T23:27:00.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to f973ef41-bf30-43cb-ad64-290461589303 2024-04-14T23:27:00.654290693Z [2024-04-14T23:27:00.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to cac9ad0b-9e22-46e0-bc30-750e9a291ef1 2024-04-14T23:27:01.809428174Z [2024-04-14T23:27:01.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:27:01.809914275Z [2024-04-14T23:27:01.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:26:00+00:00, run_id=scheduled__2024-04-14T23:26:00+00:00, run_start_date=2024-04-14 23:27:00.109093+00:00, run_end_date=2024-04-14 23:27:01.809281+00:00, run_duration=1.700188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:26:00+00:00, data_interval_end=2024-04-14 23:27:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:27:01.818354988Z [2024-04-14T23:27:01.817+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:27:00+00:00, run_after=2024-04-14T23:28:00+00:00 2024-04-14T23:27:01.858237165Z [2024-04-14T23:27:01.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status success for try_number 1 2024-04-14T23:27:01.864751694Z [2024-04-14T23:27:01.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:26:00+00:00, map_index=-1, run_start_date=2024-04-14 23:27:01.043700+00:00, run_end_date=2024-04-14 23:27:01.399554+00:00, run_duration=0.355854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:27:00.211511+00:00, queued_by_job_id=1, pid=3756 2024-04-14T23:27:03.979454782Z [2024-04-14T23:27:03.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:27:03.979808074Z [2024-04-14T23:27:03.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:26:00+00:00, run_id=scheduled__2024-04-14T23:26:00+00:00, run_start_date=2024-04-14 23:27:00.111525+00:00, run_end_date=2024-04-14 23:27:03.979392+00:00, run_duration=3.867867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:26:00+00:00, data_interval_end=2024-04-14 23:27:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:27:03.987274889Z [2024-04-14T23:27:03.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:27:00+00:00, run_after=2024-04-14T23:28:00+00:00 2024-04-14T23:27:04.032594433Z [2024-04-14T23:27:04.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status success for try_number 1 2024-04-14T23:27:04.039332310Z [2024-04-14T23:27:04.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:26:00+00:00, map_index=-1, run_start_date=2024-04-14 23:27:02.147212+00:00, run_end_date=2024-04-14 23:27:03.777670+00:00, run_duration=1.630458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:27:00.211511+00:00, queued_by_job_id=1, pid=3775 2024-04-14T23:27:05.106861401Z [2024-04-14T23:27:05.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:27:05.108418502Z [2024-04-14T23:27:05.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:26:00+00:00, run_id=scheduled__2024-04-14T23:26:00+00:00, run_start_date=2024-04-14 23:27:00.110347+00:00, run_end_date=2024-04-14 23:27:05.107285+00:00, run_duration=4.996938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:26:00+00:00, data_interval_end=2024-04-14 23:27:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:27:05.129187194Z [2024-04-14T23:27:05.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:27:00+00:00, run_after=2024-04-14T23:28:00+00:00 2024-04-14T23:27:05.178368132Z [2024-04-14T23:27:05.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status success for try_number 1 2024-04-14T23:27:05.185284839Z [2024-04-14T23:27:05.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:26:00+00:00, map_index=-1, run_start_date=2024-04-14 23:27:01.937020+00:00, run_end_date=2024-04-14 23:27:03.968007+00:00, run_duration=2.030987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:27:00.211511+00:00, queued_by_job_id=1, pid=3774 2024-04-14T23:28:00.898763739Z [2024-04-14T23:28:00.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:28:00+00:00, run_after=2024-04-14T23:29:00+00:00 2024-04-14T23:28:00.911579258Z [2024-04-14T23:28:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:28:00+00:00, run_after=2024-04-14T23:29:00+00:00 2024-04-14T23:28:00.917924577Z [2024-04-14T23:28:00.917+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:28:00.924586123Z [2024-04-14T23:28:00.924+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:28:00.983026860Z [2024-04-14T23:28:00.982+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:28:00.983061148Z 2024-04-14T23:28:00.983065313Z 2024-04-14T23:28:00.983068151Z 2024-04-14T23:28:00.983071386Z 2024-04-14T23:28:00.983332942Z [2024-04-14T23:28:00.983+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:28:00.983544210Z [2024-04-14T23:28:00.983+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:28:00.983732558Z [2024-04-14T23:28:00.983+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:28:00.983889818Z [2024-04-14T23:28:00.983+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:28:00.984446933Z [2024-04-14T23:28:00.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:28:00.984469954Z 2024-04-14T23:28:00.984473751Z 2024-04-14T23:28:00.984476595Z 2024-04-14T23:28:00.984479426Z 2024-04-14T23:28:00.987643228Z [2024-04-14T23:28:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:28:00.987732304Z [2024-04-14T23:28:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:28:00.988093391Z [2024-04-14T23:28:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:28:00.988343368Z [2024-04-14T23:28:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:28:00.988649383Z [2024-04-14T23:28:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:28:00.988866806Z [2024-04-14T23:28:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:28:00.989144875Z [2024-04-14T23:28:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:28:00.989339497Z [2024-04-14T23:28:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:28:01.322721869Z [2024-04-14T23:28:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status queued for try_number 1 2024-04-14T23:28:01.322859255Z [2024-04-14T23:28:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:27:00+00:00 exited with status queued for try_number 1 2024-04-14T23:28:01.323020487Z [2024-04-14T23:28:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:27:00+00:00 exited with status queued for try_number 1 2024-04-14T23:28:01.323116472Z [2024-04-14T23:28:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:27:00+00:00 exited with status queued for try_number 1 2024-04-14T23:28:01.343744303Z [2024-04-14T23:28:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8a2fe91-a540-40d6-9566-14be30b69759 2024-04-14T23:28:01.344008485Z [2024-04-14T23:28:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to d23dedb4-a158-44cc-8fae-42c419ac23db 2024-04-14T23:28:01.346276572Z [2024-04-14T23:28:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93fa0075-71a2-48b9-840d-3743279bf64e 2024-04-14T23:28:01.346866414Z [2024-04-14T23:28:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to b83f3156-68ce-4eec-b3bb-e81bb5492080 2024-04-14T23:28:02.704057175Z [2024-04-14T23:28:02.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:28:02.704305419Z [2024-04-14T23:28:02.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:26:00+00:00, run_id=scheduled__2024-04-14T23:26:00+00:00, run_start_date=2024-04-14 23:28:00.933862+00:00, run_end_date=2024-04-14 23:28:02.703974+00:00, run_duration=1.770112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:26:00+00:00, data_interval_end=2024-04-14 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:28:02.714301752Z [2024-04-14T23:28:02.714+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:28:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:28:02.750972067Z [2024-04-14T23:28:02.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:28:02.755162003Z [2024-04-14T23:28:02.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:27:00+00:00, run_id=scheduled__2024-04-14T23:27:00+00:00, run_start_date=2024-04-14 23:28:00.934897+00:00, run_end_date=2024-04-14 23:28:02.750894+00:00, run_duration=1.815997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:27:00+00:00, data_interval_end=2024-04-14 23:28:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:28:02.783786570Z [2024-04-14T23:28:02.783+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:28:00+00:00, run_after=2024-04-14T23:29:00+00:00 2024-04-14T23:28:02.932072079Z [2024-04-14T23:28:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:26:00+00:00 exited with status success for try_number 1 2024-04-14T23:28:02.932099770Z [2024-04-14T23:28:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:27:00+00:00 exited with status success for try_number 1 2024-04-14T23:28:02.947712126Z [2024-04-14T23:28:02.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:26:00+00:00, map_index=-1, run_start_date=2024-04-14 23:28:01.662321+00:00, run_end_date=2024-04-14 23:28:02.130763+00:00, run_duration=0.468442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:28:00.985264+00:00, queued_by_job_id=1, pid=3808 2024-04-14T23:28:02.951434008Z [2024-04-14T23:28:02.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:27:00+00:00, map_index=-1, run_start_date=2024-04-14 23:28:01.946582+00:00, run_end_date=2024-04-14 23:28:02.475713+00:00, run_duration=0.529131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:28:00.985264+00:00, queued_by_job_id=1, pid=3809 2024-04-14T23:28:05.511077421Z [2024-04-14T23:28:05.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:28:05.511525974Z [2024-04-14T23:28:05.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:27:00+00:00, run_id=scheduled__2024-04-14T23:27:00+00:00, run_start_date=2024-04-14 23:28:00.935835+00:00, run_end_date=2024-04-14 23:28:05.510808+00:00, run_duration=4.574973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:27:00+00:00, data_interval_end=2024-04-14 23:28:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:28:05.525529882Z [2024-04-14T23:28:05.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:28:00+00:00, run_after=2024-04-14T23:29:00+00:00 2024-04-14T23:28:05.536648455Z [2024-04-14T23:28:05.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:28:05.536707368Z [2024-04-14T23:28:05.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:27:00+00:00, run_id=scheduled__2024-04-14T23:27:00+00:00, run_start_date=2024-04-14 23:28:00.936757+00:00, run_end_date=2024-04-14 23:28:05.536321+00:00, run_duration=4.599564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:27:00+00:00, data_interval_end=2024-04-14 23:28:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:28:05.545675421Z [2024-04-14T23:28:05.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:28:00+00:00, run_after=2024-04-14T23:29:00+00:00 2024-04-14T23:28:05.586958859Z [2024-04-14T23:28:05.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:27:00+00:00 exited with status success for try_number 1 2024-04-14T23:28:05.587308213Z [2024-04-14T23:28:05.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:27:00+00:00 exited with status success for try_number 1 2024-04-14T23:28:05.599019056Z [2024-04-14T23:28:05.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:27:00+00:00, map_index=-1, run_start_date=2024-04-14 23:28:03.367719+00:00, run_end_date=2024-04-14 23:28:05.054640+00:00, run_duration=1.686921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:28:00.985264+00:00, queued_by_job_id=1, pid=3833 2024-04-14T23:28:05.599609801Z [2024-04-14T23:28:05.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:27:00+00:00, map_index=-1, run_start_date=2024-04-14 23:28:03.183846+00:00, run_end_date=2024-04-14 23:28:04.982036+00:00, run_duration=1.79819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:28:00.985264+00:00, queued_by_job_id=1, pid=3827 2024-04-14T23:29:00.834293505Z [2024-04-14T23:29:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:29:00.853656259Z [2024-04-14T23:29:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:29:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:29:00.868382078Z [2024-04-14T23:29:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:29:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:29:00.981609509Z [2024-04-14T23:29:00.980+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:29:00.981647304Z 2024-04-14T23:29:00.981654904Z 2024-04-14T23:29:00.981662308Z 2024-04-14T23:29:00.981867891Z [2024-04-14T23:29:00.981+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:29:00.982339662Z [2024-04-14T23:29:00.981+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:29:00.982797595Z [2024-04-14T23:29:00.982+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:29:00.984402740Z [2024-04-14T23:29:00.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:29:00.984428019Z 2024-04-14T23:29:00.984435241Z 2024-04-14T23:29:00.984441894Z 2024-04-14T23:29:00.990096535Z [2024-04-14T23:29:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:29:00.990528717Z [2024-04-14T23:29:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:29:00.991054924Z [2024-04-14T23:29:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:29:00.991350931Z [2024-04-14T23:29:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:29:00.991811164Z [2024-04-14T23:29:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:29:00.992116620Z [2024-04-14T23:29:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:29:01.217843402Z [2024-04-14T23:29:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status queued for try_number 1 2024-04-14T23:29:01.217978527Z [2024-04-14T23:29:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status queued for try_number 1 2024-04-14T23:29:01.218094456Z [2024-04-14T23:29:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status queued for try_number 1 2024-04-14T23:29:01.227935112Z [2024-04-14T23:29:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8226f6f9-c860-4afd-ac19-e4c97d84b476 2024-04-14T23:29:01.228104069Z [2024-04-14T23:29:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1907efb-9905-4ad4-a4e5-fb46124e5538 2024-04-14T23:29:01.228262165Z [2024-04-14T23:29:01.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to a59e111b-4393-43d7-a265-6ed99f1727d8 2024-04-14T23:29:02.702085501Z [2024-04-14T23:29:02.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:29:02.702509485Z [2024-04-14T23:29:02.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:28:00+00:00, run_id=scheduled__2024-04-14T23:28:00+00:00, run_start_date=2024-04-14 23:29:00.881890+00:00, run_end_date=2024-04-14 23:29:02.702169+00:00, run_duration=1.820279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:28:00+00:00, data_interval_end=2024-04-14 23:29:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:29:02.709948151Z [2024-04-14T23:29:02.709+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:29:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:29:02.757006405Z [2024-04-14T23:29:02.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status success for try_number 1 2024-04-14T23:29:02.762496425Z [2024-04-14T23:29:02.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:28:00+00:00, map_index=-1, run_start_date=2024-04-14 23:29:01.667261+00:00, run_end_date=2024-04-14 23:29:02.012731+00:00, run_duration=0.34547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:29:00.985798+00:00, queued_by_job_id=1, pid=3865 2024-04-14T23:29:04.851131866Z [2024-04-14T23:29:04.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:29:04.851376229Z [2024-04-14T23:29:04.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:28:00+00:00, run_id=scheduled__2024-04-14T23:28:00+00:00, run_start_date=2024-04-14 23:29:00.884395+00:00, run_end_date=2024-04-14 23:29:04.850951+00:00, run_duration=3.966556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:28:00+00:00, data_interval_end=2024-04-14 23:29:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:29:04.863044666Z [2024-04-14T23:29:04.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:29:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:29:04.914760451Z [2024-04-14T23:29:04.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status success for try_number 1 2024-04-14T23:29:04.922028166Z [2024-04-14T23:29:04.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:28:00+00:00, map_index=-1, run_start_date=2024-04-14 23:29:02.584119+00:00, run_end_date=2024-04-14 23:29:04.057369+00:00, run_duration=1.47325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:29:00.985798+00:00, queued_by_job_id=1, pid=3883 2024-04-14T23:29:05.993434098Z [2024-04-14T23:29:05.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:29:05.993662531Z [2024-04-14T23:29:05.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:28:00+00:00, run_id=scheduled__2024-04-14T23:28:00+00:00, run_start_date=2024-04-14 23:29:00.883127+00:00, run_end_date=2024-04-14 23:29:05.993370+00:00, run_duration=5.110243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:28:00+00:00, data_interval_end=2024-04-14 23:29:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:29:06.003444668Z [2024-04-14T23:29:06.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:29:00+00:00, run_after=2024-04-14T23:30:00+00:00 2024-04-14T23:29:06.033220929Z [2024-04-14T23:29:06.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status success for try_number 1 2024-04-14T23:29:06.037586998Z [2024-04-14T23:29:06.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:28:00+00:00, map_index=-1, run_start_date=2024-04-14 23:29:02.659571+00:00, run_end_date=2024-04-14 23:29:05.072179+00:00, run_duration=2.412608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:29:00.985798+00:00, queued_by_job_id=1, pid=3884 2024-04-14T23:30:00.742812467Z [2024-04-14T23:30:00.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:31:00+00:00 2024-04-14T23:30:00.751154175Z [2024-04-14T23:30:00.750+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:30:00.760554309Z [2024-04-14T23:30:00.760+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:30:00.777714330Z [2024-04-14T23:30:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:31:00+00:00 2024-04-14T23:30:00.794975281Z [2024-04-14T23:30:00.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:35:00+00:00 2024-04-14T23:30:00.899078328Z [2024-04-14T23:30:00.898+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T23:30:00.899112925Z 2024-04-14T23:30:00.899120671Z 2024-04-14T23:30:00.899128871Z 2024-04-14T23:30:00.899135499Z 2024-04-14T23:30:00.899142076Z 2024-04-14T23:30:00.899156485Z [2024-04-14T23:30:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:30:00.899311701Z [2024-04-14T23:30:00.899+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:30:00.899483180Z [2024-04-14T23:30:00.899+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:30:00.899659627Z [2024-04-14T23:30:00.899+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:30:00.900073173Z [2024-04-14T23:30:00.899+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:30:00.900974324Z [2024-04-14T23:30:00.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:30:00.900985600Z 2024-04-14T23:30:00.900989691Z 2024-04-14T23:30:00.900993434Z 2024-04-14T23:30:00.900996747Z 2024-04-14T23:30:00.901003102Z 2024-04-14T23:30:00.906600146Z [2024-04-14T23:30:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:30:00.906622375Z [2024-04-14T23:30:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:30:00.906993596Z [2024-04-14T23:30:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:30:00.907138218Z [2024-04-14T23:30:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:30:00.907407531Z [2024-04-14T23:30:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:30:00.907543239Z [2024-04-14T23:30:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:30:00.907832687Z [2024-04-14T23:30:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:30:00.907952563Z [2024-04-14T23:30:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:30:00.908220539Z [2024-04-14T23:30:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:30:00.908370239Z [2024-04-14T23:30:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:30:01.531834688Z [2024-04-14T23:30:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:01.531913079Z [2024-04-14T23:30:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:01.532069446Z [2024-04-14T23:30:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:29:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:01.532215526Z [2024-04-14T23:30:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:29:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:01.532320071Z [2024-04-14T23:30:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:29:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:01.546588171Z [2024-04-14T23:30:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4e96004-17f5-4b06-81db-1c21a4040fd4 2024-04-14T23:30:01.549528706Z [2024-04-14T23:30:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14d4a4b8-a787-47a7-8cf7-3b1b6fc2e09e 2024-04-14T23:30:01.549724955Z [2024-04-14T23:30:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37d2d18e-2087-4765-a02c-d34c6176605d 2024-04-14T23:30:01.549894090Z [2024-04-14T23:30:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to b686952a-3714-40df-aac4-7904ff735e55 2024-04-14T23:30:01.550061084Z [2024-04-14T23:30:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bfd03f2-b377-42bc-ba9b-8033d24b76b3 2024-04-14T23:30:03.097718959Z [2024-04-14T23:30:03.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:30:03.098013339Z [2024-04-14T23:30:03.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:29:00+00:00, run_id=scheduled__2024-04-14T23:29:00+00:00, run_start_date=2024-04-14 23:30:00.810415+00:00, run_end_date=2024-04-14 23:30:03.097659+00:00, run_duration=2.287244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:29:00+00:00, data_interval_end=2024-04-14 23:30:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:30:03.108433825Z [2024-04-14T23:30:03.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:31:00+00:00 2024-04-14T23:30:03.117410166Z [2024-04-14T23:30:03.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:30:03.117558254Z [2024-04-14T23:30:03.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:28:00+00:00, run_id=scheduled__2024-04-14T23:28:00+00:00, run_start_date=2024-04-14 23:30:00.809110+00:00, run_end_date=2024-04-14 23:30:03.117329+00:00, run_duration=2.308219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:28:00+00:00, data_interval_end=2024-04-14 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:30:03.128403495Z [2024-04-14T23:30:03.128+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:32:00+00:00 2024-04-14T23:30:03.199467040Z [2024-04-14T23:30:03.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:28:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:03.199639634Z [2024-04-14T23:30:03.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:29:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:03.206928523Z [2024-04-14T23:30:03.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:29:00+00:00, map_index=-1, run_start_date=2024-04-14 23:30:01.637554+00:00, run_end_date=2024-04-14 23:30:02.048295+00:00, run_duration=0.410741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:00.902627+00:00, queued_by_job_id=1, pid=3918 2024-04-14T23:30:03.207340269Z [2024-04-14T23:30:03.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:28:00+00:00, map_index=-1, run_start_date=2024-04-14 23:30:01.858109+00:00, run_end_date=2024-04-14 23:30:02.256523+00:00, run_duration=0.398414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:00.902627+00:00, queued_by_job_id=1, pid=3919 2024-04-14T23:30:04.272185645Z [2024-04-14T23:30:04.271+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:30:04.272207997Z 2024-04-14T23:30:04.272316925Z [2024-04-14T23:30:04.272+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:30:04.273257293Z [2024-04-14T23:30:04.273+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:30:04.273264999Z 2024-04-14T23:30:04.275823947Z [2024-04-14T23:30:04.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:30:04.276004261Z [2024-04-14T23:30:04.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:30:04.339337833Z [2024-04-14T23:30:04.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:04.339367627Z [2024-04-14T23:30:04.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:04.339373719Z [2024-04-14T23:30:04.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:29:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:04.360140796Z [2024-04-14T23:30:04.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36edd316-989e-4b4c-94bb-06a9e27cd6a9 2024-04-14T23:30:04.360168204Z [2024-04-14T23:30:04.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:25:00+00:00, map_index=-1, run_start_date=2024-04-14 23:30:03.142832+00:00, run_end_date=2024-04-14 23:30:03.567230+00:00, run_duration=0.424398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:00.902627+00:00, queued_by_job_id=1, pid=3955 2024-04-14T23:30:04.360188472Z [2024-04-14T23:30:04.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:29:00+00:00, map_index=-1, run_start_date=2024-04-14 23:30:02.786511+00:00, run_end_date=2024-04-14 23:30:04.142227+00:00, run_duration=1.355716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:00.902627+00:00, queued_by_job_id=1, pid=3938 2024-04-14T23:30:04.404691611Z [2024-04-14T23:30:04.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:30:04.405238230Z [2024-04-14T23:30:04.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:29:00+00:00, run_id=scheduled__2024-04-14T23:29:00+00:00, run_start_date=2024-04-14 23:30:00.811560+00:00, run_end_date=2024-04-14 23:30:04.404813+00:00, run_duration=3.593253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:29:00+00:00, data_interval_end=2024-04-14 23:30:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:30:04.416050729Z [2024-04-14T23:30:04.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:31:00+00:00 2024-04-14T23:30:05.349121030Z [2024-04-14T23:30:05.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:30:05.349701330Z [2024-04-14T23:30:05.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:29:00+00:00, run_id=scheduled__2024-04-14T23:29:00+00:00, run_start_date=2024-04-14 23:30:00.812832+00:00, run_end_date=2024-04-14 23:30:05.349019+00:00, run_duration=4.536187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:29:00+00:00, data_interval_end=2024-04-14 23:30:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:30:05.360888814Z [2024-04-14T23:30:05.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:31:00+00:00 2024-04-14T23:30:05.420039733Z [2024-04-14T23:30:05.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:29:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:05.428684621Z [2024-04-14T23:30:05.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:29:00+00:00, map_index=-1, run_start_date=2024-04-14 23:30:03.111315+00:00, run_end_date=2024-04-14 23:30:04.787784+00:00, run_duration=1.676469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:00.902627+00:00, queued_by_job_id=1, pid=3954 2024-04-14T23:30:06.688423804Z [2024-04-14T23:30:06.687+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:30:06.688474590Z 2024-04-14T23:30:06.688754309Z [2024-04-14T23:30:06.688+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:30:06.690380049Z [2024-04-14T23:30:06.689+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:30:06.690387250Z 2024-04-14T23:30:06.695000668Z [2024-04-14T23:30:06.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:30:06.695413246Z [2024-04-14T23:30:06.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:30:06.753323657Z [2024-04-14T23:30:06.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:06.753544383Z [2024-04-14T23:30:06.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:06.759948089Z [2024-04-14T23:30:06.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68513cb4-3abb-44d5-8530-b4fa16a3efbe 2024-04-14T23:30:06.760210649Z [2024-04-14T23:30:06.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:25:00+00:00, map_index=-1, run_start_date=2024-04-14 23:30:05.734371+00:00, run_end_date=2024-04-14 23:30:06.159253+00:00, run_duration=0.424882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:04.273693+00:00, queued_by_job_id=1, pid=3973 2024-04-14T23:30:09.050225418Z [2024-04-14T23:30:09.049+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:30:09.050271348Z 2024-04-14T23:30:09.050462037Z [2024-04-14T23:30:09.050+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:30:09.052450142Z [2024-04-14T23:30:09.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:30:09.052477968Z 2024-04-14T23:30:09.057188032Z [2024-04-14T23:30:09.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:30:09.057541293Z [2024-04-14T23:30:09.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:30:09.138097394Z [2024-04-14T23:30:09.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status queued for try_number 1 2024-04-14T23:30:09.138378964Z [2024-04-14T23:30:09.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:09.144951424Z [2024-04-14T23:30:09.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9c0ddfc-78a6-4ded-8301-27f4eaa42aef 2024-04-14T23:30:09.145235227Z [2024-04-14T23:30:09.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:25:00+00:00, map_index=0, run_start_date=2024-04-14 23:30:08.124949+00:00, run_end_date=2024-04-14 23:30:08.545175+00:00, run_duration=0.420226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:06.691163+00:00, queued_by_job_id=1, pid=3981 2024-04-14T23:30:11.354403982Z [2024-04-14T23:30:11.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:30:11.354542309Z [2024-04-14T23:30:11.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:25:00+00:00, run_id=scheduled__2024-04-14T23:25:00+00:00, run_start_date=2024-04-14 23:30:00.807455+00:00, run_end_date=2024-04-14 23:30:11.354187+00:00, run_duration=10.546732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:25:00+00:00, data_interval_end=2024-04-14 23:30:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:30:11.360181568Z [2024-04-14T23:30:11.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:30:00+00:00, run_after=2024-04-14T23:35:00+00:00 2024-04-14T23:30:11.398619364Z [2024-04-14T23:30:11.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:25:00+00:00 exited with status success for try_number 1 2024-04-14T23:30:11.404135478Z [2024-04-14T23:30:11.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:25:00+00:00, map_index=-1, run_start_date=2024-04-14 23:30:10.530719+00:00, run_end_date=2024-04-14 23:30:10.860994+00:00, run_duration=0.330275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:30:09.053823+00:00, queued_by_job_id=1, pid=3989 2024-04-14T23:31:00.749773494Z [2024-04-14T23:31:00.749+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:31:00.772670991Z [2024-04-14T23:31:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:31:00+00:00, run_after=2024-04-14T23:32:00+00:00 2024-04-14T23:31:00.785272320Z [2024-04-14T23:31:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:31:00+00:00, run_after=2024-04-14T23:32:00+00:00 2024-04-14T23:31:00.867929121Z [2024-04-14T23:31:00.866+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:31:00.867952692Z 2024-04-14T23:31:00.867956510Z 2024-04-14T23:31:00.867960070Z 2024-04-14T23:31:00.867964147Z [2024-04-14T23:31:00.867+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:31:00.867967574Z [2024-04-14T23:31:00.867+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:31:00.868446902Z [2024-04-14T23:31:00.867+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:31:00.870024905Z [2024-04-14T23:31:00.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:31:00.870035583Z 2024-04-14T23:31:00.870040126Z 2024-04-14T23:31:00.870044072Z 2024-04-14T23:31:00.875280317Z [2024-04-14T23:31:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:31:00.875596354Z [2024-04-14T23:31:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:31:00.876311358Z [2024-04-14T23:31:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:31:00.876695387Z [2024-04-14T23:31:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:31:00.877172729Z [2024-04-14T23:31:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:31:00.877438641Z [2024-04-14T23:31:00.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:31:01.115289318Z [2024-04-14T23:31:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:31:01.115321233Z [2024-04-14T23:31:01.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:31:01.115483031Z [2024-04-14T23:31:01.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:31:01.124976664Z [2024-04-14T23:31:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to d83863f2-e3aa-455b-9c9f-d12b63d86f6f 2024-04-14T23:31:01.125134539Z [2024-04-14T23:31:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85a47daa-c157-4c27-af36-a049c3b87e85 2024-04-14T23:31:01.125348753Z [2024-04-14T23:31:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15b048fd-d361-4894-bc80-a0af21d28f9d 2024-04-14T23:31:01.422716814Z [2024-04-14T23:31:01.422+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:31:02.331904610Z [2024-04-14T23:31:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:31:02.332405486Z [2024-04-14T23:31:02.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:30:00+00:00, run_id=scheduled__2024-04-14T23:30:00+00:00, run_start_date=2024-04-14 23:31:00.800352+00:00, run_end_date=2024-04-14 23:31:02.331821+00:00, run_duration=1.531469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:30:00+00:00, data_interval_end=2024-04-14 23:31:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:31:02.344360944Z [2024-04-14T23:31:02.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:31:00+00:00, run_after=2024-04-14T23:32:00+00:00 2024-04-14T23:31:02.388036417Z [2024-04-14T23:31:02.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:31:02.394168529Z [2024-04-14T23:31:02.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=-1, run_start_date=2024-04-14 23:31:01.661718+00:00, run_end_date=2024-04-14 23:31:02.064161+00:00, run_duration=0.402443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:31:00.871504+00:00, queued_by_job_id=1, pid=4012 2024-04-14T23:31:04.913962454Z [2024-04-14T23:31:04.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:31:04.914425065Z [2024-04-14T23:31:04.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:30:00+00:00, run_id=scheduled__2024-04-14T23:30:00+00:00, run_start_date=2024-04-14 23:31:00.803102+00:00, run_end_date=2024-04-14 23:31:04.913969+00:00, run_duration=4.110867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:30:00+00:00, data_interval_end=2024-04-14 23:31:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:31:04.925477332Z [2024-04-14T23:31:04.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:31:00+00:00, run_after=2024-04-14T23:32:00+00:00 2024-04-14T23:31:04.971813748Z [2024-04-14T23:31:04.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:31:04.983170000Z [2024-04-14T23:31:04.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=-1, run_start_date=2024-04-14 23:31:02.518456+00:00, run_end_date=2024-04-14 23:31:04.062866+00:00, run_duration=1.54441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:31:00.871504+00:00, queued_by_job_id=1, pid=4030 2024-04-14T23:31:05.771530592Z [2024-04-14T23:31:05.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:31:05.772049110Z [2024-04-14T23:31:05.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:30:00+00:00, run_id=scheduled__2024-04-14T23:30:00+00:00, run_start_date=2024-04-14 23:31:00.805275+00:00, run_end_date=2024-04-14 23:31:05.771367+00:00, run_duration=4.966092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:30:00+00:00, data_interval_end=2024-04-14 23:31:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:31:05.784485216Z [2024-04-14T23:31:05.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:31:00+00:00, run_after=2024-04-14T23:32:00+00:00 2024-04-14T23:31:05.831322453Z [2024-04-14T23:31:05.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:31:05.840350944Z [2024-04-14T23:31:05.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=-1, run_start_date=2024-04-14 23:31:02.642868+00:00, run_end_date=2024-04-14 23:31:04.995012+00:00, run_duration=2.352144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:31:00.871504+00:00, queued_by_job_id=1, pid=4031 2024-04-14T23:32:00.686538825Z [2024-04-14T23:32:00.685+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:32:00.702406031Z [2024-04-14T23:32:00.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:32:00+00:00, run_after=2024-04-14T23:33:00+00:00 2024-04-14T23:32:00.708776957Z [2024-04-14T23:32:00.708+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:32:00.721573355Z [2024-04-14T23:32:00.721+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:32:00+00:00, run_after=2024-04-14T23:33:00+00:00 2024-04-14T23:32:00.790277298Z [2024-04-14T23:32:00.789+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:32:00.790306830Z 2024-04-14T23:32:00.790313230Z 2024-04-14T23:32:00.790317584Z 2024-04-14T23:32:00.790322156Z 2024-04-14T23:32:00.790326875Z [2024-04-14T23:32:00.790+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:32:00.790626085Z [2024-04-14T23:32:00.790+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:32:00.790915789Z [2024-04-14T23:32:00.790+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:32:00.791133051Z [2024-04-14T23:32:00.790+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:32:00.791850965Z [2024-04-14T23:32:00.791+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:32:00.791868896Z 2024-04-14T23:32:00.791880521Z 2024-04-14T23:32:00.791889404Z 2024-04-14T23:32:00.791898124Z 2024-04-14T23:32:00.795844702Z [2024-04-14T23:32:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:32:00.796103365Z [2024-04-14T23:32:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:32:00.796418333Z [2024-04-14T23:32:00.796+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:32:00.796565963Z [2024-04-14T23:32:00.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:32:00.796873346Z [2024-04-14T23:32:00.796+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:32:00.797103369Z [2024-04-14T23:32:00.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:32:00.797322325Z [2024-04-14T23:32:00.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:32:00.797431139Z [2024-04-14T23:32:00.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:32:01.075592983Z [2024-04-14T23:32:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:32:01.075637717Z [2024-04-14T23:32:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:31:00+00:00 exited with status queued for try_number 1 2024-04-14T23:32:01.075819706Z [2024-04-14T23:32:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:31:00+00:00 exited with status queued for try_number 1 2024-04-14T23:32:01.075876154Z [2024-04-14T23:32:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:31:00+00:00 exited with status queued for try_number 1 2024-04-14T23:32:01.083043372Z [2024-04-14T23:32:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca189c27-343b-45a8-84e9-ea912ede3086 2024-04-14T23:32:01.083139242Z [2024-04-14T23:32:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e78fb2a-41a0-4f37-92ca-d66f69097acc 2024-04-14T23:32:01.083285663Z [2024-04-14T23:32:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82c40895-5e03-4ab7-aa0d-94ef443ec0fa 2024-04-14T23:32:01.083361479Z [2024-04-14T23:32:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 727feefb-da9f-4f2b-a670-cb4675d01352 2024-04-14T23:32:02.390742694Z [2024-04-14T23:32:02.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:32:02.391130811Z [2024-04-14T23:32:02.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:30:00+00:00, run_id=scheduled__2024-04-14T23:30:00+00:00, run_start_date=2024-04-14 23:32:00.730508+00:00, run_end_date=2024-04-14 23:32:02.390653+00:00, run_duration=1.660145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:30:00+00:00, data_interval_end=2024-04-14 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:32:02.399490822Z [2024-04-14T23:32:02.399+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:32:00+00:00, run_after=2024-04-14T23:34:00+00:00 2024-04-14T23:32:02.422143939Z [2024-04-14T23:32:02.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:32:02.424298000Z [2024-04-14T23:32:02.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:31:00+00:00, run_id=scheduled__2024-04-14T23:31:00+00:00, run_start_date=2024-04-14 23:32:00.731594+00:00, run_end_date=2024-04-14 23:32:02.423812+00:00, run_duration=1.692218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:31:00+00:00, data_interval_end=2024-04-14 23:32:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:32:02.437391657Z [2024-04-14T23:32:02.437+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:32:00+00:00, run_after=2024-04-14T23:33:00+00:00 2024-04-14T23:32:02.494307078Z [2024-04-14T23:32:02.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:32:02.495458177Z [2024-04-14T23:32:02.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:31:00+00:00 exited with status success for try_number 1 2024-04-14T23:32:02.505152661Z [2024-04-14T23:32:02.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=-1, run_start_date=2024-04-14 23:32:01.445380+00:00, run_end_date=2024-04-14 23:32:01.947041+00:00, run_duration=0.501661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:32:00.792826+00:00, queued_by_job_id=1, pid=4065 2024-04-14T23:32:02.505507680Z [2024-04-14T23:32:02.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:31:00+00:00, map_index=-1, run_start_date=2024-04-14 23:32:01.568423+00:00, run_end_date=2024-04-14 23:32:02.013030+00:00, run_duration=0.444607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:32:00.792826+00:00, queued_by_job_id=1, pid=4066 2024-04-14T23:32:04.740478570Z [2024-04-14T23:32:04.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:32:04.740781767Z [2024-04-14T23:32:04.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:31:00+00:00, run_id=scheduled__2024-04-14T23:31:00+00:00, run_start_date=2024-04-14 23:32:00.732425+00:00, run_end_date=2024-04-14 23:32:04.740276+00:00, run_duration=4.007851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:31:00+00:00, data_interval_end=2024-04-14 23:32:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:32:04.750328851Z [2024-04-14T23:32:04.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:32:00+00:00, run_after=2024-04-14T23:33:00+00:00 2024-04-14T23:32:04.758719075Z [2024-04-14T23:32:04.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:32:04.759810354Z [2024-04-14T23:32:04.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:31:00+00:00, run_id=scheduled__2024-04-14T23:31:00+00:00, run_start_date=2024-04-14 23:32:00.733335+00:00, run_end_date=2024-04-14 23:32:04.758623+00:00, run_duration=4.025288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:31:00+00:00, data_interval_end=2024-04-14 23:32:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:32:04.772400341Z [2024-04-14T23:32:04.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:32:00+00:00, run_after=2024-04-14T23:33:00+00:00 2024-04-14T23:32:04.817573398Z [2024-04-14T23:32:04.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:31:00+00:00 exited with status success for try_number 1 2024-04-14T23:32:04.817659728Z [2024-04-14T23:32:04.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:31:00+00:00 exited with status success for try_number 1 2024-04-14T23:32:04.826219654Z [2024-04-14T23:32:04.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:31:00+00:00, map_index=-1, run_start_date=2024-04-14 23:32:02.542416+00:00, run_end_date=2024-04-14 23:32:03.945758+00:00, run_duration=1.403342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:32:00.792826+00:00, queued_by_job_id=1, pid=4089 2024-04-14T23:32:04.826636042Z [2024-04-14T23:32:04.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:31:00+00:00, map_index=-1, run_start_date=2024-04-14 23:32:02.721575+00:00, run_end_date=2024-04-14 23:32:04.612882+00:00, run_duration=1.891307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:32:00.792826+00:00, queued_by_job_id=1, pid=4090 2024-04-14T23:33:00.581092630Z [2024-04-14T23:33:00.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:33:00+00:00, run_after=2024-04-14T23:34:00+00:00 2024-04-14T23:33:00.595047345Z [2024-04-14T23:33:00.594+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:33:00+00:00, run_after=2024-04-14T23:34:00+00:00 2024-04-14T23:33:00.602571074Z [2024-04-14T23:33:00.602+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:33:00.678631385Z [2024-04-14T23:33:00.678+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:33:00.678663685Z 2024-04-14T23:33:00.678669548Z 2024-04-14T23:33:00.678674347Z 2024-04-14T23:33:00.678868502Z [2024-04-14T23:33:00.678+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:33:00.679250912Z [2024-04-14T23:33:00.679+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:33:00.679578525Z [2024-04-14T23:33:00.679+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:33:00.680298010Z [2024-04-14T23:33:00.680+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:33:00.680314435Z 2024-04-14T23:33:00.680320039Z 2024-04-14T23:33:00.680324819Z 2024-04-14T23:33:00.684366493Z [2024-04-14T23:33:00.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:33:00.684383591Z [2024-04-14T23:33:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:33:00.684975804Z [2024-04-14T23:33:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:33:00.685187711Z [2024-04-14T23:33:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:33:00.685523237Z [2024-04-14T23:33:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:33:00.685727283Z [2024-04-14T23:33:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:33:00.927850767Z [2024-04-14T23:33:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status queued for try_number 1 2024-04-14T23:33:00.927936394Z [2024-04-14T23:33:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status queued for try_number 1 2024-04-14T23:33:00.928119198Z [2024-04-14T23:33:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status queued for try_number 1 2024-04-14T23:33:00.944880030Z [2024-04-14T23:33:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 304442e8-c7c5-4347-813e-ddebcadca13f 2024-04-14T23:33:00.945252865Z [2024-04-14T23:33:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to b337c8bb-c90a-4204-a02c-6b6a7d325a5f 2024-04-14T23:33:00.945520586Z [2024-04-14T23:33:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c1653be-c750-450a-b5d5-1513c4cdbf26 2024-04-14T23:33:02.093955572Z [2024-04-14T23:33:02.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:33:02.094247217Z [2024-04-14T23:33:02.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:32:00+00:00, run_id=scheduled__2024-04-14T23:32:00+00:00, run_start_date=2024-04-14 23:33:00.616242+00:00, run_end_date=2024-04-14 23:33:02.093842+00:00, run_duration=1.4776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:32:00+00:00, data_interval_end=2024-04-14 23:33:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:33:02.102565413Z [2024-04-14T23:33:02.102+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:33:00+00:00, run_after=2024-04-14T23:34:00+00:00 2024-04-14T23:33:02.149784238Z [2024-04-14T23:33:02.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status success for try_number 1 2024-04-14T23:33:02.156040218Z [2024-04-14T23:33:02.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:32:00+00:00, map_index=-1, run_start_date=2024-04-14 23:33:01.416483+00:00, run_end_date=2024-04-14 23:33:01.730614+00:00, run_duration=0.314131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:33:00.681262+00:00, queued_by_job_id=1, pid=4122 2024-04-14T23:33:04.048079208Z [2024-04-14T23:33:04.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:33:04.048313102Z [2024-04-14T23:33:04.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:32:00+00:00, run_id=scheduled__2024-04-14T23:32:00+00:00, run_start_date=2024-04-14 23:33:00.617676+00:00, run_end_date=2024-04-14 23:33:04.048044+00:00, run_duration=3.430368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:32:00+00:00, data_interval_end=2024-04-14 23:33:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:33:04.056588184Z [2024-04-14T23:33:04.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:33:00+00:00, run_after=2024-04-14T23:34:00+00:00 2024-04-14T23:33:04.062397758Z [2024-04-14T23:33:04.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:33:04.062713581Z [2024-04-14T23:33:04.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:32:00+00:00, run_id=scheduled__2024-04-14T23:32:00+00:00, run_start_date=2024-04-14 23:33:00.618915+00:00, run_end_date=2024-04-14 23:33:04.062434+00:00, run_duration=3.443519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:32:00+00:00, data_interval_end=2024-04-14 23:33:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:33:04.074130552Z [2024-04-14T23:33:04.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:33:00+00:00, run_after=2024-04-14T23:34:00+00:00 2024-04-14T23:33:04.111275658Z [2024-04-14T23:33:04.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status success for try_number 1 2024-04-14T23:33:04.111378378Z [2024-04-14T23:33:04.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status success for try_number 1 2024-04-14T23:33:04.117106504Z [2024-04-14T23:33:04.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:32:00+00:00, map_index=-1, run_start_date=2024-04-14 23:33:02.216302+00:00, run_end_date=2024-04-14 23:33:03.497208+00:00, run_duration=1.280906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:33:00.681262+00:00, queued_by_job_id=1, pid=4140 2024-04-14T23:33:04.117345163Z [2024-04-14T23:33:04.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:32:00+00:00, map_index=-1, run_start_date=2024-04-14 23:33:02.291441+00:00, run_end_date=2024-04-14 23:33:03.795515+00:00, run_duration=1.504074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:33:00.681262+00:00, queued_by_job_id=1, pid=4141 2024-04-14T23:34:00.129086537Z [2024-04-14T23:34:00.128+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:34:00.139705547Z [2024-04-14T23:34:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:34:00+00:00, run_after=2024-04-14T23:35:00+00:00 2024-04-14T23:34:00.145308086Z [2024-04-14T23:34:00.144+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:34:00.155676439Z [2024-04-14T23:34:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:34:00+00:00, run_after=2024-04-14T23:35:00+00:00 2024-04-14T23:34:00.215301597Z [2024-04-14T23:34:00.214+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:34:00.215323039Z 2024-04-14T23:34:00.215329091Z 2024-04-14T23:34:00.215332326Z 2024-04-14T23:34:00.215335311Z 2024-04-14T23:34:00.215492688Z [2024-04-14T23:34:00.215+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:34:00.215703231Z [2024-04-14T23:34:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:34:00.215916153Z [2024-04-14T23:34:00.215+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:34:00.216171856Z [2024-04-14T23:34:00.215+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:34:00.217444155Z [2024-04-14T23:34:00.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:34:00.217451604Z 2024-04-14T23:34:00.217470105Z 2024-04-14T23:34:00.217486927Z 2024-04-14T23:34:00.217490513Z 2024-04-14T23:34:00.224454640Z [2024-04-14T23:34:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:34:00.224600532Z [2024-04-14T23:34:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:34:00.224992019Z [2024-04-14T23:34:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:34:00.225104213Z [2024-04-14T23:34:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:34:00.225439150Z [2024-04-14T23:34:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:34:00.225602818Z [2024-04-14T23:34:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:34:00.225900131Z [2024-04-14T23:34:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:34:00.226063216Z [2024-04-14T23:34:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:34:00.659898090Z [2024-04-14T23:34:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status queued for try_number 1 2024-04-14T23:34:00.659924358Z [2024-04-14T23:34:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:33:00+00:00 exited with status queued for try_number 1 2024-04-14T23:34:00.659933010Z [2024-04-14T23:34:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:33:00+00:00 exited with status queued for try_number 1 2024-04-14T23:34:00.659998906Z [2024-04-14T23:34:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:33:00+00:00 exited with status queued for try_number 1 2024-04-14T23:34:00.671571642Z [2024-04-14T23:34:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f325279-3bdf-47a9-9a24-9a992c2cfdee 2024-04-14T23:34:00.671598840Z [2024-04-14T23:34:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 275288ab-e986-4a9e-bacd-90e3c4a9b848 2024-04-14T23:34:00.671687605Z [2024-04-14T23:34:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce13396d-c6c8-4447-8ede-936431ac3d6d 2024-04-14T23:34:00.671759213Z [2024-04-14T23:34:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8568313-32db-4066-9e5e-f6faad85a5bf 2024-04-14T23:34:01.937302946Z [2024-04-14T23:34:01.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:34:01.937550484Z [2024-04-14T23:34:01.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:32:00+00:00, run_id=scheduled__2024-04-14T23:32:00+00:00, run_start_date=2024-04-14 23:34:00.163957+00:00, run_end_date=2024-04-14 23:34:01.937229+00:00, run_duration=1.773272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:32:00+00:00, data_interval_end=2024-04-14 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:34:01.945815966Z [2024-04-14T23:34:01.945+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:34:00+00:00, run_after=2024-04-14T23:36:00+00:00 2024-04-14T23:34:01.954808597Z [2024-04-14T23:34:01.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:34:01.955009407Z [2024-04-14T23:34:01.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:33:00+00:00, run_id=scheduled__2024-04-14T23:33:00+00:00, run_start_date=2024-04-14 23:34:00.165211+00:00, run_end_date=2024-04-14 23:34:01.954725+00:00, run_duration=1.789514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:33:00+00:00, data_interval_end=2024-04-14 23:34:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:34:01.968785275Z [2024-04-14T23:34:01.968+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:34:00+00:00, run_after=2024-04-14T23:35:00+00:00 2024-04-14T23:34:02.078787105Z [2024-04-14T23:34:02.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:32:00+00:00 exited with status success for try_number 1 2024-04-14T23:34:02.078809427Z [2024-04-14T23:34:02.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:33:00+00:00 exited with status success for try_number 1 2024-04-14T23:34:02.084096406Z [2024-04-14T23:34:02.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:33:00+00:00, map_index=-1, run_start_date=2024-04-14 23:34:01.214505+00:00, run_end_date=2024-04-14 23:34:01.545665+00:00, run_duration=0.33116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:34:00.219542+00:00, queued_by_job_id=1, pid=4175 2024-04-14T23:34:02.084188726Z [2024-04-14T23:34:02.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:32:00+00:00, map_index=-1, run_start_date=2024-04-14 23:34:01.104133+00:00, run_end_date=2024-04-14 23:34:01.575055+00:00, run_duration=0.470922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:34:00.219542+00:00, queued_by_job_id=1, pid=4174 2024-04-14T23:34:04.414047149Z [2024-04-14T23:34:04.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:34:04.422455959Z [2024-04-14T23:34:04.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:33:00+00:00, run_id=scheduled__2024-04-14T23:33:00+00:00, run_start_date=2024-04-14 23:34:00.167054+00:00, run_end_date=2024-04-14 23:34:04.413821+00:00, run_duration=4.246767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:33:00+00:00, data_interval_end=2024-04-14 23:34:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:34:04.443798381Z [2024-04-14T23:34:04.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:34:00+00:00, run_after=2024-04-14T23:35:00+00:00 2024-04-14T23:34:04.457929149Z [2024-04-14T23:34:04.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:34:04.458364406Z [2024-04-14T23:34:04.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:33:00+00:00, run_id=scheduled__2024-04-14T23:33:00+00:00, run_start_date=2024-04-14 23:34:00.166230+00:00, run_end_date=2024-04-14 23:34:04.457921+00:00, run_duration=4.291691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:33:00+00:00, data_interval_end=2024-04-14 23:34:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:34:04.474912308Z [2024-04-14T23:34:04.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:34:00+00:00, run_after=2024-04-14T23:35:00+00:00 2024-04-14T23:34:04.510084922Z [2024-04-14T23:34:04.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:33:00+00:00 exited with status success for try_number 1 2024-04-14T23:34:04.510343132Z [2024-04-14T23:34:04.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:33:00+00:00 exited with status success for try_number 1 2024-04-14T23:34:04.517914735Z [2024-04-14T23:34:04.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:33:00+00:00, map_index=-1, run_start_date=2024-04-14 23:34:02.260809+00:00, run_end_date=2024-04-14 23:34:03.901930+00:00, run_duration=1.641121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:34:00.219542+00:00, queued_by_job_id=1, pid=4198 2024-04-14T23:34:04.518162722Z [2024-04-14T23:34:04.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:33:00+00:00, map_index=-1, run_start_date=2024-04-14 23:34:02.458093+00:00, run_end_date=2024-04-14 23:34:03.696256+00:00, run_duration=1.238163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:34:00.219542+00:00, queued_by_job_id=1, pid=4199 2024-04-14T23:35:00.606992623Z [2024-04-14T23:35:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:35:00+00:00, run_after=2024-04-14T23:36:00+00:00 2024-04-14T23:35:00.622464094Z [2024-04-14T23:35:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:35:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:35:00.639494346Z [2024-04-14T23:35:00.639+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:35:00+00:00, run_after=2024-04-14T23:36:00+00:00 2024-04-14T23:35:00.648131440Z [2024-04-14T23:35:00.647+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:35:00.746148292Z [2024-04-14T23:35:00.745+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:35:00.746201065Z 2024-04-14T23:35:00.746212685Z 2024-04-14T23:35:00.746221421Z 2024-04-14T23:35:00.746231616Z 2024-04-14T23:35:00.746373572Z [2024-04-14T23:35:00.745+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:35:00.746687913Z [2024-04-14T23:35:00.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:35:00.747057696Z [2024-04-14T23:35:00.746+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:35:00.747415096Z [2024-04-14T23:35:00.747+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:35:00.748627967Z [2024-04-14T23:35:00.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:35:00.748683550Z 2024-04-14T23:35:00.748694460Z 2024-04-14T23:35:00.748703432Z 2024-04-14T23:35:00.748712601Z 2024-04-14T23:35:00.753821812Z [2024-04-14T23:35:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:35:00.754225256Z [2024-04-14T23:35:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:35:00.754679337Z [2024-04-14T23:35:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:35:00.755009709Z [2024-04-14T23:35:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:35:00.755465319Z [2024-04-14T23:35:00.755+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:35:00.755765057Z [2024-04-14T23:35:00.755+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:35:00.756218576Z [2024-04-14T23:35:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:35:00.756559547Z [2024-04-14T23:35:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:35:01.301621593Z [2024-04-14T23:35:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:35:01.301820940Z [2024-04-14T23:35:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status queued for try_number 1 2024-04-14T23:35:01.301987760Z [2024-04-14T23:35:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status queued for try_number 1 2024-04-14T23:35:01.302133658Z [2024-04-14T23:35:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status queued for try_number 1 2024-04-14T23:35:01.313391278Z [2024-04-14T23:35:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb67584d-effd-472d-b3ea-032edd0caf0f 2024-04-14T23:35:01.313687087Z [2024-04-14T23:35:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 826f1349-a1c1-486e-b69a-f014c9536ced 2024-04-14T23:35:01.313892780Z [2024-04-14T23:35:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4588f2fa-d3f5-4a61-a931-7200fd4c59b5 2024-04-14T23:35:01.314081146Z [2024-04-14T23:35:01.313+0000] {scheduler_job.py:635} INFO - Setting external_id for to 080c8fcf-bfd4-4929-b9b2-856648c14812 2024-04-14T23:35:02.790989618Z [2024-04-14T23:35:02.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:35:02.791600430Z [2024-04-14T23:35:02.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:34:00+00:00, run_id=scheduled__2024-04-14T23:34:00+00:00, run_start_date=2024-04-14 23:35:00.663013+00:00, run_end_date=2024-04-14 23:35:02.791026+00:00, run_duration=2.128013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:34:00+00:00, data_interval_end=2024-04-14 23:35:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:35:02.804830057Z [2024-04-14T23:35:02.804+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:35:00+00:00, run_after=2024-04-14T23:36:00+00:00 2024-04-14T23:35:02.857130885Z [2024-04-14T23:35:02.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status success for try_number 1 2024-04-14T23:35:02.889241905Z [2024-04-14T23:35:02.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:34:00+00:00, map_index=-1, run_start_date=2024-04-14 23:35:01.612327+00:00, run_end_date=2024-04-14 23:35:02.032219+00:00, run_duration=0.419892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:35:00.750240+00:00, queued_by_job_id=1, pid=4232 2024-04-14T23:35:03.595078981Z [2024-04-14T23:35:03.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:35:03.595123431Z [2024-04-14T23:35:03.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:34:00+00:00, run_id=scheduled__2024-04-14T23:34:00+00:00, run_start_date=2024-04-14 23:35:00.664330+00:00, run_end_date=2024-04-14 23:35:03.593359+00:00, run_duration=2.929029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:34:00+00:00, data_interval_end=2024-04-14 23:35:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:35:03.612606953Z [2024-04-14T23:35:03.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:35:00+00:00, run_after=2024-04-14T23:36:00+00:00 2024-04-14T23:35:03.657202290Z [2024-04-14T23:35:03.656+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:35:03.657230543Z 2024-04-14T23:35:03.657242501Z [2024-04-14T23:35:03.657+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:35:03.657761190Z [2024-04-14T23:35:03.657+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:35:03.657768989Z 2024-04-14T23:35:03.659864799Z [2024-04-14T23:35:03.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:35:03.659899933Z [2024-04-14T23:35:03.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:35:03.718192433Z [2024-04-14T23:35:03.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:35:03.718394447Z [2024-04-14T23:35:03.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:35:03.718590048Z [2024-04-14T23:35:03.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status success for try_number 1 2024-04-14T23:35:03.724488871Z [2024-04-14T23:35:03.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=-1, run_start_date=2024-04-14 23:35:02.431583+00:00, run_end_date=2024-04-14 23:35:02.775539+00:00, run_duration=0.343956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:35:00.750240+00:00, queued_by_job_id=1, pid=4252 2024-04-14T23:35:03.724916426Z [2024-04-14T23:35:03.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:34:00+00:00, map_index=-1, run_start_date=2024-04-14 23:35:02.388150+00:00, run_end_date=2024-04-14 23:35:03.557048+00:00, run_duration=1.168898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:35:00.750240+00:00, queued_by_job_id=1, pid=4251 2024-04-14T23:35:03.725172550Z [2024-04-14T23:35:03.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1641f2fa-9565-4df0-9c2d-c4edd1cf1193 2024-04-14T23:35:04.912644823Z [2024-04-14T23:35:04.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:35:04.913050124Z [2024-04-14T23:35:04.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:34:00+00:00, run_id=scheduled__2024-04-14T23:34:00+00:00, run_start_date=2024-04-14 23:35:00.665555+00:00, run_end_date=2024-04-14 23:35:04.912525+00:00, run_duration=4.24697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:34:00+00:00, data_interval_end=2024-04-14 23:35:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:35:04.922590460Z [2024-04-14T23:35:04.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:35:00+00:00, run_after=2024-04-14T23:36:00+00:00 2024-04-14T23:35:04.960105882Z [2024-04-14T23:35:04.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status success for try_number 1 2024-04-14T23:35:04.972791174Z [2024-04-14T23:35:04.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:34:00+00:00, map_index=-1, run_start_date=2024-04-14 23:35:02.648063+00:00, run_end_date=2024-04-14 23:35:04.130940+00:00, run_duration=1.482877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:35:00.750240+00:00, queued_by_job_id=1, pid=4263 2024-04-14T23:35:06.061917227Z [2024-04-14T23:35:06.061+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:35:06.061969891Z 2024-04-14T23:35:06.062387168Z [2024-04-14T23:35:06.062+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:35:06.063099296Z [2024-04-14T23:35:06.062+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:35:06.063114067Z 2024-04-14T23:35:06.065877930Z [2024-04-14T23:35:06.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:35:06.066175518Z [2024-04-14T23:35:06.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:35:06.111749095Z [2024-04-14T23:35:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:35:06.112014812Z [2024-04-14T23:35:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:35:06.117814448Z [2024-04-14T23:35:06.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22d699ed-4d05-4a6d-af99-b4e56f6f221a 2024-04-14T23:35:06.118080695Z [2024-04-14T23:35:06.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=-1, run_start_date=2024-04-14 23:35:05.226109+00:00, run_end_date=2024-04-14 23:35:05.523108+00:00, run_duration=0.296999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:35:03.657941+00:00, queued_by_job_id=1, pid=4281 2024-04-14T23:35:08.609693899Z [2024-04-14T23:35:08.609+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:35:08.609744821Z 2024-04-14T23:35:08.609771261Z [2024-04-14T23:35:08.609+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:35:08.610349940Z [2024-04-14T23:35:08.610+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:35:08.610367834Z 2024-04-14T23:35:08.614135867Z [2024-04-14T23:35:08.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:35:08.614239255Z [2024-04-14T23:35:08.614+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:35:08.692354497Z [2024-04-14T23:35:08.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status queued for try_number 1 2024-04-14T23:35:08.692566798Z [2024-04-14T23:35:08.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:35:08.701088821Z [2024-04-14T23:35:08.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ca9c06b-854e-4ca4-a6ee-e18803dcfa26 2024-04-14T23:35:08.701647592Z [2024-04-14T23:35:08.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=0, run_start_date=2024-04-14 23:35:07.562390+00:00, run_end_date=2024-04-14 23:35:07.935060+00:00, run_duration=0.37267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:35:06.063456+00:00, queued_by_job_id=1, pid=4289 2024-04-14T23:35:10.950058276Z [2024-04-14T23:35:10.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:35:10.950566452Z [2024-04-14T23:35:10.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:30:00+00:00, run_id=scheduled__2024-04-14T23:30:00+00:00, run_start_date=2024-04-14 23:35:00.661511+00:00, run_end_date=2024-04-14 23:35:10.950015+00:00, run_duration=10.288504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:30:00+00:00, data_interval_end=2024-04-14 23:35:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:35:10.957754068Z [2024-04-14T23:35:10.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:35:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:35:11.001662035Z [2024-04-14T23:35:11.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:30:00+00:00 exited with status success for try_number 1 2024-04-14T23:35:11.012536909Z [2024-04-14T23:35:11.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:30:00+00:00, map_index=-1, run_start_date=2024-04-14 23:35:10.070359+00:00, run_end_date=2024-04-14 23:35:10.425104+00:00, run_duration=0.354745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:35:08.610803+00:00, queued_by_job_id=1, pid=4297 2024-04-14T23:36:01.027628497Z [2024-04-14T23:36:01.027+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:36:00+00:00, run_after=2024-04-14T23:37:00+00:00 2024-04-14T23:36:01.035738736Z [2024-04-14T23:36:01.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:36:01.043282378Z [2024-04-14T23:36:01.043+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:36:01.057883046Z [2024-04-14T23:36:01.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:36:00+00:00, run_after=2024-04-14T23:37:00+00:00 2024-04-14T23:36:01.185149333Z [2024-04-14T23:36:01.184+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:36:01.185178908Z 2024-04-14T23:36:01.185185902Z 2024-04-14T23:36:01.185209787Z 2024-04-14T23:36:01.185215089Z 2024-04-14T23:36:01.185621289Z [2024-04-14T23:36:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:36:01.186071666Z [2024-04-14T23:36:01.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:36:01.186520159Z [2024-04-14T23:36:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:36:01.186814206Z [2024-04-14T23:36:01.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:36:01.187843456Z [2024-04-14T23:36:01.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:36:01.187861622Z 2024-04-14T23:36:01.187867881Z 2024-04-14T23:36:01.187872966Z 2024-04-14T23:36:01.187877964Z 2024-04-14T23:36:01.193919878Z [2024-04-14T23:36:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:36:01.194216631Z [2024-04-14T23:36:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:36:01.194640155Z [2024-04-14T23:36:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:36:01.195026028Z [2024-04-14T23:36:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:36:01.195482812Z [2024-04-14T23:36:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:36:01.195698277Z [2024-04-14T23:36:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:36:01.196081312Z [2024-04-14T23:36:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:36:01.196217569Z [2024-04-14T23:36:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:36:01.503057524Z [2024-04-14T23:36:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status queued for try_number 1 2024-04-14T23:36:01.503231269Z [2024-04-14T23:36:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status queued for try_number 1 2024-04-14T23:36:01.503309152Z [2024-04-14T23:36:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status queued for try_number 1 2024-04-14T23:36:01.503396024Z [2024-04-14T23:36:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status queued for try_number 1 2024-04-14T23:36:01.511363289Z [2024-04-14T23:36:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ab6d3c8-1f81-489b-b5a6-2172ab617c5b 2024-04-14T23:36:01.511483778Z [2024-04-14T23:36:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b85e680-b35e-4501-8c53-c5da25becf56 2024-04-14T23:36:01.511619578Z [2024-04-14T23:36:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e5ee736-03f5-4ff5-911d-4e853e60a71a 2024-04-14T23:36:01.511768507Z [2024-04-14T23:36:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94628ceb-1b33-4ae5-9a22-0f223e5bd72a 2024-04-14T23:36:01.530458997Z [2024-04-14T23:36:01.530+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:36:03.806602573Z [2024-04-14T23:36:03.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:36:03.807173005Z [2024-04-14T23:36:03.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:34:00+00:00, run_id=scheduled__2024-04-14T23:34:00+00:00, run_start_date=2024-04-14 23:36:01.071430+00:00, run_end_date=2024-04-14 23:36:03.806487+00:00, run_duration=2.735057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:34:00+00:00, data_interval_end=2024-04-14 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:36:03.814680801Z [2024-04-14T23:36:03.814+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:36:00+00:00, run_after=2024-04-14T23:38:00+00:00 2024-04-14T23:36:03.821880579Z [2024-04-14T23:36:03.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:36:03.822188967Z [2024-04-14T23:36:03.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:35:00+00:00, run_id=scheduled__2024-04-14T23:35:00+00:00, run_start_date=2024-04-14 23:36:01.073040+00:00, run_end_date=2024-04-14 23:36:03.821767+00:00, run_duration=2.748727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:35:00+00:00, data_interval_end=2024-04-14 23:36:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:36:03.831330667Z [2024-04-14T23:36:03.830+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:36:00+00:00, run_after=2024-04-14T23:37:00+00:00 2024-04-14T23:36:03.888089531Z [2024-04-14T23:36:03.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:34:00+00:00 exited with status success for try_number 1 2024-04-14T23:36:03.888355221Z [2024-04-14T23:36:03.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status success for try_number 1 2024-04-14T23:36:03.897329082Z [2024-04-14T23:36:03.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:35:00+00:00, map_index=-1, run_start_date=2024-04-14 23:36:02.339787+00:00, run_end_date=2024-04-14 23:36:02.780668+00:00, run_duration=0.440881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:36:01.189615+00:00, queued_by_job_id=1, pid=4321 2024-04-14T23:36:03.897733913Z [2024-04-14T23:36:03.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:34:00+00:00, map_index=-1, run_start_date=2024-04-14 23:36:02.119800+00:00, run_end_date=2024-04-14 23:36:02.692353+00:00, run_duration=0.572553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:36:01.189615+00:00, queued_by_job_id=1, pid=4320 2024-04-14T23:36:05.087074320Z [2024-04-14T23:36:05.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:36:05.087320050Z [2024-04-14T23:36:05.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:35:00+00:00, run_id=scheduled__2024-04-14T23:35:00+00:00, run_start_date=2024-04-14 23:36:01.074148+00:00, run_end_date=2024-04-14 23:36:05.086915+00:00, run_duration=4.012767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:35:00+00:00, data_interval_end=2024-04-14 23:36:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:36:05.095024320Z [2024-04-14T23:36:05.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:36:00+00:00, run_after=2024-04-14T23:37:00+00:00 2024-04-14T23:36:05.138552012Z [2024-04-14T23:36:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status success for try_number 1 2024-04-14T23:36:05.146195902Z [2024-04-14T23:36:05.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:35:00+00:00, map_index=-1, run_start_date=2024-04-14 23:36:03.287672+00:00, run_end_date=2024-04-14 23:36:04.755092+00:00, run_duration=1.46742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:36:01.189615+00:00, queued_by_job_id=1, pid=4344 2024-04-14T23:36:06.206833084Z [2024-04-14T23:36:06.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:36:06.207068870Z [2024-04-14T23:36:06.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:35:00+00:00, run_id=scheduled__2024-04-14T23:35:00+00:00, run_start_date=2024-04-14 23:36:01.075322+00:00, run_end_date=2024-04-14 23:36:06.206731+00:00, run_duration=5.131409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:35:00+00:00, data_interval_end=2024-04-14 23:36:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:36:06.220741013Z [2024-04-14T23:36:06.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:36:00+00:00, run_after=2024-04-14T23:37:00+00:00 2024-04-14T23:36:06.260874203Z [2024-04-14T23:36:06.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status success for try_number 1 2024-04-14T23:36:06.267302652Z [2024-04-14T23:36:06.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:35:00+00:00, map_index=-1, run_start_date=2024-04-14 23:36:03.466581+00:00, run_end_date=2024-04-14 23:36:05.341001+00:00, run_duration=1.87442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:36:01.189615+00:00, queued_by_job_id=1, pid=4345 2024-04-14T23:37:00.787010023Z [2024-04-14T23:37:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:37:00+00:00, run_after=2024-04-14T23:38:00+00:00 2024-04-14T23:37:00.800346418Z [2024-04-14T23:37:00.798+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:37:00+00:00, run_after=2024-04-14T23:38:00+00:00 2024-04-14T23:37:00.817486504Z [2024-04-14T23:37:00.816+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:37:00.984349988Z [2024-04-14T23:37:00.983+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:37:00.984376135Z 2024-04-14T23:37:00.984380038Z 2024-04-14T23:37:00.984394202Z 2024-04-14T23:37:00.984679346Z [2024-04-14T23:37:00.984+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:37:00.984852372Z [2024-04-14T23:37:00.984+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:37:00.987238167Z [2024-04-14T23:37:00.986+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:37:00.988043494Z [2024-04-14T23:37:00.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:37:00.988055815Z 2024-04-14T23:37:00.988059468Z 2024-04-14T23:37:00.988062739Z 2024-04-14T23:37:01.005829711Z [2024-04-14T23:37:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:37:01.006160585Z [2024-04-14T23:37:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:37:01.006521744Z [2024-04-14T23:37:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:37:01.007576743Z [2024-04-14T23:37:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:37:01.007843407Z [2024-04-14T23:37:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:37:01.008082226Z [2024-04-14T23:37:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:37:01.554693316Z [2024-04-14T23:37:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status queued for try_number 1 2024-04-14T23:37:01.556514697Z [2024-04-14T23:37:01.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status queued for try_number 1 2024-04-14T23:37:01.556760195Z [2024-04-14T23:37:01.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status queued for try_number 1 2024-04-14T23:37:01.585417286Z [2024-04-14T23:37:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 469608a3-3c6f-4f0a-b4f0-e66ad7a0babd 2024-04-14T23:37:01.585469773Z [2024-04-14T23:37:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 184f4895-0647-489c-8ecf-25a3507d18ee 2024-04-14T23:37:01.585571252Z [2024-04-14T23:37:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9cdb7e3-7ebd-4b8d-b383-c816df356daf 2024-04-14T23:37:02.781628349Z [2024-04-14T23:37:02.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:37:02.781770366Z [2024-04-14T23:37:02.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:36:00+00:00, run_id=scheduled__2024-04-14T23:36:00+00:00, run_start_date=2024-04-14 23:37:00.848622+00:00, run_end_date=2024-04-14 23:37:02.781473+00:00, run_duration=1.932851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:36:00+00:00, data_interval_end=2024-04-14 23:37:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:37:02.796656786Z [2024-04-14T23:37:02.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:37:00+00:00, run_after=2024-04-14T23:38:00+00:00 2024-04-14T23:37:02.909311637Z [2024-04-14T23:37:02.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status success for try_number 1 2024-04-14T23:37:02.936432722Z [2024-04-14T23:37:02.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:36:00+00:00, map_index=-1, run_start_date=2024-04-14 23:37:02.406912+00:00, run_end_date=2024-04-14 23:37:02.732897+00:00, run_duration=0.325985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:37:00.988889+00:00, queued_by_job_id=1, pid=4376 2024-04-14T23:37:05.361415042Z [2024-04-14T23:37:05.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:37:05.361793666Z [2024-04-14T23:37:05.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:36:00+00:00, run_id=scheduled__2024-04-14T23:36:00+00:00, run_start_date=2024-04-14 23:37:00.850250+00:00, run_end_date=2024-04-14 23:37:05.361496+00:00, run_duration=4.511246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:36:00+00:00, data_interval_end=2024-04-14 23:37:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:37:05.370026475Z [2024-04-14T23:37:05.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:37:00+00:00, run_after=2024-04-14T23:38:00+00:00 2024-04-14T23:37:05.445973403Z [2024-04-14T23:37:05.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status success for try_number 1 2024-04-14T23:37:05.455414529Z [2024-04-14T23:37:05.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:36:00+00:00, map_index=-1, run_start_date=2024-04-14 23:37:03.612999+00:00, run_end_date=2024-04-14 23:37:05.219967+00:00, run_duration=1.606968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:37:00.988889+00:00, queued_by_job_id=1, pid=4395 2024-04-14T23:37:06.512713031Z [2024-04-14T23:37:06.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:37:06.513696498Z [2024-04-14T23:37:06.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:36:00+00:00, run_id=scheduled__2024-04-14T23:36:00+00:00, run_start_date=2024-04-14 23:37:00.858120+00:00, run_end_date=2024-04-14 23:37:06.512576+00:00, run_duration=5.654456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:36:00+00:00, data_interval_end=2024-04-14 23:37:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:37:06.522995013Z [2024-04-14T23:37:06.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:37:00+00:00, run_after=2024-04-14T23:38:00+00:00 2024-04-14T23:37:06.566458423Z [2024-04-14T23:37:06.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status success for try_number 1 2024-04-14T23:37:06.578254053Z [2024-04-14T23:37:06.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:36:00+00:00, map_index=-1, run_start_date=2024-04-14 23:37:03.407381+00:00, run_end_date=2024-04-14 23:37:05.599193+00:00, run_duration=2.191812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:37:00.988889+00:00, queued_by_job_id=1, pid=4394 2024-04-14T23:38:00.755902527Z [2024-04-14T23:38:00.755+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:38:00.768058281Z [2024-04-14T23:38:00.767+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:38:00.787706466Z [2024-04-14T23:38:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:38:00+00:00, run_after=2024-04-14T23:39:00+00:00 2024-04-14T23:38:00.815344371Z [2024-04-14T23:38:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:38:00+00:00, run_after=2024-04-14T23:39:00+00:00 2024-04-14T23:38:00.924443169Z [2024-04-14T23:38:00.924+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:38:00.924507307Z 2024-04-14T23:38:00.924517732Z 2024-04-14T23:38:00.924527516Z 2024-04-14T23:38:00.924536089Z 2024-04-14T23:38:00.924662958Z [2024-04-14T23:38:00.924+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:38:00.924829987Z [2024-04-14T23:38:00.924+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:38:00.924840842Z [2024-04-14T23:38:00.924+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:38:00.924937680Z [2024-04-14T23:38:00.924+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:38:00.925803682Z [2024-04-14T23:38:00.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:38:00.925822713Z 2024-04-14T23:38:00.925832018Z 2024-04-14T23:38:00.925840559Z 2024-04-14T23:38:00.925849240Z 2024-04-14T23:38:00.931055559Z [2024-04-14T23:38:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:38:00.931127228Z [2024-04-14T23:38:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:38:00.931477741Z [2024-04-14T23:38:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:38:00.931591352Z [2024-04-14T23:38:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:38:00.931873344Z [2024-04-14T23:38:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:38:00.932016074Z [2024-04-14T23:38:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:38:00.932258440Z [2024-04-14T23:38:00.932+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:38:00.932360447Z [2024-04-14T23:38:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:38:01.170834164Z [2024-04-14T23:38:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status queued for try_number 1 2024-04-14T23:38:01.172959708Z [2024-04-14T23:38:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:37:00+00:00 exited with status queued for try_number 1 2024-04-14T23:38:01.173138186Z [2024-04-14T23:38:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:37:00+00:00 exited with status queued for try_number 1 2024-04-14T23:38:01.173283744Z [2024-04-14T23:38:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:37:00+00:00 exited with status queued for try_number 1 2024-04-14T23:38:01.181038031Z [2024-04-14T23:38:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 706a30de-0fa5-4f2d-9951-b11ff68dd501 2024-04-14T23:38:01.181257203Z [2024-04-14T23:38:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to f555eabf-be17-485c-ab9d-07e13df7f510 2024-04-14T23:38:01.181430359Z [2024-04-14T23:38:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to c901cfe5-7ed8-44cc-a467-b1bad303d94b 2024-04-14T23:38:01.181607666Z [2024-04-14T23:38:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc4c6c1f-4881-431b-9b5f-1e66c403d3ab 2024-04-14T23:38:02.318194941Z [2024-04-14T23:38:02.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:38:02.318400317Z [2024-04-14T23:38:02.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:36:00+00:00, run_id=scheduled__2024-04-14T23:36:00+00:00, run_start_date=2024-04-14 23:38:00.832525+00:00, run_end_date=2024-04-14 23:38:02.318101+00:00, run_duration=1.485576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:36:00+00:00, data_interval_end=2024-04-14 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:38:02.324464062Z [2024-04-14T23:38:02.324+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:38:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:38:02.337309494Z [2024-04-14T23:38:02.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:38:02.337366310Z [2024-04-14T23:38:02.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:37:00+00:00, run_id=scheduled__2024-04-14T23:37:00+00:00, run_start_date=2024-04-14 23:38:00.835215+00:00, run_end_date=2024-04-14 23:38:02.337184+00:00, run_duration=1.501969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:37:00+00:00, data_interval_end=2024-04-14 23:38:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:38:02.347223991Z [2024-04-14T23:38:02.346+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:38:00+00:00, run_after=2024-04-14T23:39:00+00:00 2024-04-14T23:38:02.410314146Z [2024-04-14T23:38:02.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:36:00+00:00 exited with status success for try_number 1 2024-04-14T23:38:02.410377173Z [2024-04-14T23:38:02.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:37:00+00:00 exited with status success for try_number 1 2024-04-14T23:38:02.421493859Z [2024-04-14T23:38:02.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:36:00+00:00, map_index=-1, run_start_date=2024-04-14 23:38:01.588133+00:00, run_end_date=2024-04-14 23:38:01.956255+00:00, run_duration=0.368122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:38:00.927049+00:00, queued_by_job_id=1, pid=4428 2024-04-14T23:38:02.421601252Z [2024-04-14T23:38:02.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:37:00+00:00, map_index=-1, run_start_date=2024-04-14 23:38:01.752675+00:00, run_end_date=2024-04-14 23:38:02.154537+00:00, run_duration=0.401862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:38:00.927049+00:00, queued_by_job_id=1, pid=4429 2024-04-14T23:38:04.763253061Z [2024-04-14T23:38:04.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:38:04.763289794Z [2024-04-14T23:38:04.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:37:00+00:00, run_id=scheduled__2024-04-14T23:37:00+00:00, run_start_date=2024-04-14 23:38:00.838037+00:00, run_end_date=2024-04-14 23:38:04.759894+00:00, run_duration=3.921857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:37:00+00:00, data_interval_end=2024-04-14 23:38:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:38:04.774479291Z [2024-04-14T23:38:04.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:38:00+00:00, run_after=2024-04-14T23:39:00+00:00 2024-04-14T23:38:05.883798875Z [2024-04-14T23:38:05.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:38:05.883927439Z [2024-04-14T23:38:05.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:37:00+00:00, run_id=scheduled__2024-04-14T23:37:00+00:00, run_start_date=2024-04-14 23:38:00.840570+00:00, run_end_date=2024-04-14 23:38:05.883634+00:00, run_duration=5.043064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:37:00+00:00, data_interval_end=2024-04-14 23:38:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:38:05.894022640Z [2024-04-14T23:38:05.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:38:00+00:00, run_after=2024-04-14T23:39:00+00:00 2024-04-14T23:38:05.937965422Z [2024-04-14T23:38:05.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:37:00+00:00 exited with status success for try_number 1 2024-04-14T23:38:05.938047520Z [2024-04-14T23:38:05.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:37:00+00:00 exited with status success for try_number 1 2024-04-14T23:38:05.948872273Z [2024-04-14T23:38:05.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:37:00+00:00, map_index=-1, run_start_date=2024-04-14 23:38:02.676863+00:00, run_end_date=2024-04-14 23:38:04.715826+00:00, run_duration=2.038963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:38:00.927049+00:00, queued_by_job_id=1, pid=4452 2024-04-14T23:38:05.949117371Z [2024-04-14T23:38:05.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:37:00+00:00, map_index=-1, run_start_date=2024-04-14 23:38:02.753115+00:00, run_end_date=2024-04-14 23:38:05.405322+00:00, run_duration=2.652207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:38:00.927049+00:00, queued_by_job_id=1, pid=4453 2024-04-14T23:39:00.079129198Z [2024-04-14T23:39:00.078+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:39:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:39:00.088776159Z [2024-04-14T23:39:00.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:39:00.104195463Z [2024-04-14T23:39:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:39:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:39:00.194317897Z [2024-04-14T23:39:00.193+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:39:00.194361163Z 2024-04-14T23:39:00.194370787Z 2024-04-14T23:39:00.194379585Z 2024-04-14T23:39:00.194949248Z [2024-04-14T23:39:00.194+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:39:00.195649910Z [2024-04-14T23:39:00.195+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:39:00.196114159Z [2024-04-14T23:39:00.195+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:39:00.197657669Z [2024-04-14T23:39:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:39:00.197675955Z 2024-04-14T23:39:00.197685263Z 2024-04-14T23:39:00.197694224Z 2024-04-14T23:39:00.204645901Z [2024-04-14T23:39:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:39:00.205255034Z [2024-04-14T23:39:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:39:00.205914814Z [2024-04-14T23:39:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:39:00.206237521Z [2024-04-14T23:39:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:39:00.206696526Z [2024-04-14T23:39:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:39:00.207137350Z [2024-04-14T23:39:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:39:00.566384428Z [2024-04-14T23:39:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status queued for try_number 1 2024-04-14T23:39:00.566413632Z [2024-04-14T23:39:00.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status queued for try_number 1 2024-04-14T23:39:00.568218056Z [2024-04-14T23:39:00.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status queued for try_number 1 2024-04-14T23:39:00.579290562Z [2024-04-14T23:39:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to af636e16-ff0d-45d1-a7be-9c137518fd21 2024-04-14T23:39:00.579362170Z [2024-04-14T23:39:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9270545-628b-4b33-b991-3dc56b687af4 2024-04-14T23:39:00.579451584Z [2024-04-14T23:39:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95ee68d4-44e5-4966-8e05-103445be3c24 2024-04-14T23:39:01.706846050Z [2024-04-14T23:39:01.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:39:01.707048742Z [2024-04-14T23:39:01.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:38:00+00:00, run_id=scheduled__2024-04-14T23:38:00+00:00, run_start_date=2024-04-14 23:39:00.117069+00:00, run_end_date=2024-04-14 23:39:01.706688+00:00, run_duration=1.589619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:38:00+00:00, data_interval_end=2024-04-14 23:39:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:39:01.716577600Z [2024-04-14T23:39:01.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:39:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:39:01.757259950Z [2024-04-14T23:39:01.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status success for try_number 1 2024-04-14T23:39:01.762149670Z [2024-04-14T23:39:01.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:38:00+00:00, map_index=-1, run_start_date=2024-04-14 23:39:00.957783+00:00, run_end_date=2024-04-14 23:39:01.344168+00:00, run_duration=0.386385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:39:00.199595+00:00, queued_by_job_id=1, pid=4485 2024-04-14T23:39:03.899487013Z [2024-04-14T23:39:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:39:03.899889963Z [2024-04-14T23:39:03.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:38:00+00:00, run_id=scheduled__2024-04-14T23:38:00+00:00, run_start_date=2024-04-14 23:39:00.119622+00:00, run_end_date=2024-04-14 23:39:03.899578+00:00, run_duration=3.779956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:38:00+00:00, data_interval_end=2024-04-14 23:39:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:39:03.907930770Z [2024-04-14T23:39:03.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:39:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:39:03.913067755Z [2024-04-14T23:39:03.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:39:03.913391577Z [2024-04-14T23:39:03.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:38:00+00:00, run_id=scheduled__2024-04-14T23:38:00+00:00, run_start_date=2024-04-14 23:39:00.118377+00:00, run_end_date=2024-04-14 23:39:03.913128+00:00, run_duration=3.794751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:38:00+00:00, data_interval_end=2024-04-14 23:39:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:39:03.921657251Z [2024-04-14T23:39:03.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:39:00+00:00, run_after=2024-04-14T23:40:00+00:00 2024-04-14T23:39:03.962766658Z [2024-04-14T23:39:03.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status success for try_number 1 2024-04-14T23:39:03.962804051Z [2024-04-14T23:39:03.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status success for try_number 1 2024-04-14T23:39:03.969088969Z [2024-04-14T23:39:03.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:38:00+00:00, map_index=-1, run_start_date=2024-04-14 23:39:01.817147+00:00, run_end_date=2024-04-14 23:39:03.424113+00:00, run_duration=1.606966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:39:00.199595+00:00, queued_by_job_id=1, pid=4503 2024-04-14T23:39:03.969382787Z [2024-04-14T23:39:03.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:38:00+00:00, map_index=-1, run_start_date=2024-04-14 23:39:01.880754+00:00, run_end_date=2024-04-14 23:39:03.162271+00:00, run_duration=1.281517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:39:00.199595+00:00, queued_by_job_id=1, pid=4504 2024-04-14T23:40:00.445860298Z [2024-04-14T23:40:00.445+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:40:00.456647531Z [2024-04-14T23:40:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:41:00+00:00 2024-04-14T23:40:00.462118259Z [2024-04-14T23:40:00.461+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:40:00.471143357Z [2024-04-14T23:40:00.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:41:00+00:00 2024-04-14T23:40:00.480351520Z [2024-04-14T23:40:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:45:00+00:00 2024-04-14T23:40:00.551390188Z [2024-04-14T23:40:00.550+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T23:40:00.551429780Z 2024-04-14T23:40:00.551435587Z 2024-04-14T23:40:00.551441315Z 2024-04-14T23:40:00.551445677Z 2024-04-14T23:40:00.551450067Z 2024-04-14T23:40:00.551527065Z [2024-04-14T23:40:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:40:00.551767365Z [2024-04-14T23:40:00.551+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:40:00.551973011Z [2024-04-14T23:40:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:40:00.552176521Z [2024-04-14T23:40:00.551+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:40:00.552376519Z [2024-04-14T23:40:00.552+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:40:00.553909913Z [2024-04-14T23:40:00.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:40:00.553925111Z 2024-04-14T23:40:00.553930690Z 2024-04-14T23:40:00.553935703Z 2024-04-14T23:40:00.553940511Z 2024-04-14T23:40:00.553967622Z 2024-04-14T23:40:00.560296121Z [2024-04-14T23:40:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:40:00.560390789Z [2024-04-14T23:40:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:40:00.560620997Z [2024-04-14T23:40:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:40:00.560706730Z [2024-04-14T23:40:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:40:00.560884732Z [2024-04-14T23:40:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:40:00.560963201Z [2024-04-14T23:40:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:40:00.561157891Z [2024-04-14T23:40:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:40:00.561231039Z [2024-04-14T23:40:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:40:00.561407752Z [2024-04-14T23:40:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:40:00.561486953Z [2024-04-14T23:40:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:40:00.905363271Z [2024-04-14T23:40:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:00.905492454Z [2024-04-14T23:40:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:00.905618542Z [2024-04-14T23:40:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:39:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:00.905739254Z [2024-04-14T23:40:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:39:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:00.905830018Z [2024-04-14T23:40:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:39:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:00.933068231Z [2024-04-14T23:40:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c38268b-0e1a-4ade-a521-c917556c8f4d 2024-04-14T23:40:00.933236227Z [2024-04-14T23:40:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24777fbb-a0c6-4623-b344-0aba2578c4ef 2024-04-14T23:40:00.933427007Z [2024-04-14T23:40:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e4416dd-6c08-4dbe-a8c1-f4b77a11b7c3 2024-04-14T23:40:00.933610277Z [2024-04-14T23:40:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to a56d3531-dd14-4b4f-8257-234874d39e03 2024-04-14T23:40:00.933780366Z [2024-04-14T23:40:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c4e845f-ef53-4218-a706-5cb607b12f43 2024-04-14T23:40:02.743393683Z [2024-04-14T23:40:02.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:40:02.743564911Z [2024-04-14T23:40:02.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:38:00+00:00, run_id=scheduled__2024-04-14T23:38:00+00:00, run_start_date=2024-04-14 23:40:00.489992+00:00, run_end_date=2024-04-14 23:40:02.743293+00:00, run_duration=2.253301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:38:00+00:00, data_interval_end=2024-04-14 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:40:02.749972845Z [2024-04-14T23:40:02.749+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:42:00+00:00 2024-04-14T23:40:02.758232462Z [2024-04-14T23:40:02.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:40:02.758383957Z [2024-04-14T23:40:02.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:39:00+00:00, run_id=scheduled__2024-04-14T23:39:00+00:00, run_start_date=2024-04-14 23:40:00.490836+00:00, run_end_date=2024-04-14 23:40:02.758154+00:00, run_duration=2.267318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:39:00+00:00, data_interval_end=2024-04-14 23:40:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:40:02.767353052Z [2024-04-14T23:40:02.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:41:00+00:00 2024-04-14T23:40:02.834276063Z [2024-04-14T23:40:02.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:38:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:02.834293939Z [2024-04-14T23:40:02.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:39:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:02.842789193Z [2024-04-14T23:40:02.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:38:00+00:00, map_index=-1, run_start_date=2024-04-14 23:40:01.465440+00:00, run_end_date=2024-04-14 23:40:01.838808+00:00, run_duration=0.373368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:00.556312+00:00, queued_by_job_id=1, pid=4538 2024-04-14T23:40:02.842983823Z [2024-04-14T23:40:02.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:39:00+00:00, map_index=-1, run_start_date=2024-04-14 23:40:01.777541+00:00, run_end_date=2024-04-14 23:40:02.179197+00:00, run_duration=0.401656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:00.556312+00:00, queued_by_job_id=1, pid=4546 2024-04-14T23:40:03.941548680Z [2024-04-14T23:40:03.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:40:03.942084547Z [2024-04-14T23:40:03.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:39:00+00:00, run_id=scheduled__2024-04-14T23:39:00+00:00, run_start_date=2024-04-14 23:40:00.491838+00:00, run_end_date=2024-04-14 23:40:03.941583+00:00, run_duration=3.449745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:39:00+00:00, data_interval_end=2024-04-14 23:40:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:40:03.954429525Z [2024-04-14T23:40:03.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:41:00+00:00 2024-04-14T23:40:03.976616261Z [2024-04-14T23:40:03.976+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:40:03.976652638Z 2024-04-14T23:40:03.976842025Z [2024-04-14T23:40:03.976+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:40:03.978069477Z [2024-04-14T23:40:03.977+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:40:03.978082130Z 2024-04-14T23:40:03.980754885Z [2024-04-14T23:40:03.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:40:03.981049633Z [2024-04-14T23:40:03.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:40:04.059677787Z [2024-04-14T23:40:04.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:04.060076474Z [2024-04-14T23:40:04.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:04.060418915Z [2024-04-14T23:40:04.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:39:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:04.079975678Z [2024-04-14T23:40:04.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:35:00+00:00, map_index=-1, run_start_date=2024-04-14 23:40:02.598102+00:00, run_end_date=2024-04-14 23:40:02.968974+00:00, run_duration=0.370872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:00.556312+00:00, queued_by_job_id=1, pid=4569 2024-04-14T23:40:04.080333077Z [2024-04-14T23:40:04.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30f0a001-1b71-4e9d-850e-b5354a1534dc 2024-04-14T23:40:04.080632649Z [2024-04-14T23:40:04.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:39:00+00:00, map_index=-1, run_start_date=2024-04-14 23:40:02.541634+00:00, run_end_date=2024-04-14 23:40:03.770587+00:00, run_duration=1.228953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:00.556312+00:00, queued_by_job_id=1, pid=4563 2024-04-14T23:40:05.128370451Z [2024-04-14T23:40:05.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:40:05.128730756Z [2024-04-14T23:40:05.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:39:00+00:00, run_id=scheduled__2024-04-14T23:39:00+00:00, run_start_date=2024-04-14 23:40:00.492832+00:00, run_end_date=2024-04-14 23:40:05.128297+00:00, run_duration=4.635465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:39:00+00:00, data_interval_end=2024-04-14 23:40:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:40:05.141538064Z [2024-04-14T23:40:05.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:41:00+00:00 2024-04-14T23:40:05.185584001Z [2024-04-14T23:40:05.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:39:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:05.191391360Z [2024-04-14T23:40:05.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:39:00+00:00, map_index=-1, run_start_date=2024-04-14 23:40:02.785476+00:00, run_end_date=2024-04-14 23:40:04.536556+00:00, run_duration=1.75108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:00.556312+00:00, queued_by_job_id=1, pid=4570 2024-04-14T23:40:06.269060895Z [2024-04-14T23:40:06.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:40:06.269088398Z 2024-04-14T23:40:06.269137104Z [2024-04-14T23:40:06.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:40:06.270592695Z [2024-04-14T23:40:06.270+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:40:06.270614666Z 2024-04-14T23:40:06.274617362Z [2024-04-14T23:40:06.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:40:06.275063595Z [2024-04-14T23:40:06.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:40:06.332855764Z [2024-04-14T23:40:06.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:06.332889383Z [2024-04-14T23:40:06.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:06.340879331Z [2024-04-14T23:40:06.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to b83e9ef2-a571-4edb-b5e8-1d986266b263 2024-04-14T23:40:06.340940625Z [2024-04-14T23:40:06.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:35:00+00:00, map_index=-1, run_start_date=2024-04-14 23:40:05.669551+00:00, run_end_date=2024-04-14 23:40:05.951659+00:00, run_duration=0.282108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:03.978494+00:00, queued_by_job_id=1, pid=4593 2024-04-14T23:40:08.991104854Z [2024-04-14T23:40:08.990+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:40:08.991147198Z 2024-04-14T23:40:08.992394163Z [2024-04-14T23:40:08.992+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:40:08.994058083Z [2024-04-14T23:40:08.993+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:40:08.994084344Z 2024-04-14T23:40:08.999675025Z [2024-04-14T23:40:08.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:40:08.999856081Z [2024-04-14T23:40:08.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:40:09.069401191Z [2024-04-14T23:40:09.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status queued for try_number 1 2024-04-14T23:40:09.072278567Z [2024-04-14T23:40:09.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:09.083962957Z [2024-04-14T23:40:09.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfb9faf4-e4d7-4150-906e-6390a1109ca9 2024-04-14T23:40:09.084239710Z [2024-04-14T23:40:09.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:35:00+00:00, map_index=0, run_start_date=2024-04-14 23:40:07.772679+00:00, run_end_date=2024-04-14 23:40:08.124149+00:00, run_duration=0.35147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:06.271449+00:00, queued_by_job_id=1, pid=4601 2024-04-14T23:40:11.635694435Z [2024-04-14T23:40:11.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:40:11.636037870Z [2024-04-14T23:40:11.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:35:00+00:00, run_id=scheduled__2024-04-14T23:35:00+00:00, run_start_date=2024-04-14 23:40:00.488988+00:00, run_end_date=2024-04-14 23:40:11.635677+00:00, run_duration=11.146689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:35:00+00:00, data_interval_end=2024-04-14 23:40:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:40:11.643180561Z [2024-04-14T23:40:11.642+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:40:00+00:00, run_after=2024-04-14T23:45:00+00:00 2024-04-14T23:40:11.676895672Z [2024-04-14T23:40:11.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:35:00+00:00 exited with status success for try_number 1 2024-04-14T23:40:11.686313889Z [2024-04-14T23:40:11.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:35:00+00:00, map_index=-1, run_start_date=2024-04-14 23:40:10.425085+00:00, run_end_date=2024-04-14 23:40:10.815436+00:00, run_duration=0.390351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:40:08.995142+00:00, queued_by_job_id=1, pid=4609 2024-04-14T23:41:00.919172181Z [2024-04-14T23:41:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:41:00+00:00, run_after=2024-04-14T23:42:00+00:00 2024-04-14T23:41:00.928347192Z [2024-04-14T23:41:00.928+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:41:00.941178103Z [2024-04-14T23:41:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:41:00+00:00, run_after=2024-04-14T23:42:00+00:00 2024-04-14T23:41:01.017464819Z [2024-04-14T23:41:01.017+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:41:01.017488785Z 2024-04-14T23:41:01.017493177Z 2024-04-14T23:41:01.017497241Z 2024-04-14T23:41:01.017744274Z [2024-04-14T23:41:01.017+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:41:01.017953003Z [2024-04-14T23:41:01.017+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:41:01.018147100Z [2024-04-14T23:41:01.018+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:41:01.018792519Z [2024-04-14T23:41:01.018+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:41:01.018804939Z 2024-04-14T23:41:01.018808793Z 2024-04-14T23:41:01.018812673Z 2024-04-14T23:41:01.021920002Z [2024-04-14T23:41:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:41:01.022137662Z [2024-04-14T23:41:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:41:01.022448218Z [2024-04-14T23:41:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:41:01.022635510Z [2024-04-14T23:41:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:41:01.022988116Z [2024-04-14T23:41:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:41:01.023149782Z [2024-04-14T23:41:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:41:01.214115524Z [2024-04-14T23:41:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:41:01.214301297Z [2024-04-14T23:41:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:41:01.214371683Z [2024-04-14T23:41:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:41:01.220522484Z [2024-04-14T23:41:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f8adf6f-9237-4b4b-ad8d-9160a7458ab7 2024-04-14T23:41:01.220634444Z [2024-04-14T23:41:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e6fccec-906c-4f43-9575-4c6cf3fe1468 2024-04-14T23:41:01.220899605Z [2024-04-14T23:41:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to efab2301-4ef9-4da4-a09c-0cd64b25ee21 2024-04-14T23:41:01.634791413Z [2024-04-14T23:41:01.634+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:41:02.489957720Z [2024-04-14T23:41:02.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:41:02.490183324Z [2024-04-14T23:41:02.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:40:00+00:00, run_id=scheduled__2024-04-14T23:40:00+00:00, run_start_date=2024-04-14 23:41:00.953934+00:00, run_end_date=2024-04-14 23:41:02.489876+00:00, run_duration=1.535942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:40:00+00:00, data_interval_end=2024-04-14 23:41:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:41:02.497798878Z [2024-04-14T23:41:02.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:41:00+00:00, run_after=2024-04-14T23:42:00+00:00 2024-04-14T23:41:02.535786821Z [2024-04-14T23:41:02.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:41:02.542550712Z [2024-04-14T23:41:02.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=-1, run_start_date=2024-04-14 23:41:01.785090+00:00, run_end_date=2024-04-14 23:41:02.082663+00:00, run_duration=0.297573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:41:01.019556+00:00, queued_by_job_id=1, pid=4630 2024-04-14T23:41:04.699404163Z [2024-04-14T23:41:04.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:41:04.700024379Z [2024-04-14T23:41:04.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:40:00+00:00, run_id=scheduled__2024-04-14T23:40:00+00:00, run_start_date=2024-04-14 23:41:00.956422+00:00, run_end_date=2024-04-14 23:41:04.699190+00:00, run_duration=3.742768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:40:00+00:00, data_interval_end=2024-04-14 23:41:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:41:04.718186329Z [2024-04-14T23:41:04.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:41:00+00:00, run_after=2024-04-14T23:42:00+00:00 2024-04-14T23:41:04.725079880Z [2024-04-14T23:41:04.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:41:04.725259490Z [2024-04-14T23:41:04.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:40:00+00:00, run_id=scheduled__2024-04-14T23:40:00+00:00, run_start_date=2024-04-14 23:41:00.955277+00:00, run_end_date=2024-04-14 23:41:04.724894+00:00, run_duration=3.769617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:40:00+00:00, data_interval_end=2024-04-14 23:41:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:41:04.735384404Z [2024-04-14T23:41:04.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:41:00+00:00, run_after=2024-04-14T23:42:00+00:00 2024-04-14T23:41:04.777739548Z [2024-04-14T23:41:04.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:41:04.777874686Z [2024-04-14T23:41:04.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:41:04.784994325Z [2024-04-14T23:41:04.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=-1, run_start_date=2024-04-14 23:41:02.721436+00:00, run_end_date=2024-04-14 23:41:04.409037+00:00, run_duration=1.687601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:41:01.019556+00:00, queued_by_job_id=1, pid=4648 2024-04-14T23:41:04.785240267Z [2024-04-14T23:41:04.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=-1, run_start_date=2024-04-14 23:41:02.730369+00:00, run_end_date=2024-04-14 23:41:04.151772+00:00, run_duration=1.421403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:41:01.019556+00:00, queued_by_job_id=1, pid=4649 2024-04-14T23:42:00.248771941Z [2024-04-14T23:42:00.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:42:00+00:00, run_after=2024-04-14T23:43:00+00:00 2024-04-14T23:42:00.256629893Z [2024-04-14T23:42:00.256+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:42:00.270244736Z [2024-04-14T23:42:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:42:00+00:00, run_after=2024-04-14T23:43:00+00:00 2024-04-14T23:42:00.277364809Z [2024-04-14T23:42:00.277+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:42:00.370912179Z [2024-04-14T23:42:00.362+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:42:00.370931839Z 2024-04-14T23:42:00.370938490Z 2024-04-14T23:42:00.370942287Z 2024-04-14T23:42:00.370945771Z 2024-04-14T23:42:00.370949737Z [2024-04-14T23:42:00.363+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:42:00.370953147Z [2024-04-14T23:42:00.363+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:42:00.370956538Z [2024-04-14T23:42:00.363+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:42:00.370971248Z [2024-04-14T23:42:00.363+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:42:00.370974788Z [2024-04-14T23:42:00.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:42:00.370978096Z 2024-04-14T23:42:00.370981416Z 2024-04-14T23:42:00.370984952Z 2024-04-14T23:42:00.370988237Z 2024-04-14T23:42:00.373995636Z [2024-04-14T23:42:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:42:00.374010372Z [2024-04-14T23:42:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:42:00.374015168Z [2024-04-14T23:42:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:42:00.374018095Z [2024-04-14T23:42:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:42:00.374020931Z [2024-04-14T23:42:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:42:00.374032333Z [2024-04-14T23:42:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:42:00.374035132Z [2024-04-14T23:42:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:42:00.374037840Z [2024-04-14T23:42:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:42:00.798752042Z [2024-04-14T23:42:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:42:00.798808651Z [2024-04-14T23:42:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:41:00+00:00 exited with status queued for try_number 1 2024-04-14T23:42:00.798916784Z [2024-04-14T23:42:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:41:00+00:00 exited with status queued for try_number 1 2024-04-14T23:42:00.798977673Z [2024-04-14T23:42:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:41:00+00:00 exited with status queued for try_number 1 2024-04-14T23:42:00.805781026Z [2024-04-14T23:42:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd4f1a38-6a85-4ac3-ae1b-84fca3c8b732 2024-04-14T23:42:00.805838889Z [2024-04-14T23:42:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb9d8f28-e312-4018-8a71-1ba632c7f54b 2024-04-14T23:42:00.805915877Z [2024-04-14T23:42:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to aca06c35-ec09-4a01-b650-c9e8735245a9 2024-04-14T23:42:00.805999831Z [2024-04-14T23:42:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42fa3e99-5593-4bb0-8538-6cbb0091f98c 2024-04-14T23:42:01.935249923Z [2024-04-14T23:42:01.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:42:01.935492886Z [2024-04-14T23:42:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:40:00+00:00, run_id=scheduled__2024-04-14T23:40:00+00:00, run_start_date=2024-04-14 23:42:00.288971+00:00, run_end_date=2024-04-14 23:42:01.935129+00:00, run_duration=1.646158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:40:00+00:00, data_interval_end=2024-04-14 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:42:01.942042034Z [2024-04-14T23:42:01.941+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:42:00+00:00, run_after=2024-04-14T23:44:00+00:00 2024-04-14T23:42:01.947113823Z [2024-04-14T23:42:01.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:42:01.947226896Z [2024-04-14T23:42:01.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:41:00+00:00, run_id=scheduled__2024-04-14T23:41:00+00:00, run_start_date=2024-04-14 23:42:00.290138+00:00, run_end_date=2024-04-14 23:42:01.946971+00:00, run_duration=1.656833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:41:00+00:00, data_interval_end=2024-04-14 23:42:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:42:01.957106793Z [2024-04-14T23:42:01.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:42:00+00:00, run_after=2024-04-14T23:43:00+00:00 2024-04-14T23:42:02.005948870Z [2024-04-14T23:42:02.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:42:02.006181085Z [2024-04-14T23:42:02.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:41:00+00:00 exited with status success for try_number 1 2024-04-14T23:42:02.011883574Z [2024-04-14T23:42:02.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=-1, run_start_date=2024-04-14 23:42:00.993996+00:00, run_end_date=2024-04-14 23:42:01.403556+00:00, run_duration=0.40956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:42:00.365619+00:00, queued_by_job_id=1, pid=4681 2024-04-14T23:42:02.012337535Z [2024-04-14T23:42:02.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:41:00+00:00, map_index=-1, run_start_date=2024-04-14 23:42:01.155499+00:00, run_end_date=2024-04-14 23:42:01.609742+00:00, run_duration=0.454243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:42:00.365619+00:00, queued_by_job_id=1, pid=4682 2024-04-14T23:42:03.431336938Z [2024-04-14T23:42:03.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:42:03.431761355Z [2024-04-14T23:42:03.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:41:00+00:00, run_id=scheduled__2024-04-14T23:41:00+00:00, run_start_date=2024-04-14 23:42:00.291262+00:00, run_end_date=2024-04-14 23:42:03.431201+00:00, run_duration=3.139939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:41:00+00:00, data_interval_end=2024-04-14 23:42:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:42:03.441494590Z [2024-04-14T23:42:03.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:42:00+00:00, run_after=2024-04-14T23:43:00+00:00 2024-04-14T23:42:04.556973878Z [2024-04-14T23:42:04.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:42:04.557559672Z [2024-04-14T23:42:04.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:41:00+00:00, run_id=scheduled__2024-04-14T23:41:00+00:00, run_start_date=2024-04-14 23:42:00.292393+00:00, run_end_date=2024-04-14 23:42:04.556875+00:00, run_duration=4.264482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:41:00+00:00, data_interval_end=2024-04-14 23:42:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:42:04.586363069Z [2024-04-14T23:42:04.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:42:00+00:00, run_after=2024-04-14T23:43:00+00:00 2024-04-14T23:42:04.611896309Z [2024-04-14T23:42:04.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:41:00+00:00 exited with status success for try_number 1 2024-04-14T23:42:04.611926703Z [2024-04-14T23:42:04.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:41:00+00:00 exited with status success for try_number 1 2024-04-14T23:42:04.618334296Z [2024-04-14T23:42:04.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:41:00+00:00, map_index=-1, run_start_date=2024-04-14 23:42:02.129403+00:00, run_end_date=2024-04-14 23:42:03.366260+00:00, run_duration=1.236857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:42:00.365619+00:00, queued_by_job_id=1, pid=4706 2024-04-14T23:42:04.618409630Z [2024-04-14T23:42:04.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:41:00+00:00, map_index=-1, run_start_date=2024-04-14 23:42:02.144595+00:00, run_end_date=2024-04-14 23:42:03.684018+00:00, run_duration=1.539423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:42:00.365619+00:00, queued_by_job_id=1, pid=4705 2024-04-14T23:43:00.367767178Z [2024-04-14T23:43:00.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:43:00+00:00, run_after=2024-04-14T23:44:00+00:00 2024-04-14T23:43:00.382377232Z [2024-04-14T23:43:00.379+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:43:00+00:00, run_after=2024-04-14T23:44:00+00:00 2024-04-14T23:43:00.387593973Z [2024-04-14T23:43:00.386+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:43:00.458138772Z [2024-04-14T23:43:00.457+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:43:00.458169276Z 2024-04-14T23:43:00.458172670Z 2024-04-14T23:43:00.458175460Z 2024-04-14T23:43:00.458184095Z [2024-04-14T23:43:00.458+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:43:00.458304285Z [2024-04-14T23:43:00.458+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:43:00.458363180Z [2024-04-14T23:43:00.458+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:43:00.458824328Z [2024-04-14T23:43:00.458+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:43:00.458832801Z 2024-04-14T23:43:00.458848013Z 2024-04-14T23:43:00.458850844Z 2024-04-14T23:43:00.461954170Z [2024-04-14T23:43:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:43:00.462072844Z [2024-04-14T23:43:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:43:00.462266127Z [2024-04-14T23:43:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:43:00.462331851Z [2024-04-14T23:43:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:43:00.462484311Z [2024-04-14T23:43:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:43:00.462553477Z [2024-04-14T23:43:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:43:00.640747747Z [2024-04-14T23:43:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status queued for try_number 1 2024-04-14T23:43:00.640947452Z [2024-04-14T23:43:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status queued for try_number 1 2024-04-14T23:43:00.641123943Z [2024-04-14T23:43:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status queued for try_number 1 2024-04-14T23:43:00.647679606Z [2024-04-14T23:43:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09a57e11-97d4-40f9-a6a0-67a7bd9a3ffe 2024-04-14T23:43:00.647886593Z [2024-04-14T23:43:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57cecdfa-cbb9-400d-bdb5-5276b711a18f 2024-04-14T23:43:00.648093266Z [2024-04-14T23:43:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd8bf88c-2b65-44c3-9824-9f8ed2c964eb 2024-04-14T23:43:02.289710700Z [2024-04-14T23:43:02.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:43:02.290034161Z [2024-04-14T23:43:02.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:42:00+00:00, run_id=scheduled__2024-04-14T23:42:00+00:00, run_start_date=2024-04-14 23:43:00.405778+00:00, run_end_date=2024-04-14 23:43:02.289694+00:00, run_duration=1.883916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:42:00+00:00, data_interval_end=2024-04-14 23:43:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:43:02.299268291Z [2024-04-14T23:43:02.298+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:43:00+00:00, run_after=2024-04-14T23:44:00+00:00 2024-04-14T23:43:02.370175508Z [2024-04-14T23:43:02.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status success for try_number 1 2024-04-14T23:43:02.375053023Z [2024-04-14T23:43:02.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:42:00+00:00, map_index=-1, run_start_date=2024-04-14 23:43:01.205277+00:00, run_end_date=2024-04-14 23:43:01.667100+00:00, run_duration=0.461823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:43:00.459631+00:00, queued_by_job_id=1, pid=4738 2024-04-14T23:43:04.404256476Z [2024-04-14T23:43:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:43:04.404289116Z [2024-04-14T23:43:04.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:42:00+00:00, run_id=scheduled__2024-04-14T23:42:00+00:00, run_start_date=2024-04-14 23:43:00.406986+00:00, run_end_date=2024-04-14 23:43:04.400860+00:00, run_duration=3.993874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:42:00+00:00, data_interval_end=2024-04-14 23:43:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:43:04.411071474Z [2024-04-14T23:43:04.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:43:00+00:00, run_after=2024-04-14T23:44:00+00:00 2024-04-14T23:43:04.418051973Z [2024-04-14T23:43:04.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:43:04.418069940Z [2024-04-14T23:43:04.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:42:00+00:00, run_id=scheduled__2024-04-14T23:42:00+00:00, run_start_date=2024-04-14 23:43:00.407908+00:00, run_end_date=2024-04-14 23:43:04.417691+00:00, run_duration=4.009783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:42:00+00:00, data_interval_end=2024-04-14 23:43:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:43:04.428684707Z [2024-04-14T23:43:04.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:43:00+00:00, run_after=2024-04-14T23:44:00+00:00 2024-04-14T23:43:04.487046988Z [2024-04-14T23:43:04.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status success for try_number 1 2024-04-14T23:43:04.487072214Z [2024-04-14T23:43:04.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status success for try_number 1 2024-04-14T23:43:04.494030643Z [2024-04-14T23:43:04.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:42:00+00:00, map_index=-1, run_start_date=2024-04-14 23:43:02.439019+00:00, run_end_date=2024-04-14 23:43:03.640455+00:00, run_duration=1.201436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:43:00.459631+00:00, queued_by_job_id=1, pid=4757 2024-04-14T23:43:04.494409931Z [2024-04-14T23:43:04.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:42:00+00:00, map_index=-1, run_start_date=2024-04-14 23:43:02.373659+00:00, run_end_date=2024-04-14 23:43:03.959254+00:00, run_duration=1.585595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:43:00.459631+00:00, queued_by_job_id=1, pid=4756 2024-04-14T23:44:00.325364765Z [2024-04-14T23:44:00.324+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:44:00+00:00, run_after=2024-04-14T23:45:00+00:00 2024-04-14T23:44:00.350938212Z [2024-04-14T23:44:00.344+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:44:00.358539832Z [2024-04-14T23:44:00.357+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:44:00.369395982Z [2024-04-14T23:44:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:44:00+00:00, run_after=2024-04-14T23:45:00+00:00 2024-04-14T23:44:00.444996593Z [2024-04-14T23:44:00.444+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:44:00.445021904Z 2024-04-14T23:44:00.445029835Z 2024-04-14T23:44:00.445033875Z 2024-04-14T23:44:00.445038254Z 2024-04-14T23:44:00.445425492Z [2024-04-14T23:44:00.445+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:44:00.445704728Z [2024-04-14T23:44:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:44:00.445947233Z [2024-04-14T23:44:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:44:00.446201947Z [2024-04-14T23:44:00.446+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:44:00.446950423Z [2024-04-14T23:44:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:44:00.446964774Z 2024-04-14T23:44:00.446968985Z 2024-04-14T23:44:00.446972843Z 2024-04-14T23:44:00.446976753Z 2024-04-14T23:44:00.451142844Z [2024-04-14T23:44:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:44:00.451503949Z [2024-04-14T23:44:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:44:00.451882114Z [2024-04-14T23:44:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:44:00.452143341Z [2024-04-14T23:44:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:44:00.452439864Z [2024-04-14T23:44:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:44:00.452657221Z [2024-04-14T23:44:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:44:00.452958367Z [2024-04-14T23:44:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:44:00.453161621Z [2024-04-14T23:44:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:44:00.733966471Z [2024-04-14T23:44:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status queued for try_number 1 2024-04-14T23:44:00.734135495Z [2024-04-14T23:44:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:43:00+00:00 exited with status queued for try_number 1 2024-04-14T23:44:00.734238826Z [2024-04-14T23:44:00.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:43:00+00:00 exited with status queued for try_number 1 2024-04-14T23:44:00.734336846Z [2024-04-14T23:44:00.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:43:00+00:00 exited with status queued for try_number 1 2024-04-14T23:44:00.741205486Z [2024-04-14T23:44:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d4aa6f6-47b3-488d-9a86-beaaedfcb0fb 2024-04-14T23:44:00.741343987Z [2024-04-14T23:44:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12e1bccc-3de8-453d-9ffb-e444d0fe1bb8 2024-04-14T23:44:00.741468921Z [2024-04-14T23:44:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to fed6b706-503f-407e-a342-78b002f27936 2024-04-14T23:44:00.741606053Z [2024-04-14T23:44:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 266dfb3e-1555-49a0-84a3-5b73c2e385e8 2024-04-14T23:44:01.668049978Z [2024-04-14T23:44:01.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:44:01.669118341Z [2024-04-14T23:44:01.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:42:00+00:00, run_id=scheduled__2024-04-14T23:42:00+00:00, run_start_date=2024-04-14 23:44:00.378281+00:00, run_end_date=2024-04-14 23:44:01.667983+00:00, run_duration=1.289702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:42:00+00:00, data_interval_end=2024-04-14 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:44:01.679405166Z [2024-04-14T23:44:01.679+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:44:00+00:00, run_after=2024-04-14T23:46:00+00:00 2024-04-14T23:44:01.684777550Z [2024-04-14T23:44:01.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:44:01.685020506Z [2024-04-14T23:44:01.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:43:00+00:00, run_id=scheduled__2024-04-14T23:43:00+00:00, run_start_date=2024-04-14 23:44:00.379382+00:00, run_end_date=2024-04-14 23:44:01.684728+00:00, run_duration=1.305346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:43:00+00:00, data_interval_end=2024-04-14 23:44:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:44:01.693597952Z [2024-04-14T23:44:01.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:44:00+00:00, run_after=2024-04-14T23:45:00+00:00 2024-04-14T23:44:01.759641237Z [2024-04-14T23:44:01.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:43:00+00:00 exited with status success for try_number 1 2024-04-14T23:44:01.766153962Z [2024-04-14T23:44:01.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:43:00+00:00, map_index=-1, run_start_date=2024-04-14 23:44:01.185183+00:00, run_end_date=2024-04-14 23:44:01.538193+00:00, run_duration=0.35301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:44:00.448018+00:00, queued_by_job_id=1, pid=4790 2024-04-14T23:44:02.918583937Z [2024-04-14T23:44:02.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:42:00+00:00 exited with status success for try_number 1 2024-04-14T23:44:02.922423158Z [2024-04-14T23:44:02.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:42:00+00:00, map_index=-1, run_start_date=2024-04-14 23:44:01.295528+00:00, run_end_date=2024-04-14 23:44:01.622786+00:00, run_duration=0.327258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:44:00.448018+00:00, queued_by_job_id=1, pid=4791 2024-04-14T23:44:03.998123392Z [2024-04-14T23:44:03.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:44:03.999220626Z [2024-04-14T23:44:03.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:43:00+00:00, run_id=scheduled__2024-04-14T23:43:00+00:00, run_start_date=2024-04-14 23:44:00.381164+00:00, run_end_date=2024-04-14 23:44:03.998323+00:00, run_duration=3.617159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:43:00+00:00, data_interval_end=2024-04-14 23:44:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:44:04.020321272Z [2024-04-14T23:44:04.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:44:00+00:00, run_after=2024-04-14T23:45:00+00:00 2024-04-14T23:44:04.027389131Z [2024-04-14T23:44:04.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:44:04.027867359Z [2024-04-14T23:44:04.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:43:00+00:00, run_id=scheduled__2024-04-14T23:43:00+00:00, run_start_date=2024-04-14 23:44:00.380238+00:00, run_end_date=2024-04-14 23:44:04.027320+00:00, run_duration=3.647082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:43:00+00:00, data_interval_end=2024-04-14 23:44:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:44:04.036262773Z [2024-04-14T23:44:04.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:44:00+00:00, run_after=2024-04-14T23:45:00+00:00 2024-04-14T23:44:04.071680441Z [2024-04-14T23:44:04.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:43:00+00:00 exited with status success for try_number 1 2024-04-14T23:44:04.071975369Z [2024-04-14T23:44:04.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:43:00+00:00 exited with status success for try_number 1 2024-04-14T23:44:04.081404194Z [2024-04-14T23:44:04.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:43:00+00:00, map_index=-1, run_start_date=2024-04-14 23:44:02.205692+00:00, run_end_date=2024-04-14 23:44:03.649303+00:00, run_duration=1.443611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:44:00.448018+00:00, queued_by_job_id=1, pid=4809 2024-04-14T23:44:04.081817286Z [2024-04-14T23:44:04.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:43:00+00:00, map_index=-1, run_start_date=2024-04-14 23:44:02.456862+00:00, run_end_date=2024-04-14 23:44:03.691282+00:00, run_duration=1.23442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:44:00.448018+00:00, queued_by_job_id=1, pid=4820 2024-04-14T23:45:00.875674865Z [2024-04-14T23:45:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:45:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:45:00.898329826Z [2024-04-14T23:45:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:45:00+00:00, run_after=2024-04-14T23:46:00+00:00 2024-04-14T23:45:00.908524147Z [2024-04-14T23:45:00.908+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:45:00.921509008Z [2024-04-14T23:45:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:45:00+00:00, run_after=2024-04-14T23:46:00+00:00 2024-04-14T23:45:01.042963915Z [2024-04-14T23:45:01.042+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:45:01.042999098Z 2024-04-14T23:45:01.043008802Z 2024-04-14T23:45:01.043014892Z 2024-04-14T23:45:01.043035844Z 2024-04-14T23:45:01.043346868Z [2024-04-14T23:45:01.043+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:45:01.043593706Z [2024-04-14T23:45:01.043+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:45:01.043819194Z [2024-04-14T23:45:01.043+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:45:01.044026721Z [2024-04-14T23:45:01.043+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:45:01.044839150Z [2024-04-14T23:45:01.044+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:45:01.044881333Z 2024-04-14T23:45:01.044890723Z 2024-04-14T23:45:01.044897404Z 2024-04-14T23:45:01.044903963Z 2024-04-14T23:45:01.049008650Z [2024-04-14T23:45:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:45:01.049374051Z [2024-04-14T23:45:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:45:01.049727875Z [2024-04-14T23:45:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:45:01.049972026Z [2024-04-14T23:45:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:45:01.050329608Z [2024-04-14T23:45:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:45:01.050627322Z [2024-04-14T23:45:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:45:01.051042696Z [2024-04-14T23:45:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:45:01.051290338Z [2024-04-14T23:45:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:45:01.498163897Z [2024-04-14T23:45:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:45:01.498391294Z [2024-04-14T23:45:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status queued for try_number 1 2024-04-14T23:45:01.498620459Z [2024-04-14T23:45:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status queued for try_number 1 2024-04-14T23:45:01.498765324Z [2024-04-14T23:45:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status queued for try_number 1 2024-04-14T23:45:01.515112993Z [2024-04-14T23:45:01.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fe96131-5785-4be4-94b1-146f77c4c4c7 2024-04-14T23:45:01.515480665Z [2024-04-14T23:45:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff36a8e5-97c1-445d-bfbc-5e92f40a332f 2024-04-14T23:45:01.515766875Z [2024-04-14T23:45:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to b031af2a-b1ff-442e-a98e-e6bba8ae445d 2024-04-14T23:45:01.516066311Z [2024-04-14T23:45:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fc3026d-bd89-4b44-ab43-ec24ea034c38 2024-04-14T23:45:02.178556191Z [2024-04-14T23:45:02.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:45:02.179405517Z [2024-04-14T23:45:02.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:44:00+00:00, run_id=scheduled__2024-04-14T23:44:00+00:00, run_start_date=2024-04-14 23:45:00.944019+00:00, run_end_date=2024-04-14 23:45:02.178776+00:00, run_duration=1.234757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:44:00+00:00, data_interval_end=2024-04-14 23:45:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:45:02.193891075Z [2024-04-14T23:45:02.193+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:45:00+00:00, run_after=2024-04-14T23:46:00+00:00 2024-04-14T23:45:03.381985404Z [2024-04-14T23:45:03.381+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:45:03.382010709Z 2024-04-14T23:45:03.382014879Z [2024-04-14T23:45:03.381+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:45:03.382431977Z [2024-04-14T23:45:03.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:45:03.382442012Z 2024-04-14T23:45:03.385550627Z [2024-04-14T23:45:03.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:45:03.385763753Z [2024-04-14T23:45:03.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:45:03.442407037Z [2024-04-14T23:45:03.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:45:03.442427617Z [2024-04-14T23:45:03.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:45:03.442489522Z [2024-04-14T23:45:03.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status success for try_number 1 2024-04-14T23:45:03.449524019Z [2024-04-14T23:45:03.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 055bad1a-70d5-4a6e-9306-026ca0c49c3d 2024-04-14T23:45:03.449672110Z [2024-04-14T23:45:03.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=-1, run_start_date=2024-04-14 23:45:02.793152+00:00, run_end_date=2024-04-14 23:45:03.185877+00:00, run_duration=0.392725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:45:01.045902+00:00, queued_by_job_id=1, pid=4873 2024-04-14T23:45:03.449822058Z [2024-04-14T23:45:03.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:44:00+00:00, map_index=-1, run_start_date=2024-04-14 23:45:01.805592+00:00, run_end_date=2024-04-14 23:45:02.148017+00:00, run_duration=0.342425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:45:01.045902+00:00, queued_by_job_id=1, pid=4849 2024-04-14T23:45:04.577536570Z [2024-04-14T23:45:04.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:45:04.578021535Z [2024-04-14T23:45:04.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:44:00+00:00, run_id=scheduled__2024-04-14T23:44:00+00:00, run_start_date=2024-04-14 23:45:00.946274+00:00, run_end_date=2024-04-14 23:45:04.577388+00:00, run_duration=3.631114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:44:00+00:00, data_interval_end=2024-04-14 23:45:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:45:04.585624563Z [2024-04-14T23:45:04.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:45:00+00:00, run_after=2024-04-14T23:46:00+00:00 2024-04-14T23:45:04.638033175Z [2024-04-14T23:45:04.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status success for try_number 1 2024-04-14T23:45:04.647955277Z [2024-04-14T23:45:04.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:44:00+00:00, map_index=-1, run_start_date=2024-04-14 23:45:02.850018+00:00, run_end_date=2024-04-14 23:45:04.167143+00:00, run_duration=1.317125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:45:01.045902+00:00, queued_by_job_id=1, pid=4874 2024-04-14T23:45:05.707373018Z [2024-04-14T23:45:05.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:45:05.707798180Z [2024-04-14T23:45:05.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:44:00+00:00, run_id=scheduled__2024-04-14T23:44:00+00:00, run_start_date=2024-04-14 23:45:00.948352+00:00, run_end_date=2024-04-14 23:45:05.707325+00:00, run_duration=4.758973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:44:00+00:00, data_interval_end=2024-04-14 23:45:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:45:05.722950767Z [2024-04-14T23:45:05.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:45:00+00:00, run_after=2024-04-14T23:46:00+00:00 2024-04-14T23:45:05.768269763Z [2024-04-14T23:45:05.767+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:45:05.768311968Z 2024-04-14T23:45:05.768366859Z [2024-04-14T23:45:05.768+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:45:05.769066974Z [2024-04-14T23:45:05.768+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:45:05.769087657Z 2024-04-14T23:45:05.772422860Z [2024-04-14T23:45:05.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:45:05.772643485Z [2024-04-14T23:45:05.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:45:05.841319546Z [2024-04-14T23:45:05.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:45:05.841374212Z [2024-04-14T23:45:05.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status success for try_number 1 2024-04-14T23:45:05.841414065Z [2024-04-14T23:45:05.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:45:05.850113530Z [2024-04-14T23:45:05.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:44:00+00:00, map_index=-1, run_start_date=2024-04-14 23:45:03.113325+00:00, run_end_date=2024-04-14 23:45:04.901681+00:00, run_duration=1.788356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:45:01.045902+00:00, queued_by_job_id=1, pid=4880 2024-04-14T23:45:05.850243622Z [2024-04-14T23:45:05.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3a4aa33-2b07-400f-85af-39abc85910a4 2024-04-14T23:45:05.850416707Z [2024-04-14T23:45:05.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=-1, run_start_date=2024-04-14 23:45:04.971357+00:00, run_end_date=2024-04-14 23:45:05.384433+00:00, run_duration=0.413076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:45:03.382660+00:00, queued_by_job_id=1, pid=4898 2024-04-14T23:45:08.339196600Z [2024-04-14T23:45:08.338+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:45:08.339230601Z 2024-04-14T23:45:08.339562028Z [2024-04-14T23:45:08.339+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:45:08.340536154Z [2024-04-14T23:45:08.340+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:45:08.340576156Z 2024-04-14T23:45:08.345470283Z [2024-04-14T23:45:08.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:45:08.346445002Z [2024-04-14T23:45:08.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:45:08.453821774Z [2024-04-14T23:45:08.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status queued for try_number 1 2024-04-14T23:45:08.453919134Z [2024-04-14T23:45:08.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:45:08.459413406Z [2024-04-14T23:45:08.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae0754ab-aff4-49fe-87c6-d81f6159e00b 2024-04-14T23:45:08.459644480Z [2024-04-14T23:45:08.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=0, run_start_date=2024-04-14 23:45:07.260608+00:00, run_end_date=2024-04-14 23:45:07.628473+00:00, run_duration=0.367865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:45:05.769511+00:00, queued_by_job_id=1, pid=4906 2024-04-14T23:45:10.714167713Z [2024-04-14T23:45:10.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:45:10.714576797Z [2024-04-14T23:45:10.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:40:00+00:00, run_id=scheduled__2024-04-14T23:40:00+00:00, run_start_date=2024-04-14 23:45:00.941454+00:00, run_end_date=2024-04-14 23:45:10.714006+00:00, run_duration=9.772552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:40:00+00:00, data_interval_end=2024-04-14 23:45:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:45:10.721671535Z [2024-04-14T23:45:10.721+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:45:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:45:10.763503600Z [2024-04-14T23:45:10.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:40:00+00:00 exited with status success for try_number 1 2024-04-14T23:45:10.771088682Z [2024-04-14T23:45:10.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:40:00+00:00, map_index=-1, run_start_date=2024-04-14 23:45:09.817210+00:00, run_end_date=2024-04-14 23:45:10.225337+00:00, run_duration=0.408127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:45:08.341081+00:00, queued_by_job_id=1, pid=4914 2024-04-14T23:46:00.861509383Z [2024-04-14T23:46:00.860+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:46:00.872484816Z [2024-04-14T23:46:00.872+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:46:00.889657747Z [2024-04-14T23:46:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:46:00+00:00, run_after=2024-04-14T23:47:00+00:00 2024-04-14T23:46:00.904519948Z [2024-04-14T23:46:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:46:00+00:00, run_after=2024-04-14T23:47:00+00:00 2024-04-14T23:46:00.997454973Z [2024-04-14T23:46:00.996+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:46:00.997500302Z 2024-04-14T23:46:00.997510848Z 2024-04-14T23:46:00.997519569Z 2024-04-14T23:46:00.997528235Z 2024-04-14T23:46:00.997566963Z [2024-04-14T23:46:00.997+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:46:00.997752036Z [2024-04-14T23:46:00.997+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:46:00.998020797Z [2024-04-14T23:46:00.997+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:46:00.998331641Z [2024-04-14T23:46:00.998+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:46:00.999337291Z [2024-04-14T23:46:00.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:46:00.999356480Z 2024-04-14T23:46:00.999362924Z 2024-04-14T23:46:00.999368472Z 2024-04-14T23:46:00.999373969Z 2024-04-14T23:46:01.004528015Z [2024-04-14T23:46:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:46:01.004909695Z [2024-04-14T23:46:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:46:01.005391319Z [2024-04-14T23:46:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:46:01.005694321Z [2024-04-14T23:46:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:46:01.006175792Z [2024-04-14T23:46:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:46:01.006468796Z [2024-04-14T23:46:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:46:01.006947559Z [2024-04-14T23:46:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:46:01.007356629Z [2024-04-14T23:46:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:46:01.336537590Z [2024-04-14T23:46:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status queued for try_number 1 2024-04-14T23:46:01.336796740Z [2024-04-14T23:46:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status queued for try_number 1 2024-04-14T23:46:01.336957840Z [2024-04-14T23:46:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status queued for try_number 1 2024-04-14T23:46:01.337113884Z [2024-04-14T23:46:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status queued for try_number 1 2024-04-14T23:46:01.351413080Z [2024-04-14T23:46:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b748c02-5118-494b-a1ce-66d5436a3302 2024-04-14T23:46:01.352611196Z [2024-04-14T23:46:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ee984c4-f19f-4227-82ad-9aa068f1547a 2024-04-14T23:46:01.352878918Z [2024-04-14T23:46:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f817418-65f6-4ce0-931f-b0ccff475548 2024-04-14T23:46:01.353284315Z [2024-04-14T23:46:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8acbcec4-3f18-49e8-b371-9d0c47bf24c6 2024-04-14T23:46:01.754824139Z [2024-04-14T23:46:01.754+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:46:02.666327860Z [2024-04-14T23:46:02.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:46:02.666660839Z [2024-04-14T23:46:02.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:44:00+00:00, run_id=scheduled__2024-04-14T23:44:00+00:00, run_start_date=2024-04-14 23:46:00.917367+00:00, run_end_date=2024-04-14 23:46:02.666348+00:00, run_duration=1.748981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:44:00+00:00, data_interval_end=2024-04-14 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:46:02.679282138Z [2024-04-14T23:46:02.679+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:46:00+00:00, run_after=2024-04-14T23:48:00+00:00 2024-04-14T23:46:02.719240669Z [2024-04-14T23:46:02.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:46:02.719383108Z [2024-04-14T23:46:02.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:45:00+00:00, run_id=scheduled__2024-04-14T23:45:00+00:00, run_start_date=2024-04-14 23:46:00.918546+00:00, run_end_date=2024-04-14 23:46:02.719160+00:00, run_duration=1.800614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:45:00+00:00, data_interval_end=2024-04-14 23:46:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:46:02.734188626Z [2024-04-14T23:46:02.733+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:46:00+00:00, run_after=2024-04-14T23:47:00+00:00 2024-04-14T23:46:02.767925086Z [2024-04-14T23:46:02.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:44:00+00:00 exited with status success for try_number 1 2024-04-14T23:46:02.768212481Z [2024-04-14T23:46:02.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status success for try_number 1 2024-04-14T23:46:02.773675042Z [2024-04-14T23:46:02.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:44:00+00:00, map_index=-1, run_start_date=2024-04-14 23:46:01.756384+00:00, run_end_date=2024-04-14 23:46:02.133392+00:00, run_duration=0.377008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:46:01.000775+00:00, queued_by_job_id=1, pid=4937 2024-04-14T23:46:02.774051755Z [2024-04-14T23:46:02.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:45:00+00:00, map_index=-1, run_start_date=2024-04-14 23:46:01.867903+00:00, run_end_date=2024-04-14 23:46:02.344287+00:00, run_duration=0.476384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:46:01.000775+00:00, queued_by_job_id=1, pid=4938 2024-04-14T23:46:04.987696847Z [2024-04-14T23:46:04.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:46:04.987947553Z [2024-04-14T23:46:04.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:45:00+00:00, run_id=scheduled__2024-04-14T23:45:00+00:00, run_start_date=2024-04-14 23:46:00.920910+00:00, run_end_date=2024-04-14 23:46:04.987559+00:00, run_duration=4.066649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:45:00+00:00, data_interval_end=2024-04-14 23:46:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:46:05.000249339Z [2024-04-14T23:46:04.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:46:00+00:00, run_after=2024-04-14T23:47:00+00:00 2024-04-14T23:46:05.007759308Z [2024-04-14T23:46:05.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:46:05.007976654Z [2024-04-14T23:46:05.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:45:00+00:00, run_id=scheduled__2024-04-14T23:45:00+00:00, run_start_date=2024-04-14 23:46:00.919724+00:00, run_end_date=2024-04-14 23:46:05.007583+00:00, run_duration=4.087859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:45:00+00:00, data_interval_end=2024-04-14 23:46:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:46:05.017048516Z [2024-04-14T23:46:05.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:46:00+00:00, run_after=2024-04-14T23:47:00+00:00 2024-04-14T23:46:05.050436067Z [2024-04-14T23:46:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status success for try_number 1 2024-04-14T23:46:05.050475483Z [2024-04-14T23:46:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status success for try_number 1 2024-04-14T23:46:05.055525000Z [2024-04-14T23:46:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:45:00+00:00, map_index=-1, run_start_date=2024-04-14 23:46:02.624172+00:00, run_end_date=2024-04-14 23:46:04.723327+00:00, run_duration=2.099155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:46:01.000775+00:00, queued_by_job_id=1, pid=4961 2024-04-14T23:46:05.055700609Z [2024-04-14T23:46:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:45:00+00:00, map_index=-1, run_start_date=2024-04-14 23:46:02.624213+00:00, run_end_date=2024-04-14 23:46:04.211413+00:00, run_duration=1.5872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:46:01.000775+00:00, queued_by_job_id=1, pid=4962 2024-04-14T23:47:00.810201774Z [2024-04-14T23:47:00.809+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:47:00.831664349Z [2024-04-14T23:47:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:47:00+00:00, run_after=2024-04-14T23:48:00+00:00 2024-04-14T23:47:00.850083577Z [2024-04-14T23:47:00.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:47:00+00:00, run_after=2024-04-14T23:48:00+00:00 2024-04-14T23:47:00.957227598Z [2024-04-14T23:47:00.956+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:47:00.957257296Z 2024-04-14T23:47:00.957262679Z 2024-04-14T23:47:00.957267114Z 2024-04-14T23:47:00.957479443Z [2024-04-14T23:47:00.957+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:47:00.957806659Z [2024-04-14T23:47:00.957+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:47:00.958125237Z [2024-04-14T23:47:00.957+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:47:00.959490280Z [2024-04-14T23:47:00.959+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:47:00.959505159Z 2024-04-14T23:47:00.959510312Z 2024-04-14T23:47:00.959514716Z 2024-04-14T23:47:00.965733155Z [2024-04-14T23:47:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:47:00.966159546Z [2024-04-14T23:47:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:47:00.966501774Z [2024-04-14T23:47:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:47:00.966646840Z [2024-04-14T23:47:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:47:00.967076062Z [2024-04-14T23:47:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:47:00.967288246Z [2024-04-14T23:47:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:47:01.197058135Z [2024-04-14T23:47:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status queued for try_number 1 2024-04-14T23:47:01.197345788Z [2024-04-14T23:47:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status queued for try_number 1 2024-04-14T23:47:01.197582133Z [2024-04-14T23:47:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status queued for try_number 1 2024-04-14T23:47:01.217084108Z [2024-04-14T23:47:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96ba498b-99cc-4b40-baca-7f40befd0ac7 2024-04-14T23:47:01.217452461Z [2024-04-14T23:47:01.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to 763af7c9-29eb-4333-9df5-63103f285bb7 2024-04-14T23:47:01.217736608Z [2024-04-14T23:47:01.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71c99ae1-b6a2-44ea-a4c0-cbb819a85fc6 2024-04-14T23:47:02.357629364Z [2024-04-14T23:47:02.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:47:02.358267060Z [2024-04-14T23:47:02.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:46:00+00:00, run_id=scheduled__2024-04-14T23:46:00+00:00, run_start_date=2024-04-14 23:47:00.866155+00:00, run_end_date=2024-04-14 23:47:02.357601+00:00, run_duration=1.491446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:46:00+00:00, data_interval_end=2024-04-14 23:47:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:47:02.380150912Z [2024-04-14T23:47:02.379+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:47:00+00:00, run_after=2024-04-14T23:48:00+00:00 2024-04-14T23:47:02.419517341Z [2024-04-14T23:47:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status success for try_number 1 2024-04-14T23:47:02.423466994Z [2024-04-14T23:47:02.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:46:00+00:00, map_index=-1, run_start_date=2024-04-14 23:47:01.686692+00:00, run_end_date=2024-04-14 23:47:02.083962+00:00, run_duration=0.39727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:47:00.961197+00:00, queued_by_job_id=1, pid=4993 2024-04-14T23:47:04.927273458Z [2024-04-14T23:47:04.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:47:04.927311312Z [2024-04-14T23:47:04.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:46:00+00:00, run_id=scheduled__2024-04-14T23:46:00+00:00, run_start_date=2024-04-14 23:47:00.870459+00:00, run_end_date=2024-04-14 23:47:04.925695+00:00, run_duration=4.055236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:46:00+00:00, data_interval_end=2024-04-14 23:47:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:47:04.937447674Z [2024-04-14T23:47:04.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:47:00+00:00, run_after=2024-04-14T23:48:00+00:00 2024-04-14T23:47:04.944573103Z [2024-04-14T23:47:04.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:47:04.944871246Z [2024-04-14T23:47:04.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:46:00+00:00, run_id=scheduled__2024-04-14T23:46:00+00:00, run_start_date=2024-04-14 23:47:00.868140+00:00, run_end_date=2024-04-14 23:47:04.944451+00:00, run_duration=4.076311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:46:00+00:00, data_interval_end=2024-04-14 23:47:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:47:04.955284832Z [2024-04-14T23:47:04.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:47:00+00:00, run_after=2024-04-14T23:48:00+00:00 2024-04-14T23:47:04.997580697Z [2024-04-14T23:47:04.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status success for try_number 1 2024-04-14T23:47:04.997715358Z [2024-04-14T23:47:04.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status success for try_number 1 2024-04-14T23:47:05.004110196Z [2024-04-14T23:47:05.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:46:00+00:00, map_index=-1, run_start_date=2024-04-14 23:47:02.569434+00:00, run_end_date=2024-04-14 23:47:04.020979+00:00, run_duration=1.451545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:47:00.961197+00:00, queued_by_job_id=1, pid=5011 2024-04-14T23:47:05.004282839Z [2024-04-14T23:47:05.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:46:00+00:00, map_index=-1, run_start_date=2024-04-14 23:47:02.610754+00:00, run_end_date=2024-04-14 23:47:03.805562+00:00, run_duration=1.194808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:47:00.961197+00:00, queued_by_job_id=1, pid=5012 2024-04-14T23:48:00.763605850Z [2024-04-14T23:48:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:48:00+00:00, run_after=2024-04-14T23:49:00+00:00 2024-04-14T23:48:00.771455200Z [2024-04-14T23:48:00.771+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:48:00.787743627Z [2024-04-14T23:48:00.786+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:48:00.799315130Z [2024-04-14T23:48:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:48:00+00:00, run_after=2024-04-14T23:49:00+00:00 2024-04-14T23:48:00.870050385Z [2024-04-14T23:48:00.869+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:48:00.870070254Z 2024-04-14T23:48:00.870086257Z 2024-04-14T23:48:00.870089447Z 2024-04-14T23:48:00.870092346Z 2024-04-14T23:48:00.870462360Z [2024-04-14T23:48:00.869+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:48:00.870646010Z [2024-04-14T23:48:00.870+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:48:00.870782153Z [2024-04-14T23:48:00.870+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:48:00.870932137Z [2024-04-14T23:48:00.870+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:48:00.871458224Z [2024-04-14T23:48:00.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:48:00.871467999Z 2024-04-14T23:48:00.871471310Z 2024-04-14T23:48:00.871474057Z 2024-04-14T23:48:00.871476693Z 2024-04-14T23:48:00.874452776Z [2024-04-14T23:48:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:48:00.874702614Z [2024-04-14T23:48:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:48:00.875009065Z [2024-04-14T23:48:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:48:00.875087797Z [2024-04-14T23:48:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:48:00.875302421Z [2024-04-14T23:48:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:48:00.875465538Z [2024-04-14T23:48:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:48:00.875697105Z [2024-04-14T23:48:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:48:00.875844289Z [2024-04-14T23:48:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:48:01.526177398Z [2024-04-14T23:48:01.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status queued for try_number 1 2024-04-14T23:48:01.527679635Z [2024-04-14T23:48:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:47:00+00:00 exited with status queued for try_number 1 2024-04-14T23:48:01.527693695Z [2024-04-14T23:48:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:47:00+00:00 exited with status queued for try_number 1 2024-04-14T23:48:01.527697194Z [2024-04-14T23:48:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:47:00+00:00 exited with status queued for try_number 1 2024-04-14T23:48:01.561024378Z [2024-04-14T23:48:01.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84e6ee57-4cb9-48cb-94ca-ef3bbccdc7c8 2024-04-14T23:48:01.561156022Z [2024-04-14T23:48:01.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to e18daaba-cb39-4c8d-b4be-30b206e70f5b 2024-04-14T23:48:01.561230148Z [2024-04-14T23:48:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52da5fce-bc76-4cef-bb86-14f7ad75c6dc 2024-04-14T23:48:01.561337929Z [2024-04-14T23:48:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f663a07-453e-4d42-afd8-cabf872c7034 2024-04-14T23:48:03.664349588Z [2024-04-14T23:48:03.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:48:03.664920870Z [2024-04-14T23:48:03.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:46:00+00:00, run_id=scheduled__2024-04-14T23:46:00+00:00, run_start_date=2024-04-14 23:48:00.810192+00:00, run_end_date=2024-04-14 23:48:03.664441+00:00, run_duration=2.854249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:46:00+00:00, data_interval_end=2024-04-14 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:48:03.687021276Z [2024-04-14T23:48:03.686+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:48:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:48:03.703104879Z [2024-04-14T23:48:03.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:48:03.703529271Z [2024-04-14T23:48:03.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:47:00+00:00, run_id=scheduled__2024-04-14T23:47:00+00:00, run_start_date=2024-04-14 23:48:00.811345+00:00, run_end_date=2024-04-14 23:48:03.703190+00:00, run_duration=2.891845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:47:00+00:00, data_interval_end=2024-04-14 23:48:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:48:03.724526363Z [2024-04-14T23:48:03.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:48:00+00:00, run_after=2024-04-14T23:49:00+00:00 2024-04-14T23:48:03.811569433Z [2024-04-14T23:48:03.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:46:00+00:00 exited with status success for try_number 1 2024-04-14T23:48:03.811881164Z [2024-04-14T23:48:03.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:47:00+00:00 exited with status success for try_number 1 2024-04-14T23:48:03.825836640Z [2024-04-14T23:48:03.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:46:00+00:00, map_index=-1, run_start_date=2024-04-14 23:48:02.670736+00:00, run_end_date=2024-04-14 23:48:03.395714+00:00, run_duration=0.724978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:48:00.872133+00:00, queued_by_job_id=1, pid=5046 2024-04-14T23:48:03.826409736Z [2024-04-14T23:48:03.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:47:00+00:00, map_index=-1, run_start_date=2024-04-14 23:48:02.672672+00:00, run_end_date=2024-04-14 23:48:03.218924+00:00, run_duration=0.546252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:48:00.872133+00:00, queued_by_job_id=1, pid=5047 2024-04-14T23:48:05.869253232Z [2024-04-14T23:48:05.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:48:05.869483878Z [2024-04-14T23:48:05.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:47:00+00:00, run_id=scheduled__2024-04-14T23:47:00+00:00, run_start_date=2024-04-14 23:48:00.812254+00:00, run_end_date=2024-04-14 23:48:05.868998+00:00, run_duration=5.056744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:47:00+00:00, data_interval_end=2024-04-14 23:48:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:48:05.881413997Z [2024-04-14T23:48:05.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:48:00+00:00, run_after=2024-04-14T23:49:00+00:00 2024-04-14T23:48:05.921562751Z [2024-04-14T23:48:05.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:47:00+00:00 exited with status success for try_number 1 2024-04-14T23:48:05.927638678Z [2024-04-14T23:48:05.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:47:00+00:00, map_index=-1, run_start_date=2024-04-14 23:48:04.101899+00:00, run_end_date=2024-04-14 23:48:05.550068+00:00, run_duration=1.448169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:48:00.872133+00:00, queued_by_job_id=1, pid=5069 2024-04-14T23:48:06.964291399Z [2024-04-14T23:48:06.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:48:06.964568166Z [2024-04-14T23:48:06.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:47:00+00:00, run_id=scheduled__2024-04-14T23:47:00+00:00, run_start_date=2024-04-14 23:48:00.813171+00:00, run_end_date=2024-04-14 23:48:06.964295+00:00, run_duration=6.151124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:47:00+00:00, data_interval_end=2024-04-14 23:48:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:48:06.975848560Z [2024-04-14T23:48:06.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:48:00+00:00, run_after=2024-04-14T23:49:00+00:00 2024-04-14T23:48:07.012621077Z [2024-04-14T23:48:07.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:47:00+00:00 exited with status success for try_number 1 2024-04-14T23:48:07.017113152Z [2024-04-14T23:48:07.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:47:00+00:00, map_index=-1, run_start_date=2024-04-14 23:48:04.326429+00:00, run_end_date=2024-04-14 23:48:06.062118+00:00, run_duration=1.735689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:48:00.872133+00:00, queued_by_job_id=1, pid=5070 2024-04-14T23:49:00.614804727Z [2024-04-14T23:49:00.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:49:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:49:00.635539457Z [2024-04-14T23:49:00.635+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:49:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:49:00.647842733Z [2024-04-14T23:49:00.647+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:49:00.715442270Z [2024-04-14T23:49:00.714+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:49:00.715650143Z 2024-04-14T23:49:00.715661689Z 2024-04-14T23:49:00.715670412Z 2024-04-14T23:49:00.715739429Z [2024-04-14T23:49:00.715+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:49:00.715892763Z [2024-04-14T23:49:00.715+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:49:00.716231784Z [2024-04-14T23:49:00.715+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:49:00.718261363Z [2024-04-14T23:49:00.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:49:00.718279695Z 2024-04-14T23:49:00.718288608Z 2024-04-14T23:49:00.718297195Z 2024-04-14T23:49:00.725013071Z [2024-04-14T23:49:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:49:00.725174546Z [2024-04-14T23:49:00.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:49:00.725430285Z [2024-04-14T23:49:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:49:00.725543057Z [2024-04-14T23:49:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:49:00.725858369Z [2024-04-14T23:49:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:49:00.725974600Z [2024-04-14T23:49:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:49:00.906438854Z [2024-04-14T23:49:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status queued for try_number 1 2024-04-14T23:49:00.906700853Z [2024-04-14T23:49:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status queued for try_number 1 2024-04-14T23:49:00.906950698Z [2024-04-14T23:49:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status queued for try_number 1 2024-04-14T23:49:00.913249061Z [2024-04-14T23:49:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9df3c5ea-d1f8-43f1-9247-7160b84d2861 2024-04-14T23:49:00.913531532Z [2024-04-14T23:49:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef6dd87a-73a5-4c73-8a1b-0d86b4604db6 2024-04-14T23:49:00.913766071Z [2024-04-14T23:49:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ef18d43-f2bb-4240-8544-f588689b86d5 2024-04-14T23:49:02.042811128Z [2024-04-14T23:49:02.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:49:02.043211060Z [2024-04-14T23:49:02.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:48:00+00:00, run_id=scheduled__2024-04-14T23:48:00+00:00, run_start_date=2024-04-14 23:49:00.659555+00:00, run_end_date=2024-04-14 23:49:02.042855+00:00, run_duration=1.3833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:48:00+00:00, data_interval_end=2024-04-14 23:49:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:49:02.065554469Z [2024-04-14T23:49:02.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:49:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:49:02.115817651Z [2024-04-14T23:49:02.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status success for try_number 1 2024-04-14T23:49:02.122088772Z [2024-04-14T23:49:02.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:48:00+00:00, map_index=-1, run_start_date=2024-04-14 23:49:01.405073+00:00, run_end_date=2024-04-14 23:49:01.757741+00:00, run_duration=0.352668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:49:00.720347+00:00, queued_by_job_id=1, pid=5101 2024-04-14T23:49:05.392472814Z [2024-04-14T23:49:05.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:49:05.392539152Z [2024-04-14T23:49:05.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:48:00+00:00, run_id=scheduled__2024-04-14T23:48:00+00:00, run_start_date=2024-04-14 23:49:00.660829+00:00, run_end_date=2024-04-14 23:49:05.392245+00:00, run_duration=4.731416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:48:00+00:00, data_interval_end=2024-04-14 23:49:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:49:05.407682764Z [2024-04-14T23:49:05.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:49:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:49:05.417907755Z [2024-04-14T23:49:05.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:49:05.418117515Z [2024-04-14T23:49:05.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:48:00+00:00, run_id=scheduled__2024-04-14T23:48:00+00:00, run_start_date=2024-04-14 23:49:00.661914+00:00, run_end_date=2024-04-14 23:49:05.417703+00:00, run_duration=4.755789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:48:00+00:00, data_interval_end=2024-04-14 23:49:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:49:05.434788309Z [2024-04-14T23:49:05.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:49:00+00:00, run_after=2024-04-14T23:50:00+00:00 2024-04-14T23:49:05.479525261Z [2024-04-14T23:49:05.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status success for try_number 1 2024-04-14T23:49:05.479581078Z [2024-04-14T23:49:05.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status success for try_number 1 2024-04-14T23:49:05.487877259Z [2024-04-14T23:49:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:48:00+00:00, map_index=-1, run_start_date=2024-04-14 23:49:02.313705+00:00, run_end_date=2024-04-14 23:49:04.594392+00:00, run_duration=2.280687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:49:00.720347+00:00, queued_by_job_id=1, pid=5119 2024-04-14T23:49:05.488366883Z [2024-04-14T23:49:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:48:00+00:00, map_index=-1, run_start_date=2024-04-14 23:49:02.386249+00:00, run_end_date=2024-04-14 23:49:04.713524+00:00, run_duration=2.327275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:49:00.720347+00:00, queued_by_job_id=1, pid=5120 2024-04-14T23:50:01.092106663Z [2024-04-14T23:50:01.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:55:00+00:00 2024-04-14T23:50:01.104106335Z [2024-04-14T23:50:01.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:51:00+00:00 2024-04-14T23:50:01.115285282Z [2024-04-14T23:50:01.114+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:50:01.130292250Z [2024-04-14T23:50:01.129+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:50:01.150382909Z [2024-04-14T23:50:01.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:51:00+00:00 2024-04-14T23:50:01.246717237Z [2024-04-14T23:50:01.246+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-14T23:50:01.246759292Z 2024-04-14T23:50:01.246815981Z 2024-04-14T23:50:01.246827590Z 2024-04-14T23:50:01.246837467Z 2024-04-14T23:50:01.246847098Z 2024-04-14T23:50:01.246929854Z [2024-04-14T23:50:01.246+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:50:01.247196330Z [2024-04-14T23:50:01.246+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:50:01.247428180Z [2024-04-14T23:50:01.247+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:50:01.247681674Z [2024-04-14T23:50:01.247+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:50:01.247872798Z [2024-04-14T23:50:01.247+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:50:01.248577645Z [2024-04-14T23:50:01.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:50:01.248590117Z 2024-04-14T23:50:01.248595570Z 2024-04-14T23:50:01.248599582Z 2024-04-14T23:50:01.248603238Z 2024-04-14T23:50:01.248606909Z 2024-04-14T23:50:01.253195228Z [2024-04-14T23:50:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:50:01.253447304Z [2024-04-14T23:50:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:50:01.253783823Z [2024-04-14T23:50:01.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:50:01.254012261Z [2024-04-14T23:50:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:50:01.254377057Z [2024-04-14T23:50:01.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:50:01.254611843Z [2024-04-14T23:50:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:50:01.255025284Z [2024-04-14T23:50:01.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:50:01.255251137Z [2024-04-14T23:50:01.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:50:01.255595862Z [2024-04-14T23:50:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:50:01.255834393Z [2024-04-14T23:50:01.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:50:01.643942343Z [2024-04-14T23:50:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:01.643972705Z [2024-04-14T23:50:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:01.644015995Z [2024-04-14T23:50:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:49:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:01.644077891Z [2024-04-14T23:50:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:49:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:01.644107035Z [2024-04-14T23:50:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:49:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:01.659668390Z [2024-04-14T23:50:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc204a58-184e-489b-a979-0e2edf8b5ad3 2024-04-14T23:50:01.659717240Z [2024-04-14T23:50:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ed1286a-b705-48fa-9ff6-4a1e936531fd 2024-04-14T23:50:01.659823557Z [2024-04-14T23:50:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 816bbb39-b49d-4e7d-abbf-cf22117143ad 2024-04-14T23:50:01.659908749Z [2024-04-14T23:50:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1998724-1952-4789-9243-588cab8b7689 2024-04-14T23:50:01.659984215Z [2024-04-14T23:50:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 506af01c-5f3f-4289-bedf-ea224ccea553 2024-04-14T23:50:02.991605485Z [2024-04-14T23:50:02.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:50:02.991970132Z [2024-04-14T23:50:02.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:48:00+00:00, run_id=scheduled__2024-04-14T23:48:00+00:00, run_start_date=2024-04-14 23:50:01.162499+00:00, run_end_date=2024-04-14 23:50:02.991531+00:00, run_duration=1.829032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:48:00+00:00, data_interval_end=2024-04-14 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:50:03.000666491Z [2024-04-14T23:50:03.000+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:52:00+00:00 2024-04-14T23:50:03.030094680Z [2024-04-14T23:50:03.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:50:03.030393150Z [2024-04-14T23:50:03.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:49:00+00:00, run_id=scheduled__2024-04-14T23:49:00+00:00, run_start_date=2024-04-14 23:50:01.163680+00:00, run_end_date=2024-04-14 23:50:03.030024+00:00, run_duration=1.866344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:49:00+00:00, data_interval_end=2024-04-14 23:50:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:50:03.042790932Z [2024-04-14T23:50:03.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:51:00+00:00 2024-04-14T23:50:03.073560057Z [2024-04-14T23:50:03.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:48:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:03.073590518Z [2024-04-14T23:50:03.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:49:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:03.081514620Z [2024-04-14T23:50:03.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:49:00+00:00, map_index=-1, run_start_date=2024-04-14 23:50:02.365446+00:00, run_end_date=2024-04-14 23:50:02.817337+00:00, run_duration=0.451891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:01.249818+00:00, queued_by_job_id=1, pid=5156 2024-04-14T23:50:03.081641186Z [2024-04-14T23:50:03.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:48:00+00:00, map_index=-1, run_start_date=2024-04-14 23:50:02.279269+00:00, run_end_date=2024-04-14 23:50:02.701787+00:00, run_duration=0.422518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:01.249818+00:00, queued_by_job_id=1, pid=5155 2024-04-14T23:50:04.208734846Z [2024-04-14T23:50:04.208+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:50:04.208779562Z 2024-04-14T23:50:04.209292444Z [2024-04-14T23:50:04.208+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:50:04.210947877Z [2024-04-14T23:50:04.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:50:04.210969063Z 2024-04-14T23:50:04.216907303Z [2024-04-14T23:50:04.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:50:04.217582131Z [2024-04-14T23:50:04.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:50:04.304504143Z [2024-04-14T23:50:04.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:04.304815138Z [2024-04-14T23:50:04.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:04.312505806Z [2024-04-14T23:50:04.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 864b3419-3e7a-4101-9c57-47f59be70446 2024-04-14T23:50:04.312756070Z [2024-04-14T23:50:04.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:45:00+00:00, map_index=-1, run_start_date=2024-04-14 23:50:03.517080+00:00, run_end_date=2024-04-14 23:50:03.835314+00:00, run_duration=0.318234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:01.249818+00:00, queued_by_job_id=1, pid=5187 2024-04-14T23:50:04.734937902Z [2024-04-14T23:50:04.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:50:04.735155159Z [2024-04-14T23:50:04.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:49:00+00:00, run_id=scheduled__2024-04-14T23:49:00+00:00, run_start_date=2024-04-14 23:50:01.164717+00:00, run_end_date=2024-04-14 23:50:04.734791+00:00, run_duration=3.570074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:49:00+00:00, data_interval_end=2024-04-14 23:50:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:50:04.751795813Z [2024-04-14T23:50:04.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:51:00+00:00 2024-04-14T23:50:04.803222914Z [2024-04-14T23:50:04.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:49:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:04.814419114Z [2024-04-14T23:50:04.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:49:00+00:00, map_index=-1, run_start_date=2024-04-14 23:50:03.380314+00:00, run_end_date=2024-04-14 23:50:04.584253+00:00, run_duration=1.203939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:01.249818+00:00, queued_by_job_id=1, pid=5186 2024-04-14T23:50:05.867378183Z [2024-04-14T23:50:05.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:50:05.867596925Z [2024-04-14T23:50:05.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:49:00+00:00, run_id=scheduled__2024-04-14T23:49:00+00:00, run_start_date=2024-04-14 23:50:01.165768+00:00, run_end_date=2024-04-14 23:50:05.867247+00:00, run_duration=4.701479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:49:00+00:00, data_interval_end=2024-04-14 23:50:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:50:05.876148655Z [2024-04-14T23:50:05.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:51:00+00:00 2024-04-14T23:50:05.936990036Z [2024-04-14T23:50:05.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:49:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:05.946540734Z [2024-04-14T23:50:05.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:49:00+00:00, map_index=-1, run_start_date=2024-04-14 23:50:03.365196+00:00, run_end_date=2024-04-14 23:50:05.065710+00:00, run_duration=1.700514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:01.249818+00:00, queued_by_job_id=1, pid=5185 2024-04-14T23:50:07.024363079Z [2024-04-14T23:50:07.023+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:50:07.024410110Z 2024-04-14T23:50:07.024495707Z [2024-04-14T23:50:07.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:50:07.025378414Z [2024-04-14T23:50:07.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:50:07.025393606Z 2024-04-14T23:50:07.028979316Z [2024-04-14T23:50:07.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:50:07.030199479Z [2024-04-14T23:50:07.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:50:07.091287106Z [2024-04-14T23:50:07.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:07.091325488Z [2024-04-14T23:50:07.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:07.096609589Z [2024-04-14T23:50:07.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbf29ce5-9ec4-45ff-bed7-3d84a25bf9e0 2024-04-14T23:50:07.096892349Z [2024-04-14T23:50:07.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:45:00+00:00, map_index=-1, run_start_date=2024-04-14 23:50:05.796197+00:00, run_end_date=2024-04-14 23:50:06.162456+00:00, run_duration=0.366259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:04.212128+00:00, queued_by_job_id=1, pid=5210 2024-04-14T23:50:10.024740423Z [2024-04-14T23:50:10.024+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:50:10.024772662Z 2024-04-14T23:50:10.025278581Z [2024-04-14T23:50:10.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:50:10.027009651Z [2024-04-14T23:50:10.026+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:50:10.027024868Z 2024-04-14T23:50:10.039576416Z [2024-04-14T23:50:10.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:50:10.039800347Z [2024-04-14T23:50:10.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:50:10.100191063Z [2024-04-14T23:50:10.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status queued for try_number 1 2024-04-14T23:50:10.100765637Z [2024-04-14T23:50:10.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:10.112166429Z [2024-04-14T23:50:10.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d4fa675-dc30-40f4-98e2-f362dad678fd 2024-04-14T23:50:10.112568746Z [2024-04-14T23:50:10.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:45:00+00:00, map_index=0, run_start_date=2024-04-14 23:50:08.499147+00:00, run_end_date=2024-04-14 23:50:08.826077+00:00, run_duration=0.32693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:07.025988+00:00, queued_by_job_id=1, pid=5218 2024-04-14T23:50:12.178561411Z [2024-04-14T23:50:12.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:50:12.179049644Z [2024-04-14T23:50:12.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:45:00+00:00, run_id=scheduled__2024-04-14T23:45:00+00:00, run_start_date=2024-04-14 23:50:01.161377+00:00, run_end_date=2024-04-14 23:50:12.178373+00:00, run_duration=11.016996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:45:00+00:00, data_interval_end=2024-04-14 23:50:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:50:12.187272593Z [2024-04-14T23:50:12.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:50:00+00:00, run_after=2024-04-14T23:55:00+00:00 2024-04-14T23:50:12.236159916Z [2024-04-14T23:50:12.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:45:00+00:00 exited with status success for try_number 1 2024-04-14T23:50:12.244497608Z [2024-04-14T23:50:12.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:45:00+00:00, map_index=-1, run_start_date=2024-04-14 23:50:11.478311+00:00, run_end_date=2024-04-14 23:50:11.797101+00:00, run_duration=0.31879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:50:10.028005+00:00, queued_by_job_id=1, pid=5226 2024-04-14T23:51:00.057363514Z [2024-04-14T23:51:00.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:51:00+00:00, run_after=2024-04-14T23:52:00+00:00 2024-04-14T23:51:00.073265433Z [2024-04-14T23:51:00.072+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:51:00+00:00, run_after=2024-04-14T23:52:00+00:00 2024-04-14T23:51:00.082086539Z [2024-04-14T23:51:00.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:51:00.163804357Z [2024-04-14T23:51:00.163+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:51:00.163824426Z 2024-04-14T23:51:00.163827730Z 2024-04-14T23:51:00.163830668Z 2024-04-14T23:51:00.164107360Z [2024-04-14T23:51:00.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:51:00.164353590Z [2024-04-14T23:51:00.164+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:51:00.164576570Z [2024-04-14T23:51:00.164+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:51:00.165222879Z [2024-04-14T23:51:00.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:51:00.165232679Z 2024-04-14T23:51:00.165235552Z 2024-04-14T23:51:00.165238322Z 2024-04-14T23:51:00.169682417Z [2024-04-14T23:51:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:51:00.169965690Z [2024-04-14T23:51:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:51:00.170272608Z [2024-04-14T23:51:00.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:51:00.170471253Z [2024-04-14T23:51:00.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:51:00.171109887Z [2024-04-14T23:51:00.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:51:00.171323356Z [2024-04-14T23:51:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:51:00.514218944Z [2024-04-14T23:51:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:51:00.515600610Z [2024-04-14T23:51:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:51:00.515834816Z [2024-04-14T23:51:00.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:51:00.527310745Z [2024-04-14T23:51:00.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 323701bb-6347-4e9d-acad-d6f41be91cdc 2024-04-14T23:51:00.527623096Z [2024-04-14T23:51:00.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbd84f35-f6f9-4910-bac2-3a655a64b899 2024-04-14T23:51:00.527868525Z [2024-04-14T23:51:00.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fe05933-428e-458d-a387-7eac677b2beb 2024-04-14T23:51:01.828499971Z [2024-04-14T23:51:01.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:51:01.829255291Z [2024-04-14T23:51:01.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:50:00+00:00, run_id=scheduled__2024-04-14T23:50:00+00:00, run_start_date=2024-04-14 23:51:00.096653+00:00, run_end_date=2024-04-14 23:51:01.828821+00:00, run_duration=1.732168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:50:00+00:00, data_interval_end=2024-04-14 23:51:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:51:01.844668333Z [2024-04-14T23:51:01.844+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:51:00+00:00, run_after=2024-04-14T23:52:00+00:00 2024-04-14T23:51:01.902604154Z [2024-04-14T23:51:01.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:51:01.917397164Z [2024-04-14T23:51:01.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=-1, run_start_date=2024-04-14 23:51:01.116448+00:00, run_end_date=2024-04-14 23:51:01.514974+00:00, run_duration=0.398526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:51:00.165946+00:00, queued_by_job_id=1, pid=5248 2024-04-14T23:51:01.930215901Z [2024-04-14T23:51:01.929+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:51:04.086211541Z [2024-04-14T23:51:04.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:51:04.086241221Z [2024-04-14T23:51:04.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:50:00+00:00, run_id=scheduled__2024-04-14T23:50:00+00:00, run_start_date=2024-04-14 23:51:00.098050+00:00, run_end_date=2024-04-14 23:51:04.085818+00:00, run_duration=3.987768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:50:00+00:00, data_interval_end=2024-04-14 23:51:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:51:04.110192362Z [2024-04-14T23:51:04.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:51:00+00:00, run_after=2024-04-14T23:52:00+00:00 2024-04-14T23:51:05.177462974Z [2024-04-14T23:51:05.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:51:05.177533484Z [2024-04-14T23:51:05.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:50:00+00:00, run_id=scheduled__2024-04-14T23:50:00+00:00, run_start_date=2024-04-14 23:51:00.099225+00:00, run_end_date=2024-04-14 23:51:05.176964+00:00, run_duration=5.077739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:50:00+00:00, data_interval_end=2024-04-14 23:51:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:51:05.185194983Z [2024-04-14T23:51:05.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:51:00+00:00, run_after=2024-04-14T23:52:00+00:00 2024-04-14T23:51:05.216339873Z [2024-04-14T23:51:05.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:51:05.216376364Z [2024-04-14T23:51:05.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:51:05.222855259Z [2024-04-14T23:51:05.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=-1, run_start_date=2024-04-14 23:51:02.725086+00:00, run_end_date=2024-04-14 23:51:04.048425+00:00, run_duration=1.323339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:51:00.165946+00:00, queued_by_job_id=1, pid=5267 2024-04-14T23:51:05.223174066Z [2024-04-14T23:51:05.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=-1, run_start_date=2024-04-14 23:51:02.363903+00:00, run_end_date=2024-04-14 23:51:04.404624+00:00, run_duration=2.040721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:51:00.165946+00:00, queued_by_job_id=1, pid=5261 2024-04-14T23:52:00.909019241Z [2024-04-14T23:52:00.908+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:52:00.930032958Z [2024-04-14T23:52:00.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:52:00+00:00, run_after=2024-04-14T23:53:00+00:00 2024-04-14T23:52:00.939621223Z [2024-04-14T23:52:00.939+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:52:00.952836323Z [2024-04-14T23:52:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:52:00+00:00, run_after=2024-04-14T23:53:00+00:00 2024-04-14T23:52:01.042313650Z [2024-04-14T23:52:01.041+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:52:01.042354757Z 2024-04-14T23:52:01.042393736Z 2024-04-14T23:52:01.042402814Z 2024-04-14T23:52:01.042411341Z 2024-04-14T23:52:01.043052356Z [2024-04-14T23:52:01.042+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:52:01.043610036Z [2024-04-14T23:52:01.043+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:52:01.044063615Z [2024-04-14T23:52:01.043+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:52:01.044379544Z [2024-04-14T23:52:01.043+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:52:01.045695646Z [2024-04-14T23:52:01.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:52:01.045712289Z 2024-04-14T23:52:01.045721359Z 2024-04-14T23:52:01.045729845Z 2024-04-14T23:52:01.045738178Z 2024-04-14T23:52:01.051548572Z [2024-04-14T23:52:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:52:01.051777476Z [2024-04-14T23:52:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:52:01.052204092Z [2024-04-14T23:52:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:52:01.052433216Z [2024-04-14T23:52:01.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:52:01.052800844Z [2024-04-14T23:52:01.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:52:01.052948922Z [2024-04-14T23:52:01.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:52:01.053347956Z [2024-04-14T23:52:01.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:52:01.053602940Z [2024-04-14T23:52:01.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:52:01.251013479Z [2024-04-14T23:52:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:52:01.251185699Z [2024-04-14T23:52:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:51:00+00:00 exited with status queued for try_number 1 2024-04-14T23:52:01.251329161Z [2024-04-14T23:52:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:51:00+00:00 exited with status queued for try_number 1 2024-04-14T23:52:01.251494033Z [2024-04-14T23:52:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:51:00+00:00 exited with status queued for try_number 1 2024-04-14T23:52:01.258245539Z [2024-04-14T23:52:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b9d476b-1aee-42fd-babf-efe3addf065d 2024-04-14T23:52:01.258403210Z [2024-04-14T23:52:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to c65b4622-c2d4-49f0-be6f-38ac4d266a3c 2024-04-14T23:52:01.258522842Z [2024-04-14T23:52:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9da8a0a3-a488-4e4f-a46f-ae33995af785 2024-04-14T23:52:01.258646106Z [2024-04-14T23:52:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to d261488a-8ed7-41d7-9840-587d162144d5 2024-04-14T23:52:02.408086361Z [2024-04-14T23:52:02.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:52:02.408388620Z [2024-04-14T23:52:02.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:50:00+00:00, run_id=scheduled__2024-04-14T23:50:00+00:00, run_start_date=2024-04-14 23:52:00.964994+00:00, run_end_date=2024-04-14 23:52:02.408078+00:00, run_duration=1.443084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:50:00+00:00, data_interval_end=2024-04-14 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:52:02.414430039Z [2024-04-14T23:52:02.414+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:52:00+00:00, run_after=2024-04-14T23:54:00+00:00 2024-04-14T23:52:02.419393386Z [2024-04-14T23:52:02.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:52:02.419406314Z [2024-04-14T23:52:02.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:51:00+00:00, run_id=scheduled__2024-04-14T23:51:00+00:00, run_start_date=2024-04-14 23:52:00.966189+00:00, run_end_date=2024-04-14 23:52:02.419175+00:00, run_duration=1.452986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:51:00+00:00, data_interval_end=2024-04-14 23:52:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:52:02.430966575Z [2024-04-14T23:52:02.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:52:00+00:00, run_after=2024-04-14T23:53:00+00:00 2024-04-14T23:52:02.463493278Z [2024-04-14T23:52:02.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:51:00+00:00 exited with status success for try_number 1 2024-04-14T23:52:02.467676878Z [2024-04-14T23:52:02.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:51:00+00:00, map_index=-1, run_start_date=2024-04-14 23:52:01.775755+00:00, run_end_date=2024-04-14 23:52:02.269191+00:00, run_duration=0.493436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:52:01.047733+00:00, queued_by_job_id=1, pid=5299 2024-04-14T23:52:03.546917379Z [2024-04-14T23:52:03.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:52:03.550916436Z [2024-04-14T23:52:03.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=-1, run_start_date=2024-04-14 23:52:01.905218+00:00, run_end_date=2024-04-14 23:52:02.350742+00:00, run_duration=0.445524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:52:01.047733+00:00, queued_by_job_id=1, pid=5300 2024-04-14T23:52:04.983307190Z [2024-04-14T23:52:04.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:52:04.983636618Z [2024-04-14T23:52:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:51:00+00:00, run_id=scheduled__2024-04-14T23:51:00+00:00, run_start_date=2024-04-14 23:52:00.968950+00:00, run_end_date=2024-04-14 23:52:04.983070+00:00, run_duration=4.01412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:51:00+00:00, data_interval_end=2024-04-14 23:52:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:52:04.995970585Z [2024-04-14T23:52:04.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:52:00+00:00, run_after=2024-04-14T23:53:00+00:00 2024-04-14T23:52:05.006972312Z [2024-04-14T23:52:05.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:52:05.007410971Z [2024-04-14T23:52:05.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:51:00+00:00, run_id=scheduled__2024-04-14T23:51:00+00:00, run_start_date=2024-04-14 23:52:00.967513+00:00, run_end_date=2024-04-14 23:52:05.006909+00:00, run_duration=4.039396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:51:00+00:00, data_interval_end=2024-04-14 23:52:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:52:05.016781119Z [2024-04-14T23:52:05.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:52:00+00:00, run_after=2024-04-14T23:53:00+00:00 2024-04-14T23:52:05.056314457Z [2024-04-14T23:52:05.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:51:00+00:00 exited with status success for try_number 1 2024-04-14T23:52:05.056714363Z [2024-04-14T23:52:05.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:51:00+00:00 exited with status success for try_number 1 2024-04-14T23:52:05.066988236Z [2024-04-14T23:52:05.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:51:00+00:00, map_index=-1, run_start_date=2024-04-14 23:52:02.830591+00:00, run_end_date=2024-04-14 23:52:04.698819+00:00, run_duration=1.868228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:52:01.047733+00:00, queued_by_job_id=1, pid=5324 2024-04-14T23:52:05.067496830Z [2024-04-14T23:52:05.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:51:00+00:00, map_index=-1, run_start_date=2024-04-14 23:52:02.768190+00:00, run_end_date=2024-04-14 23:52:03.998364+00:00, run_duration=1.230174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:52:01.047733+00:00, queued_by_job_id=1, pid=5323 2024-04-14T23:53:00.843147955Z [2024-04-14T23:53:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:53:00+00:00, run_after=2024-04-14T23:54:00+00:00 2024-04-14T23:53:00.860088612Z [2024-04-14T23:53:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:53:00+00:00, run_after=2024-04-14T23:54:00+00:00 2024-04-14T23:53:00.868321620Z [2024-04-14T23:53:00.867+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:53:00.946846584Z [2024-04-14T23:53:00.946+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:53:00.946868104Z 2024-04-14T23:53:00.946882293Z 2024-04-14T23:53:00.946902739Z 2024-04-14T23:53:00.947335396Z [2024-04-14T23:53:00.947+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:53:00.947775677Z [2024-04-14T23:53:00.947+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:53:00.948136097Z [2024-04-14T23:53:00.947+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:53:00.949411316Z [2024-04-14T23:53:00.949+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:53:00.949421415Z 2024-04-14T23:53:00.949436196Z 2024-04-14T23:53:00.949440442Z 2024-04-14T23:53:00.956291380Z [2024-04-14T23:53:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:53:00.956895282Z [2024-04-14T23:53:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:53:00.957372503Z [2024-04-14T23:53:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:53:00.957655625Z [2024-04-14T23:53:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:53:00.958047687Z [2024-04-14T23:53:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:53:00.958316962Z [2024-04-14T23:53:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:53:01.161958732Z [2024-04-14T23:53:01.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status queued for try_number 1 2024-04-14T23:53:01.162089315Z [2024-04-14T23:53:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status queued for try_number 1 2024-04-14T23:53:01.162203238Z [2024-04-14T23:53:01.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status queued for try_number 1 2024-04-14T23:53:01.168818185Z [2024-04-14T23:53:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff05e63a-b0b0-4545-ba62-b8c3fa8f5933 2024-04-14T23:53:01.169012849Z [2024-04-14T23:53:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec1f6b03-6f38-4861-97bc-fee778b0101e 2024-04-14T23:53:01.169230436Z [2024-04-14T23:53:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b11672f-a628-4a1b-9d79-7f63b5b6a3f0 2024-04-14T23:53:02.336501305Z [2024-04-14T23:53:02.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:53:02.336682289Z [2024-04-14T23:53:02.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:52:00+00:00, run_id=scheduled__2024-04-14T23:52:00+00:00, run_start_date=2024-04-14 23:53:00.880819+00:00, run_end_date=2024-04-14 23:53:02.336423+00:00, run_duration=1.455604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:52:00+00:00, data_interval_end=2024-04-14 23:53:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:53:02.345099176Z [2024-04-14T23:53:02.344+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:53:00+00:00, run_after=2024-04-14T23:54:00+00:00 2024-04-14T23:53:02.377676784Z [2024-04-14T23:53:02.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status success for try_number 1 2024-04-14T23:53:02.386457748Z [2024-04-14T23:53:02.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:52:00+00:00, map_index=-1, run_start_date=2024-04-14 23:53:01.730080+00:00, run_end_date=2024-04-14 23:53:02.152211+00:00, run_duration=0.422131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:53:00.951160+00:00, queued_by_job_id=1, pid=5356 2024-04-14T23:53:04.522638940Z [2024-04-14T23:53:04.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:53:04.523298664Z [2024-04-14T23:53:04.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:52:00+00:00, run_id=scheduled__2024-04-14T23:52:00+00:00, run_start_date=2024-04-14 23:53:00.882825+00:00, run_end_date=2024-04-14 23:53:04.522613+00:00, run_duration=3.639788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:52:00+00:00, data_interval_end=2024-04-14 23:53:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:53:04.535780818Z [2024-04-14T23:53:04.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:53:00+00:00, run_after=2024-04-14T23:54:00+00:00 2024-04-14T23:53:04.542289181Z [2024-04-14T23:53:04.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:53:04.542477833Z [2024-04-14T23:53:04.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:52:00+00:00, run_id=scheduled__2024-04-14T23:52:00+00:00, run_start_date=2024-04-14 23:53:00.883855+00:00, run_end_date=2024-04-14 23:53:04.542228+00:00, run_duration=3.658373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:52:00+00:00, data_interval_end=2024-04-14 23:53:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:53:04.549601511Z [2024-04-14T23:53:04.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:53:00+00:00, run_after=2024-04-14T23:54:00+00:00 2024-04-14T23:53:04.582080414Z [2024-04-14T23:53:04.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status success for try_number 1 2024-04-14T23:53:04.582541734Z [2024-04-14T23:53:04.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status success for try_number 1 2024-04-14T23:53:04.591392878Z [2024-04-14T23:53:04.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:52:00+00:00, map_index=-1, run_start_date=2024-04-14 23:53:02.554264+00:00, run_end_date=2024-04-14 23:53:03.835861+00:00, run_duration=1.281597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:53:00.951160+00:00, queued_by_job_id=1, pid=5374 2024-04-14T23:53:04.592011277Z [2024-04-14T23:53:04.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:52:00+00:00, map_index=-1, run_start_date=2024-04-14 23:53:02.567230+00:00, run_end_date=2024-04-14 23:53:04.282848+00:00, run_duration=1.715618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:53:00.951160+00:00, queued_by_job_id=1, pid=5375 2024-04-14T23:54:00.536233295Z [2024-04-14T23:54:00.535+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:54:00.551612042Z [2024-04-14T23:54:00.551+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:54:00.563867598Z [2024-04-14T23:54:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:54:00+00:00, run_after=2024-04-14T23:55:00+00:00 2024-04-14T23:54:00.574281598Z [2024-04-14T23:54:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:54:00+00:00, run_after=2024-04-14T23:55:00+00:00 2024-04-14T23:54:00.655397085Z [2024-04-14T23:54:00.655+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:54:00.655413465Z 2024-04-14T23:54:00.655419794Z 2024-04-14T23:54:00.655422830Z 2024-04-14T23:54:00.655425901Z 2024-04-14T23:54:00.655435826Z [2024-04-14T23:54:00.655+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:54:00.655441924Z [2024-04-14T23:54:00.655+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:54:00.655533902Z [2024-04-14T23:54:00.655+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:54:00.655610700Z [2024-04-14T23:54:00.655+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:54:00.656223722Z [2024-04-14T23:54:00.656+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:54:00.656238340Z 2024-04-14T23:54:00.656242169Z 2024-04-14T23:54:00.656245505Z 2024-04-14T23:54:00.656248661Z 2024-04-14T23:54:00.659138208Z [2024-04-14T23:54:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:54:00.659243169Z [2024-04-14T23:54:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:54:00.659749535Z [2024-04-14T23:54:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:54:00.659757197Z [2024-04-14T23:54:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:54:00.659768428Z [2024-04-14T23:54:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:54:00.659771169Z [2024-04-14T23:54:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:54:00.659952968Z [2024-04-14T23:54:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:54:00.660092613Z [2024-04-14T23:54:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:54:01.117672156Z [2024-04-14T23:54:01.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status queued for try_number 1 2024-04-14T23:54:01.118930173Z [2024-04-14T23:54:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:53:00+00:00 exited with status queued for try_number 1 2024-04-14T23:54:01.119155850Z [2024-04-14T23:54:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:53:00+00:00 exited with status queued for try_number 1 2024-04-14T23:54:01.119422580Z [2024-04-14T23:54:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:53:00+00:00 exited with status queued for try_number 1 2024-04-14T23:54:01.141678966Z [2024-04-14T23:54:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2db4f29a-83f7-4204-a23f-57212c45cf2e 2024-04-14T23:54:01.141876343Z [2024-04-14T23:54:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to a93e4362-b5ec-4402-b316-81d6f690a3a7 2024-04-14T23:54:01.142018227Z [2024-04-14T23:54:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0059141e-74c0-41b0-aac8-903a8721a6a4 2024-04-14T23:54:01.142239318Z [2024-04-14T23:54:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24744d03-48a6-4162-99e5-6eb81a516733 2024-04-14T23:54:03.498744018Z [2024-04-14T23:54:03.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:54:03.499149387Z [2024-04-14T23:54:03.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:52:00+00:00, run_id=scheduled__2024-04-14T23:52:00+00:00, run_start_date=2024-04-14 23:54:00.600580+00:00, run_end_date=2024-04-14 23:54:03.498759+00:00, run_duration=2.898179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:52:00+00:00, data_interval_end=2024-04-14 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:54:03.506331719Z [2024-04-14T23:54:03.506+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:54:00+00:00, run_after=2024-04-14T23:56:00+00:00 2024-04-14T23:54:03.527724240Z [2024-04-14T23:54:03.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:54:03.529908856Z [2024-04-14T23:54:03.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:53:00+00:00, run_id=scheduled__2024-04-14T23:53:00+00:00, run_start_date=2024-04-14 23:54:00.602161+00:00, run_end_date=2024-04-14 23:54:03.527631+00:00, run_duration=2.92547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:53:00+00:00, data_interval_end=2024-04-14 23:54:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:54:03.559994231Z [2024-04-14T23:54:03.559+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:54:00+00:00, run_after=2024-04-14T23:55:00+00:00 2024-04-14T23:54:03.634065325Z [2024-04-14T23:54:03.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:52:00+00:00 exited with status success for try_number 1 2024-04-14T23:54:03.634159705Z [2024-04-14T23:54:03.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:53:00+00:00 exited with status success for try_number 1 2024-04-14T23:54:03.647937170Z [2024-04-14T23:54:03.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:52:00+00:00, map_index=-1, run_start_date=2024-04-14 23:54:02.005346+00:00, run_end_date=2024-04-14 23:54:02.632456+00:00, run_duration=0.62711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:54:00.657014+00:00, queued_by_job_id=1, pid=5408 2024-04-14T23:54:03.648445952Z [2024-04-14T23:54:03.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:53:00+00:00, map_index=-1, run_start_date=2024-04-14 23:54:02.320721+00:00, run_end_date=2024-04-14 23:54:02.821258+00:00, run_duration=0.500537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:54:00.657014+00:00, queued_by_job_id=1, pid=5409 2024-04-14T23:54:05.828005870Z [2024-04-14T23:54:05.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:54:05.828186409Z [2024-04-14T23:54:05.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:53:00+00:00, run_id=scheduled__2024-04-14T23:53:00+00:00, run_start_date=2024-04-14 23:54:00.604218+00:00, run_end_date=2024-04-14 23:54:05.827830+00:00, run_duration=5.223612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:53:00+00:00, data_interval_end=2024-04-14 23:54:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:54:05.840941842Z [2024-04-14T23:54:05.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:54:00+00:00, run_after=2024-04-14T23:55:00+00:00 2024-04-14T23:54:05.849339195Z [2024-04-14T23:54:05.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:54:05.849454439Z [2024-04-14T23:54:05.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:53:00+00:00, run_id=scheduled__2024-04-14T23:53:00+00:00, run_start_date=2024-04-14 23:54:00.603287+00:00, run_end_date=2024-04-14 23:54:05.849048+00:00, run_duration=5.245761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:53:00+00:00, data_interval_end=2024-04-14 23:54:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:54:05.859292144Z [2024-04-14T23:54:05.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:54:00+00:00, run_after=2024-04-14T23:55:00+00:00 2024-04-14T23:54:05.901383837Z [2024-04-14T23:54:05.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:53:00+00:00 exited with status success for try_number 1 2024-04-14T23:54:05.901616804Z [2024-04-14T23:54:05.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:53:00+00:00 exited with status success for try_number 1 2024-04-14T23:54:05.911687904Z [2024-04-14T23:54:05.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:53:00+00:00, map_index=-1, run_start_date=2024-04-14 23:54:03.291094+00:00, run_end_date=2024-04-14 23:54:05.066822+00:00, run_duration=1.775728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:54:00.657014+00:00, queued_by_job_id=1, pid=5432 2024-04-14T23:54:05.912106523Z [2024-04-14T23:54:05.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:53:00+00:00, map_index=-1, run_start_date=2024-04-14 23:54:03.468225+00:00, run_end_date=2024-04-14 23:54:04.893116+00:00, run_duration=1.424891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:54:00.657014+00:00, queued_by_job_id=1, pid=5433 2024-04-14T23:55:00.189246887Z [2024-04-14T23:55:00.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:55:00+00:00, run_after=2024-04-14T23:56:00+00:00 2024-04-14T23:55:00.204641962Z [2024-04-14T23:55:00.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:55:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:55:00.215682141Z [2024-04-14T23:55:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:55:00+00:00, run_after=2024-04-14T23:56:00+00:00 2024-04-14T23:55:00.220665145Z [2024-04-14T23:55:00.220+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:55:00.312569970Z [2024-04-14T23:55:00.312+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:55:00.312607683Z 2024-04-14T23:55:00.312616852Z 2024-04-14T23:55:00.312624591Z 2024-04-14T23:55:00.312631669Z 2024-04-14T23:55:00.312638825Z [2024-04-14T23:55:00.312+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:55:00.312965981Z [2024-04-14T23:55:00.312+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:55:00.313211923Z [2024-04-14T23:55:00.312+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:55:00.313388275Z [2024-04-14T23:55:00.313+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:55:00.314276765Z [2024-04-14T23:55:00.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:55:00.314288466Z 2024-04-14T23:55:00.314295926Z 2024-04-14T23:55:00.314303109Z 2024-04-14T23:55:00.314310169Z 2024-04-14T23:55:00.320184377Z [2024-04-14T23:55:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-14T23:55:00.320350232Z [2024-04-14T23:55:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:55:00.321171314Z [2024-04-14T23:55:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:55:00.321559997Z [2024-04-14T23:55:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:55:00.322012812Z [2024-04-14T23:55:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:55:00.322369110Z [2024-04-14T23:55:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:55:00.322843646Z [2024-04-14T23:55:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:55:00.323163664Z [2024-04-14T23:55:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:55:00.812208666Z [2024-04-14T23:55:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:55:00.812280108Z [2024-04-14T23:55:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status queued for try_number 1 2024-04-14T23:55:00.812346705Z [2024-04-14T23:55:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status queued for try_number 1 2024-04-14T23:55:00.812436940Z [2024-04-14T23:55:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status queued for try_number 1 2024-04-14T23:55:00.820907368Z [2024-04-14T23:55:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66f921b7-90c3-46f1-b1ff-86c7e42e774c 2024-04-14T23:55:00.821025867Z [2024-04-14T23:55:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c2ab5cc-51f1-4ed0-9d42-2911fdd73b07 2024-04-14T23:55:00.821146330Z [2024-04-14T23:55:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to e24ab1fe-1a1f-4a27-9d9a-69938a6f4dc6 2024-04-14T23:55:00.821253736Z [2024-04-14T23:55:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e06a26b-1887-4955-979b-816040aa5f4e 2024-04-14T23:55:02.028116096Z [2024-04-14T23:55:02.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:55:02.028291211Z [2024-04-14T23:55:02.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:54:00+00:00, run_id=scheduled__2024-04-14T23:54:00+00:00, run_start_date=2024-04-14 23:55:00.229870+00:00, run_end_date=2024-04-14 23:55:02.028048+00:00, run_duration=1.798178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:54:00+00:00, data_interval_end=2024-04-14 23:55:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:55:02.046209468Z [2024-04-14T23:55:02.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:55:00+00:00, run_after=2024-04-14T23:56:00+00:00 2024-04-14T23:55:02.175413451Z [2024-04-14T23:55:02.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status success for try_number 1 2024-04-14T23:55:02.190528651Z [2024-04-14T23:55:02.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:54:00+00:00, map_index=-1, run_start_date=2024-04-14 23:55:01.247827+00:00, run_end_date=2024-04-14 23:55:01.627957+00:00, run_duration=0.38013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:55:00.315701+00:00, queued_by_job_id=1, pid=5466 2024-04-14T23:55:03.278577468Z [2024-04-14T23:55:03.278+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:55:03.278616926Z 2024-04-14T23:55:03.278648014Z [2024-04-14T23:55:03.278+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:55:03.279157516Z [2024-04-14T23:55:03.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:55:03.279178009Z 2024-04-14T23:55:03.281222094Z [2024-04-14T23:55:03.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-14T23:55:03.281410380Z [2024-04-14T23:55:03.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:55:03.382863154Z [2024-04-14T23:55:03.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:55:03.382915063Z [2024-04-14T23:55:03.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:55:03.398367461Z [2024-04-14T23:55:03.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 639eea98-3eb5-43a7-94e0-98ff0bb4d909 2024-04-14T23:55:03.398625212Z [2024-04-14T23:55:03.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=-1, run_start_date=2024-04-14 23:55:02.217416+00:00, run_end_date=2024-04-14 23:55:02.703165+00:00, run_duration=0.485749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:55:00.315701+00:00, queued_by_job_id=1, pid=5491 2024-04-14T23:55:04.579860028Z [2024-04-14T23:55:04.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:55:04.580272016Z [2024-04-14T23:55:04.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:54:00+00:00, run_id=scheduled__2024-04-14T23:54:00+00:00, run_start_date=2024-04-14 23:55:00.230713+00:00, run_end_date=2024-04-14 23:55:04.579584+00:00, run_duration=4.348871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:54:00+00:00, data_interval_end=2024-04-14 23:55:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:55:04.595373177Z [2024-04-14T23:55:04.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:55:00+00:00, run_after=2024-04-14T23:56:00+00:00 2024-04-14T23:55:04.604514579Z [2024-04-14T23:55:04.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:55:04.604916456Z [2024-04-14T23:55:04.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:54:00+00:00, run_id=scheduled__2024-04-14T23:54:00+00:00, run_start_date=2024-04-14 23:55:00.231589+00:00, run_end_date=2024-04-14 23:55:04.604356+00:00, run_duration=4.372767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:54:00+00:00, data_interval_end=2024-04-14 23:55:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:55:04.621128885Z [2024-04-14T23:55:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:55:00+00:00, run_after=2024-04-14T23:56:00+00:00 2024-04-14T23:55:04.679669891Z [2024-04-14T23:55:04.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status success for try_number 1 2024-04-14T23:55:04.679925116Z [2024-04-14T23:55:04.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status success for try_number 1 2024-04-14T23:55:04.687820409Z [2024-04-14T23:55:04.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:54:00+00:00, map_index=-1, run_start_date=2024-04-14 23:55:02.174691+00:00, run_end_date=2024-04-14 23:55:03.471565+00:00, run_duration=1.296874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:55:00.315701+00:00, queued_by_job_id=1, pid=5490 2024-04-14T23:55:04.688174399Z [2024-04-14T23:55:04.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:54:00+00:00, map_index=-1, run_start_date=2024-04-14 23:55:02.300317+00:00, run_end_date=2024-04-14 23:55:03.842185+00:00, run_duration=1.541868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:55:00.315701+00:00, queued_by_job_id=1, pid=5492 2024-04-14T23:55:05.768617825Z [2024-04-14T23:55:05.768+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:55:05.768648646Z 2024-04-14T23:55:05.768876783Z [2024-04-14T23:55:05.768+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:55:05.769497208Z [2024-04-14T23:55:05.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:55:05.769508578Z 2024-04-14T23:55:05.771457238Z [2024-04-14T23:55:05.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-14T23:55:05.771490770Z [2024-04-14T23:55:05.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-14T23:55:05.819553650Z [2024-04-14T23:55:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:55:05.819618084Z [2024-04-14T23:55:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:55:05.824934704Z [2024-04-14T23:55:05.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64f024c6-ce45-4f11-a454-1106dab72c74 2024-04-14T23:55:05.825179955Z [2024-04-14T23:55:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=-1, run_start_date=2024-04-14 23:55:04.951931+00:00, run_end_date=2024-04-14 23:55:05.310401+00:00, run_duration=0.35847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:55:03.279448+00:00, queued_by_job_id=1, pid=5515 2024-04-14T23:55:07.973006897Z [2024-04-14T23:55:07.972+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-14T23:55:07.973054395Z 2024-04-14T23:55:07.973144312Z [2024-04-14T23:55:07.972+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:55:07.973609504Z [2024-04-14T23:55:07.973+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:55:07.973627393Z 2024-04-14T23:55:07.977926156Z [2024-04-14T23:55:07.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:55:07.978254688Z [2024-04-14T23:55:07.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-14T23:55:08.047266383Z [2024-04-14T23:55:08.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status queued for try_number 1 2024-04-14T23:55:08.047610905Z [2024-04-14T23:55:08.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:55:08.057931384Z [2024-04-14T23:55:08.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff5b6d14-286b-45ff-8e29-04469ef5222e 2024-04-14T23:55:08.058603480Z [2024-04-14T23:55:08.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=0, run_start_date=2024-04-14 23:55:07.281970+00:00, run_end_date=2024-04-14 23:55:07.596947+00:00, run_duration=0.314977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:55:05.769813+00:00, queued_by_job_id=1, pid=5523 2024-04-14T23:55:10.197727284Z [2024-04-14T23:55:10.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:55:10.198418723Z [2024-04-14T23:55:10.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:50:00+00:00, run_id=scheduled__2024-04-14T23:50:00+00:00, run_start_date=2024-04-14 23:55:00.228886+00:00, run_end_date=2024-04-14 23:55:10.197776+00:00, run_duration=9.96889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:50:00+00:00, data_interval_end=2024-04-14 23:55:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-14T23:55:10.211922738Z [2024-04-14T23:55:10.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:55:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:55:10.245520133Z [2024-04-14T23:55:10.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:50:00+00:00 exited with status success for try_number 1 2024-04-14T23:55:10.249122373Z [2024-04-14T23:55:10.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:50:00+00:00, map_index=-1, run_start_date=2024-04-14 23:55:09.396435+00:00, run_end_date=2024-04-14 23:55:09.818451+00:00, run_duration=0.422016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:55:07.975151+00:00, queued_by_job_id=1, pid=5531 2024-04-14T23:56:00.258283447Z [2024-04-14T23:56:00.257+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:56:00.281692560Z [2024-04-14T23:56:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:56:00+00:00, run_after=2024-04-14T23:57:00+00:00 2024-04-14T23:56:00.299458459Z [2024-04-14T23:56:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:56:00+00:00, run_after=2024-04-14T23:57:00+00:00 2024-04-14T23:56:00.306109938Z [2024-04-14T23:56:00.305+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:56:00.382611554Z [2024-04-14T23:56:00.375+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:56:00.382628668Z 2024-04-14T23:56:00.382635102Z 2024-04-14T23:56:00.382638145Z 2024-04-14T23:56:00.382641112Z 2024-04-14T23:56:00.382644337Z [2024-04-14T23:56:00.375+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:56:00.382647047Z [2024-04-14T23:56:00.375+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:56:00.382649710Z [2024-04-14T23:56:00.375+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:56:00.382652481Z [2024-04-14T23:56:00.375+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:56:00.382655075Z [2024-04-14T23:56:00.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:56:00.382657639Z 2024-04-14T23:56:00.382660215Z 2024-04-14T23:56:00.382662887Z 2024-04-14T23:56:00.382675019Z 2024-04-14T23:56:00.382678414Z [2024-04-14T23:56:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:56:00.382681769Z [2024-04-14T23:56:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:56:00.382686304Z [2024-04-14T23:56:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:56:00.382688989Z [2024-04-14T23:56:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:56:00.382691498Z [2024-04-14T23:56:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:56:00.382694049Z [2024-04-14T23:56:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:56:00.382696577Z [2024-04-14T23:56:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:56:00.382713264Z [2024-04-14T23:56:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:56:00.615564809Z [2024-04-14T23:56:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status queued for try_number 1 2024-04-14T23:56:00.615594104Z [2024-04-14T23:56:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status queued for try_number 1 2024-04-14T23:56:00.615637967Z [2024-04-14T23:56:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status queued for try_number 1 2024-04-14T23:56:00.615689964Z [2024-04-14T23:56:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status queued for try_number 1 2024-04-14T23:56:00.625533158Z [2024-04-14T23:56:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ee22af4-82a1-46e7-bf26-024371aadb71 2024-04-14T23:56:00.625572597Z [2024-04-14T23:56:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03946664-3e1f-4585-a765-ce4176aeb878 2024-04-14T23:56:00.625691560Z [2024-04-14T23:56:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 211e9985-9ae2-4ce3-b15b-fee6a1e547f9 2024-04-14T23:56:00.625762385Z [2024-04-14T23:56:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57f3f65e-fbf4-4083-a4c7-4dfb9d34f39a 2024-04-14T23:56:01.755013977Z [2024-04-14T23:56:01.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:56:01.755285839Z [2024-04-14T23:56:01.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:54:00+00:00, run_id=scheduled__2024-04-14T23:54:00+00:00, run_start_date=2024-04-14 23:56:00.315529+00:00, run_end_date=2024-04-14 23:56:01.754816+00:00, run_duration=1.439287, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:54:00+00:00, data_interval_end=2024-04-14 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:56:01.761566038Z [2024-04-14T23:56:01.761+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:56:00+00:00, run_after=2024-04-14T23:58:00+00:00 2024-04-14T23:56:01.772116467Z [2024-04-14T23:56:01.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:56:01.772394198Z [2024-04-14T23:56:01.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:55:00+00:00, run_id=scheduled__2024-04-14T23:55:00+00:00, run_start_date=2024-04-14 23:56:00.316537+00:00, run_end_date=2024-04-14 23:56:01.772000+00:00, run_duration=1.455463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:55:00+00:00, data_interval_end=2024-04-14 23:56:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:56:01.781262792Z [2024-04-14T23:56:01.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:56:00+00:00, run_after=2024-04-14T23:57:00+00:00 2024-04-14T23:56:01.813426987Z [2024-04-14T23:56:01.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:54:00+00:00 exited with status success for try_number 1 2024-04-14T23:56:01.813466621Z [2024-04-14T23:56:01.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status success for try_number 1 2024-04-14T23:56:01.819652051Z [2024-04-14T23:56:01.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:54:00+00:00, map_index=-1, run_start_date=2024-04-14 23:56:01.196401+00:00, run_end_date=2024-04-14 23:56:01.611174+00:00, run_duration=0.414773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:56:00.376971+00:00, queued_by_job_id=1, pid=5555 2024-04-14T23:56:01.819703887Z [2024-04-14T23:56:01.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:55:00+00:00, map_index=-1, run_start_date=2024-04-14 23:56:01.197965+00:00, run_end_date=2024-04-14 23:56:01.598573+00:00, run_duration=0.400608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:56:00.376971+00:00, queued_by_job_id=1, pid=5554 2024-04-14T23:56:02.028247368Z [2024-04-14T23:56:02.027+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-14T23:56:04.221823748Z [2024-04-14T23:56:04.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:56:04.222178913Z [2024-04-14T23:56:04.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:55:00+00:00, run_id=scheduled__2024-04-14T23:55:00+00:00, run_start_date=2024-04-14 23:56:00.318342+00:00, run_end_date=2024-04-14 23:56:04.221652+00:00, run_duration=3.90331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:55:00+00:00, data_interval_end=2024-04-14 23:56:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:56:04.233902636Z [2024-04-14T23:56:04.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:56:00+00:00, run_after=2024-04-14T23:57:00+00:00 2024-04-14T23:56:04.242150509Z [2024-04-14T23:56:04.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:56:04.242381410Z [2024-04-14T23:56:04.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:55:00+00:00, run_id=scheduled__2024-04-14T23:55:00+00:00, run_start_date=2024-04-14 23:56:00.317459+00:00, run_end_date=2024-04-14 23:56:04.241954+00:00, run_duration=3.924495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:55:00+00:00, data_interval_end=2024-04-14 23:56:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:56:04.253295051Z [2024-04-14T23:56:04.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:56:00+00:00, run_after=2024-04-14T23:57:00+00:00 2024-04-14T23:56:04.303351610Z [2024-04-14T23:56:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status success for try_number 1 2024-04-14T23:56:04.303483683Z [2024-04-14T23:56:04.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status success for try_number 1 2024-04-14T23:56:04.321933014Z [2024-04-14T23:56:04.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:55:00+00:00, map_index=-1, run_start_date=2024-04-14 23:56:02.181898+00:00, run_end_date=2024-04-14 23:56:03.664538+00:00, run_duration=1.48264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:56:00.376971+00:00, queued_by_job_id=1, pid=5578 2024-04-14T23:56:04.322233119Z [2024-04-14T23:56:04.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:55:00+00:00, map_index=-1, run_start_date=2024-04-14 23:56:02.242813+00:00, run_end_date=2024-04-14 23:56:03.494359+00:00, run_duration=1.251546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:56:00.376971+00:00, queued_by_job_id=1, pid=5579 2024-04-14T23:57:00.056628122Z [2024-04-14T23:57:00.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:57:00+00:00, run_after=2024-04-14T23:58:00+00:00 2024-04-14T23:57:00.068092313Z [2024-04-14T23:57:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:57:00.085755862Z [2024-04-14T23:57:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:57:00+00:00, run_after=2024-04-14T23:58:00+00:00 2024-04-14T23:57:00.167701155Z [2024-04-14T23:57:00.167+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:57:00.167759343Z 2024-04-14T23:57:00.167767847Z 2024-04-14T23:57:00.167774574Z 2024-04-14T23:57:00.167781110Z [2024-04-14T23:57:00.167+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:57:00.167887129Z [2024-04-14T23:57:00.167+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:57:00.167993115Z [2024-04-14T23:57:00.167+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:57:00.168786885Z [2024-04-14T23:57:00.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:57:00.168802131Z 2024-04-14T23:57:00.168809742Z 2024-04-14T23:57:00.168816351Z 2024-04-14T23:57:00.173333046Z [2024-04-14T23:57:00.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:57:00.173394580Z [2024-04-14T23:57:00.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:57:00.173600577Z [2024-04-14T23:57:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:57:00.173709845Z [2024-04-14T23:57:00.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:57:00.174155788Z [2024-04-14T23:57:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:57:00.174360689Z [2024-04-14T23:57:00.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:57:00.497097090Z [2024-04-14T23:57:00.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status queued for try_number 1 2024-04-14T23:57:00.497416449Z [2024-04-14T23:57:00.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status queued for try_number 1 2024-04-14T23:57:00.497692361Z [2024-04-14T23:57:00.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status queued for try_number 1 2024-04-14T23:57:00.506752542Z [2024-04-14T23:57:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0b65e72-5135-421b-9923-d0e5c8f98b05 2024-04-14T23:57:00.507009242Z [2024-04-14T23:57:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to b936f05d-1feb-44c0-9d42-fd8a462230fb 2024-04-14T23:57:00.507202307Z [2024-04-14T23:57:00.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea90cbf9-6dc0-4b76-a173-e3f566bf7fde 2024-04-14T23:57:01.686014149Z [2024-04-14T23:57:01.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:57:01.686347092Z [2024-04-14T23:57:01.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:56:00+00:00, run_id=scheduled__2024-04-14T23:56:00+00:00, run_start_date=2024-04-14 23:57:00.099213+00:00, run_end_date=2024-04-14 23:57:01.686053+00:00, run_duration=1.58684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:56:00+00:00, data_interval_end=2024-04-14 23:57:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:57:01.696139932Z [2024-04-14T23:57:01.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:57:00+00:00, run_after=2024-04-14T23:58:00+00:00 2024-04-14T23:57:01.724428522Z [2024-04-14T23:57:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status success for try_number 1 2024-04-14T23:57:01.729278368Z [2024-04-14T23:57:01.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:56:00+00:00, map_index=-1, run_start_date=2024-04-14 23:57:00.899299+00:00, run_end_date=2024-04-14 23:57:01.258914+00:00, run_duration=0.359615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:57:00.169663+00:00, queued_by_job_id=1, pid=5611 2024-04-14T23:57:03.919322353Z [2024-04-14T23:57:03.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:57:03.920001706Z [2024-04-14T23:57:03.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:56:00+00:00, run_id=scheduled__2024-04-14T23:56:00+00:00, run_start_date=2024-04-14 23:57:00.100517+00:00, run_end_date=2024-04-14 23:57:03.919231+00:00, run_duration=3.818714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:56:00+00:00, data_interval_end=2024-04-14 23:57:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:57:03.935641653Z [2024-04-14T23:57:03.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:57:00+00:00, run_after=2024-04-14T23:58:00+00:00 2024-04-14T23:57:03.945429727Z [2024-04-14T23:57:03.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:57:03.945989528Z [2024-04-14T23:57:03.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:56:00+00:00, run_id=scheduled__2024-04-14T23:56:00+00:00, run_start_date=2024-04-14 23:57:00.101775+00:00, run_end_date=2024-04-14 23:57:03.945319+00:00, run_duration=3.843544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:56:00+00:00, data_interval_end=2024-04-14 23:57:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:57:03.966423793Z [2024-04-14T23:57:03.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:57:00+00:00, run_after=2024-04-14T23:58:00+00:00 2024-04-14T23:57:04.008948955Z [2024-04-14T23:57:04.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status success for try_number 1 2024-04-14T23:57:04.008988710Z [2024-04-14T23:57:04.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status success for try_number 1 2024-04-14T23:57:04.022495743Z [2024-04-14T23:57:04.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:56:00+00:00, map_index=-1, run_start_date=2024-04-14 23:57:01.782304+00:00, run_end_date=2024-04-14 23:57:02.930539+00:00, run_duration=1.148235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:57:00.169663+00:00, queued_by_job_id=1, pid=5630 2024-04-14T23:57:04.023363980Z [2024-04-14T23:57:04.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:56:00+00:00, map_index=-1, run_start_date=2024-04-14 23:57:01.732212+00:00, run_end_date=2024-04-14 23:57:03.244194+00:00, run_duration=1.511982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:57:00.169663+00:00, queued_by_job_id=1, pid=5629 2024-04-14T23:58:00.977593875Z [2024-04-14T23:58:00.977+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:58:00+00:00, run_after=2024-04-14T23:59:00+00:00 2024-04-14T23:58:00.985642243Z [2024-04-14T23:58:00.985+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:58:00.998336057Z [2024-04-14T23:58:00.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:58:00+00:00, run_after=2024-04-14T23:59:00+00:00 2024-04-14T23:58:01.010072187Z [2024-04-14T23:58:01.009+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:58:01.108804677Z [2024-04-14T23:58:01.108+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-14T23:58:01.108839417Z 2024-04-14T23:58:01.108847487Z 2024-04-14T23:58:01.108853937Z 2024-04-14T23:58:01.108860299Z 2024-04-14T23:58:01.109003825Z [2024-04-14T23:58:01.108+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-14T23:58:01.109014895Z [2024-04-14T23:58:01.108+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:58:01.109178081Z [2024-04-14T23:58:01.108+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:58:01.109299561Z [2024-04-14T23:58:01.109+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:58:01.110328119Z [2024-04-14T23:58:01.109+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:58:01.110363444Z 2024-04-14T23:58:01.110373603Z 2024-04-14T23:58:01.110382212Z 2024-04-14T23:58:01.110391363Z 2024-04-14T23:58:01.115372358Z [2024-04-14T23:58:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:58:01.115476754Z [2024-04-14T23:58:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-14T23:58:01.115807016Z [2024-04-14T23:58:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:58:01.115897846Z [2024-04-14T23:58:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:58:01.116204677Z [2024-04-14T23:58:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:58:01.116304249Z [2024-04-14T23:58:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:58:01.116569812Z [2024-04-14T23:58:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:58:01.116677916Z [2024-04-14T23:58:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:58:01.386680289Z [2024-04-14T23:58:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status queued for try_number 1 2024-04-14T23:58:01.386754388Z [2024-04-14T23:58:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:57:00+00:00 exited with status queued for try_number 1 2024-04-14T23:58:01.386862620Z [2024-04-14T23:58:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:57:00+00:00 exited with status queued for try_number 1 2024-04-14T23:58:01.386951858Z [2024-04-14T23:58:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:57:00+00:00 exited with status queued for try_number 1 2024-04-14T23:58:01.399865614Z [2024-04-14T23:58:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to e00c9c3b-0bf8-4113-914a-c6352dc8d425 2024-04-14T23:58:01.400518437Z [2024-04-14T23:58:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa4238e6-931a-493a-92d3-a5a56b5b8978 2024-04-14T23:58:01.400723345Z [2024-04-14T23:58:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46650c48-a6a1-4b9c-b8d2-be6fd1578d96 2024-04-14T23:58:01.400867951Z [2024-04-14T23:58:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36d0fae1-48c1-4fde-96e0-2b273e05f72c 2024-04-14T23:58:02.645072816Z [2024-04-14T23:58:02.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:58:02.645571363Z [2024-04-14T23:58:02.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:56:00+00:00, run_id=scheduled__2024-04-14T23:56:00+00:00, run_start_date=2024-04-14 23:58:01.024522+00:00, run_end_date=2024-04-14 23:58:02.644971+00:00, run_duration=1.620449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:56:00+00:00, data_interval_end=2024-04-14 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-14T23:58:02.653636805Z [2024-04-14T23:58:02.653+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-14T23:58:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:58:02.661132755Z [2024-04-14T23:58:02.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:58:02.661450122Z [2024-04-14T23:58:02.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:57:00+00:00, run_id=scheduled__2024-04-14T23:57:00+00:00, run_start_date=2024-04-14 23:58:01.025874+00:00, run_end_date=2024-04-14 23:58:02.661049+00:00, run_duration=1.635175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:57:00+00:00, data_interval_end=2024-04-14 23:58:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:58:02.673835035Z [2024-04-14T23:58:02.673+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:58:00+00:00, run_after=2024-04-14T23:59:00+00:00 2024-04-14T23:58:02.726701385Z [2024-04-14T23:58:02.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:56:00+00:00 exited with status success for try_number 1 2024-04-14T23:58:02.727045565Z [2024-04-14T23:58:02.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:57:00+00:00 exited with status success for try_number 1 2024-04-14T23:58:02.734660120Z [2024-04-14T23:58:02.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:57:00+00:00, map_index=-1, run_start_date=2024-04-14 23:58:01.866132+00:00, run_end_date=2024-04-14 23:58:02.201653+00:00, run_duration=0.335521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:58:01.111540+00:00, queued_by_job_id=1, pid=5662 2024-04-14T23:58:02.735175910Z [2024-04-14T23:58:02.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:56:00+00:00, map_index=-1, run_start_date=2024-04-14 23:58:01.875560+00:00, run_end_date=2024-04-14 23:58:02.257807+00:00, run_duration=0.382247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:58:01.111540+00:00, queued_by_job_id=1, pid=5663 2024-04-14T23:58:04.904053885Z [2024-04-14T23:58:04.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:58:04.904175935Z [2024-04-14T23:58:04.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:57:00+00:00, run_id=scheduled__2024-04-14T23:57:00+00:00, run_start_date=2024-04-14 23:58:01.027111+00:00, run_end_date=2024-04-14 23:58:04.903888+00:00, run_duration=3.876777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:57:00+00:00, data_interval_end=2024-04-14 23:58:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:58:04.914475526Z [2024-04-14T23:58:04.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:58:00+00:00, run_after=2024-04-14T23:59:00+00:00 2024-04-14T23:58:04.919720215Z [2024-04-14T23:58:04.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:58:04.919877418Z [2024-04-14T23:58:04.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:57:00+00:00, run_id=scheduled__2024-04-14T23:57:00+00:00, run_start_date=2024-04-14 23:58:01.028282+00:00, run_end_date=2024-04-14 23:58:04.919599+00:00, run_duration=3.891317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:57:00+00:00, data_interval_end=2024-04-14 23:58:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:58:04.927572273Z [2024-04-14T23:58:04.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:58:00+00:00, run_after=2024-04-14T23:59:00+00:00 2024-04-14T23:58:04.957995269Z [2024-04-14T23:58:04.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:57:00+00:00 exited with status success for try_number 1 2024-04-14T23:58:04.958036549Z [2024-04-14T23:58:04.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:57:00+00:00 exited with status success for try_number 1 2024-04-14T23:58:04.964414381Z [2024-04-14T23:58:04.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:57:00+00:00, map_index=-1, run_start_date=2024-04-14 23:58:02.969963+00:00, run_end_date=2024-04-14 23:58:04.216033+00:00, run_duration=1.24607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:58:01.111540+00:00, queued_by_job_id=1, pid=5687 2024-04-14T23:58:04.964575624Z [2024-04-14T23:58:04.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:57:00+00:00, map_index=-1, run_start_date=2024-04-14 23:58:02.923359+00:00, run_end_date=2024-04-14 23:58:04.549198+00:00, run_duration=1.625839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:58:01.111540+00:00, queued_by_job_id=1, pid=5686 2024-04-14T23:59:00.588430023Z [2024-04-14T23:59:00.587+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-14T23:59:00.605806750Z [2024-04-14T23:59:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:59:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:59:00.634781335Z [2024-04-14T23:59:00.634+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:59:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:59:00.736657008Z [2024-04-14T23:59:00.736+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-14T23:59:00.736699234Z 2024-04-14T23:59:00.736710166Z 2024-04-14T23:59:00.736719329Z 2024-04-14T23:59:00.736743637Z [2024-04-14T23:59:00.736+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:59:00.737056207Z [2024-04-14T23:59:00.736+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-14T23:59:00.737354699Z [2024-04-14T23:59:00.737+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-14T23:59:00.738269450Z [2024-04-14T23:59:00.737+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-14T23:59:00.738287039Z 2024-04-14T23:59:00.738322146Z 2024-04-14T23:59:00.738331555Z 2024-04-14T23:59:00.744032621Z [2024-04-14T23:59:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:59:00.744422521Z [2024-04-14T23:59:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-14T23:59:00.744823344Z [2024-04-14T23:59:00.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:59:00.745393390Z [2024-04-14T23:59:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-14T23:59:00.746462159Z [2024-04-14T23:59:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-14T23:59:00.746485121Z [2024-04-14T23:59:00.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-14T23:59:00.976397402Z [2024-04-14T23:59:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status queued for try_number 1 2024-04-14T23:59:00.976419436Z [2024-04-14T23:59:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status queued for try_number 1 2024-04-14T23:59:00.978198436Z [2024-04-14T23:59:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status queued for try_number 1 2024-04-14T23:59:00.987405842Z [2024-04-14T23:59:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to b14c1bf8-e1bf-46d5-9a74-257695ceee5c 2024-04-14T23:59:00.987586716Z [2024-04-14T23:59:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6af93c6e-6cf7-4462-887f-a7e113052c41 2024-04-14T23:59:00.987788946Z [2024-04-14T23:59:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf13350c-44ae-4b12-a8d8-671618f22e98 2024-04-14T23:59:02.159381719Z [2024-04-14T23:59:02.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:59:02.162685592Z [2024-04-14T23:59:02.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:58:00+00:00, run_id=scheduled__2024-04-14T23:58:00+00:00, run_start_date=2024-04-14 23:59:00.651599+00:00, run_end_date=2024-04-14 23:59:02.159293+00:00, run_duration=1.507694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:58:00+00:00, data_interval_end=2024-04-14 23:59:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-14T23:59:02.186273538Z [2024-04-14T23:59:02.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-14T23:59:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:59:02.238566454Z [2024-04-14T23:59:02.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status success for try_number 1 2024-04-14T23:59:02.247844251Z [2024-04-14T23:59:02.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:58:00+00:00, map_index=-1, run_start_date=2024-04-14 23:59:01.383753+00:00, run_end_date=2024-04-14 23:59:01.737444+00:00, run_duration=0.353691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:59:00.739462+00:00, queued_by_job_id=1, pid=5719 2024-04-14T23:59:04.400750351Z [2024-04-14T23:59:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:59:04.401200168Z [2024-04-14T23:59:04.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:58:00+00:00, run_id=scheduled__2024-04-14T23:58:00+00:00, run_start_date=2024-04-14 23:59:00.653416+00:00, run_end_date=2024-04-14 23:59:04.400627+00:00, run_duration=3.747211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:58:00+00:00, data_interval_end=2024-04-14 23:59:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-14T23:59:04.410761388Z [2024-04-14T23:59:04.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:59:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:59:04.454792604Z [2024-04-14T23:59:04.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status success for try_number 1 2024-04-14T23:59:04.462292759Z [2024-04-14T23:59:04.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:58:00+00:00, map_index=-1, run_start_date=2024-04-14 23:59:02.297114+00:00, run_end_date=2024-04-14 23:59:03.569503+00:00, run_duration=1.272389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:59:00.739462+00:00, queued_by_job_id=1, pid=5738 2024-04-14T23:59:05.515779616Z [2024-04-14T23:59:05.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-14T23:59:05.516189355Z [2024-04-14T23:59:05.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:58:00+00:00, run_id=scheduled__2024-04-14T23:58:00+00:00, run_start_date=2024-04-14 23:59:00.654801+00:00, run_end_date=2024-04-14 23:59:05.515663+00:00, run_duration=4.860862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:58:00+00:00, data_interval_end=2024-04-14 23:59:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-14T23:59:05.526267906Z [2024-04-14T23:59:05.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-14T23:59:00+00:00, run_after=2024-04-15T00:00:00+00:00 2024-04-14T23:59:05.563368397Z [2024-04-14T23:59:05.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status success for try_number 1 2024-04-14T23:59:05.569402024Z [2024-04-14T23:59:05.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:58:00+00:00, map_index=-1, run_start_date=2024-04-14 23:59:02.238908+00:00, run_end_date=2024-04-14 23:59:04.741582+00:00, run_duration=2.502674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-14 23:59:00.739462+00:00, queued_by_job_id=1, pid=5737 2024-04-15T00:00:01.008887341Z [2024-04-15T00:00:01.008+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:00:01.021749585Z [2024-04-15T00:00:01.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:01:00+00:00 2024-04-15T00:00:01.026738546Z [2024-04-15T00:00:01.026+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:00:01.034983018Z [2024-04-15T00:00:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:05:00+00:00 2024-04-15T00:00:01.044065563Z [2024-04-15T00:00:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:01:00+00:00 2024-04-15T00:00:01.151987790Z [2024-04-15T00:00:01.151+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T00:00:01.152008074Z 2024-04-15T00:00:01.152011147Z 2024-04-15T00:00:01.152023902Z 2024-04-15T00:00:01.152026563Z 2024-04-15T00:00:01.152029178Z 2024-04-15T00:00:01.152032048Z [2024-04-15T00:00:01.151+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:00:01.152301455Z [2024-04-15T00:00:01.152+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:00:01.152471693Z [2024-04-15T00:00:01.152+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:00:01.152644103Z [2024-04-15T00:00:01.152+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:00:01.152828648Z [2024-04-15T00:00:01.152+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:00:01.153442161Z [2024-04-15T00:00:01.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:00:01.153454470Z 2024-04-15T00:00:01.153496870Z 2024-04-15T00:00:01.153501062Z 2024-04-15T00:00:01.153504299Z 2024-04-15T00:00:01.153507267Z 2024-04-15T00:00:01.156838694Z [2024-04-15T00:00:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-14T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:00:01.157063479Z [2024-04-15T00:00:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-14T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:00:01.157353760Z [2024-04-15T00:00:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-14T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:00:01.157528364Z [2024-04-15T00:00:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-14T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:00:01.157799865Z [2024-04-15T00:00:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:00:01.157989520Z [2024-04-15T00:00:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:00:01.158258840Z [2024-04-15T00:00:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:00:01.158423040Z [2024-04-15T00:00:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:00:01.158695059Z [2024-04-15T00:00:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-14T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:00:01.158859835Z [2024-04-15T00:00:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-14T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:00:01.459527874Z [2024-04-15T00:00:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:01.459614036Z [2024-04-15T00:00:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:01.459725020Z [2024-04-15T00:00:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:59:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:01.459813820Z [2024-04-15T00:00:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:59:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:01.459920458Z [2024-04-15T00:00:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:59:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:01.469117204Z [2024-04-15T00:00:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to d173e9ef-7997-43a8-829b-22a062dc6da0 2024-04-15T00:00:01.469222837Z [2024-04-15T00:00:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05def85d-1c1a-436d-a1db-f3b065dbc329 2024-04-15T00:00:01.469419168Z [2024-04-15T00:00:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2810bfa6-fbaa-4a94-9eab-56493e6f81ad 2024-04-15T00:00:01.469568937Z [2024-04-15T00:00:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 761c6ce9-28c1-48b8-aba1-e1938efbf1af 2024-04-15T00:00:01.469714757Z [2024-04-15T00:00:01.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c0d9ded-e4a7-4e3a-8f33-6c19b43d623b 2024-04-15T00:00:03.218182494Z [2024-04-15T00:00:03.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:00:03.218840632Z [2024-04-15T00:00:03.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-14 23:58:00+00:00, run_id=scheduled__2024-04-14T23:58:00+00:00, run_start_date=2024-04-15 00:00:01.057806+00:00, run_end_date=2024-04-15 00:00:03.218331+00:00, run_duration=2.160525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:58:00+00:00, data_interval_end=2024-04-15 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:00:03.231519472Z [2024-04-15T00:00:03.231+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:02:00+00:00 2024-04-15T00:00:03.267989399Z [2024-04-15T00:00:03.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:00:03.268385779Z [2024-04-15T00:00:03.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-14 23:59:00+00:00, run_id=scheduled__2024-04-14T23:59:00+00:00, run_start_date=2024-04-15 00:00:01.060737+00:00, run_end_date=2024-04-15 00:00:03.267994+00:00, run_duration=2.207257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:59:00+00:00, data_interval_end=2024-04-15 00:00:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:00:03.278628142Z [2024-04-15T00:00:03.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:01:00+00:00 2024-04-15T00:00:03.312676383Z [2024-04-15T00:00:03.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-14T23:58:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:03.312704836Z [2024-04-15T00:00:03.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:59:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:03.320065873Z [2024-04-15T00:00:03.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:59:00+00:00, map_index=-1, run_start_date=2024-04-15 00:00:02.011982+00:00, run_end_date=2024-04-15 00:00:02.438332+00:00, run_duration=0.42635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:01.154393+00:00, queued_by_job_id=1, pid=5772 2024-04-15T00:00:03.320271113Z [2024-04-15T00:00:03.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-14T23:58:00+00:00, map_index=-1, run_start_date=2024-04-15 00:00:02.102083+00:00, run_end_date=2024-04-15 00:00:02.537909+00:00, run_duration=0.435826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:01.154393+00:00, queued_by_job_id=1, pid=5774 2024-04-15T00:00:04.406025515Z [2024-04-15T00:00:04.405+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:00:04.406047390Z 2024-04-15T00:00:04.407172755Z [2024-04-15T00:00:04.406+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:00:04.407712928Z [2024-04-15T00:00:04.407+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:00:04.407723437Z 2024-04-15T00:00:04.410029667Z [2024-04-15T00:00:04.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-14T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:00:04.410067351Z [2024-04-15T00:00:04.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-14T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:00:04.486073662Z [2024-04-15T00:00:04.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:04.486162626Z [2024-04-15T00:00:04.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:04.495928840Z [2024-04-15T00:00:04.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eae9db6-373d-4de9-a822-7bb18ea8470d 2024-04-15T00:00:04.495992351Z [2024-04-15T00:00:04.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-14T23:55:00+00:00, map_index=-1, run_start_date=2024-04-15 00:00:03.199511+00:00, run_end_date=2024-04-15 00:00:03.510673+00:00, run_duration=0.311162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:01.154393+00:00, queued_by_job_id=1, pid=5809 2024-04-15T00:00:04.537341945Z [2024-04-15T00:00:04.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:00:04.537547593Z [2024-04-15T00:00:04.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:59:00+00:00, run_id=scheduled__2024-04-14T23:59:00+00:00, run_start_date=2024-04-15 00:00:01.064700+00:00, run_end_date=2024-04-15 00:00:04.537248+00:00, run_duration=3.472548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:59:00+00:00, data_interval_end=2024-04-15 00:00:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:00:04.545307567Z [2024-04-15T00:00:04.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:01:00+00:00 2024-04-15T00:00:04.550803349Z [2024-04-15T00:00:04.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:00:04.550939682Z [2024-04-15T00:00:04.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:59:00+00:00, run_id=scheduled__2024-04-14T23:59:00+00:00, run_start_date=2024-04-15 00:00:01.062732+00:00, run_end_date=2024-04-15 00:00:04.550733+00:00, run_duration=3.488001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:59:00+00:00, data_interval_end=2024-04-15 00:00:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:00:04.560166785Z [2024-04-15T00:00:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:01:00+00:00 2024-04-15T00:00:04.598695309Z [2024-04-15T00:00:04.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:59:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:04.598990423Z [2024-04-15T00:00:04.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-14T23:59:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:04.605925922Z [2024-04-15T00:00:04.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:59:00+00:00, map_index=-1, run_start_date=2024-04-15 00:00:02.891048+00:00, run_end_date=2024-04-15 00:00:04.404772+00:00, run_duration=1.513724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:01.154393+00:00, queued_by_job_id=1, pid=5792 2024-04-15T00:00:04.606340155Z [2024-04-15T00:00:04.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-14T23:59:00+00:00, map_index=-1, run_start_date=2024-04-15 00:00:03.199767+00:00, run_end_date=2024-04-15 00:00:04.435248+00:00, run_duration=1.235481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:01.154393+00:00, queued_by_job_id=1, pid=5808 2024-04-15T00:00:06.783335463Z [2024-04-15T00:00:06.783+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:00:06.783364471Z 2024-04-15T00:00:06.783516852Z [2024-04-15T00:00:06.783+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:00:06.784193217Z [2024-04-15T00:00:06.783+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:00:06.784229068Z 2024-04-15T00:00:06.786296996Z [2024-04-15T00:00:06.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-14T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:00:06.786521887Z [2024-04-15T00:00:06.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-14T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:00:06.854826690Z [2024-04-15T00:00:06.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:06.857217487Z [2024-04-15T00:00:06.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:06.864162204Z [2024-04-15T00:00:06.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d74021b-044d-496f-be8d-8445dbecc3d6 2024-04-15T00:00:06.864403811Z [2024-04-15T00:00:06.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-14T23:55:00+00:00, map_index=-1, run_start_date=2024-04-15 00:00:05.836598+00:00, run_end_date=2024-04-15 00:00:06.280473+00:00, run_duration=0.443875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:04.408098+00:00, queued_by_job_id=1, pid=5827 2024-04-15T00:00:08.992366413Z [2024-04-15T00:00:08.991+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:00:08.992407537Z 2024-04-15T00:00:08.992763191Z [2024-04-15T00:00:08.992+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:00:08.994935534Z [2024-04-15T00:00:08.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:00:08.994972900Z 2024-04-15T00:00:08.999645770Z [2024-04-15T00:00:08.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-14T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:00:09.000275240Z [2024-04-15T00:00:08.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-14T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:00:09.070350217Z [2024-04-15T00:00:09.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status queued for try_number 1 2024-04-15T00:00:09.070918655Z [2024-04-15T00:00:09.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:09.076208472Z [2024-04-15T00:00:09.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4de87398-ad45-4def-9a54-0ee3e2074d52 2024-04-15T00:00:09.076505500Z [2024-04-15T00:00:09.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-14T23:55:00+00:00, map_index=0, run_start_date=2024-04-15 00:00:08.269475+00:00, run_end_date=2024-04-15 00:00:08.640266+00:00, run_duration=0.370791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:06.784562+00:00, queued_by_job_id=1, pid=5835 2024-04-15T00:00:11.607394171Z [2024-04-15T00:00:11.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:00:11.607810391Z [2024-04-15T00:00:11.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-14 23:55:00+00:00, run_id=scheduled__2024-04-14T23:55:00+00:00, run_start_date=2024-04-15 00:00:01.054359+00:00, run_end_date=2024-04-15 00:00:11.607275+00:00, run_duration=10.552916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-14 23:55:00+00:00, data_interval_end=2024-04-15 00:00:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:00:11.614670785Z [2024-04-15T00:00:11.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:00:00+00:00, run_after=2024-04-15T00:05:00+00:00 2024-04-15T00:00:11.657731767Z [2024-04-15T00:00:11.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-14T23:55:00+00:00 exited with status success for try_number 1 2024-04-15T00:00:11.663729797Z [2024-04-15T00:00:11.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-14T23:55:00+00:00, map_index=-1, run_start_date=2024-04-15 00:00:10.393505+00:00, run_end_date=2024-04-15 00:00:10.751043+00:00, run_duration=0.357538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:00:08.995827+00:00, queued_by_job_id=1, pid=5843 2024-04-15T00:01:00.529826799Z [2024-04-15T00:01:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:01:00+00:00, run_after=2024-04-15T00:02:00+00:00 2024-04-15T00:01:00.540474346Z [2024-04-15T00:01:00.540+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:01:00.551591270Z [2024-04-15T00:01:00.551+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:01:00+00:00, run_after=2024-04-15T00:02:00+00:00 2024-04-15T00:01:00.626765490Z [2024-04-15T00:01:00.626+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:01:00.626833088Z 2024-04-15T00:01:00.626841417Z 2024-04-15T00:01:00.626848789Z 2024-04-15T00:01:00.627034975Z [2024-04-15T00:01:00.626+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:01:00.627263308Z [2024-04-15T00:01:00.627+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:01:00.627472936Z [2024-04-15T00:01:00.627+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:01:00.628402376Z [2024-04-15T00:01:00.628+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:01:00.628416059Z 2024-04-15T00:01:00.628422888Z 2024-04-15T00:01:00.628429459Z 2024-04-15T00:01:00.638416613Z [2024-04-15T00:01:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:01:00.638793686Z [2024-04-15T00:01:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:01:00.639236963Z [2024-04-15T00:01:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:01:00.639390599Z [2024-04-15T00:01:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:01:00.639723498Z [2024-04-15T00:01:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:01:00.639968453Z [2024-04-15T00:01:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:01:00.904482244Z [2024-04-15T00:01:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:01:00.904526561Z [2024-04-15T00:01:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:01:00.904622692Z [2024-04-15T00:01:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:01:00.910726930Z [2024-04-15T00:01:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6450e92c-dbf0-4631-bf31-30b53aa6ff34 2024-04-15T00:01:00.910864599Z [2024-04-15T00:01:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27eeaa2d-549b-4cca-ae41-b8545e429a09 2024-04-15T00:01:00.910996620Z [2024-04-15T00:01:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59f25e01-12fb-4d8d-b809-3574ffd5440d 2024-04-15T00:01:02.056910663Z [2024-04-15T00:01:02.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:01:02.057309021Z [2024-04-15T00:01:02.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:00:00+00:00, run_id=scheduled__2024-04-15T00:00:00+00:00, run_start_date=2024-04-15 00:01:00.562477+00:00, run_end_date=2024-04-15 00:01:02.056838+00:00, run_duration=1.494361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:00:00+00:00, data_interval_end=2024-04-15 00:01:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:01:02.066237984Z [2024-04-15T00:01:02.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:01:00+00:00, run_after=2024-04-15T00:02:00+00:00 2024-04-15T00:01:02.101770801Z [2024-04-15T00:01:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:01:02.107644332Z [2024-04-15T00:01:02.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=-1, run_start_date=2024-04-15 00:01:01.334829+00:00, run_end_date=2024-04-15 00:01:01.747973+00:00, run_duration=0.413144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:01:00.633419+00:00, queued_by_job_id=1, pid=5865 2024-04-15T00:01:02.120395725Z [2024-04-15T00:01:02.120+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:01:04.231185420Z [2024-04-15T00:01:04.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:01:04.231359807Z [2024-04-15T00:01:04.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:00:00+00:00, run_id=scheduled__2024-04-15T00:00:00+00:00, run_start_date=2024-04-15 00:01:00.563636+00:00, run_end_date=2024-04-15 00:01:04.231114+00:00, run_duration=3.667478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:00:00+00:00, data_interval_end=2024-04-15 00:01:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:01:04.238047441Z [2024-04-15T00:01:04.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:01:00+00:00, run_after=2024-04-15T00:02:00+00:00 2024-04-15T00:01:04.242852174Z [2024-04-15T00:01:04.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:01:04.243059991Z [2024-04-15T00:01:04.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:00:00+00:00, run_id=scheduled__2024-04-15T00:00:00+00:00, run_start_date=2024-04-15 00:01:00.564571+00:00, run_end_date=2024-04-15 00:01:04.242803+00:00, run_duration=3.678232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:00:00+00:00, data_interval_end=2024-04-15 00:01:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:01:04.250444825Z [2024-04-15T00:01:04.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:01:00+00:00, run_after=2024-04-15T00:02:00+00:00 2024-04-15T00:01:04.290470701Z [2024-04-15T00:01:04.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:01:04.290727526Z [2024-04-15T00:01:04.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:01:04.301987665Z [2024-04-15T00:01:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=-1, run_start_date=2024-04-15 00:01:02.245174+00:00, run_end_date=2024-04-15 00:01:03.526615+00:00, run_duration=1.281441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:01:00.633419+00:00, queued_by_job_id=1, pid=5883 2024-04-15T00:01:04.302214930Z [2024-04-15T00:01:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=-1, run_start_date=2024-04-15 00:01:02.256007+00:00, run_end_date=2024-04-15 00:01:03.782071+00:00, run_duration=1.526064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:01:00.633419+00:00, queued_by_job_id=1, pid=5884 2024-04-15T00:02:00.988671372Z [2024-04-15T00:02:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:02:00+00:00, run_after=2024-04-15T00:03:00+00:00 2024-04-15T00:02:01.004959124Z [2024-04-15T00:02:01.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:02:00+00:00, run_after=2024-04-15T00:03:00+00:00 2024-04-15T00:02:01.012814366Z [2024-04-15T00:02:01.012+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:02:01.018185868Z [2024-04-15T00:02:01.017+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:02:01.100607056Z [2024-04-15T00:02:01.100+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:02:01.100641987Z 2024-04-15T00:02:01.100652002Z 2024-04-15T00:02:01.100659515Z 2024-04-15T00:02:01.100666429Z 2024-04-15T00:02:01.100674041Z [2024-04-15T00:02:01.100+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:02:01.100692787Z [2024-04-15T00:02:01.100+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:02:01.100737619Z [2024-04-15T00:02:01.100+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:02:01.100829837Z [2024-04-15T00:02:01.100+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:02:01.101444488Z [2024-04-15T00:02:01.101+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:02:01.101459761Z 2024-04-15T00:02:01.101466908Z 2024-04-15T00:02:01.101473591Z 2024-04-15T00:02:01.101480180Z 2024-04-15T00:02:01.105814836Z [2024-04-15T00:02:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:02:01.105853615Z [2024-04-15T00:02:01.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:02:01.106142903Z [2024-04-15T00:02:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:02:01.106192604Z [2024-04-15T00:02:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:02:01.106431472Z [2024-04-15T00:02:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:02:01.106461272Z [2024-04-15T00:02:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:02:01.106726987Z [2024-04-15T00:02:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:02:01.106748054Z [2024-04-15T00:02:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:02:01.581630291Z [2024-04-15T00:02:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:02:01.581685509Z [2024-04-15T00:02:01.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:01:00+00:00 exited with status queued for try_number 1 2024-04-15T00:02:01.581744952Z [2024-04-15T00:02:01.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:01:00+00:00 exited with status queued for try_number 1 2024-04-15T00:02:01.581805879Z [2024-04-15T00:02:01.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:01:00+00:00 exited with status queued for try_number 1 2024-04-15T00:02:01.594001726Z [2024-04-15T00:02:01.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13255016-4ad7-489e-a10a-594e91f5c102 2024-04-15T00:02:01.594033549Z [2024-04-15T00:02:01.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbd11389-82f4-4b96-9a4c-7b20a33710d8 2024-04-15T00:02:01.594154468Z [2024-04-15T00:02:01.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to f74aaa59-02ce-4195-959a-d35124c78ffc 2024-04-15T00:02:01.594255935Z [2024-04-15T00:02:01.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4483c78-c6b6-44f2-8f27-5b5f7868f296 2024-04-15T00:02:02.754108578Z [2024-04-15T00:02:02.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:02:02.754747905Z [2024-04-15T00:02:02.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:00:00+00:00, run_id=scheduled__2024-04-15T00:00:00+00:00, run_start_date=2024-04-15 00:02:01.027618+00:00, run_end_date=2024-04-15 00:02:02.754042+00:00, run_duration=1.726424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:00:00+00:00, data_interval_end=2024-04-15 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:02:02.773676061Z [2024-04-15T00:02:02.773+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:02:00+00:00, run_after=2024-04-15T00:04:00+00:00 2024-04-15T00:02:02.789425469Z [2024-04-15T00:02:02.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:02:02.789582496Z [2024-04-15T00:02:02.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:01:00+00:00, run_id=scheduled__2024-04-15T00:01:00+00:00, run_start_date=2024-04-15 00:02:01.028672+00:00, run_end_date=2024-04-15 00:02:02.789357+00:00, run_duration=1.760685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:01:00+00:00, data_interval_end=2024-04-15 00:02:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:02:02.800166116Z [2024-04-15T00:02:02.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:02:00+00:00, run_after=2024-04-15T00:03:00+00:00 2024-04-15T00:02:02.836938438Z [2024-04-15T00:02:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:02:02.836967134Z [2024-04-15T00:02:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:01:00+00:00 exited with status success for try_number 1 2024-04-15T00:02:02.846182443Z [2024-04-15T00:02:02.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=-1, run_start_date=2024-04-15 00:02:01.807270+00:00, run_end_date=2024-04-15 00:02:02.111930+00:00, run_duration=0.30466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:02:01.102181+00:00, queued_by_job_id=1, pid=5917 2024-04-15T00:02:02.846611817Z [2024-04-15T00:02:02.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:01:00+00:00, map_index=-1, run_start_date=2024-04-15 00:02:01.900209+00:00, run_end_date=2024-04-15 00:02:02.250198+00:00, run_duration=0.349989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:02:01.102181+00:00, queued_by_job_id=1, pid=5918 2024-04-15T00:02:05.285407176Z [2024-04-15T00:02:05.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:02:05.286005557Z [2024-04-15T00:02:05.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:01:00+00:00, run_id=scheduled__2024-04-15T00:01:00+00:00, run_start_date=2024-04-15 00:02:01.029659+00:00, run_end_date=2024-04-15 00:02:05.285286+00:00, run_duration=4.255627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:01:00+00:00, data_interval_end=2024-04-15 00:02:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:02:05.296347387Z [2024-04-15T00:02:05.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:02:00+00:00, run_after=2024-04-15T00:03:00+00:00 2024-04-15T00:02:05.302037803Z [2024-04-15T00:02:05.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:02:05.303147713Z [2024-04-15T00:02:05.301+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:01:00+00:00, run_id=scheduled__2024-04-15T00:01:00+00:00, run_start_date=2024-04-15 00:02:01.030602+00:00, run_end_date=2024-04-15 00:02:05.301908+00:00, run_duration=4.271306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:01:00+00:00, data_interval_end=2024-04-15 00:02:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:02:05.312328599Z [2024-04-15T00:02:05.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:02:00+00:00, run_after=2024-04-15T00:03:00+00:00 2024-04-15T00:02:05.343661188Z [2024-04-15T00:02:05.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:01:00+00:00 exited with status success for try_number 1 2024-04-15T00:02:05.343816242Z [2024-04-15T00:02:05.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:01:00+00:00 exited with status success for try_number 1 2024-04-15T00:02:05.349228530Z [2024-04-15T00:02:05.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:01:00+00:00, map_index=-1, run_start_date=2024-04-15 00:02:02.940080+00:00, run_end_date=2024-04-15 00:02:04.472777+00:00, run_duration=1.532697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:02:01.102181+00:00, queued_by_job_id=1, pid=5941 2024-04-15T00:02:05.349512568Z [2024-04-15T00:02:05.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:01:00+00:00, map_index=-1, run_start_date=2024-04-15 00:02:02.939377+00:00, run_end_date=2024-04-15 00:02:05.173640+00:00, run_duration=2.234263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:02:01.102181+00:00, queued_by_job_id=1, pid=5942 2024-04-15T00:03:00.390980121Z [2024-04-15T00:03:00.387+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:03:00.398971603Z [2024-04-15T00:03:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:03:00+00:00, run_after=2024-04-15T00:04:00+00:00 2024-04-15T00:03:00.444121467Z [2024-04-15T00:03:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:03:00+00:00, run_after=2024-04-15T00:04:00+00:00 2024-04-15T00:03:00.539895559Z [2024-04-15T00:03:00.539+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:03:00.539924315Z 2024-04-15T00:03:00.539930745Z 2024-04-15T00:03:00.539935948Z 2024-04-15T00:03:00.539950120Z [2024-04-15T00:03:00.539+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:03:00.539955791Z [2024-04-15T00:03:00.539+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:03:00.540076657Z [2024-04-15T00:03:00.539+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:03:00.540534469Z [2024-04-15T00:03:00.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:03:00.540546245Z 2024-04-15T00:03:00.540551545Z 2024-04-15T00:03:00.540556526Z 2024-04-15T00:03:00.543174030Z [2024-04-15T00:03:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:03:00.543201145Z [2024-04-15T00:03:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:03:00.543381389Z [2024-04-15T00:03:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:03:00.543419469Z [2024-04-15T00:03:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:03:00.543578759Z [2024-04-15T00:03:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:03:00.543621458Z [2024-04-15T00:03:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:03:00.872828547Z [2024-04-15T00:03:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status queued for try_number 1 2024-04-15T00:03:00.873040143Z [2024-04-15T00:03:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status queued for try_number 1 2024-04-15T00:03:00.873245414Z [2024-04-15T00:03:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status queued for try_number 1 2024-04-15T00:03:00.878855310Z [2024-04-15T00:03:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4c805e4-38e6-4642-ac90-c5df91347d54 2024-04-15T00:03:00.879179934Z [2024-04-15T00:03:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to e90ad21a-dafc-4426-8185-8ea5d09b2a97 2024-04-15T00:03:00.879369989Z [2024-04-15T00:03:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to b34851fc-ec16-4723-b7b4-b826e47e3feb 2024-04-15T00:03:02.024399624Z [2024-04-15T00:03:02.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:03:02.025284647Z [2024-04-15T00:03:02.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:02:00+00:00, run_id=scheduled__2024-04-15T00:02:00+00:00, run_start_date=2024-04-15 00:03:00.480918+00:00, run_end_date=2024-04-15 00:03:02.024292+00:00, run_duration=1.543374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:02:00+00:00, data_interval_end=2024-04-15 00:03:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:03:02.033559044Z [2024-04-15T00:03:02.033+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:03:00+00:00, run_after=2024-04-15T00:04:00+00:00 2024-04-15T00:03:02.068704327Z [2024-04-15T00:03:02.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status success for try_number 1 2024-04-15T00:03:02.074591872Z [2024-04-15T00:03:02.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:02:00+00:00, map_index=-1, run_start_date=2024-04-15 00:03:01.219010+00:00, run_end_date=2024-04-15 00:03:01.656468+00:00, run_duration=0.437458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:03:00.541073+00:00, queued_by_job_id=1, pid=5975 2024-04-15T00:03:04.269726979Z [2024-04-15T00:03:04.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:03:04.270824078Z [2024-04-15T00:03:04.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:02:00+00:00, run_id=scheduled__2024-04-15T00:02:00+00:00, run_start_date=2024-04-15 00:03:00.485190+00:00, run_end_date=2024-04-15 00:03:04.270098+00:00, run_duration=3.784908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:02:00+00:00, data_interval_end=2024-04-15 00:03:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:03:04.285957462Z [2024-04-15T00:03:04.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:03:00+00:00, run_after=2024-04-15T00:04:00+00:00 2024-04-15T00:03:04.295402442Z [2024-04-15T00:03:04.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:03:04.295825275Z [2024-04-15T00:03:04.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:02:00+00:00, run_id=scheduled__2024-04-15T00:02:00+00:00, run_start_date=2024-04-15 00:03:00.484250+00:00, run_end_date=2024-04-15 00:03:04.295322+00:00, run_duration=3.811072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:02:00+00:00, data_interval_end=2024-04-15 00:03:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:03:04.306240416Z [2024-04-15T00:03:04.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:03:00+00:00, run_after=2024-04-15T00:04:00+00:00 2024-04-15T00:03:04.343114389Z [2024-04-15T00:03:04.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status success for try_number 1 2024-04-15T00:03:04.343134545Z [2024-04-15T00:03:04.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status success for try_number 1 2024-04-15T00:03:04.354223024Z [2024-04-15T00:03:04.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:02:00+00:00, map_index=-1, run_start_date=2024-04-15 00:03:02.515687+00:00, run_end_date=2024-04-15 00:03:04.133300+00:00, run_duration=1.617613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:03:00.541073+00:00, queued_by_job_id=1, pid=5999 2024-04-15T00:03:04.354265355Z [2024-04-15T00:03:04.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:02:00+00:00, map_index=-1, run_start_date=2024-04-15 00:03:02.229637+00:00, run_end_date=2024-04-15 00:03:03.423537+00:00, run_duration=1.1939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:03:00.541073+00:00, queued_by_job_id=1, pid=5988 2024-04-15T00:04:00.917979009Z [2024-04-15T00:04:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:04:00+00:00, run_after=2024-04-15T00:05:00+00:00 2024-04-15T00:04:00.932714590Z [2024-04-15T00:04:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:04:00+00:00, run_after=2024-04-15T00:05:00+00:00 2024-04-15T00:04:00.940200279Z [2024-04-15T00:04:00.939+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:04:00.947826941Z [2024-04-15T00:04:00.947+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:04:01.059764687Z [2024-04-15T00:04:01.059+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:04:01.059791143Z 2024-04-15T00:04:01.059802900Z 2024-04-15T00:04:01.059807704Z 2024-04-15T00:04:01.059812208Z 2024-04-15T00:04:01.060166964Z [2024-04-15T00:04:01.059+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:04:01.060452422Z [2024-04-15T00:04:01.060+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:04:01.060739863Z [2024-04-15T00:04:01.060+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:04:01.061117534Z [2024-04-15T00:04:01.060+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:04:01.062038740Z [2024-04-15T00:04:01.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:04:01.062099045Z 2024-04-15T00:04:01.062110200Z 2024-04-15T00:04:01.062119262Z 2024-04-15T00:04:01.062128048Z 2024-04-15T00:04:01.066744236Z [2024-04-15T00:04:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:04:01.067226900Z [2024-04-15T00:04:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:04:01.067689720Z [2024-04-15T00:04:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:04:01.068059245Z [2024-04-15T00:04:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:04:01.068553762Z [2024-04-15T00:04:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:04:01.068785877Z [2024-04-15T00:04:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:04:01.069255047Z [2024-04-15T00:04:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:04:01.069662515Z [2024-04-15T00:04:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:04:01.410101447Z [2024-04-15T00:04:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status queued for try_number 1 2024-04-15T00:04:01.411928481Z [2024-04-15T00:04:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:03:00+00:00 exited with status queued for try_number 1 2024-04-15T00:04:01.412034094Z [2024-04-15T00:04:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:03:00+00:00 exited with status queued for try_number 1 2024-04-15T00:04:01.412205553Z [2024-04-15T00:04:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:03:00+00:00 exited with status queued for try_number 1 2024-04-15T00:04:01.425060001Z [2024-04-15T00:04:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bd727fe-b13e-4b7c-8a9f-dec9de64a1ea 2024-04-15T00:04:01.425357359Z [2024-04-15T00:04:01.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bfc9bd2-8829-4a5b-8a6d-d56fad1ee896 2024-04-15T00:04:01.425553682Z [2024-04-15T00:04:01.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to c222c06a-ba9f-4ff4-a312-0de0e134cf70 2024-04-15T00:04:01.425757264Z [2024-04-15T00:04:01.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1343f53-492f-453a-86ad-4d895b49a481 2024-04-15T00:04:02.600386784Z [2024-04-15T00:04:02.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:04:02.600633044Z [2024-04-15T00:04:02.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:02:00+00:00, run_id=scheduled__2024-04-15T00:02:00+00:00, run_start_date=2024-04-15 00:04:00.960647+00:00, run_end_date=2024-04-15 00:04:02.600307+00:00, run_duration=1.63966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:02:00+00:00, data_interval_end=2024-04-15 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:04:02.610360208Z [2024-04-15T00:04:02.610+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:04:00+00:00, run_after=2024-04-15T00:06:00+00:00 2024-04-15T00:04:02.616837904Z [2024-04-15T00:04:02.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:04:02.617010143Z [2024-04-15T00:04:02.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:03:00+00:00, run_id=scheduled__2024-04-15T00:03:00+00:00, run_start_date=2024-04-15 00:04:00.962021+00:00, run_end_date=2024-04-15 00:04:02.616780+00:00, run_duration=1.654759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:03:00+00:00, data_interval_end=2024-04-15 00:04:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:04:02.636926198Z [2024-04-15T00:04:02.636+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:04:00+00:00, run_after=2024-04-15T00:05:00+00:00 2024-04-15T00:04:02.754995200Z [2024-04-15T00:04:02.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:02:00+00:00 exited with status success for try_number 1 2024-04-15T00:04:02.755056216Z [2024-04-15T00:04:02.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:03:00+00:00 exited with status success for try_number 1 2024-04-15T00:04:02.761865531Z [2024-04-15T00:04:02.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:02:00+00:00, map_index=-1, run_start_date=2024-04-15 00:04:01.819989+00:00, run_end_date=2024-04-15 00:04:02.180286+00:00, run_duration=0.360297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:04:01.063174+00:00, queued_by_job_id=1, pid=6028 2024-04-15T00:04:02.762141273Z [2024-04-15T00:04:02.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:03:00+00:00, map_index=-1, run_start_date=2024-04-15 00:04:01.769135+00:00, run_end_date=2024-04-15 00:04:02.143026+00:00, run_duration=0.373891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:04:01.063174+00:00, queued_by_job_id=1, pid=6027 2024-04-15T00:04:04.933525993Z [2024-04-15T00:04:04.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:04:04.933716044Z [2024-04-15T00:04:04.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:03:00+00:00, run_id=scheduled__2024-04-15T00:03:00+00:00, run_start_date=2024-04-15 00:04:00.963229+00:00, run_end_date=2024-04-15 00:04:04.933386+00:00, run_duration=3.970157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:03:00+00:00, data_interval_end=2024-04-15 00:04:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:04:04.941487882Z [2024-04-15T00:04:04.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:04:00+00:00, run_after=2024-04-15T00:05:00+00:00 2024-04-15T00:04:04.947158253Z [2024-04-15T00:04:04.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:04:04.947359188Z [2024-04-15T00:04:04.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:03:00+00:00, run_id=scheduled__2024-04-15T00:03:00+00:00, run_start_date=2024-04-15 00:04:00.964442+00:00, run_end_date=2024-04-15 00:04:04.947104+00:00, run_duration=3.982662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:03:00+00:00, data_interval_end=2024-04-15 00:04:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:04:04.955899388Z [2024-04-15T00:04:04.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:04:00+00:00, run_after=2024-04-15T00:05:00+00:00 2024-04-15T00:04:04.997239416Z [2024-04-15T00:04:04.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:03:00+00:00 exited with status success for try_number 1 2024-04-15T00:04:04.997553892Z [2024-04-15T00:04:04.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:03:00+00:00 exited with status success for try_number 1 2024-04-15T00:04:05.015012101Z [2024-04-15T00:04:05.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:03:00+00:00, map_index=-1, run_start_date=2024-04-15 00:04:02.876724+00:00, run_end_date=2024-04-15 00:04:04.123324+00:00, run_duration=1.2466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:04:01.063174+00:00, queued_by_job_id=1, pid=6052 2024-04-15T00:04:05.015133627Z [2024-04-15T00:04:05.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:03:00+00:00, map_index=-1, run_start_date=2024-04-15 00:04:02.671834+00:00, run_end_date=2024-04-15 00:04:04.449810+00:00, run_duration=1.777976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:04:01.063174+00:00, queued_by_job_id=1, pid=6046 2024-04-15T00:05:00.442773797Z [2024-04-15T00:05:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:05:00+00:00, run_after=2024-04-15T00:06:00+00:00 2024-04-15T00:05:00.451439628Z [2024-04-15T00:05:00.451+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:05:00.462109423Z [2024-04-15T00:05:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:05:00+00:00, run_after=2024-04-15T00:06:00+00:00 2024-04-15T00:05:00.473034291Z [2024-04-15T00:05:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:05:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:05:00.563251974Z [2024-04-15T00:05:00.562+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:05:00.563302782Z 2024-04-15T00:05:00.563325343Z 2024-04-15T00:05:00.563335460Z 2024-04-15T00:05:00.563345054Z 2024-04-15T00:05:00.563669690Z [2024-04-15T00:05:00.563+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:05:00.564035902Z [2024-04-15T00:05:00.563+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:05:00.564367047Z [2024-04-15T00:05:00.564+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:05:00.564690142Z [2024-04-15T00:05:00.564+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:05:00.566054742Z [2024-04-15T00:05:00.565+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:05:00.566065318Z 2024-04-15T00:05:00.566069329Z 2024-04-15T00:05:00.566072641Z 2024-04-15T00:05:00.566076082Z 2024-04-15T00:05:00.574217874Z [2024-04-15T00:05:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:05:00.574376319Z [2024-04-15T00:05:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:05:00.574739850Z [2024-04-15T00:05:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:05:00.575023866Z [2024-04-15T00:05:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:05:00.575371829Z [2024-04-15T00:05:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:05:00.575701976Z [2024-04-15T00:05:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:05:00.576134676Z [2024-04-15T00:05:00.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:05:00.576350919Z [2024-04-15T00:05:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:05:00.916148070Z [2024-04-15T00:05:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:05:00.917592783Z [2024-04-15T00:05:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status queued for try_number 1 2024-04-15T00:05:00.917736930Z [2024-04-15T00:05:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status queued for try_number 1 2024-04-15T00:05:00.917893017Z [2024-04-15T00:05:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status queued for try_number 1 2024-04-15T00:05:00.939977100Z [2024-04-15T00:05:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b13a254-f804-4a31-bf75-43914812b3f6 2024-04-15T00:05:00.940149646Z [2024-04-15T00:05:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a80ee8c-6a62-4c8d-b752-75b47f0041e2 2024-04-15T00:05:00.943055041Z [2024-04-15T00:05:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb0d13ff-c715-4ff6-afb5-2008df179738 2024-04-15T00:05:00.943359297Z [2024-04-15T00:05:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6651a90-a373-4dba-90d2-fa89de90c8a0 2024-04-15T00:05:01.840396780Z [2024-04-15T00:05:01.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:05:01.840524182Z [2024-04-15T00:05:01.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:04:00+00:00, run_id=scheduled__2024-04-15T00:04:00+00:00, run_start_date=2024-04-15 00:05:00.485170+00:00, run_end_date=2024-04-15 00:05:01.840044+00:00, run_duration=1.354874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:04:00+00:00, data_interval_end=2024-04-15 00:05:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:05:01.848868312Z [2024-04-15T00:05:01.848+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:05:00+00:00, run_after=2024-04-15T00:06:00+00:00 2024-04-15T00:05:01.924514072Z [2024-04-15T00:05:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status success for try_number 1 2024-04-15T00:05:01.932380997Z [2024-04-15T00:05:01.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:04:00+00:00, map_index=-1, run_start_date=2024-04-15 00:05:01.267162+00:00, run_end_date=2024-04-15 00:05:01.675325+00:00, run_duration=0.408163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:05:00.568343+00:00, queued_by_job_id=1, pid=6085 2024-04-15T00:05:03.531894236Z [2024-04-15T00:05:03.531+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:05:03.531946798Z 2024-04-15T00:05:03.532005692Z [2024-04-15T00:05:03.531+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:05:03.533512114Z [2024-04-15T00:05:03.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:05:03.533567273Z 2024-04-15T00:05:03.539273342Z [2024-04-15T00:05:03.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:05:03.539526278Z [2024-04-15T00:05:03.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:05:03.601040844Z [2024-04-15T00:05:03.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:05:03.601180131Z [2024-04-15T00:05:03.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:05:03.608058984Z [2024-04-15T00:05:03.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0846a1f-3935-47d7-9401-ef36f94dd9da 2024-04-15T00:05:03.608523716Z [2024-04-15T00:05:03.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=-1, run_start_date=2024-04-15 00:05:02.227498+00:00, run_end_date=2024-04-15 00:05:02.619251+00:00, run_duration=0.391753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:05:00.568343+00:00, queued_by_job_id=1, pid=6104 2024-04-15T00:05:04.787973497Z [2024-04-15T00:05:04.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:05:04.788176363Z [2024-04-15T00:05:04.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:04:00+00:00, run_id=scheduled__2024-04-15T00:04:00+00:00, run_start_date=2024-04-15 00:05:00.486314+00:00, run_end_date=2024-04-15 00:05:04.787846+00:00, run_duration=4.301532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:04:00+00:00, data_interval_end=2024-04-15 00:05:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:05:04.796823851Z [2024-04-15T00:05:04.796+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:05:00+00:00, run_after=2024-04-15T00:06:00+00:00 2024-04-15T00:05:04.802529332Z [2024-04-15T00:05:04.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:05:04.802689126Z [2024-04-15T00:05:04.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:04:00+00:00, run_id=scheduled__2024-04-15T00:04:00+00:00, run_start_date=2024-04-15 00:05:00.487388+00:00, run_end_date=2024-04-15 00:05:04.802465+00:00, run_duration=4.315077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:04:00+00:00, data_interval_end=2024-04-15 00:05:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:05:04.811190764Z [2024-04-15T00:05:04.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:05:00+00:00, run_after=2024-04-15T00:06:00+00:00 2024-04-15T00:05:04.868640003Z [2024-04-15T00:05:04.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status success for try_number 1 2024-04-15T00:05:04.868803452Z [2024-04-15T00:05:04.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status success for try_number 1 2024-04-15T00:05:04.880524216Z [2024-04-15T00:05:04.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:04:00+00:00, map_index=-1, run_start_date=2024-04-15 00:05:02.477828+00:00, run_end_date=2024-04-15 00:05:03.709608+00:00, run_duration=1.23178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:05:00.568343+00:00, queued_by_job_id=1, pid=6111 2024-04-15T00:05:04.880927849Z [2024-04-15T00:05:04.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:04:00+00:00, map_index=-1, run_start_date=2024-04-15 00:05:02.414144+00:00, run_end_date=2024-04-15 00:05:03.988526+00:00, run_duration=1.574382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:05:00.568343+00:00, queued_by_job_id=1, pid=6110 2024-04-15T00:05:05.977388063Z [2024-04-15T00:05:05.976+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:05:05.977531442Z 2024-04-15T00:05:05.983116501Z [2024-04-15T00:05:05.981+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:05:05.983207726Z [2024-04-15T00:05:05.982+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:05:05.983219994Z 2024-04-15T00:05:05.989178894Z [2024-04-15T00:05:05.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:05:05.989401094Z [2024-04-15T00:05:05.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:05:06.047519747Z [2024-04-15T00:05:06.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:05:06.047930954Z [2024-04-15T00:05:06.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:05:06.065959808Z [2024-04-15T00:05:06.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9886c3e-8638-405a-a0b0-e93a6d00abe8 2024-04-15T00:05:06.066486413Z [2024-04-15T00:05:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=-1, run_start_date=2024-04-15 00:05:05.209643+00:00, run_end_date=2024-04-15 00:05:05.581961+00:00, run_duration=0.372318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:05:03.534141+00:00, queued_by_job_id=1, pid=6134 2024-04-15T00:05:08.551804784Z [2024-04-15T00:05:08.551+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:05:08.551863891Z 2024-04-15T00:05:08.551899541Z [2024-04-15T00:05:08.551+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:05:08.552474263Z [2024-04-15T00:05:08.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:05:08.552485639Z 2024-04-15T00:05:08.554419633Z [2024-04-15T00:05:08.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:05:08.554534953Z [2024-04-15T00:05:08.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:05:08.595677980Z [2024-04-15T00:05:08.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status queued for try_number 1 2024-04-15T00:05:08.597591404Z [2024-04-15T00:05:08.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:05:08.602940936Z [2024-04-15T00:05:08.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab1b6861-37d0-4402-87c3-e38251e0c0ab 2024-04-15T00:05:08.603120101Z [2024-04-15T00:05:08.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=0, run_start_date=2024-04-15 00:05:07.465493+00:00, run_end_date=2024-04-15 00:05:07.805472+00:00, run_duration=0.339979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:05:05.983577+00:00, queued_by_job_id=1, pid=6142 2024-04-15T00:05:11.038556610Z [2024-04-15T00:05:11.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:05:11.039068604Z [2024-04-15T00:05:11.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:00:00+00:00, run_id=scheduled__2024-04-15T00:00:00+00:00, run_start_date=2024-04-15 00:05:00.483614+00:00, run_end_date=2024-04-15 00:05:11.037976+00:00, run_duration=10.554362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:00:00+00:00, data_interval_end=2024-04-15 00:05:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:05:11.053044065Z [2024-04-15T00:05:11.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:05:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:05:11.087167712Z [2024-04-15T00:05:11.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:00:00+00:00 exited with status success for try_number 1 2024-04-15T00:05:11.091837305Z [2024-04-15T00:05:11.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:00:00+00:00, map_index=-1, run_start_date=2024-04-15 00:05:09.930658+00:00, run_end_date=2024-04-15 00:05:10.273002+00:00, run_duration=0.342344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:05:08.552746+00:00, queued_by_job_id=1, pid=6150 2024-04-15T00:06:00.348570499Z [2024-04-15T00:06:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:06:00+00:00, run_after=2024-04-15T00:07:00+00:00 2024-04-15T00:06:00.357813810Z [2024-04-15T00:06:00.354+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:06:00.361250954Z [2024-04-15T00:06:00.360+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:06:00.396540570Z [2024-04-15T00:06:00.383+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:06:00+00:00, run_after=2024-04-15T00:07:00+00:00 2024-04-15T00:06:00.470825966Z [2024-04-15T00:06:00.470+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:06:00.470854612Z 2024-04-15T00:06:00.470860305Z 2024-04-15T00:06:00.470864913Z 2024-04-15T00:06:00.470906376Z 2024-04-15T00:06:00.470956528Z [2024-04-15T00:06:00.470+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:06:00.471128075Z [2024-04-15T00:06:00.470+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:06:00.471385031Z [2024-04-15T00:06:00.471+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:06:00.471584073Z [2024-04-15T00:06:00.471+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:06:00.472151702Z [2024-04-15T00:06:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:06:00.472162467Z 2024-04-15T00:06:00.472166049Z 2024-04-15T00:06:00.472169117Z 2024-04-15T00:06:00.472172234Z 2024-04-15T00:06:00.474942164Z [2024-04-15T00:06:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:06:00.475234311Z [2024-04-15T00:06:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:06:00.475744427Z [2024-04-15T00:06:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:06:00.475962022Z [2024-04-15T00:06:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:06:00.476219368Z [2024-04-15T00:06:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:06:00.476334222Z [2024-04-15T00:06:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:06:00.476583496Z [2024-04-15T00:06:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:06:00.476740962Z [2024-04-15T00:06:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:06:00.973214626Z [2024-04-15T00:06:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status queued for try_number 1 2024-04-15T00:06:00.973352661Z [2024-04-15T00:06:00.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status queued for try_number 1 2024-04-15T00:06:00.973453542Z [2024-04-15T00:06:00.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status queued for try_number 1 2024-04-15T00:06:00.973554519Z [2024-04-15T00:06:00.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status queued for try_number 1 2024-04-15T00:06:00.991961133Z [2024-04-15T00:06:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e1fd0e2-66c9-482a-9c69-61c8b8b656fa 2024-04-15T00:06:00.993994802Z [2024-04-15T00:06:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b6aeff9-af9c-45b6-8de8-e7f69fbdafa7 2024-04-15T00:06:00.994151600Z [2024-04-15T00:06:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81fa17eb-16ed-4a9f-9da6-f4064c3ba138 2024-04-15T00:06:00.994319681Z [2024-04-15T00:06:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to b01337ac-edfb-4638-aa6c-a49cbe76c040 2024-04-15T00:06:02.147042570Z [2024-04-15T00:06:02.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:06:02.147087954Z [2024-04-15T00:06:02.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:04:00+00:00, run_id=scheduled__2024-04-15T00:04:00+00:00, run_start_date=2024-04-15 00:06:00.418370+00:00, run_end_date=2024-04-15 00:06:02.142775+00:00, run_duration=1.724405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:04:00+00:00, data_interval_end=2024-04-15 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:06:02.149358185Z [2024-04-15T00:06:02.149+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:06:00+00:00, run_after=2024-04-15T00:08:00+00:00 2024-04-15T00:06:02.154396328Z [2024-04-15T00:06:02.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:06:02.154730021Z [2024-04-15T00:06:02.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:05:00+00:00, run_id=scheduled__2024-04-15T00:05:00+00:00, run_start_date=2024-04-15 00:06:00.419964+00:00, run_end_date=2024-04-15 00:06:02.154323+00:00, run_duration=1.734359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:05:00+00:00, data_interval_end=2024-04-15 00:06:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:06:02.162922432Z [2024-04-15T00:06:02.162+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:06:00+00:00, run_after=2024-04-15T00:07:00+00:00 2024-04-15T00:06:02.202240809Z [2024-04-15T00:06:02.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:04:00+00:00 exited with status success for try_number 1 2024-04-15T00:06:02.202290744Z [2024-04-15T00:06:02.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status success for try_number 1 2024-04-15T00:06:02.207734507Z [2024-04-15T00:06:02.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:04:00+00:00, map_index=-1, run_start_date=2024-04-15 00:06:01.117737+00:00, run_end_date=2024-04-15 00:06:01.498633+00:00, run_duration=0.380896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:06:00.472875+00:00, queued_by_job_id=1, pid=6173 2024-04-15T00:06:02.207892798Z [2024-04-15T00:06:02.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:05:00+00:00, map_index=-1, run_start_date=2024-04-15 00:06:01.167787+00:00, run_end_date=2024-04-15 00:06:01.508657+00:00, run_duration=0.34087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:06:00.472875+00:00, queued_by_job_id=1, pid=6174 2024-04-15T00:06:02.219342933Z [2024-04-15T00:06:02.219+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:06:04.447902033Z [2024-04-15T00:06:04.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:06:04.448101646Z [2024-04-15T00:06:04.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:05:00+00:00, run_id=scheduled__2024-04-15T00:05:00+00:00, run_start_date=2024-04-15 00:06:00.421116+00:00, run_end_date=2024-04-15 00:06:04.447809+00:00, run_duration=4.026693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:05:00+00:00, data_interval_end=2024-04-15 00:06:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:06:04.458602227Z [2024-04-15T00:06:04.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:06:00+00:00, run_after=2024-04-15T00:07:00+00:00 2024-04-15T00:06:04.464910610Z [2024-04-15T00:06:04.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:06:04.465079210Z [2024-04-15T00:06:04.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:05:00+00:00, run_id=scheduled__2024-04-15T00:05:00+00:00, run_start_date=2024-04-15 00:06:00.422113+00:00, run_end_date=2024-04-15 00:06:04.464822+00:00, run_duration=4.042709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:05:00+00:00, data_interval_end=2024-04-15 00:06:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:06:04.473672584Z [2024-04-15T00:06:04.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:06:00+00:00, run_after=2024-04-15T00:07:00+00:00 2024-04-15T00:06:04.531678750Z [2024-04-15T00:06:04.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status success for try_number 1 2024-04-15T00:06:04.531708184Z [2024-04-15T00:06:04.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status success for try_number 1 2024-04-15T00:06:04.536548085Z [2024-04-15T00:06:04.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:05:00+00:00, map_index=-1, run_start_date=2024-04-15 00:06:02.165295+00:00, run_end_date=2024-04-15 00:06:03.858270+00:00, run_duration=1.692975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:06:00.472875+00:00, queued_by_job_id=1, pid=6197 2024-04-15T00:06:04.536667532Z [2024-04-15T00:06:04.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:05:00+00:00, map_index=-1, run_start_date=2024-04-15 00:06:02.161493+00:00, run_end_date=2024-04-15 00:06:03.379928+00:00, run_duration=1.218435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:06:00.472875+00:00, queued_by_job_id=1, pid=6198 2024-04-15T00:07:00.316596167Z [2024-04-15T00:07:00.315+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:07:00.338620371Z [2024-04-15T00:07:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:07:00+00:00, run_after=2024-04-15T00:08:00+00:00 2024-04-15T00:07:00.350959350Z [2024-04-15T00:07:00.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:07:00+00:00, run_after=2024-04-15T00:08:00+00:00 2024-04-15T00:07:00.418110736Z [2024-04-15T00:07:00.417+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:07:00.418158530Z 2024-04-15T00:07:00.418165726Z 2024-04-15T00:07:00.418171535Z 2024-04-15T00:07:00.418561602Z [2024-04-15T00:07:00.418+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:07:00.418971388Z [2024-04-15T00:07:00.418+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:07:00.419346368Z [2024-04-15T00:07:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:07:00.420653636Z [2024-04-15T00:07:00.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:07:00.420666653Z 2024-04-15T00:07:00.420670111Z 2024-04-15T00:07:00.420673100Z 2024-04-15T00:07:00.425594921Z [2024-04-15T00:07:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:07:00.425877842Z [2024-04-15T00:07:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:07:00.426292730Z [2024-04-15T00:07:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:07:00.426502232Z [2024-04-15T00:07:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:07:00.426884705Z [2024-04-15T00:07:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:07:00.427141266Z [2024-04-15T00:07:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:07:00.659810759Z [2024-04-15T00:07:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status queued for try_number 1 2024-04-15T00:07:00.661828904Z [2024-04-15T00:07:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status queued for try_number 1 2024-04-15T00:07:00.662012387Z [2024-04-15T00:07:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status queued for try_number 1 2024-04-15T00:07:00.672104487Z [2024-04-15T00:07:00.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e165f62-eb7b-4f0a-95ee-5eec5d3237da 2024-04-15T00:07:00.672355384Z [2024-04-15T00:07:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a1127c0-eb36-4eff-8ce3-d34ccb3cbdc0 2024-04-15T00:07:00.672560407Z [2024-04-15T00:07:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54fef1ba-862f-474c-bf08-62264172ed16 2024-04-15T00:07:01.806581361Z [2024-04-15T00:07:01.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:07:01.808796709Z [2024-04-15T00:07:01.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:06:00+00:00, run_id=scheduled__2024-04-15T00:06:00+00:00, run_start_date=2024-04-15 00:07:00.359575+00:00, run_end_date=2024-04-15 00:07:01.806455+00:00, run_duration=1.44688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:06:00+00:00, data_interval_end=2024-04-15 00:07:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:07:01.829371950Z [2024-04-15T00:07:01.828+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:07:00+00:00, run_after=2024-04-15T00:08:00+00:00 2024-04-15T00:07:01.893378434Z [2024-04-15T00:07:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status success for try_number 1 2024-04-15T00:07:01.899668133Z [2024-04-15T00:07:01.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:06:00+00:00, map_index=-1, run_start_date=2024-04-15 00:07:01.190634+00:00, run_end_date=2024-04-15 00:07:01.550332+00:00, run_duration=0.359698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:07:00.421828+00:00, queued_by_job_id=1, pid=6230 2024-04-15T00:07:03.935957336Z [2024-04-15T00:07:03.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:07:03.936338744Z [2024-04-15T00:07:03.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:06:00+00:00, run_id=scheduled__2024-04-15T00:06:00+00:00, run_start_date=2024-04-15 00:07:00.362357+00:00, run_end_date=2024-04-15 00:07:03.935812+00:00, run_duration=3.573455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:06:00+00:00, data_interval_end=2024-04-15 00:07:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:07:03.943897744Z [2024-04-15T00:07:03.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:07:00+00:00, run_after=2024-04-15T00:08:00+00:00 2024-04-15T00:07:03.949698626Z [2024-04-15T00:07:03.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:07:03.950174293Z [2024-04-15T00:07:03.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:06:00+00:00, run_id=scheduled__2024-04-15T00:06:00+00:00, run_start_date=2024-04-15 00:07:00.361313+00:00, run_end_date=2024-04-15 00:07:03.949772+00:00, run_duration=3.588459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:06:00+00:00, data_interval_end=2024-04-15 00:07:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:07:03.958327329Z [2024-04-15T00:07:03.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:07:00+00:00, run_after=2024-04-15T00:08:00+00:00 2024-04-15T00:07:03.991987658Z [2024-04-15T00:07:03.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status success for try_number 1 2024-04-15T00:07:03.992214227Z [2024-04-15T00:07:03.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status success for try_number 1 2024-04-15T00:07:04.006165429Z [2024-04-15T00:07:04.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:06:00+00:00, map_index=-1, run_start_date=2024-04-15 00:07:01.896531+00:00, run_end_date=2024-04-15 00:07:03.428896+00:00, run_duration=1.532365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:07:00.421828+00:00, queued_by_job_id=1, pid=6248 2024-04-15T00:07:04.006492220Z [2024-04-15T00:07:04.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:06:00+00:00, map_index=-1, run_start_date=2024-04-15 00:07:01.901233+00:00, run_end_date=2024-04-15 00:07:03.261798+00:00, run_duration=1.360565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:07:00.421828+00:00, queued_by_job_id=1, pid=6249 2024-04-15T00:08:00.175443217Z [2024-04-15T00:08:00.174+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:08:00.188287778Z [2024-04-15T00:08:00.187+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:08:00.205300640Z [2024-04-15T00:08:00.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:08:00+00:00, run_after=2024-04-15T00:09:00+00:00 2024-04-15T00:08:00.218757049Z [2024-04-15T00:08:00.218+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:08:00+00:00, run_after=2024-04-15T00:09:00+00:00 2024-04-15T00:08:00.316869879Z [2024-04-15T00:08:00.316+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:08:00.316907589Z 2024-04-15T00:08:00.316942262Z 2024-04-15T00:08:00.316950676Z 2024-04-15T00:08:00.316959546Z 2024-04-15T00:08:00.316982178Z [2024-04-15T00:08:00.316+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:08:00.317132275Z [2024-04-15T00:08:00.316+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:08:00.317285412Z [2024-04-15T00:08:00.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:08:00.317399590Z [2024-04-15T00:08:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:08:00.318011511Z [2024-04-15T00:08:00.317+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:08:00.318041196Z 2024-04-15T00:08:00.318055343Z 2024-04-15T00:08:00.318066137Z 2024-04-15T00:08:00.318077192Z 2024-04-15T00:08:00.321635233Z [2024-04-15T00:08:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:08:00.321760541Z [2024-04-15T00:08:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:08:00.322045820Z [2024-04-15T00:08:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:08:00.322152173Z [2024-04-15T00:08:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:08:00.322447842Z [2024-04-15T00:08:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:08:00.322654610Z [2024-04-15T00:08:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:08:00.322845201Z [2024-04-15T00:08:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:08:00.322992851Z [2024-04-15T00:08:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:08:00.670498833Z [2024-04-15T00:08:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status queued for try_number 1 2024-04-15T00:08:00.670527656Z [2024-04-15T00:08:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:07:00+00:00 exited with status queued for try_number 1 2024-04-15T00:08:00.670611799Z [2024-04-15T00:08:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:07:00+00:00 exited with status queued for try_number 1 2024-04-15T00:08:00.670734805Z [2024-04-15T00:08:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:07:00+00:00 exited with status queued for try_number 1 2024-04-15T00:08:00.679986698Z [2024-04-15T00:08:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f4d5a97-2ccd-4147-bebf-4d2e5bf52064 2024-04-15T00:08:00.680099614Z [2024-04-15T00:08:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 276a2429-ff60-47f6-8811-d3acba78f862 2024-04-15T00:08:00.680249881Z [2024-04-15T00:08:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b22ac9-7117-4860-ba71-5abe6d7c402e 2024-04-15T00:08:00.680758974Z [2024-04-15T00:08:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f513c74-7fda-49dd-b611-028f416b91a5 2024-04-15T00:08:01.816406560Z [2024-04-15T00:08:01.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:08:01.816620947Z [2024-04-15T00:08:01.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:06:00+00:00, run_id=scheduled__2024-04-15T00:06:00+00:00, run_start_date=2024-04-15 00:08:00.231765+00:00, run_end_date=2024-04-15 00:08:01.816307+00:00, run_duration=1.584542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:06:00+00:00, data_interval_end=2024-04-15 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:08:01.822716422Z [2024-04-15T00:08:01.822+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:08:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:08:01.836867458Z [2024-04-15T00:08:01.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:08:01.837031849Z [2024-04-15T00:08:01.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:07:00+00:00, run_id=scheduled__2024-04-15T00:07:00+00:00, run_start_date=2024-04-15 00:08:00.233013+00:00, run_end_date=2024-04-15 00:08:01.836776+00:00, run_duration=1.603763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:07:00+00:00, data_interval_end=2024-04-15 00:08:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:08:01.846171089Z [2024-04-15T00:08:01.845+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:08:00+00:00, run_after=2024-04-15T00:09:00+00:00 2024-04-15T00:08:01.882175847Z [2024-04-15T00:08:01.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:06:00+00:00 exited with status success for try_number 1 2024-04-15T00:08:01.882284314Z [2024-04-15T00:08:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:07:00+00:00 exited with status success for try_number 1 2024-04-15T00:08:01.889199211Z [2024-04-15T00:08:01.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:07:00+00:00, map_index=-1, run_start_date=2024-04-15 00:08:01.042470+00:00, run_end_date=2024-04-15 00:08:01.341196+00:00, run_duration=0.298726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:08:00.318781+00:00, queued_by_job_id=1, pid=6281 2024-04-15T00:08:01.889389164Z [2024-04-15T00:08:01.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:06:00+00:00, map_index=-1, run_start_date=2024-04-15 00:08:01.107462+00:00, run_end_date=2024-04-15 00:08:01.459625+00:00, run_duration=0.352163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:08:00.318781+00:00, queued_by_job_id=1, pid=6282 2024-04-15T00:08:04.442757908Z [2024-04-15T00:08:04.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:08:04.443231323Z [2024-04-15T00:08:04.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:07:00+00:00, run_id=scheduled__2024-04-15T00:07:00+00:00, run_start_date=2024-04-15 00:08:00.235532+00:00, run_end_date=2024-04-15 00:08:04.442680+00:00, run_duration=4.207148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:07:00+00:00, data_interval_end=2024-04-15 00:08:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:08:04.452106778Z [2024-04-15T00:08:04.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:08:00+00:00, run_after=2024-04-15T00:09:00+00:00 2024-04-15T00:08:04.459331246Z [2024-04-15T00:08:04.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:08:04.459716860Z [2024-04-15T00:08:04.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:07:00+00:00, run_id=scheduled__2024-04-15T00:07:00+00:00, run_start_date=2024-04-15 00:08:00.234250+00:00, run_end_date=2024-04-15 00:08:04.459287+00:00, run_duration=4.225037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:07:00+00:00, data_interval_end=2024-04-15 00:08:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:08:04.479893603Z [2024-04-15T00:08:04.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:08:00+00:00, run_after=2024-04-15T00:09:00+00:00 2024-04-15T00:08:04.540803099Z [2024-04-15T00:08:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:07:00+00:00 exited with status success for try_number 1 2024-04-15T00:08:04.540920129Z [2024-04-15T00:08:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:07:00+00:00 exited with status success for try_number 1 2024-04-15T00:08:04.546956886Z [2024-04-15T00:08:04.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:07:00+00:00, map_index=-1, run_start_date=2024-04-15 00:08:02.194912+00:00, run_end_date=2024-04-15 00:08:03.768549+00:00, run_duration=1.573637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:08:00.318781+00:00, queued_by_job_id=1, pid=6305 2024-04-15T00:08:04.547141801Z [2024-04-15T00:08:04.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:07:00+00:00, map_index=-1, run_start_date=2024-04-15 00:08:02.302528+00:00, run_end_date=2024-04-15 00:08:03.446861+00:00, run_duration=1.144333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:08:00.318781+00:00, queued_by_job_id=1, pid=6306 2024-04-15T00:09:00.180507833Z [2024-04-15T00:09:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:09:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:09:00.189700113Z [2024-04-15T00:09:00.189+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:09:00.208356067Z [2024-04-15T00:09:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:09:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:09:00.289968264Z [2024-04-15T00:09:00.289+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:09:00.290024858Z 2024-04-15T00:09:00.290034561Z 2024-04-15T00:09:00.290065946Z 2024-04-15T00:09:00.290298834Z [2024-04-15T00:09:00.289+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:09:00.290635148Z [2024-04-15T00:09:00.290+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:09:00.291008024Z [2024-04-15T00:09:00.290+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:09:00.292251194Z [2024-04-15T00:09:00.291+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:09:00.292270786Z 2024-04-15T00:09:00.292278622Z 2024-04-15T00:09:00.292284516Z 2024-04-15T00:09:00.297088903Z [2024-04-15T00:09:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:09:00.297426760Z [2024-04-15T00:09:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:09:00.297864991Z [2024-04-15T00:09:00.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:09:00.298166034Z [2024-04-15T00:09:00.297+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:09:00.298622963Z [2024-04-15T00:09:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:09:00.298964959Z [2024-04-15T00:09:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:09:00.569127218Z [2024-04-15T00:09:00.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status queued for try_number 1 2024-04-15T00:09:00.570845415Z [2024-04-15T00:09:00.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status queued for try_number 1 2024-04-15T00:09:00.571076609Z [2024-04-15T00:09:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status queued for try_number 1 2024-04-15T00:09:00.577194254Z [2024-04-15T00:09:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87149893-2747-4882-9ec6-9bd31b87f84b 2024-04-15T00:09:00.577442474Z [2024-04-15T00:09:00.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to c41af6d4-94ea-4764-b2c5-fe159aaea0ca 2024-04-15T00:09:00.577625899Z [2024-04-15T00:09:00.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77a50d65-fc9c-49e4-a55b-0c477fbe0439 2024-04-15T00:09:01.669844775Z [2024-04-15T00:09:01.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:09:01.669992420Z [2024-04-15T00:09:01.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:08:00+00:00, run_id=scheduled__2024-04-15T00:08:00+00:00, run_start_date=2024-04-15 00:09:00.221530+00:00, run_end_date=2024-04-15 00:09:01.669677+00:00, run_duration=1.448147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:08:00+00:00, data_interval_end=2024-04-15 00:09:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:09:01.678349435Z [2024-04-15T00:09:01.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:09:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:09:01.706547035Z [2024-04-15T00:09:01.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status success for try_number 1 2024-04-15T00:09:01.711498971Z [2024-04-15T00:09:01.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:08:00+00:00, map_index=-1, run_start_date=2024-04-15 00:09:01.042012+00:00, run_end_date=2024-04-15 00:09:01.407446+00:00, run_duration=0.365434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:09:00.293234+00:00, queued_by_job_id=1, pid=6338 2024-04-15T00:09:03.829495824Z [2024-04-15T00:09:03.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:09:03.829924480Z [2024-04-15T00:09:03.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:08:00+00:00, run_id=scheduled__2024-04-15T00:08:00+00:00, run_start_date=2024-04-15 00:09:00.223241+00:00, run_end_date=2024-04-15 00:09:03.829258+00:00, run_duration=3.606017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:08:00+00:00, data_interval_end=2024-04-15 00:09:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:09:03.853648003Z [2024-04-15T00:09:03.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:09:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:09:03.864258787Z [2024-04-15T00:09:03.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:09:03.864721469Z [2024-04-15T00:09:03.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:08:00+00:00, run_id=scheduled__2024-04-15T00:08:00+00:00, run_start_date=2024-04-15 00:09:00.224319+00:00, run_end_date=2024-04-15 00:09:03.864153+00:00, run_duration=3.639834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:08:00+00:00, data_interval_end=2024-04-15 00:09:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:09:03.875408113Z [2024-04-15T00:09:03.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:09:00+00:00, run_after=2024-04-15T00:10:00+00:00 2024-04-15T00:09:03.913619829Z [2024-04-15T00:09:03.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status success for try_number 1 2024-04-15T00:09:03.913782742Z [2024-04-15T00:09:03.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status success for try_number 1 2024-04-15T00:09:03.919979937Z [2024-04-15T00:09:03.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:08:00+00:00, map_index=-1, run_start_date=2024-04-15 00:09:01.945137+00:00, run_end_date=2024-04-15 00:09:03.115965+00:00, run_duration=1.170828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:09:00.293234+00:00, queued_by_job_id=1, pid=6357 2024-04-15T00:09:03.920267627Z [2024-04-15T00:09:03.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:08:00+00:00, map_index=-1, run_start_date=2024-04-15 00:09:01.911710+00:00, run_end_date=2024-04-15 00:09:03.472598+00:00, run_duration=1.560888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:09:00.293234+00:00, queued_by_job_id=1, pid=6356 2024-04-15T00:10:00.463020352Z [2024-04-15T00:10:00.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:11:00+00:00 2024-04-15T00:10:00.492421169Z [2024-04-15T00:10:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:15:00+00:00 2024-04-15T00:10:00.510673537Z [2024-04-15T00:10:00.510+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:11:00+00:00 2024-04-15T00:10:00.516964868Z [2024-04-15T00:10:00.516+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:10:00.523904592Z [2024-04-15T00:10:00.523+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:10:00.626734647Z [2024-04-15T00:10:00.626+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T00:10:00.626766660Z 2024-04-15T00:10:00.626773687Z 2024-04-15T00:10:00.626780294Z 2024-04-15T00:10:00.626785947Z 2024-04-15T00:10:00.626791562Z 2024-04-15T00:10:00.627367425Z [2024-04-15T00:10:00.627+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:10:00.627817665Z [2024-04-15T00:10:00.627+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:10:00.628243748Z [2024-04-15T00:10:00.628+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:10:00.628629416Z [2024-04-15T00:10:00.628+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:10:00.629028592Z [2024-04-15T00:10:00.628+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:10:00.630127387Z [2024-04-15T00:10:00.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:10:00.630151129Z 2024-04-15T00:10:00.630158444Z 2024-04-15T00:10:00.630164725Z 2024-04-15T00:10:00.630170671Z 2024-04-15T00:10:00.630176464Z 2024-04-15T00:10:00.639516877Z [2024-04-15T00:10:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:10:00.639932360Z [2024-04-15T00:10:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:10:00.640368522Z [2024-04-15T00:10:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:10:00.640652516Z [2024-04-15T00:10:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:10:00.641038231Z [2024-04-15T00:10:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:10:00.641320235Z [2024-04-15T00:10:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:10:00.641723230Z [2024-04-15T00:10:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:10:00.641976709Z [2024-04-15T00:10:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:10:00.642342521Z [2024-04-15T00:10:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:10:00.642594856Z [2024-04-15T00:10:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:10:01.162519343Z [2024-04-15T00:10:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:01.163707572Z [2024-04-15T00:10:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:01.164001596Z [2024-04-15T00:10:01.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:09:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:01.164269563Z [2024-04-15T00:10:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:09:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:01.164542194Z [2024-04-15T00:10:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:09:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:01.185267097Z [2024-04-15T00:10:01.184+0000] {scheduler_job.py:635} INFO - Setting external_id for to 154819ba-7b27-448b-b884-52a968a875f1 2024-04-15T00:10:01.185618782Z [2024-04-15T00:10:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5508a01-a436-41f2-bd5e-fb3cf4220b35 2024-04-15T00:10:01.185965370Z [2024-04-15T00:10:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44ecd2be-4442-4a8e-9e6d-08b09dee710e 2024-04-15T00:10:01.186331495Z [2024-04-15T00:10:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d9db80f-c012-4057-9ef7-a06398577102 2024-04-15T00:10:01.186899015Z [2024-04-15T00:10:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54480db8-4acb-46ba-bcc2-18b604d90e58 2024-04-15T00:10:02.618441315Z [2024-04-15T00:10:02.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:10:02.618745750Z [2024-04-15T00:10:02.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:08:00+00:00, run_id=scheduled__2024-04-15T00:08:00+00:00, run_start_date=2024-04-15 00:10:00.537415+00:00, run_end_date=2024-04-15 00:10:02.618361+00:00, run_duration=2.080946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:08:00+00:00, data_interval_end=2024-04-15 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:10:02.625977286Z [2024-04-15T00:10:02.625+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:12:00+00:00 2024-04-15T00:10:02.632929203Z [2024-04-15T00:10:02.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:10:02.633270852Z [2024-04-15T00:10:02.633+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:09:00+00:00, run_id=scheduled__2024-04-15T00:09:00+00:00, run_start_date=2024-04-15 00:10:00.538300+00:00, run_end_date=2024-04-15 00:10:02.632878+00:00, run_duration=2.094578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:09:00+00:00, data_interval_end=2024-04-15 00:10:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:10:02.641318783Z [2024-04-15T00:10:02.641+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:11:00+00:00 2024-04-15T00:10:02.709990381Z [2024-04-15T00:10:02.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:08:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:02.710340027Z [2024-04-15T00:10:02.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:09:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:02.716460835Z [2024-04-15T00:10:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:08:00+00:00, map_index=-1, run_start_date=2024-04-15 00:10:01.442189+00:00, run_end_date=2024-04-15 00:10:01.897459+00:00, run_duration=0.45527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:00.633763+00:00, queued_by_job_id=1, pid=6391 2024-04-15T00:10:02.717126958Z [2024-04-15T00:10:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:09:00+00:00, map_index=-1, run_start_date=2024-04-15 00:10:01.496040+00:00, run_end_date=2024-04-15 00:10:01.922303+00:00, run_duration=0.426263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:00.633763+00:00, queued_by_job_id=1, pid=6392 2024-04-15T00:10:03.875275218Z [2024-04-15T00:10:03.874+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:10:03.875314637Z 2024-04-15T00:10:03.875884763Z [2024-04-15T00:10:03.875+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:10:03.877286005Z [2024-04-15T00:10:03.876+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:10:03.877302958Z 2024-04-15T00:10:03.880778533Z [2024-04-15T00:10:03.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:10:03.881201555Z [2024-04-15T00:10:03.880+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:10:03.947162881Z [2024-04-15T00:10:03.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:03.947304320Z [2024-04-15T00:10:03.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:03.954667877Z [2024-04-15T00:10:03.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1e5ee6d-df64-447e-b4f6-287bde45babb 2024-04-15T00:10:03.954933408Z [2024-04-15T00:10:03.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:05:00+00:00, map_index=-1, run_start_date=2024-04-15 00:10:02.309904+00:00, run_end_date=2024-04-15 00:10:02.698485+00:00, run_duration=0.388581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:00.633763+00:00, queued_by_job_id=1, pid=6411 2024-04-15T00:10:04.311821813Z [2024-04-15T00:10:04.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:10:04.313592521Z [2024-04-15T00:10:04.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:09:00+00:00, run_id=scheduled__2024-04-15T00:09:00+00:00, run_start_date=2024-04-15 00:10:00.539152+00:00, run_end_date=2024-04-15 00:10:04.311521+00:00, run_duration=3.772369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:09:00+00:00, data_interval_end=2024-04-15 00:10:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:10:04.329279751Z [2024-04-15T00:10:04.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:11:00+00:00 2024-04-15T00:10:04.435165793Z [2024-04-15T00:10:04.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:09:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:04.443221596Z [2024-04-15T00:10:04.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:09:00+00:00, map_index=-1, run_start_date=2024-04-15 00:10:02.808246+00:00, run_end_date=2024-04-15 00:10:04.160611+00:00, run_duration=1.352365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:00.633763+00:00, queued_by_job_id=1, pid=6428 2024-04-15T00:10:05.494861585Z [2024-04-15T00:10:05.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:10:05.494973176Z [2024-04-15T00:10:05.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:09:00+00:00, run_id=scheduled__2024-04-15T00:09:00+00:00, run_start_date=2024-04-15 00:10:00.539953+00:00, run_end_date=2024-04-15 00:10:05.494620+00:00, run_duration=4.954667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:09:00+00:00, data_interval_end=2024-04-15 00:10:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:10:05.502367228Z [2024-04-15T00:10:05.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:11:00+00:00 2024-04-15T00:10:05.544609804Z [2024-04-15T00:10:05.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:09:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:05.549864599Z [2024-04-15T00:10:05.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:09:00+00:00, map_index=-1, run_start_date=2024-04-15 00:10:02.762543+00:00, run_end_date=2024-04-15 00:10:04.441435+00:00, run_duration=1.678892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:00.633763+00:00, queued_by_job_id=1, pid=6427 2024-04-15T00:10:06.623516173Z [2024-04-15T00:10:06.623+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:10:06.623543030Z 2024-04-15T00:10:06.623615981Z [2024-04-15T00:10:06.623+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:10:06.624944323Z [2024-04-15T00:10:06.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:10:06.624965675Z 2024-04-15T00:10:06.626327665Z [2024-04-15T00:10:06.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:10:06.626423388Z [2024-04-15T00:10:06.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:10:06.683680460Z [2024-04-15T00:10:06.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:06.685638223Z [2024-04-15T00:10:06.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:06.690592746Z [2024-04-15T00:10:06.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46052aa9-e556-4385-bd75-4de5afcd7165 2024-04-15T00:10:06.691050563Z [2024-04-15T00:10:06.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:05:00+00:00, map_index=-1, run_start_date=2024-04-15 00:10:05.664070+00:00, run_end_date=2024-04-15 00:10:06.047673+00:00, run_duration=0.383603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:03.877925+00:00, queued_by_job_id=1, pid=6446 2024-04-15T00:10:08.959461664Z [2024-04-15T00:10:08.958+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:10:08.959501880Z 2024-04-15T00:10:08.959747879Z [2024-04-15T00:10:08.959+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:10:08.961164646Z [2024-04-15T00:10:08.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:10:08.961226870Z 2024-04-15T00:10:08.964052735Z [2024-04-15T00:10:08.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:10:08.964285761Z [2024-04-15T00:10:08.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:10:09.033364243Z [2024-04-15T00:10:09.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status queued for try_number 1 2024-04-15T00:10:09.033402566Z [2024-04-15T00:10:09.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:09.039537061Z [2024-04-15T00:10:09.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69e9e9da-94a3-4d90-ae2d-f512abf60262 2024-04-15T00:10:09.039738899Z [2024-04-15T00:10:09.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:05:00+00:00, map_index=0, run_start_date=2024-04-15 00:10:08.042591+00:00, run_end_date=2024-04-15 00:10:08.464251+00:00, run_duration=0.42166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:06.624513+00:00, queued_by_job_id=1, pid=6454 2024-04-15T00:10:11.500987240Z [2024-04-15T00:10:11.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:10:11.501403406Z [2024-04-15T00:10:11.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:05:00+00:00, run_id=scheduled__2024-04-15T00:05:00+00:00, run_start_date=2024-04-15 00:10:00.536340+00:00, run_end_date=2024-04-15 00:10:11.500951+00:00, run_duration=10.964611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:05:00+00:00, data_interval_end=2024-04-15 00:10:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:10:11.509091512Z [2024-04-15T00:10:11.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:10:00+00:00, run_after=2024-04-15T00:15:00+00:00 2024-04-15T00:10:11.542467926Z [2024-04-15T00:10:11.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:05:00+00:00 exited with status success for try_number 1 2024-04-15T00:10:11.549835489Z [2024-04-15T00:10:11.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:05:00+00:00, map_index=-1, run_start_date=2024-04-15 00:10:10.426430+00:00, run_end_date=2024-04-15 00:10:10.730585+00:00, run_duration=0.304155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:10:08.961658+00:00, queued_by_job_id=1, pid=6462 2024-04-15T00:11:00.773771156Z [2024-04-15T00:11:00.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:11:00+00:00, run_after=2024-04-15T00:12:00+00:00 2024-04-15T00:11:00.788550983Z [2024-04-15T00:11:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:11:00+00:00, run_after=2024-04-15T00:12:00+00:00 2024-04-15T00:11:00.794462508Z [2024-04-15T00:11:00.794+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:11:00.860188479Z [2024-04-15T00:11:00.859+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:11:00.860237612Z 2024-04-15T00:11:00.860243345Z 2024-04-15T00:11:00.860247946Z 2024-04-15T00:11:00.860252595Z [2024-04-15T00:11:00.860+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:11:00.860420233Z [2024-04-15T00:11:00.860+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:11:00.860429273Z [2024-04-15T00:11:00.860+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:11:00.860809489Z [2024-04-15T00:11:00.860+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:11:00.860823898Z 2024-04-15T00:11:00.860829239Z 2024-04-15T00:11:00.860833961Z 2024-04-15T00:11:00.863423678Z [2024-04-15T00:11:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:11:00.863509028Z [2024-04-15T00:11:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:11:00.863676153Z [2024-04-15T00:11:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:11:00.863763073Z [2024-04-15T00:11:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:11:00.863925728Z [2024-04-15T00:11:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:11:00.863940092Z [2024-04-15T00:11:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:11:01.037025076Z [2024-04-15T00:11:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:11:01.037077599Z [2024-04-15T00:11:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:11:01.038425424Z [2024-04-15T00:11:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:11:01.046545830Z [2024-04-15T00:11:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccdcd663-25bc-47fe-b1ec-1e7d3c580a5f 2024-04-15T00:11:01.046634579Z [2024-04-15T00:11:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44d201ec-02cb-410c-bfa5-c90c8f2fc72d 2024-04-15T00:11:01.046703734Z [2024-04-15T00:11:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8caecffe-e154-46be-acf7-f42729f3424b 2024-04-15T00:11:02.203696646Z [2024-04-15T00:11:02.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:11:02.204023343Z [2024-04-15T00:11:02.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:10:00+00:00, run_id=scheduled__2024-04-15T00:10:00+00:00, run_start_date=2024-04-15 00:11:00.805815+00:00, run_end_date=2024-04-15 00:11:02.203576+00:00, run_duration=1.397761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:10:00+00:00, data_interval_end=2024-04-15 00:11:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:11:02.214888527Z [2024-04-15T00:11:02.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:11:00+00:00, run_after=2024-04-15T00:12:00+00:00 2024-04-15T00:11:02.267729708Z [2024-04-15T00:11:02.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:11:02.276951159Z [2024-04-15T00:11:02.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=-1, run_start_date=2024-04-15 00:11:01.547698+00:00, run_end_date=2024-04-15 00:11:01.965774+00:00, run_duration=0.418076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:11:00.861308+00:00, queued_by_job_id=1, pid=6484 2024-04-15T00:11:02.289082408Z [2024-04-15T00:11:02.288+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:11:04.670492118Z [2024-04-15T00:11:04.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:11:04.671021098Z [2024-04-15T00:11:04.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:10:00+00:00, run_id=scheduled__2024-04-15T00:10:00+00:00, run_start_date=2024-04-15 00:11:00.806975+00:00, run_end_date=2024-04-15 00:11:04.670376+00:00, run_duration=3.863401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:10:00+00:00, data_interval_end=2024-04-15 00:11:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:11:04.691172677Z [2024-04-15T00:11:04.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:11:00+00:00, run_after=2024-04-15T00:12:00+00:00 2024-04-15T00:11:04.699123169Z [2024-04-15T00:11:04.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:11:04.699452452Z [2024-04-15T00:11:04.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:10:00+00:00, run_id=scheduled__2024-04-15T00:10:00+00:00, run_start_date=2024-04-15 00:11:00.808119+00:00, run_end_date=2024-04-15 00:11:04.699040+00:00, run_duration=3.890921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:10:00+00:00, data_interval_end=2024-04-15 00:11:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:11:04.716514254Z [2024-04-15T00:11:04.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:11:00+00:00, run_after=2024-04-15T00:12:00+00:00 2024-04-15T00:11:04.766431995Z [2024-04-15T00:11:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:11:04.766593128Z [2024-04-15T00:11:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:11:04.772139289Z [2024-04-15T00:11:04.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=-1, run_start_date=2024-04-15 00:11:02.723658+00:00, run_end_date=2024-04-15 00:11:04.035031+00:00, run_duration=1.311373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:11:00.861308+00:00, queued_by_job_id=1, pid=6508 2024-04-15T00:11:04.772579856Z [2024-04-15T00:11:04.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=-1, run_start_date=2024-04-15 00:11:02.396177+00:00, run_end_date=2024-04-15 00:11:04.415787+00:00, run_duration=2.01961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:11:00.861308+00:00, queued_by_job_id=1, pid=6497 2024-04-15T00:12:00.597002361Z [2024-04-15T00:12:00.596+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:12:00.616638566Z [2024-04-15T00:12:00.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:12:00+00:00, run_after=2024-04-15T00:13:00+00:00 2024-04-15T00:12:00.632838216Z [2024-04-15T00:12:00.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:12:00+00:00, run_after=2024-04-15T00:13:00+00:00 2024-04-15T00:12:00.640385463Z [2024-04-15T00:12:00.640+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:12:00.730916980Z [2024-04-15T00:12:00.730+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:12:00.730949932Z 2024-04-15T00:12:00.730956899Z 2024-04-15T00:12:00.730962626Z 2024-04-15T00:12:00.730967992Z 2024-04-15T00:12:00.730973802Z [2024-04-15T00:12:00.730+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:12:00.730979400Z [2024-04-15T00:12:00.730+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:12:00.731083826Z [2024-04-15T00:12:00.730+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:12:00.731196353Z [2024-04-15T00:12:00.731+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:12:00.732011709Z [2024-04-15T00:12:00.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:12:00.732029218Z 2024-04-15T00:12:00.732045595Z 2024-04-15T00:12:00.732074385Z 2024-04-15T00:12:00.732081140Z 2024-04-15T00:12:00.737125186Z [2024-04-15T00:12:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:12:00.737151783Z [2024-04-15T00:12:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:12:00.737479617Z [2024-04-15T00:12:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:12:00.737494844Z [2024-04-15T00:12:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:12:00.737784823Z [2024-04-15T00:12:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:12:00.737861933Z [2024-04-15T00:12:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:12:00.738130685Z [2024-04-15T00:12:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:12:00.738213012Z [2024-04-15T00:12:00.738+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:12:01.091949060Z [2024-04-15T00:12:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:12:01.091992495Z [2024-04-15T00:12:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:11:00+00:00 exited with status queued for try_number 1 2024-04-15T00:12:01.092051498Z [2024-04-15T00:12:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:11:00+00:00 exited with status queued for try_number 1 2024-04-15T00:12:01.092173555Z [2024-04-15T00:12:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:11:00+00:00 exited with status queued for try_number 1 2024-04-15T00:12:01.112191890Z [2024-04-15T00:12:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to d119093a-4e98-4256-854e-a7c317186425 2024-04-15T00:12:01.112239323Z [2024-04-15T00:12:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87f4a6e5-2131-449f-87b0-e06cf5a1a70c 2024-04-15T00:12:01.112303516Z [2024-04-15T00:12:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f27bc00-13d5-44c7-a11e-5e36471b4d82 2024-04-15T00:12:01.112385975Z [2024-04-15T00:12:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f6b2c19-db32-464e-9fb7-f671be10101b 2024-04-15T00:12:02.348946503Z [2024-04-15T00:12:02.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:12:02.349250553Z [2024-04-15T00:12:02.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:10:00+00:00, run_id=scheduled__2024-04-15T00:10:00+00:00, run_start_date=2024-04-15 00:12:00.650933+00:00, run_end_date=2024-04-15 00:12:02.348917+00:00, run_duration=1.697984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:10:00+00:00, data_interval_end=2024-04-15 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:12:02.356174687Z [2024-04-15T00:12:02.355+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:12:00+00:00, run_after=2024-04-15T00:14:00+00:00 2024-04-15T00:12:02.367299686Z [2024-04-15T00:12:02.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:12:02.367755133Z [2024-04-15T00:12:02.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:11:00+00:00, run_id=scheduled__2024-04-15T00:11:00+00:00, run_start_date=2024-04-15 00:12:00.652145+00:00, run_end_date=2024-04-15 00:12:02.367489+00:00, run_duration=1.715344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:11:00+00:00, data_interval_end=2024-04-15 00:12:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:12:02.376758261Z [2024-04-15T00:12:02.376+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:12:00+00:00, run_after=2024-04-15T00:13:00+00:00 2024-04-15T00:12:02.410348132Z [2024-04-15T00:12:02.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:12:02.410427840Z [2024-04-15T00:12:02.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:11:00+00:00 exited with status success for try_number 1 2024-04-15T00:12:02.416774800Z [2024-04-15T00:12:02.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=-1, run_start_date=2024-04-15 00:12:01.479940+00:00, run_end_date=2024-04-15 00:12:01.875099+00:00, run_duration=0.395159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:12:00.733131+00:00, queued_by_job_id=1, pid=6537 2024-04-15T00:12:02.416905491Z [2024-04-15T00:12:02.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:11:00+00:00, map_index=-1, run_start_date=2024-04-15 00:12:01.413434+00:00, run_end_date=2024-04-15 00:12:01.759766+00:00, run_duration=0.346332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:12:00.733131+00:00, queued_by_job_id=1, pid=6536 2024-04-15T00:12:04.573261998Z [2024-04-15T00:12:04.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:12:04.573751236Z [2024-04-15T00:12:04.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:11:00+00:00, run_id=scheduled__2024-04-15T00:11:00+00:00, run_start_date=2024-04-15 00:12:00.654268+00:00, run_end_date=2024-04-15 00:12:04.573102+00:00, run_duration=3.918834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:11:00+00:00, data_interval_end=2024-04-15 00:12:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:12:04.585642852Z [2024-04-15T00:12:04.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:12:00+00:00, run_after=2024-04-15T00:13:00+00:00 2024-04-15T00:12:04.592718153Z [2024-04-15T00:12:04.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:12:04.592896710Z [2024-04-15T00:12:04.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:11:00+00:00, run_id=scheduled__2024-04-15T00:11:00+00:00, run_start_date=2024-04-15 00:12:00.653182+00:00, run_end_date=2024-04-15 00:12:04.592531+00:00, run_duration=3.939349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:11:00+00:00, data_interval_end=2024-04-15 00:12:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:12:04.603617641Z [2024-04-15T00:12:04.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:12:00+00:00, run_after=2024-04-15T00:13:00+00:00 2024-04-15T00:12:04.646634688Z [2024-04-15T00:12:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:11:00+00:00 exited with status success for try_number 1 2024-04-15T00:12:04.646680885Z [2024-04-15T00:12:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:11:00+00:00 exited with status success for try_number 1 2024-04-15T00:12:04.655837860Z [2024-04-15T00:12:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:11:00+00:00, map_index=-1, run_start_date=2024-04-15 00:12:02.466213+00:00, run_end_date=2024-04-15 00:12:04.342182+00:00, run_duration=1.875969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:12:00.733131+00:00, queued_by_job_id=1, pid=6560 2024-04-15T00:12:04.656170450Z [2024-04-15T00:12:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:11:00+00:00, map_index=-1, run_start_date=2024-04-15 00:12:02.568320+00:00, run_end_date=2024-04-15 00:12:04.052048+00:00, run_duration=1.483728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:12:00.733131+00:00, queued_by_job_id=1, pid=6561 2024-04-15T00:13:00.218713542Z [2024-04-15T00:13:00.218+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:13:00+00:00, run_after=2024-04-15T00:14:00+00:00 2024-04-15T00:13:00.228091674Z [2024-04-15T00:13:00.227+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:13:00.239132355Z [2024-04-15T00:13:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:13:00+00:00, run_after=2024-04-15T00:14:00+00:00 2024-04-15T00:13:00.300378468Z [2024-04-15T00:13:00.300+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:13:00.300399543Z 2024-04-15T00:13:00.300402672Z 2024-04-15T00:13:00.300405442Z 2024-04-15T00:13:00.300485227Z [2024-04-15T00:13:00.300+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:13:00.300615708Z [2024-04-15T00:13:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:13:00.300766179Z [2024-04-15T00:13:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:13:00.301569752Z [2024-04-15T00:13:00.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:13:00.301580366Z 2024-04-15T00:13:00.301583786Z 2024-04-15T00:13:00.301586804Z 2024-04-15T00:13:00.305734939Z [2024-04-15T00:13:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:13:00.306017593Z [2024-04-15T00:13:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:13:00.306316305Z [2024-04-15T00:13:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:13:00.306425706Z [2024-04-15T00:13:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:13:00.306711963Z [2024-04-15T00:13:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:13:00.307389388Z [2024-04-15T00:13:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:13:00.669222393Z [2024-04-15T00:13:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status queued for try_number 1 2024-04-15T00:13:00.670949721Z [2024-04-15T00:13:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status queued for try_number 1 2024-04-15T00:13:00.673713021Z [2024-04-15T00:13:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status queued for try_number 1 2024-04-15T00:13:00.686150857Z [2024-04-15T00:13:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 289ec8b9-c507-404c-84ac-c3710b459701 2024-04-15T00:13:00.688179554Z [2024-04-15T00:13:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9291067-6522-4edb-9d4d-23f2121283a1 2024-04-15T00:13:00.688351835Z [2024-04-15T00:13:00.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06f8b9e5-9972-4506-abc6-b43cb48135db 2024-04-15T00:13:01.985301776Z [2024-04-15T00:13:01.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:13:01.985361482Z [2024-04-15T00:13:01.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:12:00+00:00, run_id=scheduled__2024-04-15T00:12:00+00:00, run_start_date=2024-04-15 00:13:00.247912+00:00, run_end_date=2024-04-15 00:13:01.984501+00:00, run_duration=1.736589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:12:00+00:00, data_interval_end=2024-04-15 00:13:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:13:02.020955453Z [2024-04-15T00:13:02.020+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:13:00+00:00, run_after=2024-04-15T00:14:00+00:00 2024-04-15T00:13:02.106485717Z [2024-04-15T00:13:02.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status success for try_number 1 2024-04-15T00:13:02.114111759Z [2024-04-15T00:13:02.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:12:00+00:00, map_index=-1, run_start_date=2024-04-15 00:13:01.133162+00:00, run_end_date=2024-04-15 00:13:01.657098+00:00, run_duration=0.523936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:13:00.302549+00:00, queued_by_job_id=1, pid=6592 2024-04-15T00:13:04.267835430Z [2024-04-15T00:13:04.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:13:04.268700537Z [2024-04-15T00:13:04.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:12:00+00:00, run_id=scheduled__2024-04-15T00:12:00+00:00, run_start_date=2024-04-15 00:13:00.248855+00:00, run_end_date=2024-04-15 00:13:04.268119+00:00, run_duration=4.019264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:12:00+00:00, data_interval_end=2024-04-15 00:13:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:13:04.284355277Z [2024-04-15T00:13:04.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:13:00+00:00, run_after=2024-04-15T00:14:00+00:00 2024-04-15T00:13:04.337532008Z [2024-04-15T00:13:04.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status success for try_number 1 2024-04-15T00:13:04.345349719Z [2024-04-15T00:13:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:12:00+00:00, map_index=-1, run_start_date=2024-04-15 00:13:02.749222+00:00, run_end_date=2024-04-15 00:13:04.115006+00:00, run_duration=1.365784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:13:00.302549+00:00, queued_by_job_id=1, pid=6616 2024-04-15T00:13:05.404909474Z [2024-04-15T00:13:05.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:13:05.405481642Z [2024-04-15T00:13:05.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:12:00+00:00, run_id=scheduled__2024-04-15T00:12:00+00:00, run_start_date=2024-04-15 00:13:00.249816+00:00, run_end_date=2024-04-15 00:13:05.404768+00:00, run_duration=5.154952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:12:00+00:00, data_interval_end=2024-04-15 00:13:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:13:05.437007821Z [2024-04-15T00:13:05.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:13:00+00:00, run_after=2024-04-15T00:14:00+00:00 2024-04-15T00:13:05.487065335Z [2024-04-15T00:13:05.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status success for try_number 1 2024-04-15T00:13:05.495122521Z [2024-04-15T00:13:05.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:12:00+00:00, map_index=-1, run_start_date=2024-04-15 00:13:02.076645+00:00, run_end_date=2024-04-15 00:13:04.902055+00:00, run_duration=2.82541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:13:00.302549+00:00, queued_by_job_id=1, pid=6605 2024-04-15T00:14:00.502287572Z [2024-04-15T00:14:00.501+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:14:00.509712682Z [2024-04-15T00:14:00.509+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:14:00.520997299Z [2024-04-15T00:14:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:14:00+00:00, run_after=2024-04-15T00:15:00+00:00 2024-04-15T00:14:00.533203699Z [2024-04-15T00:14:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:14:00+00:00, run_after=2024-04-15T00:15:00+00:00 2024-04-15T00:14:00.635121438Z [2024-04-15T00:14:00.634+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:14:00.635142996Z 2024-04-15T00:14:00.635147252Z 2024-04-15T00:14:00.635150435Z 2024-04-15T00:14:00.635153935Z 2024-04-15T00:14:00.635462234Z [2024-04-15T00:14:00.635+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:14:00.635661172Z [2024-04-15T00:14:00.635+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:14:00.635817612Z [2024-04-15T00:14:00.635+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:14:00.635995843Z [2024-04-15T00:14:00.635+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:14:00.636577367Z [2024-04-15T00:14:00.636+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:14:00.636589350Z 2024-04-15T00:14:00.636593050Z 2024-04-15T00:14:00.636596186Z 2024-04-15T00:14:00.636599705Z 2024-04-15T00:14:00.640337913Z [2024-04-15T00:14:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:14:00.640537545Z [2024-04-15T00:14:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:14:00.640835377Z [2024-04-15T00:14:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:14:00.641181565Z [2024-04-15T00:14:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:14:00.641512577Z [2024-04-15T00:14:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:14:00.641992001Z [2024-04-15T00:14:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:14:00.642295236Z [2024-04-15T00:14:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:14:00.642542911Z [2024-04-15T00:14:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:14:00.964891809Z [2024-04-15T00:14:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status queued for try_number 1 2024-04-15T00:14:00.964970707Z [2024-04-15T00:14:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:13:00+00:00 exited with status queued for try_number 1 2024-04-15T00:14:00.965089239Z [2024-04-15T00:14:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:13:00+00:00 exited with status queued for try_number 1 2024-04-15T00:14:00.965271869Z [2024-04-15T00:14:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:13:00+00:00 exited with status queued for try_number 1 2024-04-15T00:14:00.972064795Z [2024-04-15T00:14:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13614a72-33c6-4a91-94d9-1207d7fe4fdd 2024-04-15T00:14:00.972232261Z [2024-04-15T00:14:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87949e1f-fc8d-4e33-a286-9099270ec26f 2024-04-15T00:14:00.972371378Z [2024-04-15T00:14:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to af7eadcb-3965-4391-aaa8-bc4f8693ed65 2024-04-15T00:14:00.972508631Z [2024-04-15T00:14:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to c218a139-ef85-407f-8433-0c5d592ff3ef 2024-04-15T00:14:02.793822153Z [2024-04-15T00:14:02.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:14:02.793879243Z [2024-04-15T00:14:02.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:12:00+00:00, run_id=scheduled__2024-04-15T00:12:00+00:00, run_start_date=2024-04-15 00:14:00.545043+00:00, run_end_date=2024-04-15 00:14:02.793568+00:00, run_duration=2.248525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:12:00+00:00, data_interval_end=2024-04-15 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:14:02.801044932Z [2024-04-15T00:14:02.800+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:14:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:14:02.808445403Z [2024-04-15T00:14:02.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:14:02.808520653Z [2024-04-15T00:14:02.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:13:00+00:00, run_id=scheduled__2024-04-15T00:13:00+00:00, run_start_date=2024-04-15 00:14:00.546222+00:00, run_end_date=2024-04-15 00:14:02.808317+00:00, run_duration=2.262095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:13:00+00:00, data_interval_end=2024-04-15 00:14:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:14:02.818669596Z [2024-04-15T00:14:02.817+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:14:00+00:00, run_after=2024-04-15T00:15:00+00:00 2024-04-15T00:14:02.860372473Z [2024-04-15T00:14:02.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:12:00+00:00 exited with status success for try_number 1 2024-04-15T00:14:02.861257301Z [2024-04-15T00:14:02.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:13:00+00:00 exited with status success for try_number 1 2024-04-15T00:14:02.868013590Z [2024-04-15T00:14:02.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:13:00+00:00, map_index=-1, run_start_date=2024-04-15 00:14:01.476572+00:00, run_end_date=2024-04-15 00:14:01.982599+00:00, run_duration=0.506027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:14:00.637416+00:00, queued_by_job_id=1, pid=6645 2024-04-15T00:14:02.868138254Z [2024-04-15T00:14:02.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:12:00+00:00, map_index=-1, run_start_date=2024-04-15 00:14:01.402922+00:00, run_end_date=2024-04-15 00:14:01.787048+00:00, run_duration=0.384126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:14:00.637416+00:00, queued_by_job_id=1, pid=6644 2024-04-15T00:14:03.940771592Z [2024-04-15T00:14:03.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:14:03.941743320Z [2024-04-15T00:14:03.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:13:00+00:00, run_id=scheduled__2024-04-15T00:13:00+00:00, run_start_date=2024-04-15 00:14:00.547248+00:00, run_end_date=2024-04-15 00:14:03.940921+00:00, run_duration=3.393673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:13:00+00:00, data_interval_end=2024-04-15 00:14:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:14:03.953011625Z [2024-04-15T00:14:03.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:14:00+00:00, run_after=2024-04-15T00:15:00+00:00 2024-04-15T00:14:05.091649897Z [2024-04-15T00:14:05.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:14:05.092013078Z [2024-04-15T00:14:05.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:13:00+00:00, run_id=scheduled__2024-04-15T00:13:00+00:00, run_start_date=2024-04-15 00:14:00.548635+00:00, run_end_date=2024-04-15 00:14:05.091386+00:00, run_duration=4.542751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:13:00+00:00, data_interval_end=2024-04-15 00:14:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:14:05.104759025Z [2024-04-15T00:14:05.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:14:00+00:00, run_after=2024-04-15T00:15:00+00:00 2024-04-15T00:14:05.149690203Z [2024-04-15T00:14:05.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:13:00+00:00 exited with status success for try_number 1 2024-04-15T00:14:05.149874636Z [2024-04-15T00:14:05.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:13:00+00:00 exited with status success for try_number 1 2024-04-15T00:14:05.159179999Z [2024-04-15T00:14:05.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:13:00+00:00, map_index=-1, run_start_date=2024-04-15 00:14:02.476684+00:00, run_end_date=2024-04-15 00:14:03.851486+00:00, run_duration=1.374802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:14:00.637416+00:00, queued_by_job_id=1, pid=6668 2024-04-15T00:14:05.159502860Z [2024-04-15T00:14:05.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:13:00+00:00, map_index=-1, run_start_date=2024-04-15 00:14:02.554620+00:00, run_end_date=2024-04-15 00:14:04.228319+00:00, run_duration=1.673699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:14:00.637416+00:00, queued_by_job_id=1, pid=6669 2024-04-15T00:15:00.750166242Z [2024-04-15T00:15:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:15:00.757875453Z [2024-04-15T00:15:00.757+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:15:00.770450028Z [2024-04-15T00:15:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:15:00.781713331Z [2024-04-15T00:15:00.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:15:00.890974882Z [2024-04-15T00:15:00.890+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:15:00.891025114Z 2024-04-15T00:15:00.891037275Z 2024-04-15T00:15:00.891047061Z 2024-04-15T00:15:00.891055934Z 2024-04-15T00:15:00.891079975Z [2024-04-15T00:15:00.890+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:15:00.891219556Z [2024-04-15T00:15:00.890+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:15:00.891335128Z [2024-04-15T00:15:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:15:00.891352194Z [2024-04-15T00:15:00.891+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:15:00.892033223Z [2024-04-15T00:15:00.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:15:00.892046262Z 2024-04-15T00:15:00.892052737Z 2024-04-15T00:15:00.892080969Z 2024-04-15T00:15:00.892088241Z 2024-04-15T00:15:00.896095902Z [2024-04-15T00:15:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:15:00.896157580Z [2024-04-15T00:15:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:15:00.896231739Z [2024-04-15T00:15:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:15:00.896311420Z [2024-04-15T00:15:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:15:00.896502939Z [2024-04-15T00:15:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:15:00.896527071Z [2024-04-15T00:15:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:15:00.896722157Z [2024-04-15T00:15:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:15:00.896742683Z [2024-04-15T00:15:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:15:01.243805141Z [2024-04-15T00:15:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:01.243840879Z [2024-04-15T00:15:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:01.243885619Z [2024-04-15T00:15:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:01.243930013Z [2024-04-15T00:15:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:01.255331338Z [2024-04-15T00:15:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35548ab2-4562-4743-a49e-0568132ae657 2024-04-15T00:15:01.255385789Z [2024-04-15T00:15:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to c07442bd-fd9e-4c56-bf90-ce8322726951 2024-04-15T00:15:01.255479326Z [2024-04-15T00:15:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbf481b8-011e-43ba-8370-dae1baeecfca 2024-04-15T00:15:01.255584541Z [2024-04-15T00:15:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac1467b8-a0b8-4aa9-a9c6-39b98348cae6 2024-04-15T00:15:02.515188398Z [2024-04-15T00:15:02.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:15:02.515376450Z [2024-04-15T00:15:02.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:14:00+00:00, run_id=scheduled__2024-04-15T00:14:00+00:00, run_start_date=2024-04-15 00:15:00.796830+00:00, run_end_date=2024-04-15 00:15:02.515132+00:00, run_duration=1.718302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:14:00+00:00, data_interval_end=2024-04-15 00:15:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:15:02.525508848Z [2024-04-15T00:15:02.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:15:02.571952122Z [2024-04-15T00:15:02.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:02.577543999Z [2024-04-15T00:15:02.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:14:00+00:00, map_index=-1, run_start_date=2024-04-15 00:15:01.646261+00:00, run_end_date=2024-04-15 00:15:02.042529+00:00, run_duration=0.396268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:00.892935+00:00, queued_by_job_id=1, pid=6703 2024-04-15T00:15:03.972386783Z [2024-04-15T00:15:03.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:15:03.973251897Z [2024-04-15T00:15:03.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:14:00+00:00, run_id=scheduled__2024-04-15T00:14:00+00:00, run_start_date=2024-04-15 00:15:00.798079+00:00, run_end_date=2024-04-15 00:15:03.972693+00:00, run_duration=3.174614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:14:00+00:00, data_interval_end=2024-04-15 00:15:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:15:03.987705734Z [2024-04-15T00:15:03.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:15:04.051522473Z [2024-04-15T00:15:04.051+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:15:04.051568513Z 2024-04-15T00:15:04.051574416Z [2024-04-15T00:15:04.051+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:15:04.051962615Z [2024-04-15T00:15:04.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:15:04.051971535Z 2024-04-15T00:15:04.053807478Z [2024-04-15T00:15:04.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:15:04.053925662Z [2024-04-15T00:15:04.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:15:04.120277432Z [2024-04-15T00:15:04.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:04.120698319Z [2024-04-15T00:15:04.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:04.121984888Z [2024-04-15T00:15:04.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:04.135522733Z [2024-04-15T00:15:04.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:14:00+00:00, map_index=-1, run_start_date=2024-04-15 00:15:02.657561+00:00, run_end_date=2024-04-15 00:15:03.815131+00:00, run_duration=1.15757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:00.892935+00:00, queued_by_job_id=1, pid=6728 2024-04-15T00:15:04.135978258Z [2024-04-15T00:15:04.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 445b0539-e759-4c8a-8a26-6de601bf4b91 2024-04-15T00:15:04.136454120Z [2024-04-15T00:15:04.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=-1, run_start_date=2024-04-15 00:15:02.651960+00:00, run_end_date=2024-04-15 00:15:03.000796+00:00, run_duration=0.348836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:00.892935+00:00, queued_by_job_id=1, pid=6727 2024-04-15T00:15:05.289618656Z [2024-04-15T00:15:05.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:15:05.289642891Z [2024-04-15T00:15:05.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:14:00+00:00, run_id=scheduled__2024-04-15T00:14:00+00:00, run_start_date=2024-04-15 00:15:00.799360+00:00, run_end_date=2024-04-15 00:15:05.288839+00:00, run_duration=4.489479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:14:00+00:00, data_interval_end=2024-04-15 00:15:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:15:05.302969724Z [2024-04-15T00:15:05.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:15:05.334032869Z [2024-04-15T00:15:05.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:05.338150342Z [2024-04-15T00:15:05.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:14:00+00:00, map_index=-1, run_start_date=2024-04-15 00:15:02.658645+00:00, run_end_date=2024-04-15 00:15:04.260400+00:00, run_duration=1.601755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:00.892935+00:00, queued_by_job_id=1, pid=6729 2024-04-15T00:15:06.437094988Z [2024-04-15T00:15:06.434+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:15:06.437132513Z 2024-04-15T00:15:06.437339948Z [2024-04-15T00:15:06.436+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:15:06.439109738Z [2024-04-15T00:15:06.438+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:15:06.439162344Z 2024-04-15T00:15:06.443042996Z [2024-04-15T00:15:06.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:15:06.443194272Z [2024-04-15T00:15:06.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:15:06.516814735Z [2024-04-15T00:15:06.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:06.516906799Z [2024-04-15T00:15:06.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:06.529996699Z [2024-04-15T00:15:06.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22db98e1-4f28-44d5-9d98-4c3465c55df8 2024-04-15T00:15:06.530519220Z [2024-04-15T00:15:06.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=-1, run_start_date=2024-04-15 00:15:05.638269+00:00, run_end_date=2024-04-15 00:15:05.986300+00:00, run_duration=0.348031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:04.052157+00:00, queued_by_job_id=1, pid=6752 2024-04-15T00:15:09.105435928Z [2024-04-15T00:15:09.104+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:15:09.105466220Z 2024-04-15T00:15:09.105472763Z [2024-04-15T00:15:09.104+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:15:09.105568432Z [2024-04-15T00:15:09.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:15:09.105576419Z 2024-04-15T00:15:09.107878080Z [2024-04-15T00:15:09.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:15:09.107892374Z [2024-04-15T00:15:09.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:15:09.158027188Z [2024-04-15T00:15:09.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:09.158233305Z [2024-04-15T00:15:09.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:09.165511831Z [2024-04-15T00:15:09.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6d48612-ad48-452a-86cb-ec31b24765b8 2024-04-15T00:15:09.165757338Z [2024-04-15T00:15:09.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=0, run_start_date=2024-04-15 00:15:08.097013+00:00, run_end_date=2024-04-15 00:15:08.371346+00:00, run_duration=0.274333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:06.439746+00:00, queued_by_job_id=1, pid=6760 2024-04-15T00:15:11.861522938Z [2024-04-15T00:15:11.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:15:11.862917069Z [2024-04-15T00:15:11.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:10:00+00:00, run_id=scheduled__2024-04-15T00:10:00+00:00, run_start_date=2024-04-15 00:15:00.795470+00:00, run_end_date=2024-04-15 00:15:11.861328+00:00, run_duration=11.065858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:10:00+00:00, data_interval_end=2024-04-15 00:15:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:15:11.877813187Z [2024-04-15T00:15:11.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:15:11.915642127Z [2024-04-15T00:15:11.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:10:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:11.920433686Z [2024-04-15T00:15:11.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:10:00+00:00, map_index=-1, run_start_date=2024-04-15 00:15:10.585926+00:00, run_end_date=2024-04-15 00:15:10.954377+00:00, run_duration=0.368451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:09.105668+00:00, queued_by_job_id=1, pid=6768 2024-04-15T00:15:40.663612777Z [2024-04-15T00:15:40.663+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:15:40.701423711Z [2024-04-15T00:15:40.701+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:15:40.701447628Z 2024-04-15T00:15:40.701457486Z [2024-04-15T00:15:40.701+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 has 0/16 running and queued tasks 2024-04-15T00:15:40.701837076Z [2024-04-15T00:15:40.701+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:15:40.701855004Z 2024-04-15T00:15:40.703482669Z [2024-04-15T00:15:40.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:15:40.703557980Z [2024-04-15T00:15:40.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:15:40.747692480Z [2024-04-15T00:15:40.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status queued for try_number 1 2024-04-15T00:15:40.751751044Z [2024-04-15T00:15:40.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to beb0d4d8-ea4e-43c3-9187-a8f5ae6dfd6a 2024-04-15T00:15:41.865532044Z [2024-04-15T00:15:41.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:15:41.865739662Z [2024-04-15T00:15:41.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, execution_date=2024-04-15 00:14:00+00:00, run_id=scheduled__2024-04-15T00:14:00+00:00, run_start_date=2024-04-15 00:15:40.677716+00:00, run_end_date=2024-04-15 00:15:41.865387+00:00, run_duration=1.187671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:14:00+00:00, data_interval_end=2024-04-15 00:15:00+00:00, dag_hash=098e2fd0245e099cb80f1d5158d3ed4f 2024-04-15T00:15:41.872479751Z [2024-04-15T00:15:41.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 to 2024-04-15T00:15:00+00:00, run_after=2024-04-15T00:16:00+00:00 2024-04-15T00:15:41.896256253Z [2024-04-15T00:15:41.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status success for try_number 1 2024-04-15T00:15:41.907954593Z [2024-04-15T00:15:41.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:14:00+00:00, map_index=-1, run_start_date=2024-04-15 00:15:41.315322+00:00, run_end_date=2024-04-15 00:15:41.669825+00:00, run_duration=0.354503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:15:40.702077+00:00, queued_by_job_id=1, pid=6775 2024-04-15T00:16:01.036090609Z [2024-04-15T00:16:01.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:17:00+00:00 2024-04-15T00:16:01.047741811Z [2024-04-15T00:16:01.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:17:00+00:00 2024-04-15T00:16:01.053291655Z [2024-04-15T00:16:01.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:16:01.057930064Z [2024-04-15T00:16:01.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:16:01.066597479Z [2024-04-15T00:16:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:17:00+00:00 2024-04-15T00:16:01.132431475Z [2024-04-15T00:16:01.131+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T00:16:01.132472856Z 2024-04-15T00:16:01.132484456Z 2024-04-15T00:16:01.132493398Z 2024-04-15T00:16:01.132502110Z 2024-04-15T00:16:01.132511040Z 2024-04-15T00:16:01.133271334Z [2024-04-15T00:16:01.132+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:16:01.133554608Z [2024-04-15T00:16:01.133+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 has 0/16 running and queued tasks 2024-04-15T00:16:01.133780711Z [2024-04-15T00:16:01.133+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:16:01.134005484Z [2024-04-15T00:16:01.133+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:16:01.134214760Z [2024-04-15T00:16:01.134+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:16:01.136049234Z [2024-04-15T00:16:01.135+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:16:01.136073525Z 2024-04-15T00:16:01.136083168Z 2024-04-15T00:16:01.136091934Z 2024-04-15T00:16:01.136100681Z 2024-04-15T00:16:01.136109293Z 2024-04-15T00:16:01.143258246Z [2024-04-15T00:16:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:16:01.143365635Z [2024-04-15T00:16:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:16:01.143708389Z [2024-04-15T00:16:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:16:01.143852602Z [2024-04-15T00:16:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:16:01.144153686Z [2024-04-15T00:16:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:16:01.144288498Z [2024-04-15T00:16:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:16:01.144564348Z [2024-04-15T00:16:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:16:01.144693619Z [2024-04-15T00:16:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:16:01.144971490Z [2024-04-15T00:16:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:16:01.145098510Z [2024-04-15T00:16:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:16:01.736515297Z [2024-04-15T00:16:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status queued for try_number 1 2024-04-15T00:16:01.736599484Z [2024-04-15T00:16:01.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:16:01.736657994Z [2024-04-15T00:16:01.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:16:01.736742592Z [2024-04-15T00:16:01.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:16:01.736789204Z [2024-04-15T00:16:01.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:16:01.750848306Z [2024-04-15T00:16:01.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68248376-9d72-4af2-a9ba-1f765b7a7d1d 2024-04-15T00:16:01.751027097Z [2024-04-15T00:16:01.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to def82f73-1f62-4c42-9950-f84eaa332832 2024-04-15T00:16:01.751164589Z [2024-04-15T00:16:01.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdedf6bb-1a95-4128-9fd7-af6473a1d44b 2024-04-15T00:16:01.751317327Z [2024-04-15T00:16:01.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cabdb7c-c1b2-49b2-ac2d-0d570338b868 2024-04-15T00:16:01.751399150Z [2024-04-15T00:16:01.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94bbc7d8-fb83-4ceb-88ca-b9b2d793ead0 2024-04-15T00:16:02.345775792Z [2024-04-15T00:16:02.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:16:02.345998395Z [2024-04-15T00:16:02.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:14:00+00:00, run_id=scheduled__2024-04-15T00:14:00+00:00, run_start_date=2024-04-15 00:16:01.074701+00:00, run_end_date=2024-04-15 00:16:02.345728+00:00, run_duration=1.271027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:14:00+00:00, data_interval_end=2024-04-15 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:16:02.354041902Z [2024-04-15T00:16:02.353+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:16:02.374926288Z [2024-04-15T00:16:02.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:16:02.375054002Z [2024-04-15T00:16:02.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:15:00+00:00, run_id=scheduled__2024-04-15T00:15:00+00:00, run_start_date=2024-04-15 00:16:01.075930+00:00, run_end_date=2024-04-15 00:16:02.374834+00:00, run_duration=1.298904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:15:00+00:00, data_interval_end=2024-04-15 00:16:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:16:02.383860475Z [2024-04-15T00:16:02.383+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:17:00+00:00 2024-04-15T00:16:02.463656396Z [2024-04-15T00:16:02.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:14:00+00:00 exited with status success for try_number 1 2024-04-15T00:16:02.467878285Z [2024-04-15T00:16:02.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:14:00+00:00, map_index=-1, run_start_date=2024-04-15 00:16:01.994351+00:00, run_end_date=2024-04-15 00:16:02.316086+00:00, run_duration=0.321735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:16:01.139513+00:00, queued_by_job_id=1, pid=6810 2024-04-15T00:16:02.479374897Z [2024-04-15T00:16:02.479+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:16:03.522397127Z [2024-04-15T00:16:03.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:16:03.522704722Z [2024-04-15T00:16:03.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, execution_date=2024-04-15 00:15:00+00:00, run_id=scheduled__2024-04-15T00:15:00+00:00, run_start_date=2024-04-15 00:16:01.076758+00:00, run_end_date=2024-04-15 00:16:03.522404+00:00, run_duration=2.445646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:15:00+00:00, data_interval_end=2024-04-15 00:16:00+00:00, dag_hash=098e2fd0245e099cb80f1d5158d3ed4f 2024-04-15T00:16:03.529327526Z [2024-04-15T00:16:03.529+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:17:00+00:00 2024-04-15T00:16:03.570618143Z [2024-04-15T00:16:03.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:16:03.570841122Z [2024-04-15T00:16:03.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:16:03.577875557Z [2024-04-15T00:16:03.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=-1, run_start_date=2024-04-15 00:16:01.957049+00:00, run_end_date=2024-04-15 00:16:02.357764+00:00, run_duration=0.400715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:16:01.139513+00:00, queued_by_job_id=1, pid=6809 2024-04-15T00:16:03.578230712Z [2024-04-15T00:16:03.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=-1, run_start_date=2024-04-15 00:16:02.011062+00:00, run_end_date=2024-04-15 00:16:02.353219+00:00, run_duration=0.342157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:16:01.139513+00:00, queued_by_job_id=1, pid=6811 2024-04-15T00:16:05.029141642Z [2024-04-15T00:16:05.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:16:05.029530700Z [2024-04-15T00:16:05.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:15:00+00:00, run_id=scheduled__2024-04-15T00:15:00+00:00, run_start_date=2024-04-15 00:16:01.077626+00:00, run_end_date=2024-04-15 00:16:05.028998+00:00, run_duration=3.951372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:15:00+00:00, data_interval_end=2024-04-15 00:16:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:16:05.042991311Z [2024-04-15T00:16:05.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:17:00+00:00 2024-04-15T00:16:05.052075685Z [2024-04-15T00:16:05.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:16:05.052142132Z [2024-04-15T00:16:05.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:15:00+00:00, run_id=scheduled__2024-04-15T00:15:00+00:00, run_start_date=2024-04-15 00:16:01.078471+00:00, run_end_date=2024-04-15 00:16:05.051885+00:00, run_duration=3.973414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:15:00+00:00, data_interval_end=2024-04-15 00:16:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:16:05.061074647Z [2024-04-15T00:16:05.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:16:00+00:00, run_after=2024-04-15T00:17:00+00:00 2024-04-15T00:16:05.115522796Z [2024-04-15T00:16:05.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:16:05.125756212Z [2024-04-15T00:16:05.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=-1, run_start_date=2024-04-15 00:16:03.111795+00:00, run_end_date=2024-04-15 00:16:04.451907+00:00, run_duration=1.340112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:16:01.139513+00:00, queued_by_job_id=1, pid=6839 2024-04-15T00:16:06.213085559Z [2024-04-15T00:16:06.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:16:06.220304122Z [2024-04-15T00:16:06.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=-1, run_start_date=2024-04-15 00:16:03.160343+00:00, run_end_date=2024-04-15 00:16:04.947708+00:00, run_duration=1.787365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:16:01.139513+00:00, queued_by_job_id=1, pid=6840 2024-04-15T00:17:00.243866724Z [2024-04-15T00:17:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:17:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:17:00.253526442Z [2024-04-15T00:17:00.253+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:17:00.265201208Z [2024-04-15T00:17:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 to 2024-04-15T00:17:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:17:00.276708555Z [2024-04-15T00:17:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:17:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:17:00.371235144Z [2024-04-15T00:17:00.369+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:17:00.371253319Z 2024-04-15T00:17:00.371256657Z 2024-04-15T00:17:00.371259554Z 2024-04-15T00:17:00.371262842Z 2024-04-15T00:17:00.371265528Z [2024-04-15T00:17:00.370+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:17:00.371268778Z [2024-04-15T00:17:00.370+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:17:00.371271540Z [2024-04-15T00:17:00.370+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 has 0/16 running and queued tasks 2024-04-15T00:17:00.371274114Z [2024-04-15T00:17:00.370+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:17:00.371277254Z [2024-04-15T00:17:00.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:17:00.371279855Z 2024-04-15T00:17:00.371326744Z 2024-04-15T00:17:00.371330929Z 2024-04-15T00:17:00.371333598Z 2024-04-15T00:17:00.373703794Z [2024-04-15T00:17:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:17:00.373769515Z [2024-04-15T00:17:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:17:00.373958260Z [2024-04-15T00:17:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:17:00.374024815Z [2024-04-15T00:17:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:17:00.374533398Z [2024-04-15T00:17:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:17:00.374537748Z [2024-04-15T00:17:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:17:00.374540891Z [2024-04-15T00:17:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:17:00.374615943Z [2024-04-15T00:17:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:17:00.615320569Z [2024-04-15T00:17:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status queued for try_number 1 2024-04-15T00:17:00.616874214Z [2024-04-15T00:17:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status queued for try_number 1 2024-04-15T00:17:00.616894335Z [2024-04-15T00:17:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status queued for try_number 1 2024-04-15T00:17:00.616965676Z [2024-04-15T00:17:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status queued for try_number 1 2024-04-15T00:17:00.624407427Z [2024-04-15T00:17:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20673fdf-5811-4e07-8d24-feef22eb9dd1 2024-04-15T00:17:00.624488947Z [2024-04-15T00:17:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 803736cf-0fe6-4dcd-a73a-1a2570af3fed 2024-04-15T00:17:00.624564092Z [2024-04-15T00:17:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ee10d13-d349-4f0e-9067-944520b8e1ca 2024-04-15T00:17:00.624646103Z [2024-04-15T00:17:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6703dbed-1054-41ca-8308-b2365db722ad 2024-04-15T00:17:01.799906956Z [2024-04-15T00:17:01.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:17:01.800376275Z [2024-04-15T00:17:01.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:16:00+00:00, run_id=scheduled__2024-04-15T00:16:00+00:00, run_start_date=2024-04-15 00:17:00.288349+00:00, run_end_date=2024-04-15 00:17:01.799915+00:00, run_duration=1.511566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:16:00+00:00, data_interval_end=2024-04-15 00:17:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:17:01.810307940Z [2024-04-15T00:17:01.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:17:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:17:01.851059611Z [2024-04-15T00:17:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status success for try_number 1 2024-04-15T00:17:01.851183570Z [2024-04-15T00:17:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status failed for try_number 1 2024-04-15T00:17:01.856716492Z [2024-04-15T00:17:01.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:17:00.371597+00:00, queued_by_job_id=1, pid=None 2024-04-15T00:17:01.857314810Z [2024-04-15T00:17:01.857+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T00:17:01.859246498Z [2024-04-15T00:17:01.859+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T00:17:01.869770270Z [2024-04-15T00:17:01.869+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240415T001600, start_date=, end_date=20240415T001701 2024-04-15T00:17:01.876041007Z [2024-04-15T00:17:01.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:16:00+00:00, map_index=-1, run_start_date=2024-04-15 00:17:01.075707+00:00, run_end_date=2024-04-15 00:17:01.447782+00:00, run_duration=0.372075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:17:00.371597+00:00, queued_by_job_id=1, pid=6883 2024-04-15T00:17:04.026492518Z [2024-04-15T00:17:04.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:17:04.027394684Z [2024-04-15T00:17:04.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:16:00+00:00, run_id=scheduled__2024-04-15T00:16:00+00:00, run_start_date=2024-04-15 00:17:00.292061+00:00, run_end_date=2024-04-15 00:17:04.026363+00:00, run_duration=3.734302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:16:00+00:00, data_interval_end=2024-04-15 00:17:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:17:04.042103831Z [2024-04-15T00:17:04.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:17:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:17:04.049672771Z [2024-04-15T00:17:04.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:17:04.049854770Z [2024-04-15T00:17:04.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:16:00+00:00, run_id=scheduled__2024-04-15T00:16:00+00:00, run_start_date=2024-04-15 00:17:00.290960+00:00, run_end_date=2024-04-15 00:17:04.049517+00:00, run_duration=3.758557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:16:00+00:00, data_interval_end=2024-04-15 00:17:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:17:04.061789827Z [2024-04-15T00:17:04.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:17:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:17:04.102097139Z [2024-04-15T00:17:04.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status success for try_number 1 2024-04-15T00:17:04.102278527Z [2024-04-15T00:17:04.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status success for try_number 1 2024-04-15T00:17:04.109889184Z [2024-04-15T00:17:04.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:16:00+00:00, map_index=-1, run_start_date=2024-04-15 00:17:02.078350+00:00, run_end_date=2024-04-15 00:17:03.600328+00:00, run_duration=1.521978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:17:00.371597+00:00, queued_by_job_id=1, pid=6901 2024-04-15T00:17:04.110135059Z [2024-04-15T00:17:04.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:16:00+00:00, map_index=-1, run_start_date=2024-04-15 00:17:02.102301+00:00, run_end_date=2024-04-15 00:17:03.327547+00:00, run_duration=1.225246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:17:00.371597+00:00, queued_by_job_id=1, pid=6902 2024-04-15T00:17:12.124152680Z [2024-04-15T00:17:12.123+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:17:12.124202694Z 2024-04-15T00:17:12.124593505Z [2024-04-15T00:17:12.124+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 has 0/16 running and queued tasks 2024-04-15T00:17:12.125779698Z [2024-04-15T00:17:12.125+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:17:12.125811193Z 2024-04-15T00:17:12.129871289Z [2024-04-15T00:17:12.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:16:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:17:12.130338739Z [2024-04-15T00:17:12.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_3551244e-46ca-4b43-982d-96f330d61969', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:17:12.207980730Z [2024-04-15T00:17:12.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status queued for try_number 2 2024-04-15T00:17:12.214043166Z [2024-04-15T00:17:12.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5da87e3-42d2-42a7-b408-c4c055899209 2024-04-15T00:17:13.388857277Z [2024-04-15T00:17:13.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_3551244e-46ca-4b43-982d-96f330d61969.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status failed for try_number 2 2024-04-15T00:17:13.396214793Z [2024-04-15T00:17:13.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 00:17:01.861116+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:17:12.126483+00:00, queued_by_job_id=1, pid=None 2024-04-15T00:17:13.396940076Z [2024-04-15T00:17:13.396+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T00:17:13.399881525Z [2024-04-15T00:17:13.399+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T00:17:13.415299986Z [2024-04-15T00:17:13.415+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240415T001600, start_date=, end_date=20240415T001713 2024-04-15T00:17:14.469953249Z [2024-04-15T00:17:14.469+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T00:17:14.470452113Z [2024-04-15T00:17:14.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_3551244e-46ca-4b43-982d-96f330d61969, execution_date=2024-04-15 00:16:00+00:00, run_id=scheduled__2024-04-15T00:16:00+00:00, run_start_date=2024-04-15 00:17:00.289878+00:00, run_end_date=2024-04-15 00:17:14.469888+00:00, run_duration=14.18001, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:16:00+00:00, data_interval_end=2024-04-15 00:17:00+00:00, dag_hash=098e2fd0245e099cb80f1d5158d3ed4f 2024-04-15T00:17:14.486753388Z [2024-04-15T00:17:14.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_3551244e-46ca-4b43-982d-96f330d61969 to 2024-04-15T00:17:00+00:00, run_after=2024-04-15T00:18:00+00:00 2024-04-15T00:18:00.661174954Z [2024-04-15T00:18:00.660+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:18:00.691703216Z [2024-04-15T00:18:00.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:18:00+00:00, run_after=2024-04-15T00:19:00+00:00 2024-04-15T00:18:00.703570431Z [2024-04-15T00:18:00.703+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:18:00.719753518Z [2024-04-15T00:18:00.719+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:18:00+00:00, run_after=2024-04-15T00:19:00+00:00 2024-04-15T00:18:00.825904617Z [2024-04-15T00:18:00.825+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:18:00.825940027Z 2024-04-15T00:18:00.825948808Z 2024-04-15T00:18:00.825955731Z 2024-04-15T00:18:00.825962248Z 2024-04-15T00:18:00.825969539Z [2024-04-15T00:18:00.825+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:18:00.826066990Z [2024-04-15T00:18:00.825+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:18:00.826096257Z [2024-04-15T00:18:00.825+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:18:00.826234623Z [2024-04-15T00:18:00.826+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:18:00.826911787Z [2024-04-15T00:18:00.826+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:18:00.826925245Z 2024-04-15T00:18:00.826932249Z 2024-04-15T00:18:00.826939186Z 2024-04-15T00:18:00.826945817Z 2024-04-15T00:18:00.831846954Z [2024-04-15T00:18:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:18:00.831887848Z [2024-04-15T00:18:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:18:00.832211601Z [2024-04-15T00:18:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:18:00.832305448Z [2024-04-15T00:18:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:18:00.833064413Z [2024-04-15T00:18:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:18:00.833268300Z [2024-04-15T00:18:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:18:00.833578671Z [2024-04-15T00:18:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:18:00.833666649Z [2024-04-15T00:18:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:18:01.070596500Z [2024-04-15T00:18:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status queued for try_number 1 2024-04-15T00:18:01.070806980Z [2024-04-15T00:18:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:17:00+00:00 exited with status queued for try_number 1 2024-04-15T00:18:01.071019452Z [2024-04-15T00:18:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:17:00+00:00 exited with status queued for try_number 1 2024-04-15T00:18:01.071189842Z [2024-04-15T00:18:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:17:00+00:00 exited with status queued for try_number 1 2024-04-15T00:18:01.077950950Z [2024-04-15T00:18:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4edae28-970e-4297-a477-3f4c6f91136d 2024-04-15T00:18:01.078161920Z [2024-04-15T00:18:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43e27f16-c77f-444a-a0a6-44c026b2afca 2024-04-15T00:18:01.078356663Z [2024-04-15T00:18:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83be7e4f-4f03-4aa8-af3b-cc1ae90f28af 2024-04-15T00:18:01.078541203Z [2024-04-15T00:18:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to b66d2bd8-31c3-41ba-ab2a-d4661bc0181c 2024-04-15T00:18:02.228755333Z [2024-04-15T00:18:02.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:18:02.229243791Z [2024-04-15T00:18:02.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:16:00+00:00, run_id=scheduled__2024-04-15T00:16:00+00:00, run_start_date=2024-04-15 00:18:00.734463+00:00, run_end_date=2024-04-15 00:18:02.228654+00:00, run_duration=1.494191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:16:00+00:00, data_interval_end=2024-04-15 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:18:02.236107154Z [2024-04-15T00:18:02.235+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:18:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:18:02.276491716Z [2024-04-15T00:18:02.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:18:02.276944123Z [2024-04-15T00:18:02.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:17:00+00:00, run_id=scheduled__2024-04-15T00:17:00+00:00, run_start_date=2024-04-15 00:18:00.736017+00:00, run_end_date=2024-04-15 00:18:02.276458+00:00, run_duration=1.540441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:17:00+00:00, data_interval_end=2024-04-15 00:18:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:18:02.291893016Z [2024-04-15T00:18:02.291+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:18:00+00:00, run_after=2024-04-15T00:19:00+00:00 2024-04-15T00:18:02.330106875Z [2024-04-15T00:18:02.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:16:00+00:00 exited with status success for try_number 1 2024-04-15T00:18:02.330176553Z [2024-04-15T00:18:02.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:17:00+00:00 exited with status success for try_number 1 2024-04-15T00:18:02.336292844Z [2024-04-15T00:18:02.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:16:00+00:00, map_index=-1, run_start_date=2024-04-15 00:18:01.626671+00:00, run_end_date=2024-04-15 00:18:01.947496+00:00, run_duration=0.320825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:18:00.827847+00:00, queued_by_job_id=1, pid=6946 2024-04-15T00:18:02.336541525Z [2024-04-15T00:18:02.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:17:00+00:00, map_index=-1, run_start_date=2024-04-15 00:18:01.652742+00:00, run_end_date=2024-04-15 00:18:02.047005+00:00, run_duration=0.394263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:18:00.827847+00:00, queued_by_job_id=1, pid=6947 2024-04-15T00:18:04.520810108Z [2024-04-15T00:18:04.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:18:04.520971106Z [2024-04-15T00:18:04.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:17:00+00:00, run_id=scheduled__2024-04-15T00:17:00+00:00, run_start_date=2024-04-15 00:18:00.737382+00:00, run_end_date=2024-04-15 00:18:04.520645+00:00, run_duration=3.783263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:17:00+00:00, data_interval_end=2024-04-15 00:18:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:18:04.528694949Z [2024-04-15T00:18:04.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:18:00+00:00, run_after=2024-04-15T00:19:00+00:00 2024-04-15T00:18:04.534012347Z [2024-04-15T00:18:04.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:18:04.534162736Z [2024-04-15T00:18:04.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:17:00+00:00, run_id=scheduled__2024-04-15T00:17:00+00:00, run_start_date=2024-04-15 00:18:00.738562+00:00, run_end_date=2024-04-15 00:18:04.533862+00:00, run_duration=3.7953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:17:00+00:00, data_interval_end=2024-04-15 00:18:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:18:04.541790714Z [2024-04-15T00:18:04.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:18:00+00:00, run_after=2024-04-15T00:19:00+00:00 2024-04-15T00:18:04.577409461Z [2024-04-15T00:18:04.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:17:00+00:00 exited with status success for try_number 1 2024-04-15T00:18:04.577591843Z [2024-04-15T00:18:04.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:17:00+00:00 exited with status success for try_number 1 2024-04-15T00:18:04.585075404Z [2024-04-15T00:18:04.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:17:00+00:00, map_index=-1, run_start_date=2024-04-15 00:18:02.633306+00:00, run_end_date=2024-04-15 00:18:03.847865+00:00, run_duration=1.214559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:18:00.827847+00:00, queued_by_job_id=1, pid=6976 2024-04-15T00:18:04.585431898Z [2024-04-15T00:18:04.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:17:00+00:00, map_index=-1, run_start_date=2024-04-15 00:18:02.379788+00:00, run_end_date=2024-04-15 00:18:03.899217+00:00, run_duration=1.519429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:18:00.827847+00:00, queued_by_job_id=1, pid=6965 2024-04-15T00:19:00.318950468Z [2024-04-15T00:19:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:19:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:19:00.342594400Z [2024-04-15T00:19:00.341+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:19:00.359110371Z [2024-04-15T00:19:00.357+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:19:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:19:00.410325658Z [2024-04-15T00:19:00.410+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:19:00.410349758Z 2024-04-15T00:19:00.410353520Z 2024-04-15T00:19:00.410356620Z 2024-04-15T00:19:00.410538538Z [2024-04-15T00:19:00.410+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:19:00.410720383Z [2024-04-15T00:19:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:19:00.410902985Z [2024-04-15T00:19:00.410+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:19:00.411446645Z [2024-04-15T00:19:00.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:19:00.411457870Z 2024-04-15T00:19:00.411461318Z 2024-04-15T00:19:00.411476713Z 2024-04-15T00:19:00.414334093Z [2024-04-15T00:19:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:19:00.414576616Z [2024-04-15T00:19:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:19:00.414894676Z [2024-04-15T00:19:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:19:00.415097617Z [2024-04-15T00:19:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:19:00.415380850Z [2024-04-15T00:19:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:19:00.415573193Z [2024-04-15T00:19:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:19:00.603293560Z [2024-04-15T00:19:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status queued for try_number 1 2024-04-15T00:19:00.603390007Z [2024-04-15T00:19:00.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status queued for try_number 1 2024-04-15T00:19:00.603516777Z [2024-04-15T00:19:00.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status queued for try_number 1 2024-04-15T00:19:00.609914287Z [2024-04-15T00:19:00.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 231a3f0d-6f00-4574-93c4-8f5cf6a4ca7a 2024-04-15T00:19:00.610061613Z [2024-04-15T00:19:00.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 859aebcb-c8e1-48fe-80d6-32d6a0c690fe 2024-04-15T00:19:00.610230549Z [2024-04-15T00:19:00.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f88c2fc-b933-4489-a4e9-d606ab36f3cf 2024-04-15T00:19:02.082678735Z [2024-04-15T00:19:02.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:19:02.084358394Z [2024-04-15T00:19:02.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:18:00+00:00, run_id=scheduled__2024-04-15T00:18:00+00:00, run_start_date=2024-04-15 00:19:00.365861+00:00, run_end_date=2024-04-15 00:19:02.082600+00:00, run_duration=1.716739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:18:00+00:00, data_interval_end=2024-04-15 00:19:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:19:02.097162450Z [2024-04-15T00:19:02.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:19:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:19:02.145640273Z [2024-04-15T00:19:02.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status success for try_number 1 2024-04-15T00:19:02.158813584Z [2024-04-15T00:19:02.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:18:00+00:00, map_index=-1, run_start_date=2024-04-15 00:19:01.105509+00:00, run_end_date=2024-04-15 00:19:01.433946+00:00, run_duration=0.328437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:19:00.412137+00:00, queued_by_job_id=1, pid=7003 2024-04-15T00:19:04.337829359Z [2024-04-15T00:19:04.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:19:04.337864340Z [2024-04-15T00:19:04.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:18:00+00:00, run_id=scheduled__2024-04-15T00:18:00+00:00, run_start_date=2024-04-15 00:19:00.366845+00:00, run_end_date=2024-04-15 00:19:04.335886+00:00, run_duration=3.969041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:18:00+00:00, data_interval_end=2024-04-15 00:19:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:19:04.357464031Z [2024-04-15T00:19:04.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:19:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:19:04.371145846Z [2024-04-15T00:19:04.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:19:04.371459235Z [2024-04-15T00:19:04.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:18:00+00:00, run_id=scheduled__2024-04-15T00:18:00+00:00, run_start_date=2024-04-15 00:19:00.367727+00:00, run_end_date=2024-04-15 00:19:04.370940+00:00, run_duration=4.003213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:18:00+00:00, data_interval_end=2024-04-15 00:19:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:19:04.388050578Z [2024-04-15T00:19:04.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:19:00+00:00, run_after=2024-04-15T00:20:00+00:00 2024-04-15T00:19:04.424724429Z [2024-04-15T00:19:04.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status success for try_number 1 2024-04-15T00:19:04.424951712Z [2024-04-15T00:19:04.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status success for try_number 1 2024-04-15T00:19:04.430735899Z [2024-04-15T00:19:04.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:18:00+00:00, map_index=-1, run_start_date=2024-04-15 00:19:01.851755+00:00, run_end_date=2024-04-15 00:19:03.423733+00:00, run_duration=1.571978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:19:00.412137+00:00, queued_by_job_id=1, pid=7016 2024-04-15T00:19:04.431012438Z [2024-04-15T00:19:04.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:18:00+00:00, map_index=-1, run_start_date=2024-04-15 00:19:02.157535+00:00, run_end_date=2024-04-15 00:19:03.426191+00:00, run_duration=1.268656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:19:00.412137+00:00, queued_by_job_id=1, pid=7027 2024-04-15T00:20:00.731205923Z [2024-04-15T00:20:00.730+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:20:00.747701196Z [2024-04-15T00:20:00.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:21:00+00:00 2024-04-15T00:20:00.761517017Z [2024-04-15T00:20:00.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:25:00+00:00 2024-04-15T00:20:00.774515649Z [2024-04-15T00:20:00.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:21:00+00:00 2024-04-15T00:20:00.782331217Z [2024-04-15T00:20:00.781+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:20:00.893911564Z [2024-04-15T00:20:00.893+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T00:20:00.893962423Z 2024-04-15T00:20:00.893973244Z 2024-04-15T00:20:00.893982869Z 2024-04-15T00:20:00.894025500Z 2024-04-15T00:20:00.894034789Z 2024-04-15T00:20:00.894169199Z [2024-04-15T00:20:00.893+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:20:00.894324231Z [2024-04-15T00:20:00.894+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:20:00.894579587Z [2024-04-15T00:20:00.894+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:20:00.894830685Z [2024-04-15T00:20:00.894+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:20:00.895128781Z [2024-04-15T00:20:00.894+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:20:00.896325276Z [2024-04-15T00:20:00.895+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:20:00.896348034Z 2024-04-15T00:20:00.896357916Z 2024-04-15T00:20:00.896367159Z 2024-04-15T00:20:00.896375708Z 2024-04-15T00:20:00.896384207Z 2024-04-15T00:20:00.902987907Z [2024-04-15T00:20:00.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:20:00.903556876Z [2024-04-15T00:20:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:20:00.903884493Z [2024-04-15T00:20:00.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:20:00.904074155Z [2024-04-15T00:20:00.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:20:00.904379816Z [2024-04-15T00:20:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:20:00.904559953Z [2024-04-15T00:20:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:20:00.904904984Z [2024-04-15T00:20:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:20:00.905128102Z [2024-04-15T00:20:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:20:00.905418829Z [2024-04-15T00:20:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:20:00.905621489Z [2024-04-15T00:20:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:20:01.220558073Z [2024-04-15T00:20:01.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:01.222214112Z [2024-04-15T00:20:01.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:01.222379279Z [2024-04-15T00:20:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:19:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:01.222482077Z [2024-04-15T00:20:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:19:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:01.222564242Z [2024-04-15T00:20:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:19:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:01.229979447Z [2024-04-15T00:20:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44d43479-69f4-4aa8-a9dc-ec357b161e0c 2024-04-15T00:20:01.230085089Z [2024-04-15T00:20:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5afbdeed-ccbf-4ebc-b3c2-5d93ddbb3e3f 2024-04-15T00:20:01.230241723Z [2024-04-15T00:20:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f0629c4-3ec3-4bf3-a262-b64e97d20872 2024-04-15T00:20:01.230383017Z [2024-04-15T00:20:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6ca8014-fcb1-4fd3-85d2-df56e57b6a7d 2024-04-15T00:20:01.230521570Z [2024-04-15T00:20:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e8c3754-2fc8-4395-a62c-af6ee33fbc23 2024-04-15T00:20:02.915022903Z [2024-04-15T00:20:02.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:20:02.915324798Z [2024-04-15T00:20:02.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:18:00+00:00, run_id=scheduled__2024-04-15T00:18:00+00:00, run_start_date=2024-04-15 00:20:00.795553+00:00, run_end_date=2024-04-15 00:20:02.914810+00:00, run_duration=2.119257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:18:00+00:00, data_interval_end=2024-04-15 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:20:02.934832973Z [2024-04-15T00:20:02.933+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:22:00+00:00 2024-04-15T00:20:02.946999225Z [2024-04-15T00:20:02.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:20:02.947024148Z [2024-04-15T00:20:02.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:19:00+00:00, run_id=scheduled__2024-04-15T00:19:00+00:00, run_start_date=2024-04-15 00:20:00.796603+00:00, run_end_date=2024-04-15 00:20:02.943297+00:00, run_duration=2.146694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:19:00+00:00, data_interval_end=2024-04-15 00:20:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:20:02.953571873Z [2024-04-15T00:20:02.952+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:21:00+00:00 2024-04-15T00:20:03.033562591Z [2024-04-15T00:20:03.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:18:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:03.033723095Z [2024-04-15T00:20:03.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:19:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:03.045545178Z [2024-04-15T00:20:03.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:19:00+00:00, map_index=-1, run_start_date=2024-04-15 00:20:01.794596+00:00, run_end_date=2024-04-15 00:20:02.249220+00:00, run_duration=0.454624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:00.898692+00:00, queued_by_job_id=1, pid=7056 2024-04-15T00:20:03.045713384Z [2024-04-15T00:20:03.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:18:00+00:00, map_index=-1, run_start_date=2024-04-15 00:20:01.926842+00:00, run_end_date=2024-04-15 00:20:02.259114+00:00, run_duration=0.332272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:00.898692+00:00, queued_by_job_id=1, pid=7057 2024-04-15T00:20:04.207440045Z [2024-04-15T00:20:04.206+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:20:04.207483070Z 2024-04-15T00:20:04.207761482Z [2024-04-15T00:20:04.207+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:20:04.209168279Z [2024-04-15T00:20:04.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:20:04.209181628Z 2024-04-15T00:20:04.214590400Z [2024-04-15T00:20:04.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:20:04.214889225Z [2024-04-15T00:20:04.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:20:04.282483833Z [2024-04-15T00:20:04.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:04.283285619Z [2024-04-15T00:20:04.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:04.298127967Z [2024-04-15T00:20:04.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0049e8f-5bf7-4994-ae60-01e942a01ef5 2024-04-15T00:20:04.298523305Z [2024-04-15T00:20:04.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=-1, run_start_date=2024-04-15 00:20:02.775635+00:00, run_end_date=2024-04-15 00:20:03.175998+00:00, run_duration=0.400363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:00.898692+00:00, queued_by_job_id=1, pid=7082 2024-04-15T00:20:05.543367756Z [2024-04-15T00:20:05.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:20:05.543940335Z [2024-04-15T00:20:05.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:19:00+00:00, run_id=scheduled__2024-04-15T00:19:00+00:00, run_start_date=2024-04-15 00:20:00.798922+00:00, run_end_date=2024-04-15 00:20:05.543236+00:00, run_duration=4.744314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:19:00+00:00, data_interval_end=2024-04-15 00:20:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:20:05.573727797Z [2024-04-15T00:20:05.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:21:00+00:00 2024-04-15T00:20:05.587911417Z [2024-04-15T00:20:05.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:20:05.588169149Z [2024-04-15T00:20:05.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:19:00+00:00, run_id=scheduled__2024-04-15T00:19:00+00:00, run_start_date=2024-04-15 00:20:00.797697+00:00, run_end_date=2024-04-15 00:20:05.587814+00:00, run_duration=4.790117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:19:00+00:00, data_interval_end=2024-04-15 00:20:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:20:05.602091758Z [2024-04-15T00:20:05.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:21:00+00:00 2024-04-15T00:20:05.666087175Z [2024-04-15T00:20:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:19:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:05.666319904Z [2024-04-15T00:20:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:19:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:05.672864552Z [2024-04-15T00:20:05.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:19:00+00:00, map_index=-1, run_start_date=2024-04-15 00:20:02.774816+00:00, run_end_date=2024-04-15 00:20:04.344616+00:00, run_duration=1.5698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:00.898692+00:00, queued_by_job_id=1, pid=7081 2024-04-15T00:20:05.673163746Z [2024-04-15T00:20:05.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:19:00+00:00, map_index=-1, run_start_date=2024-04-15 00:20:03.163546+00:00, run_end_date=2024-04-15 00:20:04.428121+00:00, run_duration=1.264575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:00.898692+00:00, queued_by_job_id=1, pid=7098 2024-04-15T00:20:06.774534133Z [2024-04-15T00:20:06.774+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:20:06.774644689Z 2024-04-15T00:20:06.774672148Z [2024-04-15T00:20:06.774+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:20:06.775341404Z [2024-04-15T00:20:06.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:20:06.775369982Z 2024-04-15T00:20:06.778442540Z [2024-04-15T00:20:06.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:20:06.778472023Z [2024-04-15T00:20:06.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:20:06.843250078Z [2024-04-15T00:20:06.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:06.843301598Z [2024-04-15T00:20:06.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:06.848458220Z [2024-04-15T00:20:06.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84ee021d-435f-4e48-af11-541c7e00a268 2024-04-15T00:20:06.848742322Z [2024-04-15T00:20:06.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=-1, run_start_date=2024-04-15 00:20:05.748903+00:00, run_end_date=2024-04-15 00:20:06.108199+00:00, run_duration=0.359296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:04.210268+00:00, queued_by_job_id=1, pid=7111 2024-04-15T00:20:09.754739319Z [2024-04-15T00:20:09.754+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:20:09.754780599Z 2024-04-15T00:20:09.754901630Z [2024-04-15T00:20:09.754+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:20:09.755789760Z [2024-04-15T00:20:09.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:20:09.755808660Z 2024-04-15T00:20:09.758994190Z [2024-04-15T00:20:09.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:20:09.759282697Z [2024-04-15T00:20:09.758+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:20:09.829877884Z [2024-04-15T00:20:09.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status queued for try_number 1 2024-04-15T00:20:09.830452502Z [2024-04-15T00:20:09.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:09.845578929Z [2024-04-15T00:20:09.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50980e4c-2ef4-4b0e-8d2c-202077d6741a 2024-04-15T00:20:09.846218182Z [2024-04-15T00:20:09.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=0, run_start_date=2024-04-15 00:20:08.398924+00:00, run_end_date=2024-04-15 00:20:08.707202+00:00, run_duration=0.308278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:06.775977+00:00, queued_by_job_id=1, pid=7119 2024-04-15T00:20:12.334391974Z [2024-04-15T00:20:12.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:20:12.334954529Z [2024-04-15T00:20:12.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:15:00+00:00, run_id=scheduled__2024-04-15T00:15:00+00:00, run_start_date=2024-04-15 00:20:00.794413+00:00, run_end_date=2024-04-15 00:20:12.334362+00:00, run_duration=11.539949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:15:00+00:00, data_interval_end=2024-04-15 00:20:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:20:12.345112125Z [2024-04-15T00:20:12.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:20:00+00:00, run_after=2024-04-15T00:25:00+00:00 2024-04-15T00:20:12.396349466Z [2024-04-15T00:20:12.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:15:00+00:00 exited with status success for try_number 1 2024-04-15T00:20:12.406401236Z [2024-04-15T00:20:12.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:15:00+00:00, map_index=-1, run_start_date=2024-04-15 00:20:11.186862+00:00, run_end_date=2024-04-15 00:20:11.505685+00:00, run_duration=0.318823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:20:09.756201+00:00, queued_by_job_id=1, pid=7127 2024-04-15T00:21:00.097010607Z [2024-04-15T00:21:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:21:00.117015891Z [2024-04-15T00:21:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:21:00+00:00, run_after=2024-04-15T00:22:00+00:00 2024-04-15T00:21:00.131741869Z [2024-04-15T00:21:00.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:21:00+00:00, run_after=2024-04-15T00:22:00+00:00 2024-04-15T00:21:00.218136807Z [2024-04-15T00:21:00.217+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:21:00.218182533Z 2024-04-15T00:21:00.218219231Z 2024-04-15T00:21:00.218228554Z 2024-04-15T00:21:00.218290707Z [2024-04-15T00:21:00.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:21:00.219335824Z [2024-04-15T00:21:00.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:21:00.220533103Z [2024-04-15T00:21:00.220+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:21:00.222235746Z [2024-04-15T00:21:00.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:21:00.222262013Z 2024-04-15T00:21:00.222271200Z 2024-04-15T00:21:00.222280078Z 2024-04-15T00:21:00.229256934Z [2024-04-15T00:21:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:21:00.229965103Z [2024-04-15T00:21:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:21:00.230784965Z [2024-04-15T00:21:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:21:00.231555017Z [2024-04-15T00:21:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:21:00.232454951Z [2024-04-15T00:21:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:21:00.233146614Z [2024-04-15T00:21:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:21:00.555114654Z [2024-04-15T00:21:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:21:00.555248640Z [2024-04-15T00:21:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:21:00.555366976Z [2024-04-15T00:21:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:21:00.561297708Z [2024-04-15T00:21:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to a30964b5-eb2e-4c56-a750-57b966a8afb3 2024-04-15T00:21:00.561477754Z [2024-04-15T00:21:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to da25cca0-548f-4a2c-bb2d-ddd206b1a0b3 2024-04-15T00:21:00.561655305Z [2024-04-15T00:21:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0681a0cd-c5a0-47c4-93d2-a4d2c03bfba5 2024-04-15T00:21:01.686195962Z [2024-04-15T00:21:01.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:21:01.686439032Z [2024-04-15T00:21:01.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:20:00+00:00, run_id=scheduled__2024-04-15T00:20:00+00:00, run_start_date=2024-04-15 00:21:00.147808+00:00, run_end_date=2024-04-15 00:21:01.686159+00:00, run_duration=1.538351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:20:00+00:00, data_interval_end=2024-04-15 00:21:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:21:01.695734834Z [2024-04-15T00:21:01.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:21:00+00:00, run_after=2024-04-15T00:22:00+00:00 2024-04-15T00:21:01.734144884Z [2024-04-15T00:21:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:21:01.738599436Z [2024-04-15T00:21:01.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=-1, run_start_date=2024-04-15 00:21:00.972302+00:00, run_end_date=2024-04-15 00:21:01.336577+00:00, run_duration=0.364275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:21:00.224192+00:00, queued_by_job_id=1, pid=7149 2024-04-15T00:21:02.590544682Z [2024-04-15T00:21:02.589+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:21:03.648265064Z [2024-04-15T00:21:03.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:21:03.648564549Z [2024-04-15T00:21:03.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:20:00+00:00, run_id=scheduled__2024-04-15T00:20:00+00:00, run_start_date=2024-04-15 00:21:00.150229+00:00, run_end_date=2024-04-15 00:21:03.648082+00:00, run_duration=3.497853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:20:00+00:00, data_interval_end=2024-04-15 00:21:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:21:03.658173122Z [2024-04-15T00:21:03.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:21:00+00:00, run_after=2024-04-15T00:22:00+00:00 2024-04-15T00:21:03.665513251Z [2024-04-15T00:21:03.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:21:03.665791674Z [2024-04-15T00:21:03.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:20:00+00:00, run_id=scheduled__2024-04-15T00:20:00+00:00, run_start_date=2024-04-15 00:21:00.149131+00:00, run_end_date=2024-04-15 00:21:03.665393+00:00, run_duration=3.516262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:20:00+00:00, data_interval_end=2024-04-15 00:21:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:21:03.675730075Z [2024-04-15T00:21:03.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:21:00+00:00, run_after=2024-04-15T00:22:00+00:00 2024-04-15T00:21:03.707551973Z [2024-04-15T00:21:03.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:21:03.707695765Z [2024-04-15T00:21:03.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:21:03.713596347Z [2024-04-15T00:21:03.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=-1, run_start_date=2024-04-15 00:21:02.086848+00:00, run_end_date=2024-04-15 00:21:03.282558+00:00, run_duration=1.19571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:21:00.224192+00:00, queued_by_job_id=1, pid=7168 2024-04-15T00:21:03.713903267Z [2024-04-15T00:21:03.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=-1, run_start_date=2024-04-15 00:21:01.930491+00:00, run_end_date=2024-04-15 00:21:03.451717+00:00, run_duration=1.521226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:21:00.224192+00:00, queued_by_job_id=1, pid=7167 2024-04-15T00:22:01.108819885Z [2024-04-15T00:22:01.108+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:22:01.126328182Z [2024-04-15T00:22:01.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:22:00+00:00, run_after=2024-04-15T00:23:00+00:00 2024-04-15T00:22:01.136622669Z [2024-04-15T00:22:01.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:22:00+00:00, run_after=2024-04-15T00:23:00+00:00 2024-04-15T00:22:01.141633764Z [2024-04-15T00:22:01.141+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:22:01.217000339Z [2024-04-15T00:22:01.216+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:22:01.217039682Z 2024-04-15T00:22:01.217045536Z 2024-04-15T00:22:01.217049850Z 2024-04-15T00:22:01.217057846Z 2024-04-15T00:22:01.217165692Z [2024-04-15T00:22:01.216+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:22:01.217332077Z [2024-04-15T00:22:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:22:01.217493296Z [2024-04-15T00:22:01.217+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:22:01.217640554Z [2024-04-15T00:22:01.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:22:01.218306694Z [2024-04-15T00:22:01.218+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:22:01.218318513Z 2024-04-15T00:22:01.218323438Z 2024-04-15T00:22:01.218327670Z 2024-04-15T00:22:01.218331980Z 2024-04-15T00:22:01.222118454Z [2024-04-15T00:22:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:22:01.222328296Z [2024-04-15T00:22:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:22:01.222619663Z [2024-04-15T00:22:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:22:01.222784487Z [2024-04-15T00:22:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:22:01.223140370Z [2024-04-15T00:22:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:22:01.223311603Z [2024-04-15T00:22:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:22:01.223572728Z [2024-04-15T00:22:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:22:01.223723957Z [2024-04-15T00:22:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:22:01.488956570Z [2024-04-15T00:22:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:22:01.488998354Z [2024-04-15T00:22:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:21:00+00:00 exited with status queued for try_number 1 2024-04-15T00:22:01.489165274Z [2024-04-15T00:22:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:21:00+00:00 exited with status queued for try_number 1 2024-04-15T00:22:01.489311653Z [2024-04-15T00:22:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:21:00+00:00 exited with status queued for try_number 1 2024-04-15T00:22:01.504838489Z [2024-04-15T00:22:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 039bd17f-2c65-46f9-aa23-056dba3ffcfd 2024-04-15T00:22:01.505060824Z [2024-04-15T00:22:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8eea4f99-488f-4940-98c0-bffdc56405a1 2024-04-15T00:22:01.505257341Z [2024-04-15T00:22:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to c45056f8-36d1-4909-b21d-2c98684cb3a6 2024-04-15T00:22:01.505424344Z [2024-04-15T00:22:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2be162f-5e09-441c-91f2-25fa4a5c0ed1 2024-04-15T00:22:02.416741740Z [2024-04-15T00:22:02.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:22:02.417354978Z [2024-04-15T00:22:02.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:21:00+00:00, run_id=scheduled__2024-04-15T00:21:00+00:00, run_start_date=2024-04-15 00:22:01.151328+00:00, run_end_date=2024-04-15 00:22:02.416966+00:00, run_duration=1.265638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:21:00+00:00, data_interval_end=2024-04-15 00:22:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:22:02.427614856Z [2024-04-15T00:22:02.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:22:00+00:00, run_after=2024-04-15T00:23:00+00:00 2024-04-15T00:22:03.541162719Z [2024-04-15T00:22:03.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:22:03.541406963Z [2024-04-15T00:22:03.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:20:00+00:00, run_id=scheduled__2024-04-15T00:20:00+00:00, run_start_date=2024-04-15 00:22:01.150065+00:00, run_end_date=2024-04-15 00:22:03.540930+00:00, run_duration=2.390865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:20:00+00:00, data_interval_end=2024-04-15 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:22:03.551523174Z [2024-04-15T00:22:03.551+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:22:00+00:00, run_after=2024-04-15T00:24:00+00:00 2024-04-15T00:22:03.610802978Z [2024-04-15T00:22:03.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:22:03.610931934Z [2024-04-15T00:22:03.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:21:00+00:00 exited with status success for try_number 1 2024-04-15T00:22:03.621341002Z [2024-04-15T00:22:03.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:21:00+00:00, map_index=-1, run_start_date=2024-04-15 00:22:01.911193+00:00, run_end_date=2024-04-15 00:22:02.372465+00:00, run_duration=0.461272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:22:01.219296+00:00, queued_by_job_id=1, pid=7201 2024-04-15T00:22:03.621639337Z [2024-04-15T00:22:03.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=-1, run_start_date=2024-04-15 00:22:02.060976+00:00, run_end_date=2024-04-15 00:22:02.484021+00:00, run_duration=0.423045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:22:01.219296+00:00, queued_by_job_id=1, pid=7202 2024-04-15T00:22:04.667970682Z [2024-04-15T00:22:04.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:22:04.668087170Z [2024-04-15T00:22:04.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:21:00+00:00, run_id=scheduled__2024-04-15T00:21:00+00:00, run_start_date=2024-04-15 00:22:01.152421+00:00, run_end_date=2024-04-15 00:22:04.667797+00:00, run_duration=3.515376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:21:00+00:00, data_interval_end=2024-04-15 00:22:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:22:04.684062900Z [2024-04-15T00:22:04.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:22:00+00:00, run_after=2024-04-15T00:23:00+00:00 2024-04-15T00:22:04.729503565Z [2024-04-15T00:22:04.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:21:00+00:00 exited with status success for try_number 1 2024-04-15T00:22:04.739474386Z [2024-04-15T00:22:04.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:21:00+00:00, map_index=-1, run_start_date=2024-04-15 00:22:03.110842+00:00, run_end_date=2024-04-15 00:22:04.353169+00:00, run_duration=1.242327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:22:01.219296+00:00, queued_by_job_id=1, pid=7226 2024-04-15T00:22:05.079221720Z [2024-04-15T00:22:05.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:22:05.079558118Z [2024-04-15T00:22:05.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:21:00+00:00, run_id=scheduled__2024-04-15T00:21:00+00:00, run_start_date=2024-04-15 00:22:01.153338+00:00, run_end_date=2024-04-15 00:22:05.079017+00:00, run_duration=3.925679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:21:00+00:00, data_interval_end=2024-04-15 00:22:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:22:05.092635846Z [2024-04-15T00:22:05.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:22:00+00:00, run_after=2024-04-15T00:23:00+00:00 2024-04-15T00:22:05.139983460Z [2024-04-15T00:22:05.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:21:00+00:00 exited with status success for try_number 1 2024-04-15T00:22:05.150318912Z [2024-04-15T00:22:05.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:21:00+00:00, map_index=-1, run_start_date=2024-04-15 00:22:03.045371+00:00, run_end_date=2024-04-15 00:22:04.606752+00:00, run_duration=1.561381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:22:01.219296+00:00, queued_by_job_id=1, pid=7225 2024-04-15T00:23:01.008868618Z [2024-04-15T00:23:01.008+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:23:01.023872836Z [2024-04-15T00:23:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:23:00+00:00, run_after=2024-04-15T00:24:00+00:00 2024-04-15T00:23:01.036963421Z [2024-04-15T00:23:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:23:00+00:00, run_after=2024-04-15T00:24:00+00:00 2024-04-15T00:23:01.115050279Z [2024-04-15T00:23:01.114+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:23:01.115098727Z 2024-04-15T00:23:01.115106248Z 2024-04-15T00:23:01.115111926Z 2024-04-15T00:23:01.115455151Z [2024-04-15T00:23:01.114+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:23:01.115672098Z [2024-04-15T00:23:01.115+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:23:01.115883815Z [2024-04-15T00:23:01.115+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:23:01.116606597Z [2024-04-15T00:23:01.116+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:23:01.116615273Z 2024-04-15T00:23:01.116621195Z 2024-04-15T00:23:01.116626657Z 2024-04-15T00:23:01.121244959Z [2024-04-15T00:23:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:23:01.121406505Z [2024-04-15T00:23:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:23:01.121673835Z [2024-04-15T00:23:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:23:01.121925322Z [2024-04-15T00:23:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:23:01.122170019Z [2024-04-15T00:23:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:23:01.122300648Z [2024-04-15T00:23:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:23:01.372958027Z [2024-04-15T00:23:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status queued for try_number 1 2024-04-15T00:23:01.372993995Z [2024-04-15T00:23:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status queued for try_number 1 2024-04-15T00:23:01.373137496Z [2024-04-15T00:23:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status queued for try_number 1 2024-04-15T00:23:01.379144944Z [2024-04-15T00:23:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7984087-bdc0-4dfd-95c7-4f31c8db7798 2024-04-15T00:23:01.379245670Z [2024-04-15T00:23:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b66baca-9fb0-4a88-846c-2cc4e699a62e 2024-04-15T00:23:01.379407781Z [2024-04-15T00:23:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4647d3f-f756-4b43-a2a0-53d62fa42bc9 2024-04-15T00:23:02.588245016Z [2024-04-15T00:23:02.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:23:02.588500209Z [2024-04-15T00:23:02.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:22:00+00:00, run_id=scheduled__2024-04-15T00:22:00+00:00, run_start_date=2024-04-15 00:23:01.050206+00:00, run_end_date=2024-04-15 00:23:02.588094+00:00, run_duration=1.537888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:22:00+00:00, data_interval_end=2024-04-15 00:23:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:23:02.613493893Z [2024-04-15T00:23:02.612+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:23:00+00:00, run_after=2024-04-15T00:24:00+00:00 2024-04-15T00:23:02.699775923Z [2024-04-15T00:23:02.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status success for try_number 1 2024-04-15T00:23:02.708896744Z [2024-04-15T00:23:02.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:22:00+00:00, map_index=-1, run_start_date=2024-04-15 00:23:01.810449+00:00, run_end_date=2024-04-15 00:23:02.154315+00:00, run_duration=0.343866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:23:01.117797+00:00, queued_by_job_id=1, pid=7258 2024-04-15T00:23:04.863288090Z [2024-04-15T00:23:04.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:23:04.864051861Z [2024-04-15T00:23:04.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:22:00+00:00, run_id=scheduled__2024-04-15T00:22:00+00:00, run_start_date=2024-04-15 00:23:01.051545+00:00, run_end_date=2024-04-15 00:23:04.862864+00:00, run_duration=3.811319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:22:00+00:00, data_interval_end=2024-04-15 00:23:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:23:04.873801787Z [2024-04-15T00:23:04.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:23:00+00:00, run_after=2024-04-15T00:24:00+00:00 2024-04-15T00:23:04.914129593Z [2024-04-15T00:23:04.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status success for try_number 1 2024-04-15T00:23:04.920034359Z [2024-04-15T00:23:04.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:22:00+00:00, map_index=-1, run_start_date=2024-04-15 00:23:02.866709+00:00, run_end_date=2024-04-15 00:23:04.162378+00:00, run_duration=1.295669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:23:01.117797+00:00, queued_by_job_id=1, pid=7277 2024-04-15T00:23:05.976763548Z [2024-04-15T00:23:05.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:23:05.977345946Z [2024-04-15T00:23:05.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:22:00+00:00, run_id=scheduled__2024-04-15T00:22:00+00:00, run_start_date=2024-04-15 00:23:01.052535+00:00, run_end_date=2024-04-15 00:23:05.976630+00:00, run_duration=4.924095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:22:00+00:00, data_interval_end=2024-04-15 00:23:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:23:05.994014454Z [2024-04-15T00:23:05.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:23:00+00:00, run_after=2024-04-15T00:24:00+00:00 2024-04-15T00:23:06.049497251Z [2024-04-15T00:23:06.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status success for try_number 1 2024-04-15T00:23:06.058522942Z [2024-04-15T00:23:06.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:22:00+00:00, map_index=-1, run_start_date=2024-04-15 00:23:02.695154+00:00, run_end_date=2024-04-15 00:23:04.764183+00:00, run_duration=2.069029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:23:01.117797+00:00, queued_by_job_id=1, pid=7276 2024-04-15T00:24:00.346626446Z [2024-04-15T00:24:00.346+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:24:00.374620264Z [2024-04-15T00:24:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:24:00+00:00, run_after=2024-04-15T00:25:00+00:00 2024-04-15T00:24:00.394765917Z [2024-04-15T00:24:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:24:00+00:00, run_after=2024-04-15T00:25:00+00:00 2024-04-15T00:24:00.402926627Z [2024-04-15T00:24:00.402+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:24:00.481318973Z [2024-04-15T00:24:00.480+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:24:00.481341969Z 2024-04-15T00:24:00.481346078Z 2024-04-15T00:24:00.481349380Z 2024-04-15T00:24:00.481352711Z 2024-04-15T00:24:00.481626152Z [2024-04-15T00:24:00.481+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:24:00.481934957Z [2024-04-15T00:24:00.481+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:24:00.482210715Z [2024-04-15T00:24:00.481+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:24:00.482537003Z [2024-04-15T00:24:00.482+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:24:00.487492149Z [2024-04-15T00:24:00.483+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:24:00.487507195Z 2024-04-15T00:24:00.487511139Z 2024-04-15T00:24:00.487514258Z 2024-04-15T00:24:00.487517325Z 2024-04-15T00:24:00.496057255Z [2024-04-15T00:24:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:24:00.496224414Z [2024-04-15T00:24:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:24:00.496428839Z [2024-04-15T00:24:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:24:00.496539879Z [2024-04-15T00:24:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:24:00.496753925Z [2024-04-15T00:24:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:24:00.496863973Z [2024-04-15T00:24:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:24:00.497130984Z [2024-04-15T00:24:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:24:00.497239770Z [2024-04-15T00:24:00.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:24:01.058735548Z [2024-04-15T00:24:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status queued for try_number 1 2024-04-15T00:24:01.062474460Z [2024-04-15T00:24:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:23:00+00:00 exited with status queued for try_number 1 2024-04-15T00:24:01.062703237Z [2024-04-15T00:24:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:23:00+00:00 exited with status queued for try_number 1 2024-04-15T00:24:01.062857057Z [2024-04-15T00:24:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:23:00+00:00 exited with status queued for try_number 1 2024-04-15T00:24:01.083004745Z [2024-04-15T00:24:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8907c012-4684-4b39-92f6-09d21c00aa4a 2024-04-15T00:24:01.083271949Z [2024-04-15T00:24:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to f97d0b95-ae92-481c-9ddb-450cd00b0d33 2024-04-15T00:24:01.083508982Z [2024-04-15T00:24:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to e824f10a-f58e-42cb-8a99-7dbd9e0bf101 2024-04-15T00:24:01.083673901Z [2024-04-15T00:24:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71197136-8785-4fe9-9f1d-0d863e717922 2024-04-15T00:24:02.264297922Z [2024-04-15T00:24:02.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:24:02.264621695Z [2024-04-15T00:24:02.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:22:00+00:00, run_id=scheduled__2024-04-15T00:22:00+00:00, run_start_date=2024-04-15 00:24:00.415212+00:00, run_end_date=2024-04-15 00:24:02.264215+00:00, run_duration=1.849003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:22:00+00:00, data_interval_end=2024-04-15 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:24:02.270692432Z [2024-04-15T00:24:02.270+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:24:00+00:00, run_after=2024-04-15T00:26:00+00:00 2024-04-15T00:24:02.275621728Z [2024-04-15T00:24:02.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:24:02.275889990Z [2024-04-15T00:24:02.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:23:00+00:00, run_id=scheduled__2024-04-15T00:23:00+00:00, run_start_date=2024-04-15 00:24:00.416575+00:00, run_end_date=2024-04-15 00:24:02.275567+00:00, run_duration=1.858992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:23:00+00:00, data_interval_end=2024-04-15 00:24:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:24:02.283599339Z [2024-04-15T00:24:02.283+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:24:00+00:00, run_after=2024-04-15T00:25:00+00:00 2024-04-15T00:24:02.348976165Z [2024-04-15T00:24:02.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:22:00+00:00 exited with status success for try_number 1 2024-04-15T00:24:02.349180575Z [2024-04-15T00:24:02.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:23:00+00:00 exited with status success for try_number 1 2024-04-15T00:24:02.362448582Z [2024-04-15T00:24:02.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:23:00+00:00, map_index=-1, run_start_date=2024-04-15 00:24:01.377128+00:00, run_end_date=2024-04-15 00:24:01.794206+00:00, run_duration=0.417078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:24:00.488782+00:00, queued_by_job_id=1, pid=7311 2024-04-15T00:24:02.362861489Z [2024-04-15T00:24:02.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:22:00+00:00, map_index=-1, run_start_date=2024-04-15 00:24:01.314131+00:00, run_end_date=2024-04-15 00:24:01.619206+00:00, run_duration=0.305075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:24:00.488782+00:00, queued_by_job_id=1, pid=7310 2024-04-15T00:24:04.072702958Z [2024-04-15T00:24:04.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:24:04.073253323Z [2024-04-15T00:24:04.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:23:00+00:00, run_id=scheduled__2024-04-15T00:23:00+00:00, run_start_date=2024-04-15 00:24:00.419443+00:00, run_end_date=2024-04-15 00:24:04.072791+00:00, run_duration=3.653348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:23:00+00:00, data_interval_end=2024-04-15 00:24:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:24:04.083919429Z [2024-04-15T00:24:04.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:24:00+00:00, run_after=2024-04-15T00:25:00+00:00 2024-04-15T00:24:04.093868766Z [2024-04-15T00:24:04.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:24:04.096620643Z [2024-04-15T00:24:04.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:23:00+00:00, run_id=scheduled__2024-04-15T00:23:00+00:00, run_start_date=2024-04-15 00:24:00.420430+00:00, run_end_date=2024-04-15 00:24:04.093829+00:00, run_duration=3.673399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:23:00+00:00, data_interval_end=2024-04-15 00:24:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:24:04.104830387Z [2024-04-15T00:24:04.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:24:00+00:00, run_after=2024-04-15T00:25:00+00:00 2024-04-15T00:24:04.135510007Z [2024-04-15T00:24:04.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:23:00+00:00 exited with status success for try_number 1 2024-04-15T00:24:04.135619927Z [2024-04-15T00:24:04.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:23:00+00:00 exited with status success for try_number 1 2024-04-15T00:24:04.141091781Z [2024-04-15T00:24:04.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:23:00+00:00, map_index=-1, run_start_date=2024-04-15 00:24:02.278326+00:00, run_end_date=2024-04-15 00:24:03.894335+00:00, run_duration=1.616009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:24:00.488782+00:00, queued_by_job_id=1, pid=7334 2024-04-15T00:24:04.141888911Z [2024-04-15T00:24:04.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:23:00+00:00, map_index=-1, run_start_date=2024-04-15 00:24:02.334935+00:00, run_end_date=2024-04-15 00:24:03.731066+00:00, run_duration=1.396131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:24:00.488782+00:00, queued_by_job_id=1, pid=7335 2024-04-15T00:25:00.415103178Z [2024-04-15T00:25:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:25:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:25:00.428962085Z [2024-04-15T00:25:00.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:25:00+00:00, run_after=2024-04-15T00:26:00+00:00 2024-04-15T00:25:00.443035951Z [2024-04-15T00:25:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:25:00+00:00, run_after=2024-04-15T00:26:00+00:00 2024-04-15T00:25:00.449446024Z [2024-04-15T00:25:00.449+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:25:00.548987424Z [2024-04-15T00:25:00.548+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:25:00.549018887Z 2024-04-15T00:25:00.549025839Z 2024-04-15T00:25:00.549032015Z 2024-04-15T00:25:00.549037609Z 2024-04-15T00:25:00.549235697Z [2024-04-15T00:25:00.548+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:25:00.549329440Z [2024-04-15T00:25:00.549+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:25:00.549430659Z [2024-04-15T00:25:00.549+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:25:00.549511355Z [2024-04-15T00:25:00.549+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:25:00.550337986Z [2024-04-15T00:25:00.550+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:25:00.550351044Z 2024-04-15T00:25:00.550356797Z 2024-04-15T00:25:00.550362196Z 2024-04-15T00:25:00.550367748Z 2024-04-15T00:25:00.555034956Z [2024-04-15T00:25:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:25:00.555191898Z [2024-04-15T00:25:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:25:00.555385898Z [2024-04-15T00:25:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:25:00.555486300Z [2024-04-15T00:25:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:25:00.555700691Z [2024-04-15T00:25:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:25:00.555830728Z [2024-04-15T00:25:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:25:00.555967641Z [2024-04-15T00:25:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:25:00.556092175Z [2024-04-15T00:25:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:25:01.056140102Z [2024-04-15T00:25:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:25:01.056202847Z [2024-04-15T00:25:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status queued for try_number 1 2024-04-15T00:25:01.056232228Z [2024-04-15T00:25:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status queued for try_number 1 2024-04-15T00:25:01.056332220Z [2024-04-15T00:25:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status queued for try_number 1 2024-04-15T00:25:01.075049886Z [2024-04-15T00:25:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68b30624-bc21-4841-abca-48191dedc9c5 2024-04-15T00:25:01.075223075Z [2024-04-15T00:25:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to d00b1afe-952c-4d53-b4c6-a2d830d16d01 2024-04-15T00:25:01.075359101Z [2024-04-15T00:25:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61b066f3-1389-4bd8-8fbf-f03cbab09b80 2024-04-15T00:25:01.075463407Z [2024-04-15T00:25:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to f63b94e8-968c-4dba-8e0f-8e4873ad39ac 2024-04-15T00:25:02.825477715Z [2024-04-15T00:25:02.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:25:02.825937822Z [2024-04-15T00:25:02.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:24:00+00:00, run_id=scheduled__2024-04-15T00:24:00+00:00, run_start_date=2024-04-15 00:25:00.472993+00:00, run_end_date=2024-04-15 00:25:02.825587+00:00, run_duration=2.352594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:24:00+00:00, data_interval_end=2024-04-15 00:25:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:25:02.834390815Z [2024-04-15T00:25:02.834+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:25:00+00:00, run_after=2024-04-15T00:26:00+00:00 2024-04-15T00:25:02.926180178Z [2024-04-15T00:25:02.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status success for try_number 1 2024-04-15T00:25:02.933715262Z [2024-04-15T00:25:02.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:24:00+00:00, map_index=-1, run_start_date=2024-04-15 00:25:01.384701+00:00, run_end_date=2024-04-15 00:25:01.926652+00:00, run_duration=0.541951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:25:00.551416+00:00, queued_by_job_id=1, pid=7367 2024-04-15T00:25:03.307754331Z [2024-04-15T00:25:03.307+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:25:03.307779990Z 2024-04-15T00:25:03.308164682Z [2024-04-15T00:25:03.307+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:25:03.309578569Z [2024-04-15T00:25:03.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:25:03.309587041Z 2024-04-15T00:25:03.313362959Z [2024-04-15T00:25:03.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:25:03.313691893Z [2024-04-15T00:25:03.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:25:03.390672724Z [2024-04-15T00:25:03.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:25:03.390782282Z [2024-04-15T00:25:03.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:25:03.400095578Z [2024-04-15T00:25:03.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2733ac57-f27f-4776-b4c1-450d175ff74f 2024-04-15T00:25:03.400354476Z [2024-04-15T00:25:03.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=-1, run_start_date=2024-04-15 00:25:02.510876+00:00, run_end_date=2024-04-15 00:25:02.865737+00:00, run_duration=0.354861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:25:00.551416+00:00, queued_by_job_id=1, pid=7392 2024-04-15T00:25:04.607077436Z [2024-04-15T00:25:04.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:25:04.607465146Z [2024-04-15T00:25:04.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:24:00+00:00, run_id=scheduled__2024-04-15T00:24:00+00:00, run_start_date=2024-04-15 00:25:00.476013+00:00, run_end_date=2024-04-15 00:25:04.606824+00:00, run_duration=4.130811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:24:00+00:00, data_interval_end=2024-04-15 00:25:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:25:04.616624519Z [2024-04-15T00:25:04.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:25:00+00:00, run_after=2024-04-15T00:26:00+00:00 2024-04-15T00:25:04.625070721Z [2024-04-15T00:25:04.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:25:04.625425803Z [2024-04-15T00:25:04.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:24:00+00:00, run_id=scheduled__2024-04-15T00:24:00+00:00, run_start_date=2024-04-15 00:25:00.477053+00:00, run_end_date=2024-04-15 00:25:04.624860+00:00, run_duration=4.147807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:24:00+00:00, data_interval_end=2024-04-15 00:25:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:25:04.638212332Z [2024-04-15T00:25:04.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:25:00+00:00, run_after=2024-04-15T00:26:00+00:00 2024-04-15T00:25:04.706490561Z [2024-04-15T00:25:04.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status success for try_number 1 2024-04-15T00:25:04.706783418Z [2024-04-15T00:25:04.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status success for try_number 1 2024-04-15T00:25:04.717483126Z [2024-04-15T00:25:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:24:00+00:00, map_index=-1, run_start_date=2024-04-15 00:25:02.376418+00:00, run_end_date=2024-04-15 00:25:03.534538+00:00, run_duration=1.15812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:25:00.551416+00:00, queued_by_job_id=1, pid=7391 2024-04-15T00:25:04.717811542Z [2024-04-15T00:25:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:24:00+00:00, map_index=-1, run_start_date=2024-04-15 00:25:02.518671+00:00, run_end_date=2024-04-15 00:25:04.176671+00:00, run_duration=1.658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:25:00.551416+00:00, queued_by_job_id=1, pid=7393 2024-04-15T00:25:05.840781890Z [2024-04-15T00:25:05.840+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:25:05.840836621Z 2024-04-15T00:25:05.840897385Z [2024-04-15T00:25:05.840+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:25:05.842118721Z [2024-04-15T00:25:05.841+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:25:05.842137066Z 2024-04-15T00:25:05.846643478Z [2024-04-15T00:25:05.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:25:05.847055070Z [2024-04-15T00:25:05.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:25:05.931282708Z [2024-04-15T00:25:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:25:05.931709045Z [2024-04-15T00:25:05.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:25:05.940482623Z [2024-04-15T00:25:05.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 213662ab-6448-4464-a7f6-c66c32c92bcf 2024-04-15T00:25:05.941024312Z [2024-04-15T00:25:05.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=-1, run_start_date=2024-04-15 00:25:04.897912+00:00, run_end_date=2024-04-15 00:25:05.269533+00:00, run_duration=0.371621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:25:03.310556+00:00, queued_by_job_id=1, pid=7416 2024-04-15T00:25:08.233737798Z [2024-04-15T00:25:08.233+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:25:08.233769102Z 2024-04-15T00:25:08.233912696Z [2024-04-15T00:25:08.233+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:25:08.234392099Z [2024-04-15T00:25:08.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:25:08.234401879Z 2024-04-15T00:25:08.236446513Z [2024-04-15T00:25:08.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:25:08.236642526Z [2024-04-15T00:25:08.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:25:08.289286198Z [2024-04-15T00:25:08.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status queued for try_number 1 2024-04-15T00:25:08.289668516Z [2024-04-15T00:25:08.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:25:08.296107629Z [2024-04-15T00:25:08.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a2d740d-1739-4595-acc6-ffcd1d524647 2024-04-15T00:25:08.296450401Z [2024-04-15T00:25:08.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=0, run_start_date=2024-04-15 00:25:07.614194+00:00, run_end_date=2024-04-15 00:25:07.954023+00:00, run_duration=0.339829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:25:05.842951+00:00, queued_by_job_id=1, pid=7424 2024-04-15T00:25:10.457535549Z [2024-04-15T00:25:10.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:25:10.458225548Z [2024-04-15T00:25:10.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:20:00+00:00, run_id=scheduled__2024-04-15T00:20:00+00:00, run_start_date=2024-04-15 00:25:00.471307+00:00, run_end_date=2024-04-15 00:25:10.457644+00:00, run_duration=9.986337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:20:00+00:00, data_interval_end=2024-04-15 00:25:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:25:10.474944031Z [2024-04-15T00:25:10.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:25:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:25:10.505160976Z [2024-04-15T00:25:10.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:20:00+00:00 exited with status success for try_number 1 2024-04-15T00:25:10.508936844Z [2024-04-15T00:25:10.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:20:00+00:00, map_index=-1, run_start_date=2024-04-15 00:25:09.670148+00:00, run_end_date=2024-04-15 00:25:10.056971+00:00, run_duration=0.386823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:25:08.234699+00:00, queued_by_job_id=1, pid=7432 2024-04-15T00:26:00.431780996Z [2024-04-15T00:26:00.431+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:26:00.447801142Z [2024-04-15T00:26:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:26:00+00:00, run_after=2024-04-15T00:27:00+00:00 2024-04-15T00:26:00.455450542Z [2024-04-15T00:26:00.455+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:26:00.476422596Z [2024-04-15T00:26:00.476+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:26:00+00:00, run_after=2024-04-15T00:27:00+00:00 2024-04-15T00:26:00.574305096Z [2024-04-15T00:26:00.573+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:26:00.574329099Z 2024-04-15T00:26:00.574332877Z 2024-04-15T00:26:00.574339847Z 2024-04-15T00:26:00.574343013Z 2024-04-15T00:26:00.574419019Z [2024-04-15T00:26:00.574+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:26:00.574486579Z [2024-04-15T00:26:00.574+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:26:00.574693035Z [2024-04-15T00:26:00.574+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:26:00.574821855Z [2024-04-15T00:26:00.574+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:26:00.575990319Z [2024-04-15T00:26:00.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:26:00.576005969Z 2024-04-15T00:26:00.576010729Z 2024-04-15T00:26:00.576014831Z 2024-04-15T00:26:00.576019020Z 2024-04-15T00:26:00.580825148Z [2024-04-15T00:26:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:26:00.581045477Z [2024-04-15T00:26:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:26:00.581300673Z [2024-04-15T00:26:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:26:00.581419565Z [2024-04-15T00:26:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:26:00.581659750Z [2024-04-15T00:26:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:26:00.581764954Z [2024-04-15T00:26:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:26:00.581991212Z [2024-04-15T00:26:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:26:00.582096793Z [2024-04-15T00:26:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:26:00.791261738Z [2024-04-15T00:26:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status queued for try_number 1 2024-04-15T00:26:00.791343908Z [2024-04-15T00:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status queued for try_number 1 2024-04-15T00:26:00.791349102Z [2024-04-15T00:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status queued for try_number 1 2024-04-15T00:26:00.791376288Z [2024-04-15T00:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status queued for try_number 1 2024-04-15T00:26:00.805916502Z [2024-04-15T00:26:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41be253e-5ca8-43b2-9ac1-ee94b46468c2 2024-04-15T00:26:00.805974901Z [2024-04-15T00:26:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1418beeb-1396-4557-8ccb-287cefde4b76 2024-04-15T00:26:00.806076201Z [2024-04-15T00:26:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b03694f-5ac1-4e9d-9cb8-3c35da7d313c 2024-04-15T00:26:00.806157012Z [2024-04-15T00:26:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0abf0440-2659-4ece-ae02-d0736d907deb 2024-04-15T00:26:01.933270744Z [2024-04-15T00:26:01.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:26:01.933650269Z [2024-04-15T00:26:01.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:24:00+00:00, run_id=scheduled__2024-04-15T00:24:00+00:00, run_start_date=2024-04-15 00:26:00.492400+00:00, run_end_date=2024-04-15 00:26:01.933187+00:00, run_duration=1.440787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:24:00+00:00, data_interval_end=2024-04-15 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:26:01.939741898Z [2024-04-15T00:26:01.939+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:26:00+00:00, run_after=2024-04-15T00:28:00+00:00 2024-04-15T00:26:01.953752650Z [2024-04-15T00:26:01.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:26:01.953848693Z [2024-04-15T00:26:01.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:25:00+00:00, run_id=scheduled__2024-04-15T00:25:00+00:00, run_start_date=2024-04-15 00:26:00.494138+00:00, run_end_date=2024-04-15 00:26:01.953641+00:00, run_duration=1.459503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:25:00+00:00, data_interval_end=2024-04-15 00:26:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:26:01.962751244Z [2024-04-15T00:26:01.962+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:26:00+00:00, run_after=2024-04-15T00:27:00+00:00 2024-04-15T00:26:01.995108834Z [2024-04-15T00:26:01.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:24:00+00:00 exited with status success for try_number 1 2024-04-15T00:26:01.995134855Z [2024-04-15T00:26:01.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status success for try_number 1 2024-04-15T00:26:02.000588471Z [2024-04-15T00:26:02.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:24:00+00:00, map_index=-1, run_start_date=2024-04-15 00:26:01.317351+00:00, run_end_date=2024-04-15 00:26:01.681237+00:00, run_duration=0.363886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:26:00.577260+00:00, queued_by_job_id=1, pid=7456 2024-04-15T00:26:02.000736196Z [2024-04-15T00:26:02.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:25:00+00:00, map_index=-1, run_start_date=2024-04-15 00:26:01.400206+00:00, run_end_date=2024-04-15 00:26:01.757862+00:00, run_duration=0.357656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:26:00.577260+00:00, queued_by_job_id=1, pid=7457 2024-04-15T00:26:02.728427495Z [2024-04-15T00:26:02.728+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:26:03.707963658Z [2024-04-15T00:26:03.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:26:03.708884932Z [2024-04-15T00:26:03.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:25:00+00:00, run_id=scheduled__2024-04-15T00:25:00+00:00, run_start_date=2024-04-15 00:26:00.495366+00:00, run_end_date=2024-04-15 00:26:03.707839+00:00, run_duration=3.212473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:25:00+00:00, data_interval_end=2024-04-15 00:26:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:26:03.724163135Z [2024-04-15T00:26:03.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:26:00+00:00, run_after=2024-04-15T00:27:00+00:00 2024-04-15T00:26:04.429224428Z [2024-04-15T00:26:04.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:26:04.429268676Z [2024-04-15T00:26:04.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:25:00+00:00, run_id=scheduled__2024-04-15T00:25:00+00:00, run_start_date=2024-04-15 00:26:00.496538+00:00, run_end_date=2024-04-15 00:26:04.428938+00:00, run_duration=3.9324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:25:00+00:00, data_interval_end=2024-04-15 00:26:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:26:04.440397420Z [2024-04-15T00:26:04.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:26:00+00:00, run_after=2024-04-15T00:27:00+00:00 2024-04-15T00:26:04.475480774Z [2024-04-15T00:26:04.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status success for try_number 1 2024-04-15T00:26:04.475711803Z [2024-04-15T00:26:04.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status success for try_number 1 2024-04-15T00:26:04.483202279Z [2024-04-15T00:26:04.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:25:00+00:00, map_index=-1, run_start_date=2024-04-15 00:26:02.348095+00:00, run_end_date=2024-04-15 00:26:03.609931+00:00, run_duration=1.261836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:26:00.577260+00:00, queued_by_job_id=1, pid=7481 2024-04-15T00:26:04.483665804Z [2024-04-15T00:26:04.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:25:00+00:00, map_index=-1, run_start_date=2024-04-15 00:26:02.277435+00:00, run_end_date=2024-04-15 00:26:03.813956+00:00, run_duration=1.536521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:26:00.577260+00:00, queued_by_job_id=1, pid=7480 2024-04-15T00:27:00.355014849Z [2024-04-15T00:27:00.352+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:27:00.367581469Z [2024-04-15T00:27:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:27:00+00:00, run_after=2024-04-15T00:28:00+00:00 2024-04-15T00:27:00.379864100Z [2024-04-15T00:27:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:27:00+00:00, run_after=2024-04-15T00:28:00+00:00 2024-04-15T00:27:00.445956344Z [2024-04-15T00:27:00.445+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:27:00.445995458Z 2024-04-15T00:27:00.446000500Z 2024-04-15T00:27:00.446005039Z 2024-04-15T00:27:00.446154657Z [2024-04-15T00:27:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:27:00.446276430Z [2024-04-15T00:27:00.446+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:27:00.446365823Z [2024-04-15T00:27:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:27:00.446837002Z [2024-04-15T00:27:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:27:00.446846016Z 2024-04-15T00:27:00.446850167Z 2024-04-15T00:27:00.446854203Z 2024-04-15T00:27:00.449342711Z [2024-04-15T00:27:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:27:00.449496629Z [2024-04-15T00:27:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:27:00.449706548Z [2024-04-15T00:27:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:27:00.449837938Z [2024-04-15T00:27:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:27:00.450011573Z [2024-04-15T00:27:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:27:00.450131432Z [2024-04-15T00:27:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:27:00.710661953Z [2024-04-15T00:27:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status queued for try_number 1 2024-04-15T00:27:00.710689628Z [2024-04-15T00:27:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status queued for try_number 1 2024-04-15T00:27:00.710750824Z [2024-04-15T00:27:00.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status queued for try_number 1 2024-04-15T00:27:00.720368454Z [2024-04-15T00:27:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to e613c096-760d-4bb9-b513-145d81eff4e2 2024-04-15T00:27:00.720440842Z [2024-04-15T00:27:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1543c396-fce7-4d89-9033-795a937a7aaf 2024-04-15T00:27:00.720528297Z [2024-04-15T00:27:00.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 676f935e-a78d-495d-a00a-0e46b1a9d957 2024-04-15T00:27:01.859339077Z [2024-04-15T00:27:01.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:27:01.859740320Z [2024-04-15T00:27:01.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:26:00+00:00, run_id=scheduled__2024-04-15T00:26:00+00:00, run_start_date=2024-04-15 00:27:00.398491+00:00, run_end_date=2024-04-15 00:27:01.859253+00:00, run_duration=1.460762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:26:00+00:00, data_interval_end=2024-04-15 00:27:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:27:01.867417609Z [2024-04-15T00:27:01.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:27:00+00:00, run_after=2024-04-15T00:28:00+00:00 2024-04-15T00:27:01.902611067Z [2024-04-15T00:27:01.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status success for try_number 1 2024-04-15T00:27:01.908073812Z [2024-04-15T00:27:01.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:26:00+00:00, map_index=-1, run_start_date=2024-04-15 00:27:01.137159+00:00, run_end_date=2024-04-15 00:27:01.473910+00:00, run_duration=0.336751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:27:00.447434+00:00, queued_by_job_id=1, pid=7513 2024-04-15T00:27:03.900145426Z [2024-04-15T00:27:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:27:03.900808659Z [2024-04-15T00:27:03.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:26:00+00:00, run_id=scheduled__2024-04-15T00:26:00+00:00, run_start_date=2024-04-15 00:27:00.401336+00:00, run_end_date=2024-04-15 00:27:03.900029+00:00, run_duration=3.498693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:26:00+00:00, data_interval_end=2024-04-15 00:27:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:27:03.921311027Z [2024-04-15T00:27:03.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:27:00+00:00, run_after=2024-04-15T00:28:00+00:00 2024-04-15T00:27:03.928613916Z [2024-04-15T00:27:03.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:27:03.929042158Z [2024-04-15T00:27:03.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:26:00+00:00, run_id=scheduled__2024-04-15T00:26:00+00:00, run_start_date=2024-04-15 00:27:00.400032+00:00, run_end_date=2024-04-15 00:27:03.928514+00:00, run_duration=3.528482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:26:00+00:00, data_interval_end=2024-04-15 00:27:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:27:03.941511532Z [2024-04-15T00:27:03.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:27:00+00:00, run_after=2024-04-15T00:28:00+00:00 2024-04-15T00:27:03.972534340Z [2024-04-15T00:27:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status success for try_number 1 2024-04-15T00:27:03.972935457Z [2024-04-15T00:27:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status success for try_number 1 2024-04-15T00:27:03.979295269Z [2024-04-15T00:27:03.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:26:00+00:00, map_index=-1, run_start_date=2024-04-15 00:27:01.921687+00:00, run_end_date=2024-04-15 00:27:03.428882+00:00, run_duration=1.507195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:27:00.447434+00:00, queued_by_job_id=1, pid=7531 2024-04-15T00:27:03.979720403Z [2024-04-15T00:27:03.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:26:00+00:00, map_index=-1, run_start_date=2024-04-15 00:27:02.003660+00:00, run_end_date=2024-04-15 00:27:03.289512+00:00, run_duration=1.285852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:27:00.447434+00:00, queued_by_job_id=1, pid=7532 2024-04-15T00:28:00.837175240Z [2024-04-15T00:28:00.836+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:28:00+00:00, run_after=2024-04-15T00:29:00+00:00 2024-04-15T00:28:00.849140956Z [2024-04-15T00:28:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:28:00+00:00, run_after=2024-04-15T00:29:00+00:00 2024-04-15T00:28:00.854301310Z [2024-04-15T00:28:00.853+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:28:00.859306984Z [2024-04-15T00:28:00.858+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:28:00.950315513Z [2024-04-15T00:28:00.949+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:28:00.950359058Z 2024-04-15T00:28:00.950365086Z 2024-04-15T00:28:00.950384447Z 2024-04-15T00:28:00.950392666Z 2024-04-15T00:28:00.950733915Z [2024-04-15T00:28:00.950+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:28:00.951210550Z [2024-04-15T00:28:00.950+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:28:00.951588921Z [2024-04-15T00:28:00.951+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:28:00.952000052Z [2024-04-15T00:28:00.951+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:28:00.953264549Z [2024-04-15T00:28:00.952+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:28:00.953277956Z 2024-04-15T00:28:00.953283352Z 2024-04-15T00:28:00.953287931Z 2024-04-15T00:28:00.953302642Z 2024-04-15T00:28:00.958155866Z [2024-04-15T00:28:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:28:00.958392068Z [2024-04-15T00:28:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:28:00.958842640Z [2024-04-15T00:28:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:28:00.959157366Z [2024-04-15T00:28:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:28:00.959604278Z [2024-04-15T00:28:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:28:00.959809804Z [2024-04-15T00:28:00.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:28:00.960142953Z [2024-04-15T00:28:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:28:00.960342533Z [2024-04-15T00:28:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:28:01.286752466Z [2024-04-15T00:28:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status queued for try_number 1 2024-04-15T00:28:01.286925555Z [2024-04-15T00:28:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:27:00+00:00 exited with status queued for try_number 1 2024-04-15T00:28:01.287029805Z [2024-04-15T00:28:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:27:00+00:00 exited with status queued for try_number 1 2024-04-15T00:28:01.287149966Z [2024-04-15T00:28:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:27:00+00:00 exited with status queued for try_number 1 2024-04-15T00:28:01.298618923Z [2024-04-15T00:28:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d12b770-2905-4af3-99c8-66b650217adb 2024-04-15T00:28:01.298856143Z [2024-04-15T00:28:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 129b1217-da7f-4a78-bee5-04a2990cca68 2024-04-15T00:28:01.300781975Z [2024-04-15T00:28:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04563d72-024e-41e5-b18d-a6e23c3b30a7 2024-04-15T00:28:01.300990572Z [2024-04-15T00:28:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to b60c175d-4495-49c3-90d6-d122476eea5b 2024-04-15T00:28:02.883048860Z [2024-04-15T00:28:02.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:28:02.885998687Z [2024-04-15T00:28:02.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:26:00+00:00, run_id=scheduled__2024-04-15T00:26:00+00:00, run_start_date=2024-04-15 00:28:00.868214+00:00, run_end_date=2024-04-15 00:28:02.884987+00:00, run_duration=2.016773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:26:00+00:00, data_interval_end=2024-04-15 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:28:02.894680235Z [2024-04-15T00:28:02.894+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:28:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:28:02.902336122Z [2024-04-15T00:28:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:28:02.902552180Z [2024-04-15T00:28:02.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:27:00+00:00, run_id=scheduled__2024-04-15T00:27:00+00:00, run_start_date=2024-04-15 00:28:00.869245+00:00, run_end_date=2024-04-15 00:28:02.902319+00:00, run_duration=2.033074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:27:00+00:00, data_interval_end=2024-04-15 00:28:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:28:02.917651526Z [2024-04-15T00:28:02.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:28:00+00:00, run_after=2024-04-15T00:29:00+00:00 2024-04-15T00:28:02.984833848Z [2024-04-15T00:28:02.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:26:00+00:00 exited with status success for try_number 1 2024-04-15T00:28:02.985046640Z [2024-04-15T00:28:02.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:27:00+00:00 exited with status success for try_number 1 2024-04-15T00:28:02.991499464Z [2024-04-15T00:28:02.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:26:00+00:00, map_index=-1, run_start_date=2024-04-15 00:28:01.686817+00:00, run_end_date=2024-04-15 00:28:02.075656+00:00, run_duration=0.388839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:28:00.954541+00:00, queued_by_job_id=1, pid=7564 2024-04-15T00:28:02.991876465Z [2024-04-15T00:28:02.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:27:00+00:00, map_index=-1, run_start_date=2024-04-15 00:28:01.761472+00:00, run_end_date=2024-04-15 00:28:02.094683+00:00, run_duration=0.333211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:28:00.954541+00:00, queued_by_job_id=1, pid=7565 2024-04-15T00:28:04.277341613Z [2024-04-15T00:28:04.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:28:04.277396834Z [2024-04-15T00:28:04.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:27:00+00:00, run_id=scheduled__2024-04-15T00:27:00+00:00, run_start_date=2024-04-15 00:28:00.870218+00:00, run_end_date=2024-04-15 00:28:04.275412+00:00, run_duration=3.405194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:27:00+00:00, data_interval_end=2024-04-15 00:28:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:28:04.311815341Z [2024-04-15T00:28:04.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:28:00+00:00, run_after=2024-04-15T00:29:00+00:00 2024-04-15T00:28:04.373012482Z [2024-04-15T00:28:04.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:27:00+00:00 exited with status success for try_number 1 2024-04-15T00:28:04.382429215Z [2024-04-15T00:28:04.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:27:00+00:00, map_index=-1, run_start_date=2024-04-15 00:28:02.662401+00:00, run_end_date=2024-04-15 00:28:03.911424+00:00, run_duration=1.249023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:28:00.954541+00:00, queued_by_job_id=1, pid=7588 2024-04-15T00:28:05.447796069Z [2024-04-15T00:28:05.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:28:05.448236509Z [2024-04-15T00:28:05.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:27:00+00:00, run_id=scheduled__2024-04-15T00:27:00+00:00, run_start_date=2024-04-15 00:28:00.871082+00:00, run_end_date=2024-04-15 00:28:05.447681+00:00, run_duration=4.576599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:27:00+00:00, data_interval_end=2024-04-15 00:28:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:28:05.464267902Z [2024-04-15T00:28:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:28:00+00:00, run_after=2024-04-15T00:29:00+00:00 2024-04-15T00:28:05.513190610Z [2024-04-15T00:28:05.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:27:00+00:00 exited with status success for try_number 1 2024-04-15T00:28:05.521664787Z [2024-04-15T00:28:05.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:27:00+00:00, map_index=-1, run_start_date=2024-04-15 00:28:02.724692+00:00, run_end_date=2024-04-15 00:28:04.297217+00:00, run_duration=1.572525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:28:00.954541+00:00, queued_by_job_id=1, pid=7589 2024-04-15T00:29:00.835284460Z [2024-04-15T00:29:00.834+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:29:00.852162898Z [2024-04-15T00:29:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:29:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:29:00.865838086Z [2024-04-15T00:29:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:29:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:29:00.953627062Z [2024-04-15T00:29:00.953+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:29:00.953652241Z 2024-04-15T00:29:00.953655668Z 2024-04-15T00:29:00.953671217Z 2024-04-15T00:29:00.954167634Z [2024-04-15T00:29:00.953+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:29:00.954447993Z [2024-04-15T00:29:00.954+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:29:00.954657268Z [2024-04-15T00:29:00.954+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:29:00.956014233Z [2024-04-15T00:29:00.955+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:29:00.956057317Z 2024-04-15T00:29:00.956062865Z 2024-04-15T00:29:00.956082898Z 2024-04-15T00:29:00.961137304Z [2024-04-15T00:29:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:29:00.961390398Z [2024-04-15T00:29:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:29:00.961741821Z [2024-04-15T00:29:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:29:00.961941829Z [2024-04-15T00:29:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:29:00.962218006Z [2024-04-15T00:29:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:29:00.962378175Z [2024-04-15T00:29:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:29:01.195666005Z [2024-04-15T00:29:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status queued for try_number 1 2024-04-15T00:29:01.199252547Z [2024-04-15T00:29:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status queued for try_number 1 2024-04-15T00:29:01.199510093Z [2024-04-15T00:29:01.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status queued for try_number 1 2024-04-15T00:29:01.209012181Z [2024-04-15T00:29:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 644f5887-5a9c-4905-aa24-febbfab83851 2024-04-15T00:29:01.209307165Z [2024-04-15T00:29:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1613c613-421f-498b-ba11-3d14e239baf1 2024-04-15T00:29:01.209534974Z [2024-04-15T00:29:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a861d75-d370-406c-8187-3ab2b1b7b825 2024-04-15T00:29:02.456595412Z [2024-04-15T00:29:02.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:29:02.457219079Z [2024-04-15T00:29:02.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:28:00+00:00, run_id=scheduled__2024-04-15T00:28:00+00:00, run_start_date=2024-04-15 00:29:00.888695+00:00, run_end_date=2024-04-15 00:29:02.456567+00:00, run_duration=1.567872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:28:00+00:00, data_interval_end=2024-04-15 00:29:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:29:02.475286526Z [2024-04-15T00:29:02.474+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:29:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:29:02.518234274Z [2024-04-15T00:29:02.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status success for try_number 1 2024-04-15T00:29:02.523930308Z [2024-04-15T00:29:02.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:28:00+00:00, map_index=-1, run_start_date=2024-04-15 00:29:01.680627+00:00, run_end_date=2024-04-15 00:29:02.045590+00:00, run_duration=0.364963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:29:00.957904+00:00, queued_by_job_id=1, pid=7621 2024-04-15T00:29:04.650416618Z [2024-04-15T00:29:04.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:29:04.650923012Z [2024-04-15T00:29:04.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:28:00+00:00, run_id=scheduled__2024-04-15T00:28:00+00:00, run_start_date=2024-04-15 00:29:00.892707+00:00, run_end_date=2024-04-15 00:29:04.650304+00:00, run_duration=3.757597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:28:00+00:00, data_interval_end=2024-04-15 00:29:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:29:04.663065717Z [2024-04-15T00:29:04.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:29:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:29:04.673570689Z [2024-04-15T00:29:04.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:29:04.673943203Z [2024-04-15T00:29:04.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:28:00+00:00, run_id=scheduled__2024-04-15T00:28:00+00:00, run_start_date=2024-04-15 00:29:00.890461+00:00, run_end_date=2024-04-15 00:29:04.673432+00:00, run_duration=3.782971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:28:00+00:00, data_interval_end=2024-04-15 00:29:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:29:04.691156868Z [2024-04-15T00:29:04.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:29:00+00:00, run_after=2024-04-15T00:30:00+00:00 2024-04-15T00:29:04.729042173Z [2024-04-15T00:29:04.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status success for try_number 1 2024-04-15T00:29:04.729399916Z [2024-04-15T00:29:04.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status success for try_number 1 2024-04-15T00:29:04.738408889Z [2024-04-15T00:29:04.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:28:00+00:00, map_index=-1, run_start_date=2024-04-15 00:29:02.581695+00:00, run_end_date=2024-04-15 00:29:04.107907+00:00, run_duration=1.526212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:29:00.957904+00:00, queued_by_job_id=1, pid=7639 2024-04-15T00:29:04.738966217Z [2024-04-15T00:29:04.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:28:00+00:00, map_index=-1, run_start_date=2024-04-15 00:29:02.681365+00:00, run_end_date=2024-04-15 00:29:03.890551+00:00, run_duration=1.209186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:29:00.957904+00:00, queued_by_job_id=1, pid=7640 2024-04-15T00:30:00.842609883Z [2024-04-15T00:30:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:31:00+00:00 2024-04-15T00:30:00.848239048Z [2024-04-15T00:30:00.848+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:30:00.853865954Z [2024-04-15T00:30:00.853+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:30:00.864399048Z [2024-04-15T00:30:00.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:35:00+00:00 2024-04-15T00:30:00.876159600Z [2024-04-15T00:30:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:31:00+00:00 2024-04-15T00:30:00.981998078Z [2024-04-15T00:30:00.981+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T00:30:00.982084675Z 2024-04-15T00:30:00.982141369Z 2024-04-15T00:30:00.982161926Z 2024-04-15T00:30:00.982172179Z 2024-04-15T00:30:00.982212383Z 2024-04-15T00:30:00.982303871Z [2024-04-15T00:30:00.981+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:30:00.982509747Z [2024-04-15T00:30:00.982+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:30:00.982866509Z [2024-04-15T00:30:00.982+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:30:00.983214762Z [2024-04-15T00:30:00.982+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:30:00.983519163Z [2024-04-15T00:30:00.983+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:30:00.984843562Z [2024-04-15T00:30:00.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:30:00.984850168Z 2024-04-15T00:30:00.984853331Z 2024-04-15T00:30:00.984856525Z 2024-04-15T00:30:00.984859402Z 2024-04-15T00:30:00.984862161Z 2024-04-15T00:30:00.992804189Z [2024-04-15T00:30:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:30:00.993127873Z [2024-04-15T00:30:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:30:00.993739068Z [2024-04-15T00:30:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:30:00.994005017Z [2024-04-15T00:30:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:30:00.994803171Z [2024-04-15T00:30:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:30:00.995100298Z [2024-04-15T00:30:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:30:00.995765019Z [2024-04-15T00:30:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:30:00.995987047Z [2024-04-15T00:30:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:30:00.996457919Z [2024-04-15T00:30:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:30:00.996736857Z [2024-04-15T00:30:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:30:01.575578715Z [2024-04-15T00:30:01.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:01.579182449Z [2024-04-15T00:30:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:01.579437448Z [2024-04-15T00:30:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:29:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:01.579618324Z [2024-04-15T00:30:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:29:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:01.579861462Z [2024-04-15T00:30:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:29:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:01.597810870Z [2024-04-15T00:30:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1c29462-18df-4041-875d-8449cb42c1c5 2024-04-15T00:30:01.598101229Z [2024-04-15T00:30:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 721d02aa-48bb-4008-b46c-8515cfe0c281 2024-04-15T00:30:01.598309424Z [2024-04-15T00:30:01.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c607b70-9511-4ff9-bde2-61ff6db44008 2024-04-15T00:30:01.598485046Z [2024-04-15T00:30:01.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b05a58-d0fb-4d5c-91d4-d535fb6a75a9 2024-04-15T00:30:01.598664613Z [2024-04-15T00:30:01.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf9f667a-126f-4412-900b-2c6703768f44 2024-04-15T00:30:02.912443394Z [2024-04-15T00:30:02.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:30:02.912971885Z [2024-04-15T00:30:02.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:28:00+00:00, run_id=scheduled__2024-04-15T00:28:00+00:00, run_start_date=2024-04-15 00:30:00.889405+00:00, run_end_date=2024-04-15 00:30:02.912581+00:00, run_duration=2.023176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:28:00+00:00, data_interval_end=2024-04-15 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:30:02.920712465Z [2024-04-15T00:30:02.920+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:32:00+00:00 2024-04-15T00:30:02.986327514Z [2024-04-15T00:30:02.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:28:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:02.991608367Z [2024-04-15T00:30:02.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:28:00+00:00, map_index=-1, run_start_date=2024-04-15 00:30:02.086206+00:00, run_end_date=2024-04-15 00:30:02.480537+00:00, run_duration=0.394331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:00.989245+00:00, queued_by_job_id=1, pid=7669 2024-04-15T00:30:03.770575636Z [2024-04-15T00:30:03.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:30:03.770944172Z [2024-04-15T00:30:03.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:29:00+00:00, run_id=scheduled__2024-04-15T00:29:00+00:00, run_start_date=2024-04-15 00:30:00.890484+00:00, run_end_date=2024-04-15 00:30:03.770656+00:00, run_duration=2.880172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:29:00+00:00, data_interval_end=2024-04-15 00:30:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:30:03.778231735Z [2024-04-15T00:30:03.778+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:31:00+00:00 2024-04-15T00:30:03.846299783Z [2024-04-15T00:30:03.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:29:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:03.850761953Z [2024-04-15T00:30:03.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:29:00+00:00, map_index=-1, run_start_date=2024-04-15 00:30:02.675735+00:00, run_end_date=2024-04-15 00:30:03.115329+00:00, run_duration=0.439594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:00.989245+00:00, queued_by_job_id=1, pid=7682 2024-04-15T00:30:04.309644838Z [2024-04-15T00:30:04.309+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:30:04.309668540Z 2024-04-15T00:30:04.309942425Z [2024-04-15T00:30:04.309+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:30:04.310492823Z [2024-04-15T00:30:04.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:30:04.310518264Z 2024-04-15T00:30:04.312692767Z [2024-04-15T00:30:04.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:30:04.312846121Z [2024-04-15T00:30:04.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:30:04.405190286Z [2024-04-15T00:30:04.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:04.405401250Z [2024-04-15T00:30:04.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:04.411203880Z [2024-04-15T00:30:04.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to de0615f6-d1c9-47ce-8c17-48bfb1889291 2024-04-15T00:30:04.411376063Z [2024-04-15T00:30:04.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:25:00+00:00, map_index=-1, run_start_date=2024-04-15 00:30:03.493434+00:00, run_end_date=2024-04-15 00:30:03.857016+00:00, run_duration=0.363582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:00.989245+00:00, queued_by_job_id=1, pid=7706 2024-04-15T00:30:04.984097870Z [2024-04-15T00:30:04.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:30:04.984553057Z [2024-04-15T00:30:04.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:29:00+00:00, run_id=scheduled__2024-04-15T00:29:00+00:00, run_start_date=2024-04-15 00:30:00.891517+00:00, run_end_date=2024-04-15 00:30:04.984255+00:00, run_duration=4.092738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:29:00+00:00, data_interval_end=2024-04-15 00:30:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:30:04.999588980Z [2024-04-15T00:30:04.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:31:00+00:00 2024-04-15T00:30:05.054285259Z [2024-04-15T00:30:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:29:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:05.059348945Z [2024-04-15T00:30:05.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:29:00+00:00, map_index=-1, run_start_date=2024-04-15 00:30:03.468429+00:00, run_end_date=2024-04-15 00:30:04.829443+00:00, run_duration=1.361014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:00.989245+00:00, queued_by_job_id=1, pid=7705 2024-04-15T00:30:06.122127400Z [2024-04-15T00:30:06.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:30:06.122412903Z [2024-04-15T00:30:06.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:29:00+00:00, run_id=scheduled__2024-04-15T00:29:00+00:00, run_start_date=2024-04-15 00:30:00.892558+00:00, run_end_date=2024-04-15 00:30:06.121973+00:00, run_duration=5.229415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:29:00+00:00, data_interval_end=2024-04-15 00:30:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:30:06.133579289Z [2024-04-15T00:30:06.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:31:00+00:00 2024-04-15T00:30:06.173691018Z [2024-04-15T00:30:06.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:29:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:06.179483441Z [2024-04-15T00:30:06.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:29:00+00:00, map_index=-1, run_start_date=2024-04-15 00:30:03.308563+00:00, run_end_date=2024-04-15 00:30:04.982575+00:00, run_duration=1.674012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:00.989245+00:00, queued_by_job_id=1, pid=7699 2024-04-15T00:30:07.271104325Z [2024-04-15T00:30:07.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:30:07.271126768Z 2024-04-15T00:30:07.271130153Z [2024-04-15T00:30:07.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:30:07.271134831Z [2024-04-15T00:30:07.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:30:07.271137765Z 2024-04-15T00:30:07.274677819Z [2024-04-15T00:30:07.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:30:07.274688298Z [2024-04-15T00:30:07.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:30:07.317851827Z [2024-04-15T00:30:07.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:07.317870821Z [2024-04-15T00:30:07.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:07.321773700Z [2024-04-15T00:30:07.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a023202-a467-4066-b127-39758edab60a 2024-04-15T00:30:07.321789223Z [2024-04-15T00:30:07.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:25:00+00:00, map_index=-1, run_start_date=2024-04-15 00:30:05.849158+00:00, run_end_date=2024-04-15 00:30:06.226899+00:00, run_duration=0.377741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:04.310782+00:00, queued_by_job_id=1, pid=7729 2024-04-15T00:30:10.094377612Z [2024-04-15T00:30:10.094+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:30:10.094404273Z 2024-04-15T00:30:10.094450949Z [2024-04-15T00:30:10.094+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:30:10.094911544Z [2024-04-15T00:30:10.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:30:10.094929852Z 2024-04-15T00:30:10.096960269Z [2024-04-15T00:30:10.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:30:10.096980046Z [2024-04-15T00:30:10.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:30:10.170467211Z [2024-04-15T00:30:10.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status queued for try_number 1 2024-04-15T00:30:10.170645035Z [2024-04-15T00:30:10.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:10.177918489Z [2024-04-15T00:30:10.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96bcf1e5-1fd9-4fb1-a4e5-887692ef3eb8 2024-04-15T00:30:10.178247917Z [2024-04-15T00:30:10.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:25:00+00:00, map_index=0, run_start_date=2024-04-15 00:30:08.653906+00:00, run_end_date=2024-04-15 00:30:08.975930+00:00, run_duration=0.322024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:07.269561+00:00, queued_by_job_id=1, pid=7737 2024-04-15T00:30:13.081286707Z [2024-04-15T00:30:13.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:30:13.081423483Z [2024-04-15T00:30:13.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:25:00+00:00, run_id=scheduled__2024-04-15T00:25:00+00:00, run_start_date=2024-04-15 00:30:00.888116+00:00, run_end_date=2024-04-15 00:30:13.081109+00:00, run_duration=12.192993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:25:00+00:00, data_interval_end=2024-04-15 00:30:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:30:13.086604024Z [2024-04-15T00:30:13.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:30:00+00:00, run_after=2024-04-15T00:35:00+00:00 2024-04-15T00:30:13.127296624Z [2024-04-15T00:30:13.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:25:00+00:00 exited with status success for try_number 1 2024-04-15T00:30:13.133822287Z [2024-04-15T00:30:13.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:25:00+00:00, map_index=-1, run_start_date=2024-04-15 00:30:11.510664+00:00, run_end_date=2024-04-15 00:30:11.870465+00:00, run_duration=0.359801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:30:10.095453+00:00, queued_by_job_id=1, pid=7745 2024-04-15T00:31:00.864997642Z [2024-04-15T00:31:00.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:31:00+00:00, run_after=2024-04-15T00:32:00+00:00 2024-04-15T00:31:00.877342538Z [2024-04-15T00:31:00.875+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:31:00.905039318Z [2024-04-15T00:31:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:31:00+00:00, run_after=2024-04-15T00:32:00+00:00 2024-04-15T00:31:00.975006217Z [2024-04-15T00:31:00.974+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:31:00.975028702Z 2024-04-15T00:31:00.975032082Z 2024-04-15T00:31:00.975035414Z 2024-04-15T00:31:00.975248910Z [2024-04-15T00:31:00.974+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:31:00.975529009Z [2024-04-15T00:31:00.975+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:31:00.975719421Z [2024-04-15T00:31:00.975+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:31:00.976237302Z [2024-04-15T00:31:00.976+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:31:00.976260834Z 2024-04-15T00:31:00.976264218Z 2024-04-15T00:31:00.976266938Z 2024-04-15T00:31:00.981912686Z [2024-04-15T00:31:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:31:00.981933039Z [2024-04-15T00:31:00.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:31:00.981938071Z [2024-04-15T00:31:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:31:00.981942685Z [2024-04-15T00:31:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:31:00.981960928Z [2024-04-15T00:31:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:31:00.981965462Z [2024-04-15T00:31:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:31:01.280086666Z [2024-04-15T00:31:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:31:01.280366007Z [2024-04-15T00:31:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:31:01.280534169Z [2024-04-15T00:31:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:31:01.291677377Z [2024-04-15T00:31:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf175122-0520-4614-aa5a-e375dc113d09 2024-04-15T00:31:01.291996336Z [2024-04-15T00:31:01.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09f2284c-9af1-481f-a36e-62250627b7be 2024-04-15T00:31:01.292160346Z [2024-04-15T00:31:01.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 349d1424-a167-465b-b8b2-fc9a3762cf49 2024-04-15T00:31:02.451511531Z [2024-04-15T00:31:02.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:31:02.451824084Z [2024-04-15T00:31:02.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:30:00+00:00, run_id=scheduled__2024-04-15T00:30:00+00:00, run_start_date=2024-04-15 00:31:00.917222+00:00, run_end_date=2024-04-15 00:31:02.451288+00:00, run_duration=1.534066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:30:00+00:00, data_interval_end=2024-04-15 00:31:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:31:02.461043493Z [2024-04-15T00:31:02.460+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:31:00+00:00, run_after=2024-04-15T00:32:00+00:00 2024-04-15T00:31:02.502844064Z [2024-04-15T00:31:02.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:31:02.509845113Z [2024-04-15T00:31:02.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=-1, run_start_date=2024-04-15 00:31:01.681715+00:00, run_end_date=2024-04-15 00:31:02.083209+00:00, run_duration=0.401494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:31:00.976895+00:00, queued_by_job_id=1, pid=7766 2024-04-15T00:31:02.811396492Z [2024-04-15T00:31:02.811+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:31:04.885234766Z [2024-04-15T00:31:04.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:31:04.885684615Z [2024-04-15T00:31:04.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:30:00+00:00, run_id=scheduled__2024-04-15T00:30:00+00:00, run_start_date=2024-04-15 00:31:00.918526+00:00, run_end_date=2024-04-15 00:31:04.885029+00:00, run_duration=3.966503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:30:00+00:00, data_interval_end=2024-04-15 00:31:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:31:04.900669242Z [2024-04-15T00:31:04.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:31:00+00:00, run_after=2024-04-15T00:32:00+00:00 2024-04-15T00:31:04.964020928Z [2024-04-15T00:31:04.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:31:04.972448419Z [2024-04-15T00:31:04.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=-1, run_start_date=2024-04-15 00:31:02.668132+00:00, run_end_date=2024-04-15 00:31:04.063712+00:00, run_duration=1.39558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:31:00.976895+00:00, queued_by_job_id=1, pid=7784 2024-04-15T00:31:05.348976558Z [2024-04-15T00:31:05.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:31:05.349629944Z [2024-04-15T00:31:05.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:30:00+00:00, run_id=scheduled__2024-04-15T00:30:00+00:00, run_start_date=2024-04-15 00:31:00.919669+00:00, run_end_date=2024-04-15 00:31:05.349083+00:00, run_duration=4.429414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:30:00+00:00, data_interval_end=2024-04-15 00:31:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:31:05.362466270Z [2024-04-15T00:31:05.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:31:00+00:00, run_after=2024-04-15T00:32:00+00:00 2024-04-15T00:31:05.412193204Z [2024-04-15T00:31:05.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:31:05.420688113Z [2024-04-15T00:31:05.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=-1, run_start_date=2024-04-15 00:31:02.814388+00:00, run_end_date=2024-04-15 00:31:04.993618+00:00, run_duration=2.17923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:31:00.976895+00:00, queued_by_job_id=1, pid=7785 2024-04-15T00:32:00.037819544Z [2024-04-15T00:32:00.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:32:00.054668822Z [2024-04-15T00:32:00.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:32:00+00:00, run_after=2024-04-15T00:33:00+00:00 2024-04-15T00:32:00.062849177Z [2024-04-15T00:32:00.062+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:32:00.076051329Z [2024-04-15T00:32:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:32:00+00:00, run_after=2024-04-15T00:33:00+00:00 2024-04-15T00:32:00.158575527Z [2024-04-15T00:32:00.157+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:32:00.158603355Z 2024-04-15T00:32:00.158612478Z 2024-04-15T00:32:00.158619852Z 2024-04-15T00:32:00.158627091Z 2024-04-15T00:32:00.158963887Z [2024-04-15T00:32:00.158+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:32:00.159146162Z [2024-04-15T00:32:00.158+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:32:00.159262845Z [2024-04-15T00:32:00.159+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:32:00.159373843Z [2024-04-15T00:32:00.159+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:32:00.160220273Z [2024-04-15T00:32:00.159+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:32:00.160236316Z 2024-04-15T00:32:00.160244667Z 2024-04-15T00:32:00.160251997Z 2024-04-15T00:32:00.160281013Z 2024-04-15T00:32:00.167428990Z [2024-04-15T00:32:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:32:00.167773419Z [2024-04-15T00:32:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:32:00.168288304Z [2024-04-15T00:32:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:32:00.168713819Z [2024-04-15T00:32:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:32:00.169153769Z [2024-04-15T00:32:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:32:00.169286351Z [2024-04-15T00:32:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:32:00.169606891Z [2024-04-15T00:32:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:32:00.170051101Z [2024-04-15T00:32:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:32:00.479789511Z [2024-04-15T00:32:00.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:32:00.480010038Z [2024-04-15T00:32:00.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:31:00+00:00 exited with status queued for try_number 1 2024-04-15T00:32:00.480161665Z [2024-04-15T00:32:00.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:31:00+00:00 exited with status queued for try_number 1 2024-04-15T00:32:00.480297170Z [2024-04-15T00:32:00.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:31:00+00:00 exited with status queued for try_number 1 2024-04-15T00:32:00.494414258Z [2024-04-15T00:32:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09b4bdc2-347e-477a-a32c-e20d448498bd 2024-04-15T00:32:00.494589968Z [2024-04-15T00:32:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3828600c-93c3-4d79-9857-23966bed646d 2024-04-15T00:32:00.495225994Z [2024-04-15T00:32:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44983d29-e171-4d27-94df-1a5c3cada81a 2024-04-15T00:32:00.495531666Z [2024-04-15T00:32:00.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc0bab99-cff3-48b7-ba60-ede133577671 2024-04-15T00:32:02.051002844Z [2024-04-15T00:32:02.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:32:02.051207200Z [2024-04-15T00:32:02.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:30:00+00:00, run_id=scheduled__2024-04-15T00:30:00+00:00, run_start_date=2024-04-15 00:32:00.086819+00:00, run_end_date=2024-04-15 00:32:02.050670+00:00, run_duration=1.963851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:30:00+00:00, data_interval_end=2024-04-15 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:32:02.057653945Z [2024-04-15T00:32:02.057+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:32:00+00:00, run_after=2024-04-15T00:34:00+00:00 2024-04-15T00:32:02.073792470Z [2024-04-15T00:32:02.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:32:02.074072575Z [2024-04-15T00:32:02.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:31:00+00:00, run_id=scheduled__2024-04-15T00:31:00+00:00, run_start_date=2024-04-15 00:32:00.087925+00:00, run_end_date=2024-04-15 00:32:02.073652+00:00, run_duration=1.985727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:31:00+00:00, data_interval_end=2024-04-15 00:32:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:32:02.082680133Z [2024-04-15T00:32:02.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:32:00+00:00, run_after=2024-04-15T00:33:00+00:00 2024-04-15T00:32:02.112065124Z [2024-04-15T00:32:02.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:32:02.112244702Z [2024-04-15T00:32:02.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:31:00+00:00 exited with status success for try_number 1 2024-04-15T00:32:02.117954431Z [2024-04-15T00:32:02.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=-1, run_start_date=2024-04-15 00:32:00.911322+00:00, run_end_date=2024-04-15 00:32:01.303585+00:00, run_duration=0.392263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:32:00.161572+00:00, queued_by_job_id=1, pid=7814 2024-04-15T00:32:02.118184406Z [2024-04-15T00:32:02.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:31:00+00:00, map_index=-1, run_start_date=2024-04-15 00:32:01.429294+00:00, run_end_date=2024-04-15 00:32:01.797827+00:00, run_duration=0.368533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:32:00.161572+00:00, queued_by_job_id=1, pid=7825 2024-04-15T00:32:04.286112495Z [2024-04-15T00:32:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:32:04.286486392Z [2024-04-15T00:32:04.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:31:00+00:00, run_id=scheduled__2024-04-15T00:31:00+00:00, run_start_date=2024-04-15 00:32:00.089863+00:00, run_end_date=2024-04-15 00:32:04.286187+00:00, run_duration=4.196324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:31:00+00:00, data_interval_end=2024-04-15 00:32:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:32:04.294128987Z [2024-04-15T00:32:04.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:32:00+00:00, run_after=2024-04-15T00:33:00+00:00 2024-04-15T00:32:04.300534270Z [2024-04-15T00:32:04.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:32:04.300730505Z [2024-04-15T00:32:04.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:31:00+00:00, run_id=scheduled__2024-04-15T00:31:00+00:00, run_start_date=2024-04-15 00:32:00.088893+00:00, run_end_date=2024-04-15 00:32:04.300455+00:00, run_duration=4.211562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:31:00+00:00, data_interval_end=2024-04-15 00:32:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:32:04.310088212Z [2024-04-15T00:32:04.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:32:00+00:00, run_after=2024-04-15T00:33:00+00:00 2024-04-15T00:32:04.373871068Z [2024-04-15T00:32:04.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:31:00+00:00 exited with status success for try_number 1 2024-04-15T00:32:04.373906491Z [2024-04-15T00:32:04.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:31:00+00:00 exited with status success for try_number 1 2024-04-15T00:32:04.383461781Z [2024-04-15T00:32:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:31:00+00:00, map_index=-1, run_start_date=2024-04-15 00:32:02.256199+00:00, run_end_date=2024-04-15 00:32:03.429483+00:00, run_duration=1.173284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:32:00.161572+00:00, queued_by_job_id=1, pid=7844 2024-04-15T00:32:04.383525013Z [2024-04-15T00:32:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:31:00+00:00, map_index=-1, run_start_date=2024-04-15 00:32:02.235679+00:00, run_end_date=2024-04-15 00:32:03.806658+00:00, run_duration=1.570979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:32:00.161572+00:00, queued_by_job_id=1, pid=7843 2024-04-15T00:33:00.050545633Z [2024-04-15T00:33:00.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:33:00+00:00, run_after=2024-04-15T00:34:00+00:00 2024-04-15T00:33:00.061666903Z [2024-04-15T00:33:00.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:33:00.075358426Z [2024-04-15T00:33:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:33:00+00:00, run_after=2024-04-15T00:34:00+00:00 2024-04-15T00:33:00.154319801Z [2024-04-15T00:33:00.153+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:33:00.154360417Z 2024-04-15T00:33:00.154366834Z 2024-04-15T00:33:00.154371942Z 2024-04-15T00:33:00.154617072Z [2024-04-15T00:33:00.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:33:00.154967952Z [2024-04-15T00:33:00.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:33:00.155254003Z [2024-04-15T00:33:00.155+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:33:00.156165070Z [2024-04-15T00:33:00.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:33:00.156198130Z 2024-04-15T00:33:00.156208538Z 2024-04-15T00:33:00.156217455Z 2024-04-15T00:33:00.160337048Z [2024-04-15T00:33:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:33:00.160540725Z [2024-04-15T00:33:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:33:00.160839308Z [2024-04-15T00:33:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:33:00.161047092Z [2024-04-15T00:33:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:33:00.161393317Z [2024-04-15T00:33:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:33:00.161585540Z [2024-04-15T00:33:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:33:00.360505142Z [2024-04-15T00:33:00.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status queued for try_number 1 2024-04-15T00:33:00.371303432Z [2024-04-15T00:33:00.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status queued for try_number 1 2024-04-15T00:33:00.371332643Z [2024-04-15T00:33:00.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status queued for try_number 1 2024-04-15T00:33:00.380176603Z [2024-04-15T00:33:00.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bd25b88-e17f-44a2-a6f1-9a9f716981b7 2024-04-15T00:33:00.380192558Z [2024-04-15T00:33:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66f73b3f-818a-44e1-ba64-214ae032c3c4 2024-04-15T00:33:00.381087050Z [2024-04-15T00:33:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cc1a082-a703-481d-b21f-d8a0b93e6de8 2024-04-15T00:33:01.616921855Z [2024-04-15T00:33:01.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:33:01.617404607Z [2024-04-15T00:33:01.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:32:00+00:00, run_id=scheduled__2024-04-15T00:32:00+00:00, run_start_date=2024-04-15 00:33:00.087579+00:00, run_end_date=2024-04-15 00:33:01.616815+00:00, run_duration=1.529236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:32:00+00:00, data_interval_end=2024-04-15 00:33:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:33:01.635647480Z [2024-04-15T00:33:01.635+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:33:00+00:00, run_after=2024-04-15T00:34:00+00:00 2024-04-15T00:33:01.682583621Z [2024-04-15T00:33:01.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status success for try_number 1 2024-04-15T00:33:01.688539818Z [2024-04-15T00:33:01.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:32:00+00:00, map_index=-1, run_start_date=2024-04-15 00:33:00.880940+00:00, run_end_date=2024-04-15 00:33:01.285006+00:00, run_duration=0.404066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:33:00.157374+00:00, queued_by_job_id=1, pid=7876 2024-04-15T00:33:04.103620536Z [2024-04-15T00:33:04.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:33:04.104146556Z [2024-04-15T00:33:04.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:32:00+00:00, run_id=scheduled__2024-04-15T00:32:00+00:00, run_start_date=2024-04-15 00:33:00.089868+00:00, run_end_date=2024-04-15 00:33:04.103527+00:00, run_duration=4.013659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:32:00+00:00, data_interval_end=2024-04-15 00:33:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:33:04.112759504Z [2024-04-15T00:33:04.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:33:00+00:00, run_after=2024-04-15T00:34:00+00:00 2024-04-15T00:33:04.118187329Z [2024-04-15T00:33:04.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:33:04.118313522Z [2024-04-15T00:33:04.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:32:00+00:00, run_id=scheduled__2024-04-15T00:32:00+00:00, run_start_date=2024-04-15 00:33:00.088633+00:00, run_end_date=2024-04-15 00:33:04.118041+00:00, run_duration=4.029408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:32:00+00:00, data_interval_end=2024-04-15 00:33:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:33:04.127148385Z [2024-04-15T00:33:04.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:33:00+00:00, run_after=2024-04-15T00:34:00+00:00 2024-04-15T00:33:04.163352019Z [2024-04-15T00:33:04.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status success for try_number 1 2024-04-15T00:33:04.163737650Z [2024-04-15T00:33:04.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status success for try_number 1 2024-04-15T00:33:04.171643431Z [2024-04-15T00:33:04.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:32:00+00:00, map_index=-1, run_start_date=2024-04-15 00:33:01.847483+00:00, run_end_date=2024-04-15 00:33:03.138446+00:00, run_duration=1.290963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:33:00.157374+00:00, queued_by_job_id=1, pid=7894 2024-04-15T00:33:04.171692520Z [2024-04-15T00:33:04.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:32:00+00:00, map_index=-1, run_start_date=2024-04-15 00:33:02.001033+00:00, run_end_date=2024-04-15 00:33:03.789728+00:00, run_duration=1.788695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:33:00.157374+00:00, queued_by_job_id=1, pid=7895 2024-04-15T00:34:01.036327447Z [2024-04-15T00:34:01.035+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:34:01.061202539Z [2024-04-15T00:34:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:34:00+00:00, run_after=2024-04-15T00:35:00+00:00 2024-04-15T00:34:01.077749685Z [2024-04-15T00:34:01.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:34:00+00:00, run_after=2024-04-15T00:35:00+00:00 2024-04-15T00:34:01.086313123Z [2024-04-15T00:34:01.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:34:01.186145379Z [2024-04-15T00:34:01.185+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:34:01.186186687Z 2024-04-15T00:34:01.186205574Z 2024-04-15T00:34:01.186215811Z 2024-04-15T00:34:01.186224536Z 2024-04-15T00:34:01.186250089Z [2024-04-15T00:34:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:34:01.186638877Z [2024-04-15T00:34:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:34:01.187127954Z [2024-04-15T00:34:01.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:34:01.187767110Z [2024-04-15T00:34:01.187+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:34:01.189833226Z [2024-04-15T00:34:01.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:34:01.189852090Z 2024-04-15T00:34:01.189861844Z 2024-04-15T00:34:01.189870750Z 2024-04-15T00:34:01.189879385Z 2024-04-15T00:34:01.197004031Z [2024-04-15T00:34:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:34:01.197450514Z [2024-04-15T00:34:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:34:01.198132522Z [2024-04-15T00:34:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:34:01.198565823Z [2024-04-15T00:34:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:34:01.199295935Z [2024-04-15T00:34:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:34:01.199720721Z [2024-04-15T00:34:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:34:01.200338932Z [2024-04-15T00:34:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:34:01.200771758Z [2024-04-15T00:34:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:34:01.465769294Z [2024-04-15T00:34:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status queued for try_number 1 2024-04-15T00:34:01.467539010Z [2024-04-15T00:34:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:33:00+00:00 exited with status queued for try_number 1 2024-04-15T00:34:01.467749369Z [2024-04-15T00:34:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:33:00+00:00 exited with status queued for try_number 1 2024-04-15T00:34:01.467911296Z [2024-04-15T00:34:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:33:00+00:00 exited with status queued for try_number 1 2024-04-15T00:34:01.476478743Z [2024-04-15T00:34:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06d31093-d1f1-4853-888b-628e99235f1b 2024-04-15T00:34:01.476718277Z [2024-04-15T00:34:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to df6b69df-b0f1-4f26-8811-6f53a5ebddf6 2024-04-15T00:34:01.476953733Z [2024-04-15T00:34:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30a8e823-f880-40e4-b696-d5d929719851 2024-04-15T00:34:01.477130662Z [2024-04-15T00:34:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6601245d-1525-405f-b353-2e7204d7333e 2024-04-15T00:34:02.728413353Z [2024-04-15T00:34:02.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:34:02.729121395Z [2024-04-15T00:34:02.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:32:00+00:00, run_id=scheduled__2024-04-15T00:32:00+00:00, run_start_date=2024-04-15 00:34:01.098239+00:00, run_end_date=2024-04-15 00:34:02.728486+00:00, run_duration=1.630247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:32:00+00:00, data_interval_end=2024-04-15 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:34:02.738739868Z [2024-04-15T00:34:02.738+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:34:00+00:00, run_after=2024-04-15T00:36:00+00:00 2024-04-15T00:34:02.750787365Z [2024-04-15T00:34:02.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:34:02.750950530Z [2024-04-15T00:34:02.750+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:33:00+00:00, run_id=scheduled__2024-04-15T00:33:00+00:00, run_start_date=2024-04-15 00:34:01.099620+00:00, run_end_date=2024-04-15 00:34:02.750713+00:00, run_duration=1.651093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:33:00+00:00, data_interval_end=2024-04-15 00:34:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:34:02.760234232Z [2024-04-15T00:34:02.759+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:34:00+00:00, run_after=2024-04-15T00:35:00+00:00 2024-04-15T00:34:02.809317121Z [2024-04-15T00:34:02.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:32:00+00:00 exited with status success for try_number 1 2024-04-15T00:34:02.809691257Z [2024-04-15T00:34:02.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:33:00+00:00 exited with status success for try_number 1 2024-04-15T00:34:02.815379034Z [2024-04-15T00:34:02.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:33:00+00:00, map_index=-1, run_start_date=2024-04-15 00:34:01.916688+00:00, run_end_date=2024-04-15 00:34:02.431148+00:00, run_duration=0.51446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:34:01.192108+00:00, queued_by_job_id=1, pid=7929 2024-04-15T00:34:02.817453559Z [2024-04-15T00:34:02.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:32:00+00:00, map_index=-1, run_start_date=2024-04-15 00:34:01.848089+00:00, run_end_date=2024-04-15 00:34:02.208016+00:00, run_duration=0.359927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:34:01.192108+00:00, queued_by_job_id=1, pid=7928 2024-04-15T00:34:05.121604295Z [2024-04-15T00:34:05.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:34:05.121724399Z [2024-04-15T00:34:05.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:33:00+00:00, run_id=scheduled__2024-04-15T00:33:00+00:00, run_start_date=2024-04-15 00:34:01.101357+00:00, run_end_date=2024-04-15 00:34:05.121508+00:00, run_duration=4.020151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:33:00+00:00, data_interval_end=2024-04-15 00:34:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:34:05.130146914Z [2024-04-15T00:34:05.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:34:00+00:00, run_after=2024-04-15T00:35:00+00:00 2024-04-15T00:34:05.170500750Z [2024-04-15T00:34:05.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:33:00+00:00 exited with status success for try_number 1 2024-04-15T00:34:05.180359377Z [2024-04-15T00:34:05.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:33:00+00:00, map_index=-1, run_start_date=2024-04-15 00:34:03.043497+00:00, run_end_date=2024-04-15 00:34:04.472629+00:00, run_duration=1.429132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:34:01.192108+00:00, queued_by_job_id=1, pid=7951 2024-04-15T00:34:06.224176695Z [2024-04-15T00:34:06.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:34:06.224743887Z [2024-04-15T00:34:06.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:33:00+00:00, run_id=scheduled__2024-04-15T00:33:00+00:00, run_start_date=2024-04-15 00:34:01.103711+00:00, run_end_date=2024-04-15 00:34:06.224335+00:00, run_duration=5.120624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:33:00+00:00, data_interval_end=2024-04-15 00:34:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:34:06.235808072Z [2024-04-15T00:34:06.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:34:00+00:00, run_after=2024-04-15T00:35:00+00:00 2024-04-15T00:34:06.291281729Z [2024-04-15T00:34:06.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:33:00+00:00 exited with status success for try_number 1 2024-04-15T00:34:06.299566845Z [2024-04-15T00:34:06.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:33:00+00:00, map_index=-1, run_start_date=2024-04-15 00:34:03.214242+00:00, run_end_date=2024-04-15 00:34:05.145264+00:00, run_duration=1.931022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:34:01.192108+00:00, queued_by_job_id=1, pid=7953 2024-04-15T00:35:01.044707737Z [2024-04-15T00:35:01.044+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:35:01.056658979Z [2024-04-15T00:35:01.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:35:00+00:00, run_after=2024-04-15T00:36:00+00:00 2024-04-15T00:35:01.067108165Z [2024-04-15T00:35:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:35:00+00:00, run_after=2024-04-15T00:36:00+00:00 2024-04-15T00:35:01.076664622Z [2024-04-15T00:35:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:35:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:35:01.142408460Z [2024-04-15T00:35:01.141+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:35:01.142449799Z 2024-04-15T00:35:01.142460154Z 2024-04-15T00:35:01.142486569Z 2024-04-15T00:35:01.142496271Z 2024-04-15T00:35:01.142853586Z [2024-04-15T00:35:01.142+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:35:01.143367056Z [2024-04-15T00:35:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:35:01.143735207Z [2024-04-15T00:35:01.143+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:35:01.144036676Z [2024-04-15T00:35:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:35:01.145294604Z [2024-04-15T00:35:01.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:35:01.145305268Z 2024-04-15T00:35:01.145309119Z 2024-04-15T00:35:01.145312691Z 2024-04-15T00:35:01.145316383Z 2024-04-15T00:35:01.151737999Z [2024-04-15T00:35:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:35:01.151949647Z [2024-04-15T00:35:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:35:01.152292629Z [2024-04-15T00:35:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:35:01.152554128Z [2024-04-15T00:35:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:35:01.152849640Z [2024-04-15T00:35:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:35:01.153134597Z [2024-04-15T00:35:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:35:01.153432005Z [2024-04-15T00:35:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:35:01.153604024Z [2024-04-15T00:35:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:35:01.571847846Z [2024-04-15T00:35:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:35:01.572210483Z [2024-04-15T00:35:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status queued for try_number 1 2024-04-15T00:35:01.572462410Z [2024-04-15T00:35:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status queued for try_number 1 2024-04-15T00:35:01.572622022Z [2024-04-15T00:35:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status queued for try_number 1 2024-04-15T00:35:01.584998914Z [2024-04-15T00:35:01.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc9693ec-a78c-4d0e-a2b0-c0fbb4e05853 2024-04-15T00:35:01.585242822Z [2024-04-15T00:35:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e158d23-9459-459c-8c2b-ae5cecad5db9 2024-04-15T00:35:01.585456378Z [2024-04-15T00:35:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d94a63b-9199-4499-b915-1a96f2395fe1 2024-04-15T00:35:01.585656464Z [2024-04-15T00:35:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 333414cb-2895-42d7-a763-32eb33bd3525 2024-04-15T00:35:02.785662113Z [2024-04-15T00:35:02.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:35:02.785962236Z [2024-04-15T00:35:02.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:34:00+00:00, run_id=scheduled__2024-04-15T00:34:00+00:00, run_start_date=2024-04-15 00:35:01.086770+00:00, run_end_date=2024-04-15 00:35:02.785610+00:00, run_duration=1.69884, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:34:00+00:00, data_interval_end=2024-04-15 00:35:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:35:02.795913633Z [2024-04-15T00:35:02.795+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:35:00+00:00, run_after=2024-04-15T00:36:00+00:00 2024-04-15T00:35:02.837473815Z [2024-04-15T00:35:02.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status success for try_number 1 2024-04-15T00:35:02.850961339Z [2024-04-15T00:35:02.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:34:00+00:00, map_index=-1, run_start_date=2024-04-15 00:35:01.904379+00:00, run_end_date=2024-04-15 00:35:02.192399+00:00, run_duration=0.28802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:35:01.147825+00:00, queued_by_job_id=1, pid=7986 2024-04-15T00:35:03.957043750Z [2024-04-15T00:35:03.956+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:35:03.957093512Z 2024-04-15T00:35:03.957393687Z [2024-04-15T00:35:03.956+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:35:03.958274411Z [2024-04-15T00:35:03.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:35:03.958305535Z 2024-04-15T00:35:03.962087505Z [2024-04-15T00:35:03.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:35:03.962694392Z [2024-04-15T00:35:03.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:35:04.035301677Z [2024-04-15T00:35:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:35:04.035383580Z [2024-04-15T00:35:04.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:35:04.042827171Z [2024-04-15T00:35:04.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73830344-ecec-4c9a-905d-80bfd8c6a658 2024-04-15T00:35:04.042970698Z [2024-04-15T00:35:04.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=-1, run_start_date=2024-04-15 00:35:02.956995+00:00, run_end_date=2024-04-15 00:35:03.328597+00:00, run_duration=0.371602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:35:01.147825+00:00, queued_by_job_id=1, pid=8012 2024-04-15T00:35:05.183954483Z [2024-04-15T00:35:05.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:35:05.184084930Z [2024-04-15T00:35:05.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:34:00+00:00, run_id=scheduled__2024-04-15T00:34:00+00:00, run_start_date=2024-04-15 00:35:01.087709+00:00, run_end_date=2024-04-15 00:35:05.183811+00:00, run_duration=4.096102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:34:00+00:00, data_interval_end=2024-04-15 00:35:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:35:05.197952989Z [2024-04-15T00:35:05.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:35:00+00:00, run_after=2024-04-15T00:36:00+00:00 2024-04-15T00:35:05.203284244Z [2024-04-15T00:35:05.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:35:05.203491119Z [2024-04-15T00:35:05.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:34:00+00:00, run_id=scheduled__2024-04-15T00:34:00+00:00, run_start_date=2024-04-15 00:35:01.088567+00:00, run_end_date=2024-04-15 00:35:05.203185+00:00, run_duration=4.114618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:34:00+00:00, data_interval_end=2024-04-15 00:35:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:35:05.210676180Z [2024-04-15T00:35:05.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:35:00+00:00, run_after=2024-04-15T00:36:00+00:00 2024-04-15T00:35:05.248958992Z [2024-04-15T00:35:05.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status success for try_number 1 2024-04-15T00:35:05.249000847Z [2024-04-15T00:35:05.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status success for try_number 1 2024-04-15T00:35:05.254409120Z [2024-04-15T00:35:05.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:34:00+00:00, map_index=-1, run_start_date=2024-04-15 00:35:02.827262+00:00, run_end_date=2024-04-15 00:35:04.048881+00:00, run_duration=1.221619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:35:01.147825+00:00, queued_by_job_id=1, pid=8011 2024-04-15T00:35:05.254497424Z [2024-04-15T00:35:05.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:34:00+00:00, map_index=-1, run_start_date=2024-04-15 00:35:02.779543+00:00, run_end_date=2024-04-15 00:35:04.355485+00:00, run_duration=1.575942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:35:01.147825+00:00, queued_by_job_id=1, pid=8010 2024-04-15T00:35:06.355871548Z [2024-04-15T00:35:06.355+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:35:06.355912485Z 2024-04-15T00:35:06.355922856Z [2024-04-15T00:35:06.355+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:35:06.356500879Z [2024-04-15T00:35:06.356+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:35:06.356537613Z 2024-04-15T00:35:06.359766008Z [2024-04-15T00:35:06.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:35:06.359923673Z [2024-04-15T00:35:06.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:35:06.424425668Z [2024-04-15T00:35:06.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:35:06.424453217Z [2024-04-15T00:35:06.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:35:06.434638583Z [2024-04-15T00:35:06.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0af0f4f-af8c-44a0-90fc-a75adc4c779d 2024-04-15T00:35:06.434763055Z [2024-04-15T00:35:06.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=-1, run_start_date=2024-04-15 00:35:05.543311+00:00, run_end_date=2024-04-15 00:35:05.909474+00:00, run_duration=0.366163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:35:03.958934+00:00, queued_by_job_id=1, pid=8035 2024-04-15T00:35:08.938535908Z [2024-04-15T00:35:08.938+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:35:08.938555880Z 2024-04-15T00:35:08.938902055Z [2024-04-15T00:35:08.938+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:35:08.939823996Z [2024-04-15T00:35:08.939+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:35:08.939877521Z 2024-04-15T00:35:08.943435653Z [2024-04-15T00:35:08.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:35:08.944814225Z [2024-04-15T00:35:08.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:35:08.994602762Z [2024-04-15T00:35:08.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status queued for try_number 1 2024-04-15T00:35:08.994805893Z [2024-04-15T00:35:08.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:35:08.999536198Z [2024-04-15T00:35:08.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77721262-c90f-4f9e-97cd-8c1b44c2ad9d 2024-04-15T00:35:08.999881682Z [2024-04-15T00:35:08.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=0, run_start_date=2024-04-15 00:35:07.857205+00:00, run_end_date=2024-04-15 00:35:08.193724+00:00, run_duration=0.336519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:35:06.357038+00:00, queued_by_job_id=1, pid=8043 2024-04-15T00:35:11.228534150Z [2024-04-15T00:35:11.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:35:11.228949949Z [2024-04-15T00:35:11.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:30:00+00:00, run_id=scheduled__2024-04-15T00:30:00+00:00, run_start_date=2024-04-15 00:35:01.085785+00:00, run_end_date=2024-04-15 00:35:11.228330+00:00, run_duration=10.142545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:30:00+00:00, data_interval_end=2024-04-15 00:35:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:35:11.237931433Z [2024-04-15T00:35:11.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:35:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:35:11.286332630Z [2024-04-15T00:35:11.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:30:00+00:00 exited with status success for try_number 1 2024-04-15T00:35:11.295297340Z [2024-04-15T00:35:11.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:30:00+00:00, map_index=-1, run_start_date=2024-04-15 00:35:10.522823+00:00, run_end_date=2024-04-15 00:35:10.887258+00:00, run_duration=0.364435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:35:08.941037+00:00, queued_by_job_id=1, pid=8051 2024-04-15T00:36:00.966089386Z [2024-04-15T00:36:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:36:00+00:00, run_after=2024-04-15T00:37:00+00:00 2024-04-15T00:36:00.982990602Z [2024-04-15T00:36:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:36:00+00:00, run_after=2024-04-15T00:37:00+00:00 2024-04-15T00:36:00.991455716Z [2024-04-15T00:36:00.991+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:36:01.000084695Z [2024-04-15T00:36:00.999+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:36:01.093302995Z [2024-04-15T00:36:01.092+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:36:01.093381751Z 2024-04-15T00:36:01.093391330Z 2024-04-15T00:36:01.093399133Z 2024-04-15T00:36:01.093407016Z 2024-04-15T00:36:01.093418380Z [2024-04-15T00:36:01.093+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:36:01.093458740Z [2024-04-15T00:36:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:36:01.093809581Z [2024-04-15T00:36:01.093+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:36:01.094106366Z [2024-04-15T00:36:01.093+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:36:01.095312919Z [2024-04-15T00:36:01.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:36:01.095340022Z 2024-04-15T00:36:01.095347119Z 2024-04-15T00:36:01.095353027Z 2024-04-15T00:36:01.095359365Z 2024-04-15T00:36:01.100516974Z [2024-04-15T00:36:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:36:01.100550279Z [2024-04-15T00:36:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:36:01.100985252Z [2024-04-15T00:36:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:36:01.101261771Z [2024-04-15T00:36:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:36:01.101666914Z [2024-04-15T00:36:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:36:01.101926240Z [2024-04-15T00:36:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:36:01.102366060Z [2024-04-15T00:36:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:36:01.102569606Z [2024-04-15T00:36:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:36:01.338425354Z [2024-04-15T00:36:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status queued for try_number 1 2024-04-15T00:36:01.340056276Z [2024-04-15T00:36:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status queued for try_number 1 2024-04-15T00:36:01.340150825Z [2024-04-15T00:36:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status queued for try_number 1 2024-04-15T00:36:01.340234222Z [2024-04-15T00:36:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status queued for try_number 1 2024-04-15T00:36:01.349419447Z [2024-04-15T00:36:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c3382e4-9dfd-4e21-9533-d4a009ac1d87 2024-04-15T00:36:01.349574932Z [2024-04-15T00:36:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to e08fc8ff-30b2-4112-aa3b-9a55c401fd53 2024-04-15T00:36:01.349711606Z [2024-04-15T00:36:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9774916-5959-45ed-a1bd-34679eddd877 2024-04-15T00:36:01.349863969Z [2024-04-15T00:36:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to f09433bb-2ddb-402c-8c65-5db8209f23ad 2024-04-15T00:36:02.503833196Z [2024-04-15T00:36:02.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:36:02.504549366Z [2024-04-15T00:36:02.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:34:00+00:00, run_id=scheduled__2024-04-15T00:34:00+00:00, run_start_date=2024-04-15 00:36:01.014150+00:00, run_end_date=2024-04-15 00:36:02.504037+00:00, run_duration=1.489887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:34:00+00:00, data_interval_end=2024-04-15 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:36:02.511780277Z [2024-04-15T00:36:02.511+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:36:00+00:00, run_after=2024-04-15T00:38:00+00:00 2024-04-15T00:36:02.517744195Z [2024-04-15T00:36:02.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:36:02.518100928Z [2024-04-15T00:36:02.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:35:00+00:00, run_id=scheduled__2024-04-15T00:35:00+00:00, run_start_date=2024-04-15 00:36:01.015386+00:00, run_end_date=2024-04-15 00:36:02.517800+00:00, run_duration=1.502414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:35:00+00:00, data_interval_end=2024-04-15 00:36:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:36:02.525915668Z [2024-04-15T00:36:02.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:36:00+00:00, run_after=2024-04-15T00:37:00+00:00 2024-04-15T00:36:02.569774192Z [2024-04-15T00:36:02.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:34:00+00:00 exited with status success for try_number 1 2024-04-15T00:36:02.570204423Z [2024-04-15T00:36:02.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status success for try_number 1 2024-04-15T00:36:02.579790494Z [2024-04-15T00:36:02.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:34:00+00:00, map_index=-1, run_start_date=2024-04-15 00:36:01.876760+00:00, run_end_date=2024-04-15 00:36:02.209821+00:00, run_duration=0.333061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:36:01.096637+00:00, queued_by_job_id=1, pid=8076 2024-04-15T00:36:02.580081138Z [2024-04-15T00:36:02.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:35:00+00:00, map_index=-1, run_start_date=2024-04-15 00:36:01.837681+00:00, run_end_date=2024-04-15 00:36:02.243321+00:00, run_duration=0.40564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:36:01.096637+00:00, queued_by_job_id=1, pid=8075 2024-04-15T00:36:02.923196039Z [2024-04-15T00:36:02.922+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:36:04.981772816Z [2024-04-15T00:36:04.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:36:04.982192617Z [2024-04-15T00:36:04.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:35:00+00:00, run_id=scheduled__2024-04-15T00:35:00+00:00, run_start_date=2024-04-15 00:36:01.018904+00:00, run_end_date=2024-04-15 00:36:04.981688+00:00, run_duration=3.962784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:35:00+00:00, data_interval_end=2024-04-15 00:36:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:36:04.996367322Z [2024-04-15T00:36:04.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:36:00+00:00, run_after=2024-04-15T00:37:00+00:00 2024-04-15T00:36:05.014416834Z [2024-04-15T00:36:05.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:36:05.015151068Z [2024-04-15T00:36:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:35:00+00:00, run_id=scheduled__2024-04-15T00:35:00+00:00, run_start_date=2024-04-15 00:36:01.017888+00:00, run_end_date=2024-04-15 00:36:05.014215+00:00, run_duration=3.996327, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:35:00+00:00, data_interval_end=2024-04-15 00:36:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:36:05.034958071Z [2024-04-15T00:36:05.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:36:00+00:00, run_after=2024-04-15T00:37:00+00:00 2024-04-15T00:36:05.080847820Z [2024-04-15T00:36:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status success for try_number 1 2024-04-15T00:36:05.081295634Z [2024-04-15T00:36:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status success for try_number 1 2024-04-15T00:36:05.092834049Z [2024-04-15T00:36:05.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:35:00+00:00, map_index=-1, run_start_date=2024-04-15 00:36:02.790297+00:00, run_end_date=2024-04-15 00:36:04.304357+00:00, run_duration=1.51406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:36:01.096637+00:00, queued_by_job_id=1, pid=8099 2024-04-15T00:36:05.093236312Z [2024-04-15T00:36:05.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:35:00+00:00, map_index=-1, run_start_date=2024-04-15 00:36:02.864410+00:00, run_end_date=2024-04-15 00:36:04.628263+00:00, run_duration=1.763853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:36:01.096637+00:00, queued_by_job_id=1, pid=8100 2024-04-15T00:37:00.789265605Z [2024-04-15T00:37:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:37:00+00:00, run_after=2024-04-15T00:38:00+00:00 2024-04-15T00:37:00.796142707Z [2024-04-15T00:37:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:37:00.806244227Z [2024-04-15T00:37:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:37:00+00:00, run_after=2024-04-15T00:38:00+00:00 2024-04-15T00:37:00.876042437Z [2024-04-15T00:37:00.875+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:37:00.876107659Z 2024-04-15T00:37:00.876117696Z 2024-04-15T00:37:00.876126395Z 2024-04-15T00:37:00.876135044Z [2024-04-15T00:37:00.875+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:37:00.876193517Z [2024-04-15T00:37:00.875+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:37:00.876348897Z [2024-04-15T00:37:00.876+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:37:00.876858869Z [2024-04-15T00:37:00.876+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:37:00.876895131Z 2024-04-15T00:37:00.876904773Z 2024-04-15T00:37:00.876913303Z 2024-04-15T00:37:00.880223671Z [2024-04-15T00:37:00.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:37:00.880273096Z [2024-04-15T00:37:00.880+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:37:00.880564886Z [2024-04-15T00:37:00.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:37:00.880696772Z [2024-04-15T00:37:00.880+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:37:00.880898625Z [2024-04-15T00:37:00.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:37:00.881028543Z [2024-04-15T00:37:00.880+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:37:01.059596967Z [2024-04-15T00:37:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status queued for try_number 1 2024-04-15T00:37:01.059661839Z [2024-04-15T00:37:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status queued for try_number 1 2024-04-15T00:37:01.059694659Z [2024-04-15T00:37:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status queued for try_number 1 2024-04-15T00:37:01.068223207Z [2024-04-15T00:37:01.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to 442fac3c-cae4-47b7-8330-250e364c66d6 2024-04-15T00:37:01.068280231Z [2024-04-15T00:37:01.068+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb0fd343-5710-43f9-8ce5-2038db68c439 2024-04-15T00:37:01.068383134Z [2024-04-15T00:37:01.068+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dae6a8b-4e78-4177-b204-d204b3b3ec97 2024-04-15T00:37:02.210154250Z [2024-04-15T00:37:02.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:37:02.210278525Z [2024-04-15T00:37:02.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:36:00+00:00, run_id=scheduled__2024-04-15T00:36:00+00:00, run_start_date=2024-04-15 00:37:00.816737+00:00, run_end_date=2024-04-15 00:37:02.210015+00:00, run_duration=1.393278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:36:00+00:00, data_interval_end=2024-04-15 00:37:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:37:02.218262842Z [2024-04-15T00:37:02.217+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:37:00+00:00, run_after=2024-04-15T00:38:00+00:00 2024-04-15T00:37:02.244676111Z [2024-04-15T00:37:02.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status success for try_number 1 2024-04-15T00:37:02.257157811Z [2024-04-15T00:37:02.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:36:00+00:00, map_index=-1, run_start_date=2024-04-15 00:37:01.513650+00:00, run_end_date=2024-04-15 00:37:01.813963+00:00, run_duration=0.300313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:37:00.877557+00:00, queued_by_job_id=1, pid=8131 2024-04-15T00:37:04.435800603Z [2024-04-15T00:37:04.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:37:04.436254386Z [2024-04-15T00:37:04.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:36:00+00:00, run_id=scheduled__2024-04-15T00:36:00+00:00, run_start_date=2024-04-15 00:37:00.817955+00:00, run_end_date=2024-04-15 00:37:04.435671+00:00, run_duration=3.617716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:36:00+00:00, data_interval_end=2024-04-15 00:37:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:37:04.446297506Z [2024-04-15T00:37:04.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:37:00+00:00, run_after=2024-04-15T00:38:00+00:00 2024-04-15T00:37:04.453325153Z [2024-04-15T00:37:04.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:37:04.453704425Z [2024-04-15T00:37:04.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:36:00+00:00, run_id=scheduled__2024-04-15T00:36:00+00:00, run_start_date=2024-04-15 00:37:00.818986+00:00, run_end_date=2024-04-15 00:37:04.453219+00:00, run_duration=3.634233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:36:00+00:00, data_interval_end=2024-04-15 00:37:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:37:04.462680244Z [2024-04-15T00:37:04.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:37:00+00:00, run_after=2024-04-15T00:38:00+00:00 2024-04-15T00:37:04.502737764Z [2024-04-15T00:37:04.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status success for try_number 1 2024-04-15T00:37:04.514290075Z [2024-04-15T00:37:04.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:36:00+00:00, map_index=-1, run_start_date=2024-04-15 00:37:02.515394+00:00, run_end_date=2024-04-15 00:37:03.792132+00:00, run_duration=1.276738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:37:00.877557+00:00, queued_by_job_id=1, pid=8149 2024-04-15T00:37:05.606497004Z [2024-04-15T00:37:05.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status success for try_number 1 2024-04-15T00:37:05.615171403Z [2024-04-15T00:37:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:36:00+00:00, map_index=-1, run_start_date=2024-04-15 00:37:02.593866+00:00, run_end_date=2024-04-15 00:37:04.354955+00:00, run_duration=1.761089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:37:00.877557+00:00, queued_by_job_id=1, pid=8150 2024-04-15T00:38:00.159472299Z [2024-04-15T00:38:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:38:00.165852888Z [2024-04-15T00:38:00.165+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:38:00.176613472Z [2024-04-15T00:38:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:38:00+00:00, run_after=2024-04-15T00:39:00+00:00 2024-04-15T00:38:00.187426507Z [2024-04-15T00:38:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:38:00+00:00, run_after=2024-04-15T00:39:00+00:00 2024-04-15T00:38:00.277026230Z [2024-04-15T00:38:00.276+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:38:00.277063846Z 2024-04-15T00:38:00.277075526Z 2024-04-15T00:38:00.277084649Z 2024-04-15T00:38:00.277093309Z 2024-04-15T00:38:00.277581802Z [2024-04-15T00:38:00.277+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:38:00.277839097Z [2024-04-15T00:38:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:38:00.278222525Z [2024-04-15T00:38:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:38:00.278751925Z [2024-04-15T00:38:00.278+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:38:00.280691780Z [2024-04-15T00:38:00.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:38:00.280722632Z 2024-04-15T00:38:00.280733329Z 2024-04-15T00:38:00.280742121Z 2024-04-15T00:38:00.280751552Z 2024-04-15T00:38:00.287174955Z [2024-04-15T00:38:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:38:00.287258695Z [2024-04-15T00:38:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:38:00.287554643Z [2024-04-15T00:38:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:38:00.287889351Z [2024-04-15T00:38:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:38:00.288402460Z [2024-04-15T00:38:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:38:00.288666894Z [2024-04-15T00:38:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:38:00.289263722Z [2024-04-15T00:38:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:38:00.289380526Z [2024-04-15T00:38:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:38:00.791548476Z [2024-04-15T00:38:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status queued for try_number 1 2024-04-15T00:38:00.791793739Z [2024-04-15T00:38:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:37:00+00:00 exited with status queued for try_number 1 2024-04-15T00:38:00.792010916Z [2024-04-15T00:38:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:37:00+00:00 exited with status queued for try_number 1 2024-04-15T00:38:00.792233606Z [2024-04-15T00:38:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:37:00+00:00 exited with status queued for try_number 1 2024-04-15T00:38:00.812489993Z [2024-04-15T00:38:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9a14efa-6c28-48a5-bc65-2e6e5d36861f 2024-04-15T00:38:00.812945706Z [2024-04-15T00:38:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c6dc0fc-0dc0-4c93-92ff-b8f59d4d4998 2024-04-15T00:38:00.813268158Z [2024-04-15T00:38:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e58e2d2-d7b1-4fc1-be77-42fd70b12c0e 2024-04-15T00:38:00.813537589Z [2024-04-15T00:38:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbc933f3-7133-4b76-be8c-1c4fae32a015 2024-04-15T00:38:01.979102243Z [2024-04-15T00:38:01.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:38:01.979458259Z [2024-04-15T00:38:01.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:36:00+00:00, run_id=scheduled__2024-04-15T00:36:00+00:00, run_start_date=2024-04-15 00:38:00.199833+00:00, run_end_date=2024-04-15 00:38:01.979148+00:00, run_duration=1.779315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:36:00+00:00, data_interval_end=2024-04-15 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:38:01.986679258Z [2024-04-15T00:38:01.986+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:38:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:38:02.000707492Z [2024-04-15T00:38:02.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:38:02.003780333Z [2024-04-15T00:38:02.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:37:00+00:00, run_id=scheduled__2024-04-15T00:37:00+00:00, run_start_date=2024-04-15 00:38:00.201056+00:00, run_end_date=2024-04-15 00:38:02.003461+00:00, run_duration=1.802405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:37:00+00:00, data_interval_end=2024-04-15 00:38:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:38:02.022215586Z [2024-04-15T00:38:02.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:38:00+00:00, run_after=2024-04-15T00:39:00+00:00 2024-04-15T00:38:02.067592656Z [2024-04-15T00:38:02.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:36:00+00:00 exited with status success for try_number 1 2024-04-15T00:38:02.067797385Z [2024-04-15T00:38:02.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:37:00+00:00 exited with status success for try_number 1 2024-04-15T00:38:02.074092222Z [2024-04-15T00:38:02.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:36:00+00:00, map_index=-1, run_start_date=2024-04-15 00:38:01.024658+00:00, run_end_date=2024-04-15 00:38:01.349020+00:00, run_duration=0.324362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:38:00.283015+00:00, queued_by_job_id=1, pid=8184 2024-04-15T00:38:02.074384496Z [2024-04-15T00:38:02.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:37:00+00:00, map_index=-1, run_start_date=2024-04-15 00:38:01.048777+00:00, run_end_date=2024-04-15 00:38:01.381622+00:00, run_duration=0.332845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:38:00.283015+00:00, queued_by_job_id=1, pid=8185 2024-04-15T00:38:04.240178340Z [2024-04-15T00:38:04.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:38:04.240307811Z [2024-04-15T00:38:04.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:37:00+00:00, run_id=scheduled__2024-04-15T00:37:00+00:00, run_start_date=2024-04-15 00:38:00.203237+00:00, run_end_date=2024-04-15 00:38:04.240007+00:00, run_duration=4.03677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:37:00+00:00, data_interval_end=2024-04-15 00:38:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:38:04.252257380Z [2024-04-15T00:38:04.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:38:00+00:00, run_after=2024-04-15T00:39:00+00:00 2024-04-15T00:38:04.259864836Z [2024-04-15T00:38:04.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:38:04.260291811Z [2024-04-15T00:38:04.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:37:00+00:00, run_id=scheduled__2024-04-15T00:37:00+00:00, run_start_date=2024-04-15 00:38:00.202155+00:00, run_end_date=2024-04-15 00:38:04.259849+00:00, run_duration=4.057694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:37:00+00:00, data_interval_end=2024-04-15 00:38:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:38:04.280716616Z [2024-04-15T00:38:04.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:38:00+00:00, run_after=2024-04-15T00:39:00+00:00 2024-04-15T00:38:04.329162871Z [2024-04-15T00:38:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:37:00+00:00 exited with status success for try_number 1 2024-04-15T00:38:04.334530391Z [2024-04-15T00:38:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:37:00+00:00 exited with status success for try_number 1 2024-04-15T00:38:04.342685680Z [2024-04-15T00:38:04.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:37:00+00:00, map_index=-1, run_start_date=2024-04-15 00:38:02.110085+00:00, run_end_date=2024-04-15 00:38:03.354710+00:00, run_duration=1.244625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:38:00.283015+00:00, queued_by_job_id=1, pid=8209 2024-04-15T00:38:04.342809372Z [2024-04-15T00:38:04.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:37:00+00:00, map_index=-1, run_start_date=2024-04-15 00:38:02.092154+00:00, run_end_date=2024-04-15 00:38:03.729563+00:00, run_duration=1.637409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:38:00.283015+00:00, queued_by_job_id=1, pid=8208 2024-04-15T00:39:00.548282521Z [2024-04-15T00:39:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:39:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:39:00.555753272Z [2024-04-15T00:39:00.555+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:39:00.566268205Z [2024-04-15T00:39:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:39:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:39:00.665926837Z [2024-04-15T00:39:00.665+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:39:00.666005088Z 2024-04-15T00:39:00.666012338Z 2024-04-15T00:39:00.666017856Z 2024-04-15T00:39:00.666023765Z [2024-04-15T00:39:00.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:39:00.666075909Z [2024-04-15T00:39:00.665+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:39:00.673053921Z [2024-04-15T00:39:00.665+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:39:00.673956018Z [2024-04-15T00:39:00.673+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:39:00.673962922Z 2024-04-15T00:39:00.673966315Z 2024-04-15T00:39:00.673969667Z 2024-04-15T00:39:00.679114329Z [2024-04-15T00:39:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:39:00.680437551Z [2024-04-15T00:39:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:39:00.680449493Z [2024-04-15T00:39:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:39:00.680458312Z [2024-04-15T00:39:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:39:00.680462355Z [2024-04-15T00:39:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:39:00.689109902Z [2024-04-15T00:39:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:39:00.896114369Z [2024-04-15T00:39:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status queued for try_number 1 2024-04-15T00:39:00.896254346Z [2024-04-15T00:39:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status queued for try_number 1 2024-04-15T00:39:00.896423266Z [2024-04-15T00:39:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status queued for try_number 1 2024-04-15T00:39:00.905119977Z [2024-04-15T00:39:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e5cd6fa-e2c0-4639-ad68-c4b1b15e8831 2024-04-15T00:39:00.905275828Z [2024-04-15T00:39:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3859f39-542a-464c-9cb9-4a55d8fa8281 2024-04-15T00:39:00.905452409Z [2024-04-15T00:39:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to a06b62fd-4143-46da-885b-3644c10fe933 2024-04-15T00:39:02.066005114Z [2024-04-15T00:39:02.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:39:02.066450286Z [2024-04-15T00:39:02.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:38:00+00:00, run_id=scheduled__2024-04-15T00:38:00+00:00, run_start_date=2024-04-15 00:39:00.582803+00:00, run_end_date=2024-04-15 00:39:02.066079+00:00, run_duration=1.483276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:38:00+00:00, data_interval_end=2024-04-15 00:39:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:39:02.076014265Z [2024-04-15T00:39:02.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:39:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:39:02.117433234Z [2024-04-15T00:39:02.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status success for try_number 1 2024-04-15T00:39:02.124657413Z [2024-04-15T00:39:02.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:38:00+00:00, map_index=-1, run_start_date=2024-04-15 00:39:01.380523+00:00, run_end_date=2024-04-15 00:39:01.703944+00:00, run_duration=0.323421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:39:00.676257+00:00, queued_by_job_id=1, pid=8242 2024-04-15T00:39:04.197762309Z [2024-04-15T00:39:04.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:39:04.198142998Z [2024-04-15T00:39:04.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:38:00+00:00, run_id=scheduled__2024-04-15T00:38:00+00:00, run_start_date=2024-04-15 00:39:00.584361+00:00, run_end_date=2024-04-15 00:39:04.197522+00:00, run_duration=3.613161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:38:00+00:00, data_interval_end=2024-04-15 00:39:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:39:04.207341478Z [2024-04-15T00:39:04.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:39:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:39:04.232280952Z [2024-04-15T00:39:04.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status success for try_number 1 2024-04-15T00:39:04.237159127Z [2024-04-15T00:39:04.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:38:00+00:00, map_index=-1, run_start_date=2024-04-15 00:39:02.520138+00:00, run_end_date=2024-04-15 00:39:03.771821+00:00, run_duration=1.251683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:39:00.676257+00:00, queued_by_job_id=1, pid=8261 2024-04-15T00:39:05.284456379Z [2024-04-15T00:39:05.284+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:39:05.284870103Z [2024-04-15T00:39:05.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:38:00+00:00, run_id=scheduled__2024-04-15T00:38:00+00:00, run_start_date=2024-04-15 00:39:00.585562+00:00, run_end_date=2024-04-15 00:39:05.284356+00:00, run_duration=4.698794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:38:00+00:00, data_interval_end=2024-04-15 00:39:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:39:05.292709959Z [2024-04-15T00:39:05.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:39:00+00:00, run_after=2024-04-15T00:40:00+00:00 2024-04-15T00:39:05.322638734Z [2024-04-15T00:39:05.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status success for try_number 1 2024-04-15T00:39:05.327411540Z [2024-04-15T00:39:05.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:38:00+00:00, map_index=-1, run_start_date=2024-04-15 00:39:02.490370+00:00, run_end_date=2024-04-15 00:39:04.085150+00:00, run_duration=1.59478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:39:00.676257+00:00, queued_by_job_id=1, pid=8260 2024-04-15T00:40:00.151428980Z [2024-04-15T00:40:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:45:00+00:00 2024-04-15T00:40:00.166509067Z [2024-04-15T00:40:00.166+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:40:00.174529767Z [2024-04-15T00:40:00.174+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:40:00.191731196Z [2024-04-15T00:40:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:41:00+00:00 2024-04-15T00:40:00.205550424Z [2024-04-15T00:40:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:41:00+00:00 2024-04-15T00:40:00.351367559Z [2024-04-15T00:40:00.351+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T00:40:00.351386647Z 2024-04-15T00:40:00.351390491Z 2024-04-15T00:40:00.351394403Z 2024-04-15T00:40:00.351397621Z 2024-04-15T00:40:00.351401616Z 2024-04-15T00:40:00.351751658Z [2024-04-15T00:40:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:40:00.351810167Z [2024-04-15T00:40:00.351+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:40:00.351881733Z [2024-04-15T00:40:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:40:00.351944502Z [2024-04-15T00:40:00.351+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:40:00.352014405Z [2024-04-15T00:40:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:40:00.352450248Z [2024-04-15T00:40:00.352+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:40:00.352457071Z 2024-04-15T00:40:00.352460777Z 2024-04-15T00:40:00.352473764Z 2024-04-15T00:40:00.352477344Z 2024-04-15T00:40:00.352480524Z 2024-04-15T00:40:00.355488979Z [2024-04-15T00:40:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:40:00.355550454Z [2024-04-15T00:40:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:40:00.355794852Z [2024-04-15T00:40:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:40:00.355881411Z [2024-04-15T00:40:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:40:00.356082166Z [2024-04-15T00:40:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:40:00.356116085Z [2024-04-15T00:40:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:40:00.356244012Z [2024-04-15T00:40:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:40:00.356298911Z [2024-04-15T00:40:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:40:00.356421152Z [2024-04-15T00:40:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:40:00.356743110Z [2024-04-15T00:40:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:40:00.934065310Z [2024-04-15T00:40:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:00.934335006Z [2024-04-15T00:40:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:00.935368953Z [2024-04-15T00:40:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:39:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:00.935550201Z [2024-04-15T00:40:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:39:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:00.935754850Z [2024-04-15T00:40:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:39:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:00.952217120Z [2024-04-15T00:40:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d5c1f49-add3-4bc9-948a-9f56c5c01f44 2024-04-15T00:40:00.952363031Z [2024-04-15T00:40:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3faefebb-5691-4c3c-8586-2e159579c651 2024-04-15T00:40:00.952606591Z [2024-04-15T00:40:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a356138-9a2b-4fb7-bf0c-e346c8646f05 2024-04-15T00:40:00.952795347Z [2024-04-15T00:40:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad5fe8b0-82e5-46c5-b2af-c1761bb8e46c 2024-04-15T00:40:00.952995171Z [2024-04-15T00:40:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67c8a995-d2fe-4a0a-8db5-ed4a426f3b86 2024-04-15T00:40:02.279529270Z [2024-04-15T00:40:02.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:40:02.279920205Z [2024-04-15T00:40:02.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:38:00+00:00, run_id=scheduled__2024-04-15T00:38:00+00:00, run_start_date=2024-04-15 00:40:00.223042+00:00, run_end_date=2024-04-15 00:40:02.279608+00:00, run_duration=2.056566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:38:00+00:00, data_interval_end=2024-04-15 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:40:02.291676875Z [2024-04-15T00:40:02.291+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:42:00+00:00 2024-04-15T00:40:02.303304993Z [2024-04-15T00:40:02.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:40:02.303550149Z [2024-04-15T00:40:02.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:39:00+00:00, run_id=scheduled__2024-04-15T00:39:00+00:00, run_start_date=2024-04-15 00:40:00.224229+00:00, run_end_date=2024-04-15 00:40:02.303331+00:00, run_duration=2.079102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:39:00+00:00, data_interval_end=2024-04-15 00:40:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:40:02.312610152Z [2024-04-15T00:40:02.312+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:41:00+00:00 2024-04-15T00:40:02.351194076Z [2024-04-15T00:40:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:38:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:02.351526448Z [2024-04-15T00:40:02.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:39:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:02.359345343Z [2024-04-15T00:40:02.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:39:00+00:00, map_index=-1, run_start_date=2024-04-15 00:40:01.436205+00:00, run_end_date=2024-04-15 00:40:01.817467+00:00, run_duration=0.381262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:00.353274+00:00, queued_by_job_id=1, pid=8302 2024-04-15T00:40:02.359580887Z [2024-04-15T00:40:02.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:38:00+00:00, map_index=-1, run_start_date=2024-04-15 00:40:01.070130+00:00, run_end_date=2024-04-15 00:40:01.485440+00:00, run_duration=0.41531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:00.353274+00:00, queued_by_job_id=1, pid=8291 2024-04-15T00:40:03.460857257Z [2024-04-15T00:40:03.460+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:40:03.460891343Z 2024-04-15T00:40:03.460998969Z [2024-04-15T00:40:03.460+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:40:03.461921181Z [2024-04-15T00:40:03.461+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:40:03.461930772Z 2024-04-15T00:40:03.465011526Z [2024-04-15T00:40:03.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:40:03.465201416Z [2024-04-15T00:40:03.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:40:03.509182628Z [2024-04-15T00:40:03.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:03.509308447Z [2024-04-15T00:40:03.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:03.513598984Z [2024-04-15T00:40:03.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81980aca-774a-420b-885d-54d595d530ed 2024-04-15T00:40:03.513759026Z [2024-04-15T00:40:03.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:35:00+00:00, map_index=-1, run_start_date=2024-04-15 00:40:02.246470+00:00, run_end_date=2024-04-15 00:40:02.588263+00:00, run_duration=0.341793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:00.353274+00:00, queued_by_job_id=1, pid=8326 2024-04-15T00:40:05.306122184Z [2024-04-15T00:40:05.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:40:05.306527538Z [2024-04-15T00:40:05.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:39:00+00:00, run_id=scheduled__2024-04-15T00:39:00+00:00, run_start_date=2024-04-15 00:40:00.226507+00:00, run_end_date=2024-04-15 00:40:05.306000+00:00, run_duration=5.079493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:39:00+00:00, data_interval_end=2024-04-15 00:40:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:40:05.326589818Z [2024-04-15T00:40:05.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:41:00+00:00 2024-04-15T00:40:05.335324048Z [2024-04-15T00:40:05.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:40:05.335824643Z [2024-04-15T00:40:05.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:39:00+00:00, run_id=scheduled__2024-04-15T00:39:00+00:00, run_start_date=2024-04-15 00:40:00.225382+00:00, run_end_date=2024-04-15 00:40:05.335360+00:00, run_duration=5.109978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:39:00+00:00, data_interval_end=2024-04-15 00:40:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:40:05.345502174Z [2024-04-15T00:40:05.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:41:00+00:00 2024-04-15T00:40:05.384119160Z [2024-04-15T00:40:05.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:39:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:05.384298971Z [2024-04-15T00:40:05.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:39:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:05.390224452Z [2024-04-15T00:40:05.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:39:00+00:00, map_index=-1, run_start_date=2024-04-15 00:40:02.396767+00:00, run_end_date=2024-04-15 00:40:04.764603+00:00, run_duration=2.367836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:00.353274+00:00, queued_by_job_id=1, pid=8328 2024-04-15T00:40:05.390499744Z [2024-04-15T00:40:05.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:39:00+00:00, map_index=-1, run_start_date=2024-04-15 00:40:02.391441+00:00, run_end_date=2024-04-15 00:40:04.458834+00:00, run_duration=2.067393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:00.353274+00:00, queued_by_job_id=1, pid=8327 2024-04-15T00:40:06.484983292Z [2024-04-15T00:40:06.484+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:40:06.485028733Z 2024-04-15T00:40:06.485316126Z [2024-04-15T00:40:06.484+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:40:06.486274579Z [2024-04-15T00:40:06.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:40:06.486299215Z 2024-04-15T00:40:06.489329392Z [2024-04-15T00:40:06.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:40:06.489571932Z [2024-04-15T00:40:06.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:40:06.563462367Z [2024-04-15T00:40:06.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:06.563724393Z [2024-04-15T00:40:06.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:06.569949407Z [2024-04-15T00:40:06.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38bfc284-5b96-4e62-ba4e-ae3e1aba5084 2024-04-15T00:40:06.570146004Z [2024-04-15T00:40:06.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:35:00+00:00, map_index=-1, run_start_date=2024-04-15 00:40:05.125871+00:00, run_end_date=2024-04-15 00:40:05.457572+00:00, run_duration=0.331701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:03.462360+00:00, queued_by_job_id=1, pid=8351 2024-04-15T00:40:09.008767770Z [2024-04-15T00:40:09.008+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:40:09.008829696Z 2024-04-15T00:40:09.009060882Z [2024-04-15T00:40:09.008+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:40:09.010188390Z [2024-04-15T00:40:09.009+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:40:09.010222756Z 2024-04-15T00:40:09.014838383Z [2024-04-15T00:40:09.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:40:09.014960120Z [2024-04-15T00:40:09.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:40:09.072374845Z [2024-04-15T00:40:09.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status queued for try_number 1 2024-04-15T00:40:09.072624990Z [2024-04-15T00:40:09.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:09.081007602Z [2024-04-15T00:40:09.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 120da219-2bda-46c4-8956-3ceab0102ab8 2024-04-15T00:40:09.081312321Z [2024-04-15T00:40:09.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:35:00+00:00, map_index=0, run_start_date=2024-04-15 00:40:07.916095+00:00, run_end_date=2024-04-15 00:40:08.254530+00:00, run_duration=0.338435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:06.486814+00:00, queued_by_job_id=1, pid=8359 2024-04-15T00:40:11.558654918Z [2024-04-15T00:40:11.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:40:11.559037150Z [2024-04-15T00:40:11.558+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:35:00+00:00, run_id=scheduled__2024-04-15T00:35:00+00:00, run_start_date=2024-04-15 00:40:00.221338+00:00, run_end_date=2024-04-15 00:40:11.558449+00:00, run_duration=11.337111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:35:00+00:00, data_interval_end=2024-04-15 00:40:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:40:11.567926263Z [2024-04-15T00:40:11.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:40:00+00:00, run_after=2024-04-15T00:45:00+00:00 2024-04-15T00:40:11.606538852Z [2024-04-15T00:40:11.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:35:00+00:00 exited with status success for try_number 1 2024-04-15T00:40:11.614604366Z [2024-04-15T00:40:11.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:35:00+00:00, map_index=-1, run_start_date=2024-04-15 00:40:10.428595+00:00, run_end_date=2024-04-15 00:40:10.824989+00:00, run_duration=0.396394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:40:09.010837+00:00, queued_by_job_id=1, pid=8367 2024-04-15T00:41:00.158103821Z [2024-04-15T00:41:00.157+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:41:00.172107774Z [2024-04-15T00:41:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:41:00+00:00, run_after=2024-04-15T00:42:00+00:00 2024-04-15T00:41:00.182391991Z [2024-04-15T00:41:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:41:00+00:00, run_after=2024-04-15T00:42:00+00:00 2024-04-15T00:41:00.233620376Z [2024-04-15T00:41:00.233+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:41:00.233641899Z 2024-04-15T00:41:00.233645706Z 2024-04-15T00:41:00.233648913Z 2024-04-15T00:41:00.233876325Z [2024-04-15T00:41:00.233+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:41:00.234202577Z [2024-04-15T00:41:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:41:00.234358595Z [2024-04-15T00:41:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:41:00.234939338Z [2024-04-15T00:41:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:41:00.234950853Z 2024-04-15T00:41:00.234953905Z 2024-04-15T00:41:00.234956801Z 2024-04-15T00:41:00.237779689Z [2024-04-15T00:41:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:41:00.238033865Z [2024-04-15T00:41:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:41:00.238348400Z [2024-04-15T00:41:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:41:00.238570615Z [2024-04-15T00:41:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:41:00.238902062Z [2024-04-15T00:41:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:41:00.239100813Z [2024-04-15T00:41:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:41:00.598257269Z [2024-04-15T00:41:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:41:00.598343119Z [2024-04-15T00:41:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:41:00.598465011Z [2024-04-15T00:41:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:41:00.611596266Z [2024-04-15T00:41:00.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48640da0-bfea-4220-8eb8-dd3d66d580a2 2024-04-15T00:41:00.611771702Z [2024-04-15T00:41:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 718f3a57-7c83-4346-8b7b-11457110c952 2024-04-15T00:41:00.612468963Z [2024-04-15T00:41:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8b494df-7a8d-44bc-9540-f1a2cfcefc6e 2024-04-15T00:41:01.756364335Z [2024-04-15T00:41:01.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:41:01.756851754Z [2024-04-15T00:41:01.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:40:00+00:00, run_id=scheduled__2024-04-15T00:40:00+00:00, run_start_date=2024-04-15 00:41:00.191505+00:00, run_end_date=2024-04-15 00:41:01.756213+00:00, run_duration=1.564708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:40:00+00:00, data_interval_end=2024-04-15 00:41:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:41:01.766822865Z [2024-04-15T00:41:01.766+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:41:00+00:00, run_after=2024-04-15T00:42:00+00:00 2024-04-15T00:41:01.806804083Z [2024-04-15T00:41:01.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:41:01.812401464Z [2024-04-15T00:41:01.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=-1, run_start_date=2024-04-15 00:41:01.003360+00:00, run_end_date=2024-04-15 00:41:01.396774+00:00, run_duration=0.393414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:41:00.235631+00:00, queued_by_job_id=1, pid=8389 2024-04-15T00:41:02.962342969Z [2024-04-15T00:41:02.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:41:02.962535661Z [2024-04-15T00:41:02.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:40:00+00:00, run_id=scheduled__2024-04-15T00:40:00+00:00, run_start_date=2024-04-15 00:41:00.192444+00:00, run_end_date=2024-04-15 00:41:02.962191+00:00, run_duration=2.769747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:40:00+00:00, data_interval_end=2024-04-15 00:41:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:41:02.983253582Z [2024-04-15T00:41:02.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:41:00+00:00, run_after=2024-04-15T00:42:00+00:00 2024-04-15T00:41:03.047218301Z [2024-04-15T00:41:03.046+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:41:04.108221866Z [2024-04-15T00:41:04.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:41:04.108644500Z [2024-04-15T00:41:04.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:40:00+00:00, run_id=scheduled__2024-04-15T00:40:00+00:00, run_start_date=2024-04-15 00:41:00.193389+00:00, run_end_date=2024-04-15 00:41:04.107917+00:00, run_duration=3.914528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:40:00+00:00, data_interval_end=2024-04-15 00:41:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:41:04.119050355Z [2024-04-15T00:41:04.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:41:00+00:00, run_after=2024-04-15T00:42:00+00:00 2024-04-15T00:41:04.170895794Z [2024-04-15T00:41:04.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:41:04.179060574Z [2024-04-15T00:41:04.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=-1, run_start_date=2024-04-15 00:41:01.806938+00:00, run_end_date=2024-04-15 00:41:02.921984+00:00, run_duration=1.115046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:41:00.235631+00:00, queued_by_job_id=1, pid=8407 2024-04-15T00:41:05.272730701Z [2024-04-15T00:41:05.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:41:05.282718751Z [2024-04-15T00:41:05.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=-1, run_start_date=2024-04-15 00:41:01.956090+00:00, run_end_date=2024-04-15 00:41:04.027657+00:00, run_duration=2.071567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:41:00.235631+00:00, queued_by_job_id=1, pid=8408 2024-04-15T00:42:00.864458876Z [2024-04-15T00:42:00.863+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:42:00.879243114Z [2024-04-15T00:42:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:42:00+00:00, run_after=2024-04-15T00:43:00+00:00 2024-04-15T00:42:00.891472389Z [2024-04-15T00:42:00.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:42:00+00:00, run_after=2024-04-15T00:43:00+00:00 2024-04-15T00:42:00.899400493Z [2024-04-15T00:42:00.898+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:42:01.000003895Z [2024-04-15T00:42:00.999+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:42:01.000040195Z 2024-04-15T00:42:01.000080300Z 2024-04-15T00:42:01.000098474Z 2024-04-15T00:42:01.000109383Z 2024-04-15T00:42:01.003660075Z [2024-04-15T00:42:01.003+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:42:01.003906222Z [2024-04-15T00:42:01.003+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:42:01.004110152Z [2024-04-15T00:42:01.003+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:42:01.004296384Z [2024-04-15T00:42:01.004+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:42:01.005152195Z [2024-04-15T00:42:01.004+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:42:01.005162195Z 2024-04-15T00:42:01.005166901Z 2024-04-15T00:42:01.005171650Z 2024-04-15T00:42:01.005175977Z 2024-04-15T00:42:01.009910512Z [2024-04-15T00:42:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:42:01.010353174Z [2024-04-15T00:42:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:42:01.010706799Z [2024-04-15T00:42:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:42:01.010963827Z [2024-04-15T00:42:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:42:01.011308043Z [2024-04-15T00:42:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:42:01.011508286Z [2024-04-15T00:42:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:42:01.011839190Z [2024-04-15T00:42:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:42:01.011996252Z [2024-04-15T00:42:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:42:01.414251090Z [2024-04-15T00:42:01.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:42:01.414650967Z [2024-04-15T00:42:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:41:00+00:00 exited with status queued for try_number 1 2024-04-15T00:42:01.414841533Z [2024-04-15T00:42:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:41:00+00:00 exited with status queued for try_number 1 2024-04-15T00:42:01.415027549Z [2024-04-15T00:42:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:41:00+00:00 exited with status queued for try_number 1 2024-04-15T00:42:01.424101786Z [2024-04-15T00:42:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to c23cd859-2e42-4a1f-a434-fff461221698 2024-04-15T00:42:01.424300955Z [2024-04-15T00:42:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3fbc0e7-77e4-4506-8bb2-2783031da3aa 2024-04-15T00:42:01.424547583Z [2024-04-15T00:42:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91151836-30f7-41d2-b856-3ef8bc702fc5 2024-04-15T00:42:01.424839398Z [2024-04-15T00:42:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcaffbb8-6a40-4a65-b941-be690b6ae70a 2024-04-15T00:42:02.834332064Z [2024-04-15T00:42:02.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:42:02.834541956Z [2024-04-15T00:42:02.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:40:00+00:00, run_id=scheduled__2024-04-15T00:40:00+00:00, run_start_date=2024-04-15 00:42:00.912580+00:00, run_end_date=2024-04-15 00:42:02.834238+00:00, run_duration=1.921658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:40:00+00:00, data_interval_end=2024-04-15 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:42:02.843005753Z [2024-04-15T00:42:02.842+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:42:00+00:00, run_after=2024-04-15T00:44:00+00:00 2024-04-15T00:42:02.850954428Z [2024-04-15T00:42:02.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:42:02.850972285Z [2024-04-15T00:42:02.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:41:00+00:00, run_id=scheduled__2024-04-15T00:41:00+00:00, run_start_date=2024-04-15 00:42:00.914378+00:00, run_end_date=2024-04-15 00:42:02.848301+00:00, run_duration=1.933923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:41:00+00:00, data_interval_end=2024-04-15 00:42:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:42:02.860006705Z [2024-04-15T00:42:02.857+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:42:00+00:00, run_after=2024-04-15T00:43:00+00:00 2024-04-15T00:42:02.914465517Z [2024-04-15T00:42:02.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:42:02.914489354Z [2024-04-15T00:42:02.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:41:00+00:00 exited with status success for try_number 1 2024-04-15T00:42:02.920271577Z [2024-04-15T00:42:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=-1, run_start_date=2024-04-15 00:42:01.750907+00:00, run_end_date=2024-04-15 00:42:02.202349+00:00, run_duration=0.451442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:42:01.006647+00:00, queued_by_job_id=1, pid=8441 2024-04-15T00:42:02.920396338Z [2024-04-15T00:42:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:41:00+00:00, map_index=-1, run_start_date=2024-04-15 00:42:01.805166+00:00, run_end_date=2024-04-15 00:42:02.269776+00:00, run_duration=0.46461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:42:01.006647+00:00, queued_by_job_id=1, pid=8442 2024-04-15T00:42:05.045600879Z [2024-04-15T00:42:05.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:42:05.045978183Z [2024-04-15T00:42:05.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:41:00+00:00, run_id=scheduled__2024-04-15T00:41:00+00:00, run_start_date=2024-04-15 00:42:00.915615+00:00, run_end_date=2024-04-15 00:42:05.045509+00:00, run_duration=4.129894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:41:00+00:00, data_interval_end=2024-04-15 00:42:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:42:05.055948896Z [2024-04-15T00:42:05.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:42:00+00:00, run_after=2024-04-15T00:43:00+00:00 2024-04-15T00:42:05.100426990Z [2024-04-15T00:42:05.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:41:00+00:00 exited with status success for try_number 1 2024-04-15T00:42:05.109536752Z [2024-04-15T00:42:05.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:41:00+00:00, map_index=-1, run_start_date=2024-04-15 00:42:02.858037+00:00, run_end_date=2024-04-15 00:42:04.243894+00:00, run_duration=1.385857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:42:01.006647+00:00, queued_by_job_id=1, pid=8460 2024-04-15T00:42:06.172538645Z [2024-04-15T00:42:06.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:42:06.173014502Z [2024-04-15T00:42:06.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:41:00+00:00, run_id=scheduled__2024-04-15T00:41:00+00:00, run_start_date=2024-04-15 00:42:00.916748+00:00, run_end_date=2024-04-15 00:42:06.172453+00:00, run_duration=5.255705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:41:00+00:00, data_interval_end=2024-04-15 00:42:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:42:06.187667025Z [2024-04-15T00:42:06.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:42:00+00:00, run_after=2024-04-15T00:43:00+00:00 2024-04-15T00:42:06.235227805Z [2024-04-15T00:42:06.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:41:00+00:00 exited with status success for try_number 1 2024-04-15T00:42:06.244331507Z [2024-04-15T00:42:06.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:41:00+00:00, map_index=-1, run_start_date=2024-04-15 00:42:03.168671+00:00, run_end_date=2024-04-15 00:42:05.122614+00:00, run_duration=1.953943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:42:01.006647+00:00, queued_by_job_id=1, pid=8471 2024-04-15T00:43:00.206555598Z [2024-04-15T00:43:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:43:00+00:00, run_after=2024-04-15T00:44:00+00:00 2024-04-15T00:43:00.213365888Z [2024-04-15T00:43:00.212+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:43:00.223280836Z [2024-04-15T00:43:00.222+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:43:00+00:00, run_after=2024-04-15T00:44:00+00:00 2024-04-15T00:43:00.276362247Z [2024-04-15T00:43:00.275+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:43:00.276457921Z 2024-04-15T00:43:00.276674392Z 2024-04-15T00:43:00.276695859Z 2024-04-15T00:43:00.276736398Z [2024-04-15T00:43:00.276+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:43:00.277021610Z [2024-04-15T00:43:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:43:00.277430600Z [2024-04-15T00:43:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:43:00.279567576Z [2024-04-15T00:43:00.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:43:00.279577673Z 2024-04-15T00:43:00.279580629Z 2024-04-15T00:43:00.279583576Z 2024-04-15T00:43:00.286822820Z [2024-04-15T00:43:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:43:00.287259925Z [2024-04-15T00:43:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:43:00.287776215Z [2024-04-15T00:43:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:43:00.288032670Z [2024-04-15T00:43:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:43:00.288486800Z [2024-04-15T00:43:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:43:00.288761910Z [2024-04-15T00:43:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:43:00.597912995Z [2024-04-15T00:43:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status queued for try_number 1 2024-04-15T00:43:00.598403588Z [2024-04-15T00:43:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status queued for try_number 1 2024-04-15T00:43:00.598563315Z [2024-04-15T00:43:00.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status queued for try_number 1 2024-04-15T00:43:00.609593063Z [2024-04-15T00:43:00.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a9d1811-6d5f-46b9-b990-dd8201a279c0 2024-04-15T00:43:00.609949688Z [2024-04-15T00:43:00.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3f08923-bef7-4489-98fd-8f26b9764730 2024-04-15T00:43:00.610141403Z [2024-04-15T00:43:00.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43bee4ba-1fb1-4b3b-b741-098993f149ad 2024-04-15T00:43:01.824051928Z [2024-04-15T00:43:01.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:43:01.824274628Z [2024-04-15T00:43:01.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:42:00+00:00, run_id=scheduled__2024-04-15T00:42:00+00:00, run_start_date=2024-04-15 00:43:00.231523+00:00, run_end_date=2024-04-15 00:43:01.823948+00:00, run_duration=1.592425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:42:00+00:00, data_interval_end=2024-04-15 00:43:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:43:01.838840023Z [2024-04-15T00:43:01.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:43:00+00:00, run_after=2024-04-15T00:44:00+00:00 2024-04-15T00:43:01.878812175Z [2024-04-15T00:43:01.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status success for try_number 1 2024-04-15T00:43:01.888968697Z [2024-04-15T00:43:01.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:42:00+00:00, map_index=-1, run_start_date=2024-04-15 00:43:01.038646+00:00, run_end_date=2024-04-15 00:43:01.456412+00:00, run_duration=0.417766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:43:00.282324+00:00, queued_by_job_id=1, pid=8498 2024-04-15T00:43:03.821642362Z [2024-04-15T00:43:03.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:43:03.821958834Z [2024-04-15T00:43:03.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:42:00+00:00, run_id=scheduled__2024-04-15T00:42:00+00:00, run_start_date=2024-04-15 00:43:00.232547+00:00, run_end_date=2024-04-15 00:43:03.821474+00:00, run_duration=3.588927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:42:00+00:00, data_interval_end=2024-04-15 00:43:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:43:03.831141845Z [2024-04-15T00:43:03.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:43:00+00:00, run_after=2024-04-15T00:44:00+00:00 2024-04-15T00:43:03.877702540Z [2024-04-15T00:43:03.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status success for try_number 1 2024-04-15T00:43:03.883212202Z [2024-04-15T00:43:03.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:42:00+00:00, map_index=-1, run_start_date=2024-04-15 00:43:02.191489+00:00, run_end_date=2024-04-15 00:43:03.369122+00:00, run_duration=1.177633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:43:00.282324+00:00, queued_by_job_id=1, pid=8517 2024-04-15T00:43:04.925708550Z [2024-04-15T00:43:04.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:43:04.925768131Z [2024-04-15T00:43:04.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:42:00+00:00, run_id=scheduled__2024-04-15T00:42:00+00:00, run_start_date=2024-04-15 00:43:00.233498+00:00, run_end_date=2024-04-15 00:43:04.925459+00:00, run_duration=4.691961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:42:00+00:00, data_interval_end=2024-04-15 00:43:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:43:04.934435392Z [2024-04-15T00:43:04.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:43:00+00:00, run_after=2024-04-15T00:44:00+00:00 2024-04-15T00:43:04.984970047Z [2024-04-15T00:43:04.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status success for try_number 1 2024-04-15T00:43:04.993572877Z [2024-04-15T00:43:04.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:42:00+00:00, map_index=-1, run_start_date=2024-04-15 00:43:02.171429+00:00, run_end_date=2024-04-15 00:43:04.729472+00:00, run_duration=2.558043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:43:00.282324+00:00, queued_by_job_id=1, pid=8516 2024-04-15T00:44:00.852067208Z [2024-04-15T00:44:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:44:00+00:00, run_after=2024-04-15T00:45:00+00:00 2024-04-15T00:44:00.863178373Z [2024-04-15T00:44:00.862+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:44:00.869545603Z [2024-04-15T00:44:00.869+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:44:00.891584144Z [2024-04-15T00:44:00.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:44:00+00:00, run_after=2024-04-15T00:45:00+00:00 2024-04-15T00:44:00.987281363Z [2024-04-15T00:44:00.986+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:44:00.987323355Z 2024-04-15T00:44:00.987335647Z 2024-04-15T00:44:00.987375096Z 2024-04-15T00:44:00.987384104Z 2024-04-15T00:44:00.987509687Z [2024-04-15T00:44:00.987+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:44:00.987778696Z [2024-04-15T00:44:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:44:00.988007976Z [2024-04-15T00:44:00.987+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:44:00.988250113Z [2024-04-15T00:44:00.988+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:44:00.989070057Z [2024-04-15T00:44:00.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:44:00.989084730Z 2024-04-15T00:44:00.989089815Z 2024-04-15T00:44:00.989094163Z 2024-04-15T00:44:00.989098725Z 2024-04-15T00:44:00.993754635Z [2024-04-15T00:44:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:44:00.994107971Z [2024-04-15T00:44:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:44:00.994454068Z [2024-04-15T00:44:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:44:00.994655933Z [2024-04-15T00:44:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:44:00.994989683Z [2024-04-15T00:44:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:44:00.995174701Z [2024-04-15T00:44:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:44:00.995512323Z [2024-04-15T00:44:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:44:00.995742097Z [2024-04-15T00:44:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:44:01.309009754Z [2024-04-15T00:44:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status queued for try_number 1 2024-04-15T00:44:01.310960686Z [2024-04-15T00:44:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:43:00+00:00 exited with status queued for try_number 1 2024-04-15T00:44:01.311173977Z [2024-04-15T00:44:01.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:43:00+00:00 exited with status queued for try_number 1 2024-04-15T00:44:01.311285695Z [2024-04-15T00:44:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:43:00+00:00 exited with status queued for try_number 1 2024-04-15T00:44:01.318966007Z [2024-04-15T00:44:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e6fc7d5-deca-4c1a-8aa1-0162d8d8a1d2 2024-04-15T00:44:01.319230338Z [2024-04-15T00:44:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29c8854f-f045-4867-93ef-e0b34528ec0a 2024-04-15T00:44:01.319531622Z [2024-04-15T00:44:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 953f0872-ebc7-442d-8ec6-5d9a35706c9c 2024-04-15T00:44:01.319700550Z [2024-04-15T00:44:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ef515e9-895d-4966-b47a-275b44fc45d4 2024-04-15T00:44:02.497421311Z [2024-04-15T00:44:02.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:44:02.497930413Z [2024-04-15T00:44:02.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:42:00+00:00, run_id=scheduled__2024-04-15T00:42:00+00:00, run_start_date=2024-04-15 00:44:00.905721+00:00, run_end_date=2024-04-15 00:44:02.497536+00:00, run_duration=1.591815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:42:00+00:00, data_interval_end=2024-04-15 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:44:02.506315640Z [2024-04-15T00:44:02.506+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:44:00+00:00, run_after=2024-04-15T00:46:00+00:00 2024-04-15T00:44:02.514768553Z [2024-04-15T00:44:02.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:44:02.515247437Z [2024-04-15T00:44:02.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:43:00+00:00, run_id=scheduled__2024-04-15T00:43:00+00:00, run_start_date=2024-04-15 00:44:00.907510+00:00, run_end_date=2024-04-15 00:44:02.514924+00:00, run_duration=1.607414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:43:00+00:00, data_interval_end=2024-04-15 00:44:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:44:02.527210853Z [2024-04-15T00:44:02.526+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:44:00+00:00, run_after=2024-04-15T00:45:00+00:00 2024-04-15T00:44:02.606431012Z [2024-04-15T00:44:02.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:42:00+00:00 exited with status success for try_number 1 2024-04-15T00:44:02.606818300Z [2024-04-15T00:44:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:43:00+00:00 exited with status success for try_number 1 2024-04-15T00:44:02.618256379Z [2024-04-15T00:44:02.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:42:00+00:00, map_index=-1, run_start_date=2024-04-15 00:44:01.683699+00:00, run_end_date=2024-04-15 00:44:02.050897+00:00, run_duration=0.367198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:44:00.990267+00:00, queued_by_job_id=1, pid=8544 2024-04-15T00:44:02.619137916Z [2024-04-15T00:44:02.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:43:00+00:00, map_index=-1, run_start_date=2024-04-15 00:44:01.932307+00:00, run_end_date=2024-04-15 00:44:02.333469+00:00, run_duration=0.401162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:44:00.990267+00:00, queued_by_job_id=1, pid=8550 2024-04-15T00:44:04.788009080Z [2024-04-15T00:44:04.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:44:04.788373515Z [2024-04-15T00:44:04.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:43:00+00:00, run_id=scheduled__2024-04-15T00:43:00+00:00, run_start_date=2024-04-15 00:44:00.910579+00:00, run_end_date=2024-04-15 00:44:04.787876+00:00, run_duration=3.877297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:43:00+00:00, data_interval_end=2024-04-15 00:44:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:44:04.797410607Z [2024-04-15T00:44:04.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:44:00+00:00, run_after=2024-04-15T00:45:00+00:00 2024-04-15T00:44:04.805214834Z [2024-04-15T00:44:04.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:44:04.805586023Z [2024-04-15T00:44:04.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:43:00+00:00, run_id=scheduled__2024-04-15T00:43:00+00:00, run_start_date=2024-04-15 00:44:00.909138+00:00, run_end_date=2024-04-15 00:44:04.805099+00:00, run_duration=3.895961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:43:00+00:00, data_interval_end=2024-04-15 00:44:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:44:04.824771662Z [2024-04-15T00:44:04.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:44:00+00:00, run_after=2024-04-15T00:45:00+00:00 2024-04-15T00:44:04.902982052Z [2024-04-15T00:44:04.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:43:00+00:00 exited with status success for try_number 1 2024-04-15T00:44:04.903359182Z [2024-04-15T00:44:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:43:00+00:00 exited with status success for try_number 1 2024-04-15T00:44:04.913421880Z [2024-04-15T00:44:04.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:43:00+00:00, map_index=-1, run_start_date=2024-04-15 00:44:02.862610+00:00, run_end_date=2024-04-15 00:44:04.393788+00:00, run_duration=1.531178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:44:00.990267+00:00, queued_by_job_id=1, pid=8574 2024-04-15T00:44:04.913907344Z [2024-04-15T00:44:04.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:43:00+00:00, map_index=-1, run_start_date=2024-04-15 00:44:02.790950+00:00, run_end_date=2024-04-15 00:44:04.715441+00:00, run_duration=1.924491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:44:00.990267+00:00, queued_by_job_id=1, pid=8573 2024-04-15T00:45:00.637120973Z [2024-04-15T00:45:00.636+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:45:00.647219815Z [2024-04-15T00:45:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:45:00+00:00, run_after=2024-04-15T00:46:00+00:00 2024-04-15T00:45:00.657279361Z [2024-04-15T00:45:00.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:45:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:45:00.667496164Z [2024-04-15T00:45:00.667+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:45:00+00:00, run_after=2024-04-15T00:46:00+00:00 2024-04-15T00:45:00.761206795Z [2024-04-15T00:45:00.760+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:45:00.761239265Z 2024-04-15T00:45:00.761265913Z 2024-04-15T00:45:00.761271123Z 2024-04-15T00:45:00.761276144Z 2024-04-15T00:45:00.761529510Z [2024-04-15T00:45:00.761+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:45:00.761817043Z [2024-04-15T00:45:00.761+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:45:00.762105101Z [2024-04-15T00:45:00.761+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:45:00.762365401Z [2024-04-15T00:45:00.762+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:45:00.763282888Z [2024-04-15T00:45:00.762+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:45:00.763301546Z 2024-04-15T00:45:00.763307099Z 2024-04-15T00:45:00.763312200Z 2024-04-15T00:45:00.763317210Z 2024-04-15T00:45:00.768804017Z [2024-04-15T00:45:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:45:00.769166452Z [2024-04-15T00:45:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:45:00.769540993Z [2024-04-15T00:45:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:45:00.769758961Z [2024-04-15T00:45:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:45:00.770120732Z [2024-04-15T00:45:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:45:00.770348109Z [2024-04-15T00:45:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:45:00.770711616Z [2024-04-15T00:45:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:45:00.771036465Z [2024-04-15T00:45:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:45:01.266336455Z [2024-04-15T00:45:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:45:01.266640363Z [2024-04-15T00:45:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status queued for try_number 1 2024-04-15T00:45:01.266704094Z [2024-04-15T00:45:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status queued for try_number 1 2024-04-15T00:45:01.266748974Z [2024-04-15T00:45:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status queued for try_number 1 2024-04-15T00:45:01.287033301Z [2024-04-15T00:45:01.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3984c1da-a102-425e-b5fc-2ced777f5d02 2024-04-15T00:45:01.287112347Z [2024-04-15T00:45:01.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to 110d11f9-b9e3-4761-ac14-ba744499ab4c 2024-04-15T00:45:01.287233321Z [2024-04-15T00:45:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0122a54-0c9b-4d38-8e00-5b4608f6cb35 2024-04-15T00:45:01.287319755Z [2024-04-15T00:45:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e39b008-7746-49f9-80d7-292318b186d0 2024-04-15T00:45:02.967029132Z [2024-04-15T00:45:02.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:45:02.967552556Z [2024-04-15T00:45:02.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:44:00+00:00, run_id=scheduled__2024-04-15T00:44:00+00:00, run_start_date=2024-04-15 00:45:00.678725+00:00, run_end_date=2024-04-15 00:45:02.966957+00:00, run_duration=2.288232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:44:00+00:00, data_interval_end=2024-04-15 00:45:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:45:02.976421748Z [2024-04-15T00:45:02.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:45:00+00:00, run_after=2024-04-15T00:46:00+00:00 2024-04-15T00:45:03.035822920Z [2024-04-15T00:45:03.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status success for try_number 1 2024-04-15T00:45:03.042511244Z [2024-04-15T00:45:03.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:44:00+00:00, map_index=-1, run_start_date=2024-04-15 00:45:01.805021+00:00, run_end_date=2024-04-15 00:45:02.181004+00:00, run_duration=0.375983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:45:00.765446+00:00, queued_by_job_id=1, pid=8608 2024-04-15T00:45:04.114669781Z [2024-04-15T00:45:04.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:45:04.115515694Z [2024-04-15T00:45:04.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:44:00+00:00, run_id=scheduled__2024-04-15T00:44:00+00:00, run_start_date=2024-04-15 00:45:00.679578+00:00, run_end_date=2024-04-15 00:45:04.114577+00:00, run_duration=3.434999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:44:00+00:00, data_interval_end=2024-04-15 00:45:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:45:04.132965250Z [2024-04-15T00:45:04.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:45:00+00:00, run_after=2024-04-15T00:46:00+00:00 2024-04-15T00:45:04.185296417Z [2024-04-15T00:45:04.184+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:45:04.185314444Z 2024-04-15T00:45:04.185727445Z [2024-04-15T00:45:04.185+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:45:04.187527801Z [2024-04-15T00:45:04.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:45:04.187543146Z 2024-04-15T00:45:04.190752420Z [2024-04-15T00:45:04.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:45:04.191084147Z [2024-04-15T00:45:04.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:45:04.264330913Z [2024-04-15T00:45:04.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:45:04.264412793Z [2024-04-15T00:45:04.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:45:04.264539289Z [2024-04-15T00:45:04.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status success for try_number 1 2024-04-15T00:45:04.275016069Z [2024-04-15T00:45:04.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=-1, run_start_date=2024-04-15 00:45:02.821716+00:00, run_end_date=2024-04-15 00:45:03.190254+00:00, run_duration=0.368538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:45:00.765446+00:00, queued_by_job_id=1, pid=8638 2024-04-15T00:45:04.275492372Z [2024-04-15T00:45:04.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:44:00+00:00, map_index=-1, run_start_date=2024-04-15 00:45:02.639492+00:00, run_end_date=2024-04-15 00:45:03.843756+00:00, run_duration=1.204264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:45:00.765446+00:00, queued_by_job_id=1, pid=8627 2024-04-15T00:45:04.275876498Z [2024-04-15T00:45:04.275+0000] {scheduler_job.py:635} INFO - Setting external_id for to be9e2914-ca77-4e99-9263-2b2e943d31b7 2024-04-15T00:45:04.336809924Z [2024-04-15T00:45:04.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:45:04.337424988Z [2024-04-15T00:45:04.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:44:00+00:00, run_id=scheduled__2024-04-15T00:44:00+00:00, run_start_date=2024-04-15 00:45:00.680490+00:00, run_end_date=2024-04-15 00:45:04.336914+00:00, run_duration=3.656424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:44:00+00:00, data_interval_end=2024-04-15 00:45:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:45:04.347984498Z [2024-04-15T00:45:04.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:45:00+00:00, run_after=2024-04-15T00:46:00+00:00 2024-04-15T00:45:04.412371724Z [2024-04-15T00:45:04.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status success for try_number 1 2024-04-15T00:45:04.416857183Z [2024-04-15T00:45:04.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:44:00+00:00, map_index=-1, run_start_date=2024-04-15 00:45:02.561940+00:00, run_end_date=2024-04-15 00:45:04.109379+00:00, run_duration=1.547439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:45:00.765446+00:00, queued_by_job_id=1, pid=8626 2024-04-15T00:45:06.950084710Z [2024-04-15T00:45:06.949+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:45:06.950129986Z 2024-04-15T00:45:06.950152800Z [2024-04-15T00:45:06.949+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:45:06.951033862Z [2024-04-15T00:45:06.950+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:45:06.951084936Z 2024-04-15T00:45:06.954706280Z [2024-04-15T00:45:06.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:45:06.954784759Z [2024-04-15T00:45:06.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:45:07.008860090Z [2024-04-15T00:45:07.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:45:07.009182379Z [2024-04-15T00:45:07.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:45:07.016069029Z [2024-04-15T00:45:07.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5486a656-4f59-4eab-a861-dd345da43f34 2024-04-15T00:45:07.016468721Z [2024-04-15T00:45:07.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=-1, run_start_date=2024-04-15 00:45:05.848203+00:00, run_end_date=2024-04-15 00:45:06.212574+00:00, run_duration=0.364371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:45:04.188123+00:00, queued_by_job_id=1, pid=8656 2024-04-15T00:45:09.286157515Z [2024-04-15T00:45:09.285+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:45:09.286205460Z 2024-04-15T00:45:09.286479798Z [2024-04-15T00:45:09.286+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:45:09.287925895Z [2024-04-15T00:45:09.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:45:09.287949497Z 2024-04-15T00:45:09.292810920Z [2024-04-15T00:45:09.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:45:09.293206422Z [2024-04-15T00:45:09.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:45:09.360863786Z [2024-04-15T00:45:09.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status queued for try_number 1 2024-04-15T00:45:09.360883621Z [2024-04-15T00:45:09.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:45:09.371789499Z [2024-04-15T00:45:09.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce196d99-8919-4d9b-8705-9d83c25ae343 2024-04-15T00:45:09.373007620Z [2024-04-15T00:45:09.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=0, run_start_date=2024-04-15 00:45:08.690543+00:00, run_end_date=2024-04-15 00:45:09.051677+00:00, run_duration=0.361134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:45:06.951574+00:00, queued_by_job_id=1, pid=8664 2024-04-15T00:45:11.949119106Z [2024-04-15T00:45:11.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:45:11.949501695Z [2024-04-15T00:45:11.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:40:00+00:00, run_id=scheduled__2024-04-15T00:40:00+00:00, run_start_date=2024-04-15 00:45:00.677499+00:00, run_end_date=2024-04-15 00:45:11.949217+00:00, run_duration=11.271718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:40:00+00:00, data_interval_end=2024-04-15 00:45:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:45:11.954704663Z [2024-04-15T00:45:11.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:45:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:45:11.996242531Z [2024-04-15T00:45:11.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:40:00+00:00 exited with status success for try_number 1 2024-04-15T00:45:12.011359444Z [2024-04-15T00:45:12.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:40:00+00:00, map_index=-1, run_start_date=2024-04-15 00:45:10.828493+00:00, run_end_date=2024-04-15 00:45:11.172787+00:00, run_duration=0.344294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:45:09.288771+00:00, queued_by_job_id=1, pid=8672 2024-04-15T00:46:00.598056922Z [2024-04-15T00:46:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:46:00+00:00, run_after=2024-04-15T00:47:00+00:00 2024-04-15T00:46:00.608686961Z [2024-04-15T00:46:00.608+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:46:00.624715874Z [2024-04-15T00:46:00.624+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:46:00+00:00, run_after=2024-04-15T00:47:00+00:00 2024-04-15T00:46:00.634480738Z [2024-04-15T00:46:00.634+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:46:00.728240814Z [2024-04-15T00:46:00.727+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:46:00.728275424Z 2024-04-15T00:46:00.728283333Z 2024-04-15T00:46:00.728287483Z 2024-04-15T00:46:00.728291919Z 2024-04-15T00:46:00.728408552Z [2024-04-15T00:46:00.728+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:46:00.728643710Z [2024-04-15T00:46:00.728+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:46:00.728836316Z [2024-04-15T00:46:00.728+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:46:00.729111578Z [2024-04-15T00:46:00.728+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:46:00.730099591Z [2024-04-15T00:46:00.729+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:46:00.730110338Z 2024-04-15T00:46:00.730114628Z 2024-04-15T00:46:00.730118659Z 2024-04-15T00:46:00.730122670Z 2024-04-15T00:46:00.735999325Z [2024-04-15T00:46:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:46:00.736186069Z [2024-04-15T00:46:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:46:00.736630856Z [2024-04-15T00:46:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:46:00.736825584Z [2024-04-15T00:46:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:46:00.737200636Z [2024-04-15T00:46:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:46:00.737355316Z [2024-04-15T00:46:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:46:00.737630510Z [2024-04-15T00:46:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:46:00.737758222Z [2024-04-15T00:46:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:46:00.974400117Z [2024-04-15T00:46:00.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status queued for try_number 1 2024-04-15T00:46:00.974441911Z [2024-04-15T00:46:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status queued for try_number 1 2024-04-15T00:46:00.974474601Z [2024-04-15T00:46:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status queued for try_number 1 2024-04-15T00:46:00.974482822Z [2024-04-15T00:46:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status queued for try_number 1 2024-04-15T00:46:00.982081411Z [2024-04-15T00:46:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to f60369bb-b843-4bc8-9b5f-02d4b60b6a19 2024-04-15T00:46:00.982124464Z [2024-04-15T00:46:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6130f10-2447-472a-8a22-c0147a5b1741 2024-04-15T00:46:00.982179354Z [2024-04-15T00:46:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a925845-870a-4b30-adfc-0f5165dd52ee 2024-04-15T00:46:00.982286357Z [2024-04-15T00:46:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to bae56cdc-dbb9-4149-81d6-b852a25165dc 2024-04-15T00:46:02.119315755Z [2024-04-15T00:46:02.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:46:02.119931352Z [2024-04-15T00:46:02.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:44:00+00:00, run_id=scheduled__2024-04-15T00:44:00+00:00, run_start_date=2024-04-15 00:46:00.656970+00:00, run_end_date=2024-04-15 00:46:02.119198+00:00, run_duration=1.462228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:44:00+00:00, data_interval_end=2024-04-15 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:46:02.128340143Z [2024-04-15T00:46:02.128+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:46:00+00:00, run_after=2024-04-15T00:48:00+00:00 2024-04-15T00:46:02.144956604Z [2024-04-15T00:46:02.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:46:02.145197302Z [2024-04-15T00:46:02.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:45:00+00:00, run_id=scheduled__2024-04-15T00:45:00+00:00, run_start_date=2024-04-15 00:46:00.659410+00:00, run_end_date=2024-04-15 00:46:02.144850+00:00, run_duration=1.48544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:45:00+00:00, data_interval_end=2024-04-15 00:46:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:46:02.154556200Z [2024-04-15T00:46:02.154+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:46:00+00:00, run_after=2024-04-15T00:47:00+00:00 2024-04-15T00:46:02.189517216Z [2024-04-15T00:46:02.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:44:00+00:00 exited with status success for try_number 1 2024-04-15T00:46:02.196573989Z [2024-04-15T00:46:02.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:44:00+00:00, map_index=-1, run_start_date=2024-04-15 00:46:01.506920+00:00, run_end_date=2024-04-15 00:46:01.899017+00:00, run_duration=0.392097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:46:00.731992+00:00, queued_by_job_id=1, pid=8695 2024-04-15T00:46:02.490932749Z [2024-04-15T00:46:02.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status success for try_number 1 2024-04-15T00:46:02.500673421Z [2024-04-15T00:46:02.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:45:00+00:00, map_index=-1, run_start_date=2024-04-15 00:46:01.634342+00:00, run_end_date=2024-04-15 00:46:02.055128+00:00, run_duration=0.420786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:46:00.731992+00:00, queued_by_job_id=1, pid=8696 2024-04-15T00:46:03.183507873Z [2024-04-15T00:46:03.182+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:46:04.247876528Z [2024-04-15T00:46:04.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:46:04.248193738Z [2024-04-15T00:46:04.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:45:00+00:00, run_id=scheduled__2024-04-15T00:45:00+00:00, run_start_date=2024-04-15 00:46:00.661272+00:00, run_end_date=2024-04-15 00:46:04.247791+00:00, run_duration=3.586519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:45:00+00:00, data_interval_end=2024-04-15 00:46:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:46:04.256190248Z [2024-04-15T00:46:04.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:46:00+00:00, run_after=2024-04-15T00:47:00+00:00 2024-04-15T00:46:04.327502597Z [2024-04-15T00:46:04.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status success for try_number 1 2024-04-15T00:46:04.338159150Z [2024-04-15T00:46:04.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:45:00+00:00, map_index=-1, run_start_date=2024-04-15 00:46:02.433908+00:00, run_end_date=2024-04-15 00:46:03.789148+00:00, run_duration=1.35524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:46:00.731992+00:00, queued_by_job_id=1, pid=8719 2024-04-15T00:46:05.385171406Z [2024-04-15T00:46:05.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:46:05.385589568Z [2024-04-15T00:46:05.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:45:00+00:00, run_id=scheduled__2024-04-15T00:45:00+00:00, run_start_date=2024-04-15 00:46:00.663237+00:00, run_end_date=2024-04-15 00:46:05.385035+00:00, run_duration=4.721798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:45:00+00:00, data_interval_end=2024-04-15 00:46:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:46:05.394363961Z [2024-04-15T00:46:05.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:46:00+00:00, run_after=2024-04-15T00:47:00+00:00 2024-04-15T00:46:05.448249034Z [2024-04-15T00:46:05.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status success for try_number 1 2024-04-15T00:46:05.458112470Z [2024-04-15T00:46:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:45:00+00:00, map_index=-1, run_start_date=2024-04-15 00:46:02.692713+00:00, run_end_date=2024-04-15 00:46:04.410761+00:00, run_duration=1.718048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:46:00.731992+00:00, queued_by_job_id=1, pid=8720 2024-04-15T00:47:00.072695939Z [2024-04-15T00:47:00.072+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:47:00.101837935Z [2024-04-15T00:47:00.101+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:47:00+00:00, run_after=2024-04-15T00:48:00+00:00 2024-04-15T00:47:00.117759827Z [2024-04-15T00:47:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:47:00+00:00, run_after=2024-04-15T00:48:00+00:00 2024-04-15T00:47:00.173094347Z [2024-04-15T00:47:00.172+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:47:00.173139528Z 2024-04-15T00:47:00.173149282Z 2024-04-15T00:47:00.173158083Z 2024-04-15T00:47:00.173965704Z [2024-04-15T00:47:00.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:47:00.174754559Z [2024-04-15T00:47:00.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:47:00.175050358Z [2024-04-15T00:47:00.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:47:00.176388758Z [2024-04-15T00:47:00.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:47:00.176482692Z 2024-04-15T00:47:00.176493060Z 2024-04-15T00:47:00.176501985Z 2024-04-15T00:47:00.181790465Z [2024-04-15T00:47:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:47:00.181958628Z [2024-04-15T00:47:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:47:00.182371065Z [2024-04-15T00:47:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:47:00.182581175Z [2024-04-15T00:47:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:47:00.183162165Z [2024-04-15T00:47:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:47:00.183336001Z [2024-04-15T00:47:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:47:00.560452814Z [2024-04-15T00:47:00.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status queued for try_number 1 2024-04-15T00:47:00.560485332Z [2024-04-15T00:47:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status queued for try_number 1 2024-04-15T00:47:00.560602561Z [2024-04-15T00:47:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status queued for try_number 1 2024-04-15T00:47:00.569268656Z [2024-04-15T00:47:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 117930d8-79cf-4a19-a7c8-0a5137b65e34 2024-04-15T00:47:00.569371416Z [2024-04-15T00:47:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c33114d-b3f4-4a81-b3c3-c52e33360ae0 2024-04-15T00:47:00.569497231Z [2024-04-15T00:47:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16da28b5-4ff5-4536-a970-11c60c93c424 2024-04-15T00:47:01.699038375Z [2024-04-15T00:47:01.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:47:01.699344898Z [2024-04-15T00:47:01.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:46:00+00:00, run_id=scheduled__2024-04-15T00:46:00+00:00, run_start_date=2024-04-15 00:47:00.126781+00:00, run_end_date=2024-04-15 00:47:01.699004+00:00, run_duration=1.572223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:46:00+00:00, data_interval_end=2024-04-15 00:47:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:47:01.709149710Z [2024-04-15T00:47:01.708+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:47:00+00:00, run_after=2024-04-15T00:48:00+00:00 2024-04-15T00:47:01.749256036Z [2024-04-15T00:47:01.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status success for try_number 1 2024-04-15T00:47:01.754925560Z [2024-04-15T00:47:01.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:46:00+00:00, map_index=-1, run_start_date=2024-04-15 00:47:00.964549+00:00, run_end_date=2024-04-15 00:47:01.346544+00:00, run_duration=0.381995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:47:00.177916+00:00, queued_by_job_id=1, pid=8752 2024-04-15T00:47:04.033583136Z [2024-04-15T00:47:04.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:47:04.033985023Z [2024-04-15T00:47:04.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:46:00+00:00, run_id=scheduled__2024-04-15T00:46:00+00:00, run_start_date=2024-04-15 00:47:00.128843+00:00, run_end_date=2024-04-15 00:47:04.033691+00:00, run_duration=3.904848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:46:00+00:00, data_interval_end=2024-04-15 00:47:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:47:04.042455946Z [2024-04-15T00:47:04.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:47:00+00:00, run_after=2024-04-15T00:48:00+00:00 2024-04-15T00:47:04.049099170Z [2024-04-15T00:47:04.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:47:04.049423529Z [2024-04-15T00:47:04.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:46:00+00:00, run_id=scheduled__2024-04-15T00:46:00+00:00, run_start_date=2024-04-15 00:47:00.127965+00:00, run_end_date=2024-04-15 00:47:04.049163+00:00, run_duration=3.921198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:46:00+00:00, data_interval_end=2024-04-15 00:47:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:47:04.059492856Z [2024-04-15T00:47:04.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:47:00+00:00, run_after=2024-04-15T00:48:00+00:00 2024-04-15T00:47:04.099824280Z [2024-04-15T00:47:04.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status success for try_number 1 2024-04-15T00:47:04.100219273Z [2024-04-15T00:47:04.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status success for try_number 1 2024-04-15T00:47:04.110328110Z [2024-04-15T00:47:04.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:46:00+00:00, map_index=-1, run_start_date=2024-04-15 00:47:01.803541+00:00, run_end_date=2024-04-15 00:47:03.593428+00:00, run_duration=1.789887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:47:00.177916+00:00, queued_by_job_id=1, pid=8771 2024-04-15T00:47:04.110843061Z [2024-04-15T00:47:04.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:46:00+00:00, map_index=-1, run_start_date=2024-04-15 00:47:01.778389+00:00, run_end_date=2024-04-15 00:47:02.965346+00:00, run_duration=1.186957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:47:00.177916+00:00, queued_by_job_id=1, pid=8770 2024-04-15T00:48:00.918008549Z [2024-04-15T00:48:00.917+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:48:00.938044742Z [2024-04-15T00:48:00.937+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:48:00+00:00, run_after=2024-04-15T00:49:00+00:00 2024-04-15T00:48:00.946453090Z [2024-04-15T00:48:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:48:00.960336199Z [2024-04-15T00:48:00.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:48:00+00:00, run_after=2024-04-15T00:49:00+00:00 2024-04-15T00:48:01.053047303Z [2024-04-15T00:48:01.052+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:48:01.053084337Z 2024-04-15T00:48:01.053093816Z 2024-04-15T00:48:01.053101770Z 2024-04-15T00:48:01.053109906Z 2024-04-15T00:48:01.053735269Z [2024-04-15T00:48:01.052+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:48:01.054181472Z [2024-04-15T00:48:01.053+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:48:01.054659439Z [2024-04-15T00:48:01.054+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:48:01.055036918Z [2024-04-15T00:48:01.054+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:48:01.058478693Z [2024-04-15T00:48:01.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:48:01.058520221Z 2024-04-15T00:48:01.058539853Z 2024-04-15T00:48:01.058557440Z 2024-04-15T00:48:01.058616679Z 2024-04-15T00:48:01.064458006Z [2024-04-15T00:48:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:48:01.064703239Z [2024-04-15T00:48:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:48:01.065207739Z [2024-04-15T00:48:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:48:01.065400501Z [2024-04-15T00:48:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:48:01.065852062Z [2024-04-15T00:48:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:48:01.066049105Z [2024-04-15T00:48:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:48:01.066630683Z [2024-04-15T00:48:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:48:01.066931262Z [2024-04-15T00:48:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:48:01.504003044Z [2024-04-15T00:48:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status queued for try_number 1 2024-04-15T00:48:01.505308467Z [2024-04-15T00:48:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:47:00+00:00 exited with status queued for try_number 1 2024-04-15T00:48:01.505424461Z [2024-04-15T00:48:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:47:00+00:00 exited with status queued for try_number 1 2024-04-15T00:48:01.505529519Z [2024-04-15T00:48:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:47:00+00:00 exited with status queued for try_number 1 2024-04-15T00:48:01.524569016Z [2024-04-15T00:48:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb00b185-a844-4120-a959-c27cb9ac2dd0 2024-04-15T00:48:01.524815781Z [2024-04-15T00:48:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7f81944-ceae-4a4d-af55-76936fbe60d0 2024-04-15T00:48:01.525066602Z [2024-04-15T00:48:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6396661e-11d4-4856-a9f7-d540d54b24ca 2024-04-15T00:48:01.525290929Z [2024-04-15T00:48:01.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2586165c-5324-4edc-ac02-bea1145a0c13 2024-04-15T00:48:02.770544074Z [2024-04-15T00:48:02.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:48:02.771330814Z [2024-04-15T00:48:02.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:46:00+00:00, run_id=scheduled__2024-04-15T00:46:00+00:00, run_start_date=2024-04-15 00:48:00.975105+00:00, run_end_date=2024-04-15 00:48:02.770438+00:00, run_duration=1.795333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:46:00+00:00, data_interval_end=2024-04-15 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:48:02.780722870Z [2024-04-15T00:48:02.780+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:48:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:48:02.786761076Z [2024-04-15T00:48:02.786+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:48:02.786944439Z [2024-04-15T00:48:02.786+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:47:00+00:00, run_id=scheduled__2024-04-15T00:47:00+00:00, run_start_date=2024-04-15 00:48:00.976312+00:00, run_end_date=2024-04-15 00:48:02.786510+00:00, run_duration=1.810198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:47:00+00:00, data_interval_end=2024-04-15 00:48:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:48:02.795695486Z [2024-04-15T00:48:02.795+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:48:00+00:00, run_after=2024-04-15T00:49:00+00:00 2024-04-15T00:48:02.836544071Z [2024-04-15T00:48:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:46:00+00:00 exited with status success for try_number 1 2024-04-15T00:48:02.836697672Z [2024-04-15T00:48:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:47:00+00:00 exited with status success for try_number 1 2024-04-15T00:48:02.852944775Z [2024-04-15T00:48:02.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:47:00+00:00, map_index=-1, run_start_date=2024-04-15 00:48:01.824504+00:00, run_end_date=2024-04-15 00:48:02.220185+00:00, run_duration=0.395681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:48:01.059924+00:00, queued_by_job_id=1, pid=8804 2024-04-15T00:48:02.853337315Z [2024-04-15T00:48:02.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:46:00+00:00, map_index=-1, run_start_date=2024-04-15 00:48:01.947483+00:00, run_end_date=2024-04-15 00:48:02.333340+00:00, run_duration=0.385857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:48:01.059924+00:00, queued_by_job_id=1, pid=8805 2024-04-15T00:48:04.537863649Z [2024-04-15T00:48:04.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:48:04.538116618Z [2024-04-15T00:48:04.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:47:00+00:00, run_id=scheduled__2024-04-15T00:47:00+00:00, run_start_date=2024-04-15 00:48:00.977428+00:00, run_end_date=2024-04-15 00:48:04.537719+00:00, run_duration=3.560291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:47:00+00:00, data_interval_end=2024-04-15 00:48:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:48:04.545594357Z [2024-04-15T00:48:04.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:48:00+00:00, run_after=2024-04-15T00:49:00+00:00 2024-04-15T00:48:04.595690647Z [2024-04-15T00:48:04.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:47:00+00:00 exited with status success for try_number 1 2024-04-15T00:48:04.603186601Z [2024-04-15T00:48:04.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:47:00+00:00, map_index=-1, run_start_date=2024-04-15 00:48:02.891944+00:00, run_end_date=2024-04-15 00:48:04.130526+00:00, run_duration=1.238582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:48:01.059924+00:00, queued_by_job_id=1, pid=8829 2024-04-15T00:48:05.662111560Z [2024-04-15T00:48:05.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:48:05.662376662Z [2024-04-15T00:48:05.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:47:00+00:00, run_id=scheduled__2024-04-15T00:47:00+00:00, run_start_date=2024-04-15 00:48:00.978551+00:00, run_end_date=2024-04-15 00:48:05.661880+00:00, run_duration=4.683329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:47:00+00:00, data_interval_end=2024-04-15 00:48:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:48:05.677799295Z [2024-04-15T00:48:05.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:48:00+00:00, run_after=2024-04-15T00:49:00+00:00 2024-04-15T00:48:05.728350946Z [2024-04-15T00:48:05.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:47:00+00:00 exited with status success for try_number 1 2024-04-15T00:48:05.739509318Z [2024-04-15T00:48:05.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:47:00+00:00, map_index=-1, run_start_date=2024-04-15 00:48:02.821303+00:00, run_end_date=2024-04-15 00:48:04.531754+00:00, run_duration=1.710451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:48:01.059924+00:00, queued_by_job_id=1, pid=8828 2024-04-15T00:49:00.842396571Z [2024-04-15T00:49:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:49:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:49:00.853392007Z [2024-04-15T00:49:00.853+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:49:00.869093852Z [2024-04-15T00:49:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:49:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:49:00.973387313Z [2024-04-15T00:49:00.972+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:49:00.973413163Z 2024-04-15T00:49:00.973418195Z 2024-04-15T00:49:00.973422482Z 2024-04-15T00:49:00.973611365Z [2024-04-15T00:49:00.973+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:49:00.973855924Z [2024-04-15T00:49:00.973+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:49:00.974055104Z [2024-04-15T00:49:00.973+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:49:00.974985131Z [2024-04-15T00:49:00.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:49:00.975005480Z 2024-04-15T00:49:00.975011779Z 2024-04-15T00:49:00.975017717Z 2024-04-15T00:49:00.979844837Z [2024-04-15T00:49:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:49:00.980257826Z [2024-04-15T00:49:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:49:00.980855152Z [2024-04-15T00:49:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:49:00.981256195Z [2024-04-15T00:49:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:49:00.981816077Z [2024-04-15T00:49:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:49:00.982104259Z [2024-04-15T00:49:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:49:01.180866170Z [2024-04-15T00:49:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status queued for try_number 1 2024-04-15T00:49:01.180910423Z [2024-04-15T00:49:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status queued for try_number 1 2024-04-15T00:49:01.181010972Z [2024-04-15T00:49:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status queued for try_number 1 2024-04-15T00:49:01.188456319Z [2024-04-15T00:49:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b2bbc4b-10d9-4589-bbea-866173e5947b 2024-04-15T00:49:01.188501754Z [2024-04-15T00:49:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7a6cccf-088f-42e2-b1e7-6b5afcf05d0e 2024-04-15T00:49:01.188611762Z [2024-04-15T00:49:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9042a657-81b2-4c35-ae80-7b5c410c0846 2024-04-15T00:49:02.307702255Z [2024-04-15T00:49:02.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:49:02.307841826Z [2024-04-15T00:49:02.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:48:00+00:00, run_id=scheduled__2024-04-15T00:48:00+00:00, run_start_date=2024-04-15 00:49:00.896363+00:00, run_end_date=2024-04-15 00:49:02.307539+00:00, run_duration=1.411176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:48:00+00:00, data_interval_end=2024-04-15 00:49:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:49:02.316159682Z [2024-04-15T00:49:02.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:49:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:49:02.345479985Z [2024-04-15T00:49:02.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status success for try_number 1 2024-04-15T00:49:02.350255737Z [2024-04-15T00:49:02.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:48:00+00:00, map_index=-1, run_start_date=2024-04-15 00:49:01.652110+00:00, run_end_date=2024-04-15 00:49:01.974735+00:00, run_duration=0.322625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:49:00.976196+00:00, queued_by_job_id=1, pid=8862 2024-04-15T00:49:05.060780097Z [2024-04-15T00:49:05.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:49:05.061224385Z [2024-04-15T00:49:05.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:48:00+00:00, run_id=scheduled__2024-04-15T00:48:00+00:00, run_start_date=2024-04-15 00:49:00.898115+00:00, run_end_date=2024-04-15 00:49:05.060559+00:00, run_duration=4.162444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:48:00+00:00, data_interval_end=2024-04-15 00:49:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:49:05.073358715Z [2024-04-15T00:49:05.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:49:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:49:05.130430835Z [2024-04-15T00:49:05.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status success for try_number 1 2024-04-15T00:49:05.140805375Z [2024-04-15T00:49:05.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:48:00+00:00, map_index=-1, run_start_date=2024-04-15 00:49:02.541157+00:00, run_end_date=2024-04-15 00:49:03.938516+00:00, run_duration=1.397359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:49:00.976196+00:00, queued_by_job_id=1, pid=8881 2024-04-15T00:49:06.194144774Z [2024-04-15T00:49:06.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:49:06.194585872Z [2024-04-15T00:49:06.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:48:00+00:00, run_id=scheduled__2024-04-15T00:48:00+00:00, run_start_date=2024-04-15 00:49:00.899781+00:00, run_end_date=2024-04-15 00:49:06.193913+00:00, run_duration=5.294132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:48:00+00:00, data_interval_end=2024-04-15 00:49:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:49:06.207309222Z [2024-04-15T00:49:06.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:49:00+00:00, run_after=2024-04-15T00:50:00+00:00 2024-04-15T00:49:06.247371176Z [2024-04-15T00:49:06.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status success for try_number 1 2024-04-15T00:49:06.254180004Z [2024-04-15T00:49:06.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:48:00+00:00, map_index=-1, run_start_date=2024-04-15 00:49:02.516902+00:00, run_end_date=2024-04-15 00:49:05.414244+00:00, run_duration=2.897342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:49:00.976196+00:00, queued_by_job_id=1, pid=8880 2024-04-15T00:50:00.790476282Z [2024-04-15T00:50:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:51:00+00:00 2024-04-15T00:50:00.798864861Z [2024-04-15T00:50:00.798+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:50:00.806715775Z [2024-04-15T00:50:00.806+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:50:00.819033450Z [2024-04-15T00:50:00.818+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:51:00+00:00 2024-04-15T00:50:00.839617870Z [2024-04-15T00:50:00.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:55:00+00:00 2024-04-15T00:50:00.959907452Z [2024-04-15T00:50:00.959+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T00:50:00.959931372Z 2024-04-15T00:50:00.959934834Z 2024-04-15T00:50:00.959938225Z 2024-04-15T00:50:00.959941476Z 2024-04-15T00:50:00.959944489Z 2024-04-15T00:50:00.960159659Z [2024-04-15T00:50:00.959+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:50:00.960325309Z [2024-04-15T00:50:00.960+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:50:00.960490884Z [2024-04-15T00:50:00.960+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:50:00.960656416Z [2024-04-15T00:50:00.960+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:50:00.960821448Z [2024-04-15T00:50:00.960+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:50:00.961437313Z [2024-04-15T00:50:00.961+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:50:00.961447000Z 2024-04-15T00:50:00.961450683Z 2024-04-15T00:50:00.961454355Z 2024-04-15T00:50:00.961457577Z 2024-04-15T00:50:00.961460628Z 2024-04-15T00:50:00.964935435Z [2024-04-15T00:50:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:50:00.965140554Z [2024-04-15T00:50:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:50:00.965419874Z [2024-04-15T00:50:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:50:00.965593280Z [2024-04-15T00:50:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:50:00.965868907Z [2024-04-15T00:50:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:50:00.966039761Z [2024-04-15T00:50:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:50:00.966294128Z [2024-04-15T00:50:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:50:00.966452925Z [2024-04-15T00:50:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:50:00.966709427Z [2024-04-15T00:50:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:50:00.966886430Z [2024-04-15T00:50:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:50:01.563986560Z [2024-04-15T00:50:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:01.564015972Z [2024-04-15T00:50:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:01.564060168Z [2024-04-15T00:50:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:49:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:01.564127957Z [2024-04-15T00:50:01.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:49:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:01.564168665Z [2024-04-15T00:50:01.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:49:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:01.588264017Z [2024-04-15T00:50:01.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75c5396c-c118-42d8-a5b3-b82e67d9157b 2024-04-15T00:50:01.588291879Z [2024-04-15T00:50:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33ab6e62-bdfc-4b8e-945a-2ebc7efdef15 2024-04-15T00:50:01.588420290Z [2024-04-15T00:50:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10ff1ffc-c57e-4a90-819f-44f79bb32acf 2024-04-15T00:50:01.588511036Z [2024-04-15T00:50:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f4d5f77-3b01-48fd-845d-e99c39484848 2024-04-15T00:50:01.588591165Z [2024-04-15T00:50:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to d296de92-3171-4d01-b435-859c10de8a9e 2024-04-15T00:50:02.927598695Z [2024-04-15T00:50:02.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:50:02.927957596Z [2024-04-15T00:50:02.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:49:00+00:00, run_id=scheduled__2024-04-15T00:49:00+00:00, run_start_date=2024-04-15 00:50:00.863863+00:00, run_end_date=2024-04-15 00:50:02.927519+00:00, run_duration=2.063656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:49:00+00:00, data_interval_end=2024-04-15 00:50:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:50:02.937489254Z [2024-04-15T00:50:02.937+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:51:00+00:00 2024-04-15T00:50:02.971535896Z [2024-04-15T00:50:02.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:50:02.971764784Z [2024-04-15T00:50:02.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:48:00+00:00, run_id=scheduled__2024-04-15T00:48:00+00:00, run_start_date=2024-04-15 00:50:00.861525+00:00, run_end_date=2024-04-15 00:50:02.971482+00:00, run_duration=2.109957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:48:00+00:00, data_interval_end=2024-04-15 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:50:02.979885924Z [2024-04-15T00:50:02.979+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:52:00+00:00 2024-04-15T00:50:03.063739426Z [2024-04-15T00:50:03.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:48:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:03.063906919Z [2024-04-15T00:50:03.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:49:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:03.074699849Z [2024-04-15T00:50:03.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:49:00+00:00, map_index=-1, run_start_date=2024-04-15 00:50:01.925633+00:00, run_end_date=2024-04-15 00:50:02.378804+00:00, run_duration=0.453171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:00.962415+00:00, queued_by_job_id=1, pid=8915 2024-04-15T00:50:03.074956084Z [2024-04-15T00:50:03.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:48:00+00:00, map_index=-1, run_start_date=2024-04-15 00:50:02.145005+00:00, run_end_date=2024-04-15 00:50:02.527127+00:00, run_duration=0.382122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:00.962415+00:00, queued_by_job_id=1, pid=8917 2024-04-15T00:50:04.183107529Z [2024-04-15T00:50:04.182+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:50:04.183119212Z 2024-04-15T00:50:04.183126553Z [2024-04-15T00:50:04.182+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:50:04.183994699Z [2024-04-15T00:50:04.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:50:04.184004555Z 2024-04-15T00:50:04.187480428Z [2024-04-15T00:50:04.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:50:04.187661738Z [2024-04-15T00:50:04.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:50:04.241591051Z [2024-04-15T00:50:04.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:04.241676126Z [2024-04-15T00:50:04.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:04.250505933Z [2024-04-15T00:50:04.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 023c343c-acf0-42ad-85fb-401b99df0b54 2024-04-15T00:50:04.251138056Z [2024-04-15T00:50:04.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:45:00+00:00, map_index=-1, run_start_date=2024-04-15 00:50:03.434801+00:00, run_end_date=2024-04-15 00:50:03.828474+00:00, run_duration=0.393673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:00.962415+00:00, queued_by_job_id=1, pid=8951 2024-04-15T00:50:04.314560400Z [2024-04-15T00:50:04.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:50:04.318921099Z [2024-04-15T00:50:04.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:49:00+00:00, run_id=scheduled__2024-04-15T00:49:00+00:00, run_start_date=2024-04-15 00:50:00.866065+00:00, run_end_date=2024-04-15 00:50:04.314605+00:00, run_duration=3.44854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:49:00+00:00, data_interval_end=2024-04-15 00:50:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:50:04.332146955Z [2024-04-15T00:50:04.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:51:00+00:00 2024-04-15T00:50:04.387471705Z [2024-04-15T00:50:04.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:49:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:04.396529099Z [2024-04-15T00:50:04.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:49:00+00:00, map_index=-1, run_start_date=2024-04-15 00:50:02.809090+00:00, run_end_date=2024-04-15 00:50:04.113097+00:00, run_duration=1.304007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:00.962415+00:00, queued_by_job_id=1, pid=8934 2024-04-15T00:50:05.949478324Z [2024-04-15T00:50:05.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:50:05.950070138Z [2024-04-15T00:50:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:49:00+00:00, run_id=scheduled__2024-04-15T00:49:00+00:00, run_start_date=2024-04-15 00:50:00.868384+00:00, run_end_date=2024-04-15 00:50:05.949388+00:00, run_duration=5.081004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:49:00+00:00, data_interval_end=2024-04-15 00:50:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:50:05.960455321Z [2024-04-15T00:50:05.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:51:00+00:00 2024-04-15T00:50:06.039337041Z [2024-04-15T00:50:06.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:49:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:06.049227433Z [2024-04-15T00:50:06.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:49:00+00:00, map_index=-1, run_start_date=2024-04-15 00:50:03.590219+00:00, run_end_date=2024-04-15 00:50:05.205334+00:00, run_duration=1.615115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:00.962415+00:00, queued_by_job_id=1, pid=8952 2024-04-15T00:50:07.127659960Z [2024-04-15T00:50:07.127+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:50:07.127680808Z 2024-04-15T00:50:07.127689188Z [2024-04-15T00:50:07.127+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:50:07.128357580Z [2024-04-15T00:50:07.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:50:07.128373734Z 2024-04-15T00:50:07.130973207Z [2024-04-15T00:50:07.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:50:07.131194607Z [2024-04-15T00:50:07.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:50:07.258484306Z [2024-04-15T00:50:07.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:07.258749340Z [2024-04-15T00:50:07.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:07.267262243Z [2024-04-15T00:50:07.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d7f11f8-ad8f-46da-a4a4-f7edb1a97fe1 2024-04-15T00:50:07.267618420Z [2024-04-15T00:50:07.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:45:00+00:00, map_index=-1, run_start_date=2024-04-15 00:50:05.766605+00:00, run_end_date=2024-04-15 00:50:06.142458+00:00, run_duration=0.375853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:04.184473+00:00, queued_by_job_id=1, pid=8970 2024-04-15T00:50:09.483003719Z [2024-04-15T00:50:09.482+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:50:09.483050503Z 2024-04-15T00:50:09.483130062Z [2024-04-15T00:50:09.482+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:50:09.483587469Z [2024-04-15T00:50:09.483+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:50:09.483600814Z 2024-04-15T00:50:09.485485696Z [2024-04-15T00:50:09.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:50:09.485567130Z [2024-04-15T00:50:09.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:50:09.537016722Z [2024-04-15T00:50:09.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status queued for try_number 1 2024-04-15T00:50:09.537287109Z [2024-04-15T00:50:09.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:09.542965876Z [2024-04-15T00:50:09.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to d67c9424-275c-46f4-84dc-faadd8d38bf6 2024-04-15T00:50:09.543348503Z [2024-04-15T00:50:09.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:45:00+00:00, map_index=0, run_start_date=2024-04-15 00:50:08.614818+00:00, run_end_date=2024-04-15 00:50:08.951445+00:00, run_duration=0.336627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:07.128729+00:00, queued_by_job_id=1, pid=8978 2024-04-15T00:50:11.802024571Z [2024-04-15T00:50:11.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:50:11.802289935Z [2024-04-15T00:50:11.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:45:00+00:00, run_id=scheduled__2024-04-15T00:45:00+00:00, run_start_date=2024-04-15 00:50:00.858699+00:00, run_end_date=2024-04-15 00:50:11.801816+00:00, run_duration=10.943117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:45:00+00:00, data_interval_end=2024-04-15 00:50:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:50:11.811516109Z [2024-04-15T00:50:11.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:50:00+00:00, run_after=2024-04-15T00:55:00+00:00 2024-04-15T00:50:11.851488004Z [2024-04-15T00:50:11.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:45:00+00:00 exited with status success for try_number 1 2024-04-15T00:50:11.859098956Z [2024-04-15T00:50:11.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:45:00+00:00, map_index=-1, run_start_date=2024-04-15 00:50:11.011846+00:00, run_end_date=2024-04-15 00:50:11.390622+00:00, run_duration=0.378776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:50:09.483926+00:00, queued_by_job_id=1, pid=8986 2024-04-15T00:51:00.196178843Z [2024-04-15T00:51:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:51:00+00:00, run_after=2024-04-15T00:52:00+00:00 2024-04-15T00:51:00.210909346Z [2024-04-15T00:51:00.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:51:00+00:00, run_after=2024-04-15T00:52:00+00:00 2024-04-15T00:51:00.226756954Z [2024-04-15T00:51:00.226+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:51:00.311149262Z [2024-04-15T00:51:00.310+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:51:00.311167039Z 2024-04-15T00:51:00.311170349Z 2024-04-15T00:51:00.311173893Z 2024-04-15T00:51:00.311509265Z [2024-04-15T00:51:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:51:00.311678548Z [2024-04-15T00:51:00.311+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:51:00.311772701Z [2024-04-15T00:51:00.311+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:51:00.312275927Z [2024-04-15T00:51:00.312+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:51:00.312297575Z 2024-04-15T00:51:00.312304154Z 2024-04-15T00:51:00.312309435Z 2024-04-15T00:51:00.314504135Z [2024-04-15T00:51:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:51:00.314641459Z [2024-04-15T00:51:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:51:00.314833766Z [2024-04-15T00:51:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:51:00.314983721Z [2024-04-15T00:51:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:51:00.315198635Z [2024-04-15T00:51:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:51:00.315370763Z [2024-04-15T00:51:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:51:00.706135019Z [2024-04-15T00:51:00.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:51:00.706601524Z [2024-04-15T00:51:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:51:00.707012825Z [2024-04-15T00:51:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:51:00.720224265Z [2024-04-15T00:51:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6ede2b1-f264-43f8-b2e5-523020368f55 2024-04-15T00:51:00.721689620Z [2024-04-15T00:51:00.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6445cbe6-b120-4e19-8dce-5c5054e1808e 2024-04-15T00:51:00.721978458Z [2024-04-15T00:51:00.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0a56581-4189-4f2c-8f0c-01d842cf2d51 2024-04-15T00:51:01.866366407Z [2024-04-15T00:51:01.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:51:01.866721382Z [2024-04-15T00:51:01.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:50:00+00:00, run_id=scheduled__2024-04-15T00:50:00+00:00, run_start_date=2024-04-15 00:51:00.251810+00:00, run_end_date=2024-04-15 00:51:01.866296+00:00, run_duration=1.614486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:50:00+00:00, data_interval_end=2024-04-15 00:51:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:51:01.878594820Z [2024-04-15T00:51:01.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:51:00+00:00, run_after=2024-04-15T00:52:00+00:00 2024-04-15T00:51:01.918839229Z [2024-04-15T00:51:01.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:51:01.930233660Z [2024-04-15T00:51:01.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=-1, run_start_date=2024-04-15 00:51:01.091489+00:00, run_end_date=2024-04-15 00:51:01.471068+00:00, run_duration=0.379579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:51:00.312770+00:00, queued_by_job_id=1, pid=9007 2024-04-15T00:51:03.291283697Z [2024-04-15T00:51:03.290+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:51:04.353113160Z [2024-04-15T00:51:04.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:51:04.353146227Z [2024-04-15T00:51:04.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:50:00+00:00, run_id=scheduled__2024-04-15T00:50:00+00:00, run_start_date=2024-04-15 00:51:00.254282+00:00, run_end_date=2024-04-15 00:51:04.352585+00:00, run_duration=4.098303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:50:00+00:00, data_interval_end=2024-04-15 00:51:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:51:04.364955771Z [2024-04-15T00:51:04.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:51:00+00:00, run_after=2024-04-15T00:52:00+00:00 2024-04-15T00:51:04.371571495Z [2024-04-15T00:51:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:51:04.371823612Z [2024-04-15T00:51:04.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:50:00+00:00, run_id=scheduled__2024-04-15T00:50:00+00:00, run_start_date=2024-04-15 00:51:00.256482+00:00, run_end_date=2024-04-15 00:51:04.371462+00:00, run_duration=4.11498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:50:00+00:00, data_interval_end=2024-04-15 00:51:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:51:04.379947721Z [2024-04-15T00:51:04.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:51:00+00:00, run_after=2024-04-15T00:52:00+00:00 2024-04-15T00:51:04.414295346Z [2024-04-15T00:51:04.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:51:04.414411129Z [2024-04-15T00:51:04.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:51:04.420976623Z [2024-04-15T00:51:04.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=-1, run_start_date=2024-04-15 00:51:02.124597+00:00, run_end_date=2024-04-15 00:51:04.144968+00:00, run_duration=2.020371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:51:00.312770+00:00, queued_by_job_id=1, pid=9026 2024-04-15T00:51:04.421365209Z [2024-04-15T00:51:04.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=-1, run_start_date=2024-04-15 00:51:02.104058+00:00, run_end_date=2024-04-15 00:51:03.702251+00:00, run_duration=1.598193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:51:00.312770+00:00, queued_by_job_id=1, pid=9025 2024-04-15T00:52:00.929918866Z [2024-04-15T00:52:00.929+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:52:00.946631527Z [2024-04-15T00:52:00.946+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:52:00+00:00, run_after=2024-04-15T00:53:00+00:00 2024-04-15T00:52:00.959552319Z [2024-04-15T00:52:00.959+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:52:00.980220976Z [2024-04-15T00:52:00.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:52:00+00:00, run_after=2024-04-15T00:53:00+00:00 2024-04-15T00:52:01.080351038Z [2024-04-15T00:52:01.079+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:52:01.080380221Z 2024-04-15T00:52:01.080386786Z 2024-04-15T00:52:01.080391663Z 2024-04-15T00:52:01.080396610Z 2024-04-15T00:52:01.080786277Z [2024-04-15T00:52:01.080+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:52:01.081075349Z [2024-04-15T00:52:01.080+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:52:01.081328910Z [2024-04-15T00:52:01.081+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:52:01.081576159Z [2024-04-15T00:52:01.081+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:52:01.082375786Z [2024-04-15T00:52:01.082+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:52:01.082391910Z 2024-04-15T00:52:01.082397388Z 2024-04-15T00:52:01.082402740Z 2024-04-15T00:52:01.082407723Z 2024-04-15T00:52:01.087287321Z [2024-04-15T00:52:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:52:01.087970683Z [2024-04-15T00:52:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:52:01.088470407Z [2024-04-15T00:52:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:52:01.088857101Z [2024-04-15T00:52:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:52:01.089312653Z [2024-04-15T00:52:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:52:01.089587527Z [2024-04-15T00:52:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:52:01.090037229Z [2024-04-15T00:52:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:52:01.090278369Z [2024-04-15T00:52:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:52:01.452186034Z [2024-04-15T00:52:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:52:01.452348598Z [2024-04-15T00:52:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:51:00+00:00 exited with status queued for try_number 1 2024-04-15T00:52:01.452497106Z [2024-04-15T00:52:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:51:00+00:00 exited with status queued for try_number 1 2024-04-15T00:52:01.452617556Z [2024-04-15T00:52:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:51:00+00:00 exited with status queued for try_number 1 2024-04-15T00:52:01.464344266Z [2024-04-15T00:52:01.464+0000] {scheduler_job.py:635} INFO - Setting external_id for to c28014aa-aac4-4939-bf8f-2ad23af4c3ab 2024-04-15T00:52:01.464515694Z [2024-04-15T00:52:01.464+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cc2998a-9276-4cd9-a3d9-1e3a6dfeb24c 2024-04-15T00:52:01.464736285Z [2024-04-15T00:52:01.464+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7562c6e-37cc-422d-aecf-1a82f8f6240d 2024-04-15T00:52:01.464941917Z [2024-04-15T00:52:01.464+0000] {scheduler_job.py:635} INFO - Setting external_id for to c84acd75-4693-4cc6-b7f2-c86567d7b3c8 2024-04-15T00:52:02.745877657Z [2024-04-15T00:52:02.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:52:02.746386087Z [2024-04-15T00:52:02.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:50:00+00:00, run_id=scheduled__2024-04-15T00:50:00+00:00, run_start_date=2024-04-15 00:52:00.996880+00:00, run_end_date=2024-04-15 00:52:02.745811+00:00, run_duration=1.748931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:50:00+00:00, data_interval_end=2024-04-15 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:52:02.754485512Z [2024-04-15T00:52:02.754+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:52:00+00:00, run_after=2024-04-15T00:54:00+00:00 2024-04-15T00:52:02.765411394Z [2024-04-15T00:52:02.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:52:02.765552640Z [2024-04-15T00:52:02.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:51:00+00:00, run_id=scheduled__2024-04-15T00:51:00+00:00, run_start_date=2024-04-15 00:52:00.998774+00:00, run_end_date=2024-04-15 00:52:02.765335+00:00, run_duration=1.766561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:51:00+00:00, data_interval_end=2024-04-15 00:52:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:52:02.774627069Z [2024-04-15T00:52:02.774+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:52:00+00:00, run_after=2024-04-15T00:53:00+00:00 2024-04-15T00:52:02.810814542Z [2024-04-15T00:52:02.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:52:02.810906408Z [2024-04-15T00:52:02.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:51:00+00:00 exited with status success for try_number 1 2024-04-15T00:52:02.817475092Z [2024-04-15T00:52:02.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=-1, run_start_date=2024-04-15 00:52:01.985186+00:00, run_end_date=2024-04-15 00:52:02.426472+00:00, run_duration=0.441286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:52:01.083906+00:00, queued_by_job_id=1, pid=9060 2024-04-15T00:52:02.817802392Z [2024-04-15T00:52:02.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:51:00+00:00, map_index=-1, run_start_date=2024-04-15 00:52:01.931952+00:00, run_end_date=2024-04-15 00:52:02.475964+00:00, run_duration=0.544012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:52:01.083906+00:00, queued_by_job_id=1, pid=9059 2024-04-15T00:52:04.992580668Z [2024-04-15T00:52:04.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:52:04.992817739Z [2024-04-15T00:52:04.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:51:00+00:00, run_id=scheduled__2024-04-15T00:51:00+00:00, run_start_date=2024-04-15 00:52:01.001565+00:00, run_end_date=2024-04-15 00:52:04.992534+00:00, run_duration=3.990969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:51:00+00:00, data_interval_end=2024-04-15 00:52:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:52:05.001756086Z [2024-04-15T00:52:05.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:52:00+00:00, run_after=2024-04-15T00:53:00+00:00 2024-04-15T00:52:05.010964497Z [2024-04-15T00:52:05.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:52:05.011217206Z [2024-04-15T00:52:05.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:51:00+00:00, run_id=scheduled__2024-04-15T00:51:00+00:00, run_start_date=2024-04-15 00:52:01.000184+00:00, run_end_date=2024-04-15 00:52:05.010919+00:00, run_duration=4.010735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:51:00+00:00, data_interval_end=2024-04-15 00:52:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:52:05.029429373Z [2024-04-15T00:52:05.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:52:00+00:00, run_after=2024-04-15T00:53:00+00:00 2024-04-15T00:52:05.279516290Z [2024-04-15T00:52:05.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:51:00+00:00 exited with status success for try_number 1 2024-04-15T00:52:05.279834040Z [2024-04-15T00:52:05.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:51:00+00:00 exited with status success for try_number 1 2024-04-15T00:52:05.288159173Z [2024-04-15T00:52:05.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:51:00+00:00, map_index=-1, run_start_date=2024-04-15 00:52:03.122915+00:00, run_end_date=2024-04-15 00:52:04.944005+00:00, run_duration=1.82109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:52:01.083906+00:00, queued_by_job_id=1, pid=9078 2024-04-15T00:52:05.290085118Z [2024-04-15T00:52:05.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:51:00+00:00, map_index=-1, run_start_date=2024-04-15 00:52:03.721429+00:00, run_end_date=2024-04-15 00:52:04.985398+00:00, run_duration=1.263969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:52:01.083906+00:00, queued_by_job_id=1, pid=9089 2024-04-15T00:53:00.838321016Z [2024-04-15T00:53:00.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:53:00+00:00, run_after=2024-04-15T00:54:00+00:00 2024-04-15T00:53:00.847227231Z [2024-04-15T00:53:00.846+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:53:00.860910952Z [2024-04-15T00:53:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:53:00+00:00, run_after=2024-04-15T00:54:00+00:00 2024-04-15T00:53:00.939816254Z [2024-04-15T00:53:00.939+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:53:00.939898638Z 2024-04-15T00:53:00.939913476Z 2024-04-15T00:53:00.939926872Z 2024-04-15T00:53:00.939975180Z [2024-04-15T00:53:00.939+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:53:00.940039043Z [2024-04-15T00:53:00.939+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:53:00.940211265Z [2024-04-15T00:53:00.939+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:53:00.941018269Z [2024-04-15T00:53:00.940+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:53:00.941046452Z 2024-04-15T00:53:00.941060121Z 2024-04-15T00:53:00.941080877Z 2024-04-15T00:53:00.945139016Z [2024-04-15T00:53:00.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:53:00.945305701Z [2024-04-15T00:53:00.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:53:00.945661246Z [2024-04-15T00:53:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:53:00.945877899Z [2024-04-15T00:53:00.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:53:00.946182194Z [2024-04-15T00:53:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:53:00.946338163Z [2024-04-15T00:53:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:53:01.173466071Z [2024-04-15T00:53:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status queued for try_number 1 2024-04-15T00:53:01.173629248Z [2024-04-15T00:53:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status queued for try_number 1 2024-04-15T00:53:01.173793887Z [2024-04-15T00:53:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status queued for try_number 1 2024-04-15T00:53:01.182446454Z [2024-04-15T00:53:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84fd2301-42f1-4816-be99-ec369939e934 2024-04-15T00:53:01.182546312Z [2024-04-15T00:53:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9386ab1c-dbaa-47c5-844b-deec509207f2 2024-04-15T00:53:01.182920954Z [2024-04-15T00:53:01.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65e564d0-2777-4182-9b5d-e751686ffe12 2024-04-15T00:53:02.379177604Z [2024-04-15T00:53:02.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:53:02.379486140Z [2024-04-15T00:53:02.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:52:00+00:00, run_id=scheduled__2024-04-15T00:52:00+00:00, run_start_date=2024-04-15 00:53:00.872545+00:00, run_end_date=2024-04-15 00:53:02.379093+00:00, run_duration=1.506548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:52:00+00:00, data_interval_end=2024-04-15 00:53:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:53:02.390746791Z [2024-04-15T00:53:02.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:53:00+00:00, run_after=2024-04-15T00:54:00+00:00 2024-04-15T00:53:02.419239636Z [2024-04-15T00:53:02.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status success for try_number 1 2024-04-15T00:53:02.423833124Z [2024-04-15T00:53:02.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:52:00+00:00, map_index=-1, run_start_date=2024-04-15 00:53:01.580010+00:00, run_end_date=2024-04-15 00:53:01.911772+00:00, run_duration=0.331762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:53:00.942081+00:00, queued_by_job_id=1, pid=9116 2024-04-15T00:53:04.966094440Z [2024-04-15T00:53:04.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:53:04.966274904Z [2024-04-15T00:53:04.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:52:00+00:00, run_id=scheduled__2024-04-15T00:52:00+00:00, run_start_date=2024-04-15 00:53:00.873753+00:00, run_end_date=2024-04-15 00:53:04.965888+00:00, run_duration=4.092135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:52:00+00:00, data_interval_end=2024-04-15 00:53:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:53:04.973986050Z [2024-04-15T00:53:04.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:53:00+00:00, run_after=2024-04-15T00:54:00+00:00 2024-04-15T00:53:04.979187831Z [2024-04-15T00:53:04.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:53:04.979415030Z [2024-04-15T00:53:04.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:52:00+00:00, run_id=scheduled__2024-04-15T00:52:00+00:00, run_start_date=2024-04-15 00:53:00.875286+00:00, run_end_date=2024-04-15 00:53:04.979078+00:00, run_duration=4.103792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:52:00+00:00, data_interval_end=2024-04-15 00:53:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:53:04.986766648Z [2024-04-15T00:53:04.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:53:00+00:00, run_after=2024-04-15T00:54:00+00:00 2024-04-15T00:53:05.030267823Z [2024-04-15T00:53:05.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status success for try_number 1 2024-04-15T00:53:05.030554588Z [2024-04-15T00:53:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status success for try_number 1 2024-04-15T00:53:05.036048553Z [2024-04-15T00:53:05.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:52:00+00:00, map_index=-1, run_start_date=2024-04-15 00:53:02.747849+00:00, run_end_date=2024-04-15 00:53:04.425109+00:00, run_duration=1.67726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:53:00.942081+00:00, queued_by_job_id=1, pid=9135 2024-04-15T00:53:05.036280291Z [2024-04-15T00:53:05.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:52:00+00:00, map_index=-1, run_start_date=2024-04-15 00:53:02.625776+00:00, run_end_date=2024-04-15 00:53:04.561950+00:00, run_duration=1.936174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:53:00.942081+00:00, queued_by_job_id=1, pid=9134 2024-04-15T00:54:00.843069626Z [2024-04-15T00:54:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:54:00+00:00, run_after=2024-04-15T00:55:00+00:00 2024-04-15T00:54:00.855318689Z [2024-04-15T00:54:00.854+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:54:00.872490879Z [2024-04-15T00:54:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:54:00+00:00, run_after=2024-04-15T00:55:00+00:00 2024-04-15T00:54:00.880884748Z [2024-04-15T00:54:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:54:00.989190532Z [2024-04-15T00:54:00.988+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:54:00.989232162Z 2024-04-15T00:54:00.989243252Z 2024-04-15T00:54:00.989252307Z 2024-04-15T00:54:00.989261078Z 2024-04-15T00:54:00.989690655Z [2024-04-15T00:54:00.989+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:54:00.990067335Z [2024-04-15T00:54:00.989+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:54:00.990391466Z [2024-04-15T00:54:00.990+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:54:00.990662101Z [2024-04-15T00:54:00.990+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:54:00.992025355Z [2024-04-15T00:54:00.991+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:54:00.992036768Z 2024-04-15T00:54:00.992041218Z 2024-04-15T00:54:00.992048752Z 2024-04-15T00:54:00.992053253Z 2024-04-15T00:54:01.007886403Z [2024-04-15T00:54:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:54:01.009926548Z [2024-04-15T00:54:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:54:01.011007991Z [2024-04-15T00:54:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:54:01.011859070Z [2024-04-15T00:54:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:54:01.012180332Z [2024-04-15T00:54:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:54:01.012803856Z [2024-04-15T00:54:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:54:01.013123717Z [2024-04-15T00:54:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:54:01.013424180Z [2024-04-15T00:54:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:54:01.414176120Z [2024-04-15T00:54:01.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status queued for try_number 1 2024-04-15T00:54:01.414453057Z [2024-04-15T00:54:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:53:00+00:00 exited with status queued for try_number 1 2024-04-15T00:54:01.414684000Z [2024-04-15T00:54:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:53:00+00:00 exited with status queued for try_number 1 2024-04-15T00:54:01.415005731Z [2024-04-15T00:54:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:53:00+00:00 exited with status queued for try_number 1 2024-04-15T00:54:01.427085692Z [2024-04-15T00:54:01.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4b739cc-8cfb-445e-b0d8-be2769795dd1 2024-04-15T00:54:01.427360427Z [2024-04-15T00:54:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 971e91e3-8166-49b4-b4dc-5f2a732d6683 2024-04-15T00:54:01.427596799Z [2024-04-15T00:54:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4061a0d6-86de-4733-be03-e153dd1e34d2 2024-04-15T00:54:01.427795838Z [2024-04-15T00:54:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33a5e903-dbec-43db-ab6e-396c6c283eb7 2024-04-15T00:54:02.592714390Z [2024-04-15T00:54:02.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:54:02.593227573Z [2024-04-15T00:54:02.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:52:00+00:00, run_id=scheduled__2024-04-15T00:52:00+00:00, run_start_date=2024-04-15 00:54:00.893598+00:00, run_end_date=2024-04-15 00:54:02.592707+00:00, run_duration=1.699109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:52:00+00:00, data_interval_end=2024-04-15 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:54:02.601633228Z [2024-04-15T00:54:02.601+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:54:00+00:00, run_after=2024-04-15T00:56:00+00:00 2024-04-15T00:54:02.608074112Z [2024-04-15T00:54:02.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:54:02.608317673Z [2024-04-15T00:54:02.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:53:00+00:00, run_id=scheduled__2024-04-15T00:53:00+00:00, run_start_date=2024-04-15 00:54:00.894858+00:00, run_end_date=2024-04-15 00:54:02.608082+00:00, run_duration=1.713224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:53:00+00:00, data_interval_end=2024-04-15 00:54:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:54:02.616602488Z [2024-04-15T00:54:02.616+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:54:00+00:00, run_after=2024-04-15T00:55:00+00:00 2024-04-15T00:54:02.657113114Z [2024-04-15T00:54:02.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:52:00+00:00 exited with status success for try_number 1 2024-04-15T00:54:02.658928479Z [2024-04-15T00:54:02.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:53:00+00:00 exited with status success for try_number 1 2024-04-15T00:54:02.664594694Z [2024-04-15T00:54:02.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:52:00+00:00, map_index=-1, run_start_date=2024-04-15 00:54:01.694624+00:00, run_end_date=2024-04-15 00:54:02.004830+00:00, run_duration=0.310206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:54:00.997463+00:00, queued_by_job_id=1, pid=9168 2024-04-15T00:54:02.664863803Z [2024-04-15T00:54:02.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:53:00+00:00, map_index=-1, run_start_date=2024-04-15 00:54:01.804371+00:00, run_end_date=2024-04-15 00:54:02.164288+00:00, run_duration=0.359917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:54:00.997463+00:00, queued_by_job_id=1, pid=9169 2024-04-15T00:54:04.864806179Z [2024-04-15T00:54:04.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:54:04.865057504Z [2024-04-15T00:54:04.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:53:00+00:00, run_id=scheduled__2024-04-15T00:53:00+00:00, run_start_date=2024-04-15 00:54:00.896124+00:00, run_end_date=2024-04-15 00:54:04.864612+00:00, run_duration=3.968488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:53:00+00:00, data_interval_end=2024-04-15 00:54:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:54:04.876175727Z [2024-04-15T00:54:04.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:54:00+00:00, run_after=2024-04-15T00:55:00+00:00 2024-04-15T00:54:04.883980920Z [2024-04-15T00:54:04.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:54:04.884191570Z [2024-04-15T00:54:04.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:53:00+00:00, run_id=scheduled__2024-04-15T00:53:00+00:00, run_start_date=2024-04-15 00:54:00.897345+00:00, run_end_date=2024-04-15 00:54:04.883768+00:00, run_duration=3.986423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:53:00+00:00, data_interval_end=2024-04-15 00:54:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:54:04.893729994Z [2024-04-15T00:54:04.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:54:00+00:00, run_after=2024-04-15T00:55:00+00:00 2024-04-15T00:54:04.939241480Z [2024-04-15T00:54:04.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:53:00+00:00 exited with status success for try_number 1 2024-04-15T00:54:04.939443270Z [2024-04-15T00:54:04.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:53:00+00:00 exited with status success for try_number 1 2024-04-15T00:54:04.951564137Z [2024-04-15T00:54:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:53:00+00:00, map_index=-1, run_start_date=2024-04-15 00:54:02.702090+00:00, run_end_date=2024-04-15 00:54:03.946083+00:00, run_duration=1.243993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:54:00.997463+00:00, queued_by_job_id=1, pid=9192 2024-04-15T00:54:04.951813888Z [2024-04-15T00:54:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:53:00+00:00, map_index=-1, run_start_date=2024-04-15 00:54:02.829750+00:00, run_end_date=2024-04-15 00:54:04.404001+00:00, run_duration=1.574251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:54:00.997463+00:00, queued_by_job_id=1, pid=9193 2024-04-15T00:55:00.731741490Z [2024-04-15T00:55:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:55:00+00:00, run_after=2024-04-15T00:56:00+00:00 2024-04-15T00:55:00.743570009Z [2024-04-15T00:55:00.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:55:00+00:00, run_after=2024-04-15T00:56:00+00:00 2024-04-15T00:55:00.749582060Z [2024-04-15T00:55:00.749+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:55:00.762369910Z [2024-04-15T00:55:00.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:55:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:55:00.848883854Z [2024-04-15T00:55:00.848+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:55:00.848929701Z 2024-04-15T00:55:00.848944675Z 2024-04-15T00:55:00.848957325Z 2024-04-15T00:55:00.848969919Z 2024-04-15T00:55:00.849096447Z [2024-04-15T00:55:00.848+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:55:00.849396430Z [2024-04-15T00:55:00.849+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:55:00.849643190Z [2024-04-15T00:55:00.849+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:55:00.849892468Z [2024-04-15T00:55:00.849+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:55:00.850685616Z [2024-04-15T00:55:00.850+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:55:00.850699732Z 2024-04-15T00:55:00.850704974Z 2024-04-15T00:55:00.850709438Z 2024-04-15T00:55:00.850713738Z 2024-04-15T00:55:00.854986734Z [2024-04-15T00:55:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T00:55:00.855236168Z [2024-04-15T00:55:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:55:00.855631184Z [2024-04-15T00:55:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:55:00.855854762Z [2024-04-15T00:55:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:55:00.856185597Z [2024-04-15T00:55:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:55:00.856398434Z [2024-04-15T00:55:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:55:00.856821925Z [2024-04-15T00:55:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:55:00.857024449Z [2024-04-15T00:55:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:55:01.363524121Z [2024-04-15T00:55:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:55:01.363755815Z [2024-04-15T00:55:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status queued for try_number 1 2024-04-15T00:55:01.363931279Z [2024-04-15T00:55:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status queued for try_number 1 2024-04-15T00:55:01.364086102Z [2024-04-15T00:55:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status queued for try_number 1 2024-04-15T00:55:01.382232936Z [2024-04-15T00:55:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17bdc486-d21c-4e7e-85e2-372e192ee853 2024-04-15T00:55:01.382616691Z [2024-04-15T00:55:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e68ad42-ead3-4c9d-9812-afa17d5fdb10 2024-04-15T00:55:01.382949479Z [2024-04-15T00:55:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d27dbaa-ab81-4458-bf7c-26b7d3908215 2024-04-15T00:55:01.383168511Z [2024-04-15T00:55:01.383+0000] {scheduler_job.py:635} INFO - Setting external_id for to aac95dd1-9a42-4500-8c4b-61908ffbf4c5 2024-04-15T00:55:02.684862376Z [2024-04-15T00:55:02.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:55:02.685597425Z [2024-04-15T00:55:02.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:54:00+00:00, run_id=scheduled__2024-04-15T00:54:00+00:00, run_start_date=2024-04-15 00:55:00.774299+00:00, run_end_date=2024-04-15 00:55:02.685228+00:00, run_duration=1.910929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:54:00+00:00, data_interval_end=2024-04-15 00:55:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:55:02.696230840Z [2024-04-15T00:55:02.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:55:00+00:00, run_after=2024-04-15T00:56:00+00:00 2024-04-15T00:55:02.751161774Z [2024-04-15T00:55:02.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status success for try_number 1 2024-04-15T00:55:02.755883079Z [2024-04-15T00:55:02.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:54:00+00:00, map_index=-1, run_start_date=2024-04-15 00:55:01.568045+00:00, run_end_date=2024-04-15 00:55:01.925778+00:00, run_duration=0.357733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:55:00.851852+00:00, queued_by_job_id=1, pid=9226 2024-04-15T00:55:03.872215222Z [2024-04-15T00:55:03.871+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:55:03.872245345Z 2024-04-15T00:55:03.872456962Z [2024-04-15T00:55:03.872+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:55:03.873314666Z [2024-04-15T00:55:03.873+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:55:03.873332269Z 2024-04-15T00:55:03.877384768Z [2024-04-15T00:55:03.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T00:55:03.877595869Z [2024-04-15T00:55:03.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:55:03.943270124Z [2024-04-15T00:55:03.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:55:03.943317864Z [2024-04-15T00:55:03.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:55:03.950084383Z [2024-04-15T00:55:03.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3393991c-efdd-481f-bb57-65a781f7404d 2024-04-15T00:55:03.950198578Z [2024-04-15T00:55:03.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=-1, run_start_date=2024-04-15 00:55:02.577671+00:00, run_end_date=2024-04-15 00:55:02.859598+00:00, run_duration=0.281927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:55:00.851852+00:00, queued_by_job_id=1, pid=9251 2024-04-15T00:55:04.001013988Z [2024-04-15T00:55:04.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:55:04.001708823Z [2024-04-15T00:55:04.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:54:00+00:00, run_id=scheduled__2024-04-15T00:54:00+00:00, run_start_date=2024-04-15 00:55:00.775349+00:00, run_end_date=2024-04-15 00:55:04.001234+00:00, run_duration=3.225885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:54:00+00:00, data_interval_end=2024-04-15 00:55:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:55:04.018009687Z [2024-04-15T00:55:04.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:55:00+00:00, run_after=2024-04-15T00:56:00+00:00 2024-04-15T00:55:04.088179799Z [2024-04-15T00:55:04.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status success for try_number 1 2024-04-15T00:55:04.095684561Z [2024-04-15T00:55:04.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:54:00+00:00, map_index=-1, run_start_date=2024-04-15 00:55:02.611808+00:00, run_end_date=2024-04-15 00:55:03.868786+00:00, run_duration=1.256978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:55:00.851852+00:00, queued_by_job_id=1, pid=9252 2024-04-15T00:55:04.742648763Z [2024-04-15T00:55:04.742+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:55:04.743020423Z [2024-04-15T00:55:04.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:54:00+00:00, run_id=scheduled__2024-04-15T00:54:00+00:00, run_start_date=2024-04-15 00:55:00.776348+00:00, run_end_date=2024-04-15 00:55:04.742548+00:00, run_duration=3.9662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:54:00+00:00, data_interval_end=2024-04-15 00:55:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:55:04.754084768Z [2024-04-15T00:55:04.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:55:00+00:00, run_after=2024-04-15T00:56:00+00:00 2024-04-15T00:55:04.810356452Z [2024-04-15T00:55:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status success for try_number 1 2024-04-15T00:55:04.816391848Z [2024-04-15T00:55:04.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:54:00+00:00, map_index=-1, run_start_date=2024-04-15 00:55:02.578514+00:00, run_end_date=2024-04-15 00:55:04.164489+00:00, run_duration=1.585975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:55:00.851852+00:00, queued_by_job_id=1, pid=9250 2024-04-15T00:55:05.977183885Z [2024-04-15T00:55:05.976+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:55:05.977247730Z 2024-04-15T00:55:05.977579211Z [2024-04-15T00:55:05.977+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:55:05.978452474Z [2024-04-15T00:55:05.978+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:55:05.978468478Z 2024-04-15T00:55:05.981519066Z [2024-04-15T00:55:05.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T00:55:05.981840615Z [2024-04-15T00:55:05.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T00:55:06.074341329Z [2024-04-15T00:55:06.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:55:06.074795167Z [2024-04-15T00:55:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:55:06.081564624Z [2024-04-15T00:55:06.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6353b60-7f9a-450c-af45-e02995978b2f 2024-04-15T00:55:06.082298630Z [2024-04-15T00:55:06.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=-1, run_start_date=2024-04-15 00:55:05.373313+00:00, run_end_date=2024-04-15 00:55:05.803300+00:00, run_duration=0.429987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:55:03.874153+00:00, queued_by_job_id=1, pid=9275 2024-04-15T00:55:08.845572865Z [2024-04-15T00:55:08.845+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T00:55:08.845632904Z 2024-04-15T00:55:08.845775076Z [2024-04-15T00:55:08.845+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:55:08.846914295Z [2024-04-15T00:55:08.846+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:55:08.846927741Z 2024-04-15T00:55:08.850285341Z [2024-04-15T00:55:08.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:55:08.850636787Z [2024-04-15T00:55:08.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T00:55:08.906823480Z [2024-04-15T00:55:08.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status queued for try_number 1 2024-04-15T00:55:08.907290873Z [2024-04-15T00:55:08.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:55:08.915819454Z [2024-04-15T00:55:08.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to c40de9d7-7f6e-4ad5-977d-803d1256c75f 2024-04-15T00:55:08.916132400Z [2024-04-15T00:55:08.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=0, run_start_date=2024-04-15 00:55:07.466858+00:00, run_end_date=2024-04-15 00:55:07.827660+00:00, run_duration=0.360802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:55:05.979040+00:00, queued_by_job_id=1, pid=9283 2024-04-15T00:55:10.971674969Z [2024-04-15T00:55:10.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:55:10.972025395Z [2024-04-15T00:55:10.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:50:00+00:00, run_id=scheduled__2024-04-15T00:50:00+00:00, run_start_date=2024-04-15 00:55:00.773133+00:00, run_end_date=2024-04-15 00:55:10.971637+00:00, run_duration=10.198504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:50:00+00:00, data_interval_end=2024-04-15 00:55:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T00:55:10.983370096Z [2024-04-15T00:55:10.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:55:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:55:11.014379342Z [2024-04-15T00:55:11.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:50:00+00:00 exited with status success for try_number 1 2024-04-15T00:55:11.018664611Z [2024-04-15T00:55:11.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:50:00+00:00, map_index=-1, run_start_date=2024-04-15 00:55:10.272211+00:00, run_end_date=2024-04-15 00:55:10.618519+00:00, run_duration=0.346308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:55:08.847564+00:00, queued_by_job_id=1, pid=9291 2024-04-15T00:56:00.606911507Z [2024-04-15T00:56:00.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:56:00+00:00, run_after=2024-04-15T00:57:00+00:00 2024-04-15T00:56:00.618024848Z [2024-04-15T00:56:00.616+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:56:00.630347660Z [2024-04-15T00:56:00.630+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:56:00+00:00, run_after=2024-04-15T00:57:00+00:00 2024-04-15T00:56:00.639154782Z [2024-04-15T00:56:00.638+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:56:00.726603325Z [2024-04-15T00:56:00.726+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:56:00.726633076Z 2024-04-15T00:56:00.726646215Z 2024-04-15T00:56:00.726652068Z 2024-04-15T00:56:00.726657508Z 2024-04-15T00:56:00.727022489Z [2024-04-15T00:56:00.726+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:56:00.727347839Z [2024-04-15T00:56:00.727+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:56:00.727636852Z [2024-04-15T00:56:00.727+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:56:00.727924655Z [2024-04-15T00:56:00.727+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:56:00.728905387Z [2024-04-15T00:56:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:56:00.728921958Z 2024-04-15T00:56:00.728960083Z 2024-04-15T00:56:00.728965665Z 2024-04-15T00:56:00.728970757Z 2024-04-15T00:56:00.733384176Z [2024-04-15T00:56:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:56:00.734769845Z [2024-04-15T00:56:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:56:00.735230507Z [2024-04-15T00:56:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:56:00.735483797Z [2024-04-15T00:56:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:56:00.735920703Z [2024-04-15T00:56:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:56:00.736166752Z [2024-04-15T00:56:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:56:00.736678540Z [2024-04-15T00:56:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:56:00.737038459Z [2024-04-15T00:56:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:56:01.280357487Z [2024-04-15T00:56:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status queued for try_number 1 2024-04-15T00:56:01.280752348Z [2024-04-15T00:56:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status queued for try_number 1 2024-04-15T00:56:01.280987387Z [2024-04-15T00:56:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status queued for try_number 1 2024-04-15T00:56:01.281092683Z [2024-04-15T00:56:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status queued for try_number 1 2024-04-15T00:56:01.290202498Z [2024-04-15T00:56:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8fb5d80-f7a4-4537-b9f5-3e3d3871344b 2024-04-15T00:56:01.290428236Z [2024-04-15T00:56:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad767502-2152-4c31-aded-4d60a78232cf 2024-04-15T00:56:01.290701451Z [2024-04-15T00:56:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 763e0ffc-63de-49a9-8dd1-c845a9e48e7e 2024-04-15T00:56:01.290937424Z [2024-04-15T00:56:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68676c71-0bf2-4b50-9cd1-f541f95a6481 2024-04-15T00:56:02.471025376Z [2024-04-15T00:56:02.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:56:02.471296547Z [2024-04-15T00:56:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:54:00+00:00, run_id=scheduled__2024-04-15T00:54:00+00:00, run_start_date=2024-04-15 00:56:00.647388+00:00, run_end_date=2024-04-15 00:56:02.471004+00:00, run_duration=1.823616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:54:00+00:00, data_interval_end=2024-04-15 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:56:02.478256891Z [2024-04-15T00:56:02.478+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:56:00+00:00, run_after=2024-04-15T00:58:00+00:00 2024-04-15T00:56:02.483842144Z [2024-04-15T00:56:02.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:56:02.484056555Z [2024-04-15T00:56:02.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:55:00+00:00, run_id=scheduled__2024-04-15T00:55:00+00:00, run_start_date=2024-04-15 00:56:00.648432+00:00, run_end_date=2024-04-15 00:56:02.483774+00:00, run_duration=1.835342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:55:00+00:00, data_interval_end=2024-04-15 00:56:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:56:02.492446986Z [2024-04-15T00:56:02.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:56:00+00:00, run_after=2024-04-15T00:57:00+00:00 2024-04-15T00:56:02.530251759Z [2024-04-15T00:56:02.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:54:00+00:00 exited with status success for try_number 1 2024-04-15T00:56:02.531987115Z [2024-04-15T00:56:02.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status success for try_number 1 2024-04-15T00:56:02.537395108Z [2024-04-15T00:56:02.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:54:00+00:00, map_index=-1, run_start_date=2024-04-15 00:56:01.435649+00:00, run_end_date=2024-04-15 00:56:01.773499+00:00, run_duration=0.33785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:56:00.730257+00:00, queued_by_job_id=1, pid=9314 2024-04-15T00:56:02.537616388Z [2024-04-15T00:56:02.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:55:00+00:00, map_index=-1, run_start_date=2024-04-15 00:56:01.543006+00:00, run_end_date=2024-04-15 00:56:02.006691+00:00, run_duration=0.463685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:56:00.730257+00:00, queued_by_job_id=1, pid=9315 2024-04-15T00:56:03.431437885Z [2024-04-15T00:56:03.430+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T00:56:04.480295422Z [2024-04-15T00:56:04.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:56:04.480500891Z [2024-04-15T00:56:04.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:55:00+00:00, run_id=scheduled__2024-04-15T00:55:00+00:00, run_start_date=2024-04-15 00:56:00.649380+00:00, run_end_date=2024-04-15 00:56:04.480107+00:00, run_duration=3.830727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:55:00+00:00, data_interval_end=2024-04-15 00:56:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:56:04.495448998Z [2024-04-15T00:56:04.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:56:00+00:00, run_after=2024-04-15T00:57:00+00:00 2024-04-15T00:56:04.506329669Z [2024-04-15T00:56:04.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:56:04.506643939Z [2024-04-15T00:56:04.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:55:00+00:00, run_id=scheduled__2024-04-15T00:55:00+00:00, run_start_date=2024-04-15 00:56:00.650255+00:00, run_end_date=2024-04-15 00:56:04.506185+00:00, run_duration=3.85593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:55:00+00:00, data_interval_end=2024-04-15 00:56:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:56:04.518630381Z [2024-04-15T00:56:04.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:56:00+00:00, run_after=2024-04-15T00:57:00+00:00 2024-04-15T00:56:04.571239329Z [2024-04-15T00:56:04.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status success for try_number 1 2024-04-15T00:56:04.571417052Z [2024-04-15T00:56:04.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status success for try_number 1 2024-04-15T00:56:04.583514479Z [2024-04-15T00:56:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:55:00+00:00, map_index=-1, run_start_date=2024-04-15 00:56:02.526479+00:00, run_end_date=2024-04-15 00:56:04.093928+00:00, run_duration=1.567449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:56:00.730257+00:00, queued_by_job_id=1, pid=9339 2024-04-15T00:56:04.583893850Z [2024-04-15T00:56:04.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:55:00+00:00, map_index=-1, run_start_date=2024-04-15 00:56:02.351866+00:00, run_end_date=2024-04-15 00:56:03.696754+00:00, run_duration=1.344888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:56:00.730257+00:00, queued_by_job_id=1, pid=9338 2024-04-15T00:57:00.913786867Z [2024-04-15T00:57:00.913+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:57:00.932305768Z [2024-04-15T00:57:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:57:00+00:00, run_after=2024-04-15T00:58:00+00:00 2024-04-15T00:57:00.945730411Z [2024-04-15T00:57:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:57:00+00:00, run_after=2024-04-15T00:58:00+00:00 2024-04-15T00:57:01.023483533Z [2024-04-15T00:57:01.023+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:57:01.023511878Z 2024-04-15T00:57:01.023516760Z 2024-04-15T00:57:01.023521094Z 2024-04-15T00:57:01.023831056Z [2024-04-15T00:57:01.023+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:57:01.024068009Z [2024-04-15T00:57:01.023+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:57:01.024293985Z [2024-04-15T00:57:01.024+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:57:01.025422336Z [2024-04-15T00:57:01.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:57:01.025439353Z 2024-04-15T00:57:01.025444845Z 2024-04-15T00:57:01.025450257Z 2024-04-15T00:57:01.029931460Z [2024-04-15T00:57:01.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:57:01.030292734Z [2024-04-15T00:57:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:57:01.030771714Z [2024-04-15T00:57:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:57:01.031161404Z [2024-04-15T00:57:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:57:01.033872417Z [2024-04-15T00:57:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:57:01.034190789Z [2024-04-15T00:57:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:57:01.247021662Z [2024-04-15T00:57:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status queued for try_number 1 2024-04-15T00:57:01.247116418Z [2024-04-15T00:57:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status queued for try_number 1 2024-04-15T00:57:01.247200371Z [2024-04-15T00:57:01.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status queued for try_number 1 2024-04-15T00:57:01.258736111Z [2024-04-15T00:57:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 401034fe-13af-45f0-a378-832a9b9fe588 2024-04-15T00:57:01.258889309Z [2024-04-15T00:57:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25dffb5e-5378-40c2-b311-2c237b1bf671 2024-04-15T00:57:01.259103180Z [2024-04-15T00:57:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71476908-0118-4300-bc93-2582f01790db 2024-04-15T00:57:03.259210448Z [2024-04-15T00:57:03.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:57:03.259639875Z [2024-04-15T00:57:03.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:56:00+00:00, run_id=scheduled__2024-04-15T00:56:00+00:00, run_start_date=2024-04-15 00:57:00.958982+00:00, run_end_date=2024-04-15 00:57:03.259055+00:00, run_duration=2.300073, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:56:00+00:00, data_interval_end=2024-04-15 00:57:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:57:03.270362581Z [2024-04-15T00:57:03.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:57:00+00:00, run_after=2024-04-15T00:58:00+00:00 2024-04-15T00:57:03.321809776Z [2024-04-15T00:57:03.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status success for try_number 1 2024-04-15T00:57:03.329195869Z [2024-04-15T00:57:03.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:56:00+00:00, map_index=-1, run_start_date=2024-04-15 00:57:01.775941+00:00, run_end_date=2024-04-15 00:57:02.147400+00:00, run_duration=0.371459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:57:01.026577+00:00, queued_by_job_id=1, pid=9371 2024-04-15T00:57:04.382970894Z [2024-04-15T00:57:04.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:57:04.382996515Z [2024-04-15T00:57:04.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:56:00+00:00, run_id=scheduled__2024-04-15T00:56:00+00:00, run_start_date=2024-04-15 00:57:00.960115+00:00, run_end_date=2024-04-15 00:57:04.376389+00:00, run_duration=3.416274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:56:00+00:00, data_interval_end=2024-04-15 00:57:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:57:04.388858592Z [2024-04-15T00:57:04.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:57:00+00:00, run_after=2024-04-15T00:58:00+00:00 2024-04-15T00:57:04.430526341Z [2024-04-15T00:57:04.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status success for try_number 1 2024-04-15T00:57:04.437100725Z [2024-04-15T00:57:04.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:56:00+00:00, map_index=-1, run_start_date=2024-04-15 00:57:02.610642+00:00, run_end_date=2024-04-15 00:57:03.791262+00:00, run_duration=1.18062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:57:01.026577+00:00, queued_by_job_id=1, pid=9389 2024-04-15T00:57:05.493477128Z [2024-04-15T00:57:05.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:57:05.493862052Z [2024-04-15T00:57:05.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:56:00+00:00, run_id=scheduled__2024-04-15T00:56:00+00:00, run_start_date=2024-04-15 00:57:00.961341+00:00, run_end_date=2024-04-15 00:57:05.493322+00:00, run_duration=4.531981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:56:00+00:00, data_interval_end=2024-04-15 00:57:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:57:05.506335835Z [2024-04-15T00:57:05.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:57:00+00:00, run_after=2024-04-15T00:58:00+00:00 2024-04-15T00:57:05.547441026Z [2024-04-15T00:57:05.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status success for try_number 1 2024-04-15T00:57:05.554969082Z [2024-04-15T00:57:05.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:56:00+00:00, map_index=-1, run_start_date=2024-04-15 00:57:02.749135+00:00, run_end_date=2024-04-15 00:57:04.565686+00:00, run_duration=1.816551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:57:01.026577+00:00, queued_by_job_id=1, pid=9390 2024-04-15T00:58:00.227416221Z [2024-04-15T00:58:00.226+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:58:00.242383612Z [2024-04-15T00:58:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:58:00+00:00, run_after=2024-04-15T00:59:00+00:00 2024-04-15T00:58:00.255778819Z [2024-04-15T00:58:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:58:00+00:00, run_after=2024-04-15T00:59:00+00:00 2024-04-15T00:58:00.262395396Z [2024-04-15T00:58:00.262+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:58:00.375327186Z [2024-04-15T00:58:00.371+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T00:58:00.375346841Z 2024-04-15T00:58:00.375350704Z 2024-04-15T00:58:00.375354011Z 2024-04-15T00:58:00.375357279Z 2024-04-15T00:58:00.375360800Z [2024-04-15T00:58:00.371+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T00:58:00.375363906Z [2024-04-15T00:58:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:58:00.375387360Z [2024-04-15T00:58:00.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:58:00.375390587Z [2024-04-15T00:58:00.372+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:58:00.375393421Z [2024-04-15T00:58:00.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:58:00.375396249Z 2024-04-15T00:58:00.375398982Z 2024-04-15T00:58:00.375401787Z 2024-04-15T00:58:00.375404584Z 2024-04-15T00:58:00.382105906Z [2024-04-15T00:58:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:58:00.382120880Z [2024-04-15T00:58:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T00:58:00.382124594Z [2024-04-15T00:58:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:58:00.382127700Z [2024-04-15T00:58:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:58:00.382130384Z [2024-04-15T00:58:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:58:00.382133238Z [2024-04-15T00:58:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:58:00.382136187Z [2024-04-15T00:58:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:58:00.382138806Z [2024-04-15T00:58:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:58:00.843828386Z [2024-04-15T00:58:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status queued for try_number 1 2024-04-15T00:58:00.844049359Z [2024-04-15T00:58:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:57:00+00:00 exited with status queued for try_number 1 2024-04-15T00:58:00.844169097Z [2024-04-15T00:58:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:57:00+00:00 exited with status queued for try_number 1 2024-04-15T00:58:00.844281624Z [2024-04-15T00:58:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:57:00+00:00 exited with status queued for try_number 1 2024-04-15T00:58:00.854395012Z [2024-04-15T00:58:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fc3ca49-d1fb-4e86-8acd-6c399cebe759 2024-04-15T00:58:00.855684642Z [2024-04-15T00:58:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to a20dea2a-fa10-4e6b-8fd2-7e844881345e 2024-04-15T00:58:00.855933329Z [2024-04-15T00:58:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94a3e7f4-b647-4f16-80a3-99e59f99ef40 2024-04-15T00:58:00.856121321Z [2024-04-15T00:58:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f698ae7-4e92-4189-a2e5-7f5a85ee03be 2024-04-15T00:58:02.010538087Z [2024-04-15T00:58:02.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:58:02.010815356Z [2024-04-15T00:58:02.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:56:00+00:00, run_id=scheduled__2024-04-15T00:56:00+00:00, run_start_date=2024-04-15 00:58:00.273685+00:00, run_end_date=2024-04-15 00:58:02.010432+00:00, run_duration=1.736747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:56:00+00:00, data_interval_end=2024-04-15 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T00:58:02.017118159Z [2024-04-15T00:58:02.016+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T00:58:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:58:02.022394470Z [2024-04-15T00:58:02.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:58:02.022799876Z [2024-04-15T00:58:02.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:57:00+00:00, run_id=scheduled__2024-04-15T00:57:00+00:00, run_start_date=2024-04-15 00:58:00.276057+00:00, run_end_date=2024-04-15 00:58:02.022526+00:00, run_duration=1.746469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:57:00+00:00, data_interval_end=2024-04-15 00:58:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:58:02.036165299Z [2024-04-15T00:58:02.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:58:00+00:00, run_after=2024-04-15T00:59:00+00:00 2024-04-15T00:58:02.127752754Z [2024-04-15T00:58:02.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:56:00+00:00 exited with status success for try_number 1 2024-04-15T00:58:02.128148509Z [2024-04-15T00:58:02.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:57:00+00:00 exited with status success for try_number 1 2024-04-15T00:58:02.135519673Z [2024-04-15T00:58:02.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:56:00+00:00, map_index=-1, run_start_date=2024-04-15 00:58:01.076747+00:00, run_end_date=2024-04-15 00:58:01.361663+00:00, run_duration=0.284916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:58:00.374900+00:00, queued_by_job_id=1, pid=9423 2024-04-15T00:58:02.135987808Z [2024-04-15T00:58:02.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:57:00+00:00, map_index=-1, run_start_date=2024-04-15 00:58:01.082931+00:00, run_end_date=2024-04-15 00:58:01.378070+00:00, run_duration=0.295139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:58:00.374900+00:00, queued_by_job_id=1, pid=9424 2024-04-15T00:58:04.296098380Z [2024-04-15T00:58:04.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:58:04.296222946Z [2024-04-15T00:58:04.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:57:00+00:00, run_id=scheduled__2024-04-15T00:57:00+00:00, run_start_date=2024-04-15 00:58:00.292952+00:00, run_end_date=2024-04-15 00:58:04.295915+00:00, run_duration=4.002963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:57:00+00:00, data_interval_end=2024-04-15 00:58:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:58:04.310197133Z [2024-04-15T00:58:04.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:58:00+00:00, run_after=2024-04-15T00:59:00+00:00 2024-04-15T00:58:04.317925448Z [2024-04-15T00:58:04.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:58:04.318070393Z [2024-04-15T00:58:04.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:57:00+00:00, run_id=scheduled__2024-04-15T00:57:00+00:00, run_start_date=2024-04-15 00:58:00.295347+00:00, run_end_date=2024-04-15 00:58:04.317763+00:00, run_duration=4.022416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:57:00+00:00, data_interval_end=2024-04-15 00:58:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:58:04.327274607Z [2024-04-15T00:58:04.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:58:00+00:00, run_after=2024-04-15T00:59:00+00:00 2024-04-15T00:58:04.377409873Z [2024-04-15T00:58:04.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:57:00+00:00 exited with status success for try_number 1 2024-04-15T00:58:04.377443822Z [2024-04-15T00:58:04.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:57:00+00:00 exited with status success for try_number 1 2024-04-15T00:58:04.386715981Z [2024-04-15T00:58:04.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:57:00+00:00, map_index=-1, run_start_date=2024-04-15 00:58:02.110131+00:00, run_end_date=2024-04-15 00:58:03.361668+00:00, run_duration=1.251537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:58:00.374900+00:00, queued_by_job_id=1, pid=9448 2024-04-15T00:58:04.387049452Z [2024-04-15T00:58:04.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:57:00+00:00, map_index=-1, run_start_date=2024-04-15 00:58:02.027724+00:00, run_end_date=2024-04-15 00:58:03.710621+00:00, run_duration=1.682897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:58:00.374900+00:00, queued_by_job_id=1, pid=9447 2024-04-15T00:59:00.117279063Z [2024-04-15T00:59:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:59:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:59:00.128830971Z [2024-04-15T00:59:00.128+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T00:59:00.147544529Z [2024-04-15T00:59:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:59:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:59:00.204843686Z [2024-04-15T00:59:00.204+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T00:59:00.204867397Z 2024-04-15T00:59:00.204871049Z 2024-04-15T00:59:00.204874057Z 2024-04-15T00:59:00.205163960Z [2024-04-15T00:59:00.204+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T00:59:00.205529214Z [2024-04-15T00:59:00.205+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:59:00.205895353Z [2024-04-15T00:59:00.205+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T00:59:00.208319386Z [2024-04-15T00:59:00.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T00:59:00.208333324Z 2024-04-15T00:59:00.208336766Z 2024-04-15T00:59:00.208340138Z 2024-04-15T00:59:00.213668304Z [2024-04-15T00:59:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:59:00.213942889Z [2024-04-15T00:59:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T00:59:00.214546435Z [2024-04-15T00:59:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:59:00.214892463Z [2024-04-15T00:59:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T00:59:00.215524994Z [2024-04-15T00:59:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T00:59:00.215832599Z [2024-04-15T00:59:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T00:59:00.577100030Z [2024-04-15T00:59:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status queued for try_number 1 2024-04-15T00:59:00.577132879Z [2024-04-15T00:59:00.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status queued for try_number 1 2024-04-15T00:59:00.579120211Z [2024-04-15T00:59:00.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status queued for try_number 1 2024-04-15T00:59:00.585923533Z [2024-04-15T00:59:00.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe78762b-a8a6-4bdc-890c-f9bf26b8f732 2024-04-15T00:59:00.586246440Z [2024-04-15T00:59:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66323492-864b-429d-987c-d95a98209b52 2024-04-15T00:59:00.586456281Z [2024-04-15T00:59:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65046606-3e05-493b-bd25-d567a84432a6 2024-04-15T00:59:01.727066975Z [2024-04-15T00:59:01.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:59:01.727402889Z [2024-04-15T00:59:01.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:58:00+00:00, run_id=scheduled__2024-04-15T00:58:00+00:00, run_start_date=2024-04-15 00:59:00.158642+00:00, run_end_date=2024-04-15 00:59:01.726946+00:00, run_duration=1.568304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:58:00+00:00, data_interval_end=2024-04-15 00:59:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T00:59:01.738285258Z [2024-04-15T00:59:01.738+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T00:59:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:59:01.767378338Z [2024-04-15T00:59:01.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status success for try_number 1 2024-04-15T00:59:01.775746193Z [2024-04-15T00:59:01.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:58:00+00:00, map_index=-1, run_start_date=2024-04-15 00:59:00.990487+00:00, run_end_date=2024-04-15 00:59:01.378660+00:00, run_duration=0.388173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:59:00.209983+00:00, queued_by_job_id=1, pid=9480 2024-04-15T00:59:03.938995937Z [2024-04-15T00:59:03.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:59:03.939381544Z [2024-04-15T00:59:03.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:58:00+00:00, run_id=scheduled__2024-04-15T00:58:00+00:00, run_start_date=2024-04-15 00:59:00.159655+00:00, run_end_date=2024-04-15 00:59:03.939089+00:00, run_duration=3.779434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:58:00+00:00, data_interval_end=2024-04-15 00:59:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T00:59:03.947372329Z [2024-04-15T00:59:03.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:59:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:59:03.953711411Z [2024-04-15T00:59:03.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T00:59:03.953932854Z [2024-04-15T00:59:03.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:58:00+00:00, run_id=scheduled__2024-04-15T00:58:00+00:00, run_start_date=2024-04-15 00:59:00.160541+00:00, run_end_date=2024-04-15 00:59:03.953528+00:00, run_duration=3.792987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:58:00+00:00, data_interval_end=2024-04-15 00:59:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T00:59:03.963001707Z [2024-04-15T00:59:03.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T00:59:00+00:00, run_after=2024-04-15T01:00:00+00:00 2024-04-15T00:59:03.998142119Z [2024-04-15T00:59:03.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status success for try_number 1 2024-04-15T00:59:03.998398041Z [2024-04-15T00:59:03.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status success for try_number 1 2024-04-15T00:59:04.021604973Z [2024-04-15T00:59:04.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:58:00+00:00, map_index=-1, run_start_date=2024-04-15 00:59:01.851882+00:00, run_end_date=2024-04-15 00:59:03.030661+00:00, run_duration=1.178779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:59:00.209983+00:00, queued_by_job_id=1, pid=9498 2024-04-15T00:59:04.021687694Z [2024-04-15T00:59:04.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:58:00+00:00, map_index=-1, run_start_date=2024-04-15 00:59:01.932224+00:00, run_end_date=2024-04-15 00:59:03.502563+00:00, run_duration=1.570339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 00:59:00.209983+00:00, queued_by_job_id=1, pid=9499 2024-04-15T01:00:01.062545966Z [2024-04-15T01:00:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:01:00+00:00 2024-04-15T01:00:01.078995100Z [2024-04-15T01:00:01.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:05:00+00:00 2024-04-15T01:00:01.089976332Z [2024-04-15T01:00:01.089+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:00:01.101306418Z [2024-04-15T01:00:01.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:00:01.122837768Z [2024-04-15T01:00:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:01:00+00:00 2024-04-15T01:00:01.232402244Z [2024-04-15T01:00:01.232+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:00:01.232475782Z 2024-04-15T01:00:01.232484546Z 2024-04-15T01:00:01.232493073Z 2024-04-15T01:00:01.232499955Z 2024-04-15T01:00:01.232506936Z 2024-04-15T01:00:01.232591344Z [2024-04-15T01:00:01.232+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:00:01.232636746Z [2024-04-15T01:00:01.232+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:00:01.232641117Z [2024-04-15T01:00:01.232+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:00:01.232760753Z [2024-04-15T01:00:01.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:00:01.232876819Z [2024-04-15T01:00:01.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:00:01.233414651Z [2024-04-15T01:00:01.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:00:01.233420323Z 2024-04-15T01:00:01.233424603Z 2024-04-15T01:00:01.233428277Z 2024-04-15T01:00:01.233432039Z 2024-04-15T01:00:01.233442030Z 2024-04-15T01:00:01.237197188Z [2024-04-15T01:00:01.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:00:01.237347766Z [2024-04-15T01:00:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:00:01.237548018Z [2024-04-15T01:00:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:00:01.237623391Z [2024-04-15T01:00:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:00:01.237850464Z [2024-04-15T01:00:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:00:01.237932592Z [2024-04-15T01:00:01.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:00:01.238144182Z [2024-04-15T01:00:01.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:00:01.238269926Z [2024-04-15T01:00:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:00:01.238429986Z [2024-04-15T01:00:01.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:00:01.238520059Z [2024-04-15T01:00:01.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:00:01.742197492Z [2024-04-15T01:00:01.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:01.742500775Z [2024-04-15T01:00:01.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:01.742677618Z [2024-04-15T01:00:01.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:59:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:01.742827972Z [2024-04-15T01:00:01.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:59:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:01.742996641Z [2024-04-15T01:00:01.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:59:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:01.753415631Z [2024-04-15T01:00:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48694db9-262f-4c15-9fa5-7f74fca4fe5e 2024-04-15T01:00:01.753676285Z [2024-04-15T01:00:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to d80b4c5e-7cfd-4c65-8904-a19d3d431594 2024-04-15T01:00:01.753911977Z [2024-04-15T01:00:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to f865b4e1-df41-418c-a0a1-c3c0e2e10d94 2024-04-15T01:00:01.754111180Z [2024-04-15T01:00:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a1bd561-ce49-46da-b04f-65a36178281f 2024-04-15T01:00:01.754305790Z [2024-04-15T01:00:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb454d1f-a5e1-44dd-9018-2e16721a1698 2024-04-15T01:00:02.914802876Z [2024-04-15T01:00:02.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:00:02.915196437Z [2024-04-15T01:00:02.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 00:58:00+00:00, run_id=scheduled__2024-04-15T00:58:00+00:00, run_start_date=2024-04-15 01:00:01.137031+00:00, run_end_date=2024-04-15 01:00:02.914822+00:00, run_duration=1.777791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:58:00+00:00, data_interval_end=2024-04-15 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:00:02.922529279Z [2024-04-15T01:00:02.922+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:02:00+00:00 2024-04-15T01:00:02.940762762Z [2024-04-15T01:00:02.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:00:02.941192428Z [2024-04-15T01:00:02.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 00:59:00+00:00, run_id=scheduled__2024-04-15T00:59:00+00:00, run_start_date=2024-04-15 01:00:01.138350+00:00, run_end_date=2024-04-15 01:00:02.940860+00:00, run_duration=1.80251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:59:00+00:00, data_interval_end=2024-04-15 01:00:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:00:02.953209718Z [2024-04-15T01:00:02.952+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:01:00+00:00 2024-04-15T01:00:02.989311903Z [2024-04-15T01:00:02.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T00:58:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:02.989650868Z [2024-04-15T01:00:02.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:59:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:02.998264952Z [2024-04-15T01:00:02.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:59:00+00:00, map_index=-1, run_start_date=2024-04-15 01:00:02.187009+00:00, run_end_date=2024-04-15 01:00:02.601652+00:00, run_duration=0.414643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:01.234496+00:00, queued_by_job_id=1, pid=9534 2024-04-15T01:00:02.998477760Z [2024-04-15T01:00:02.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T00:58:00+00:00, map_index=-1, run_start_date=2024-04-15 01:00:02.016188+00:00, run_end_date=2024-04-15 01:00:02.390127+00:00, run_duration=0.373939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:01.234496+00:00, queued_by_job_id=1, pid=9533 2024-04-15T01:00:04.096809574Z [2024-04-15T01:00:04.096+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:00:04.096851915Z 2024-04-15T01:00:04.097137985Z [2024-04-15T01:00:04.096+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:00:04.097893181Z [2024-04-15T01:00:04.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:00:04.097907627Z 2024-04-15T01:00:04.100928999Z [2024-04-15T01:00:04.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:00:04.101172746Z [2024-04-15T01:00:04.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:00:04.168986665Z [2024-04-15T01:00:04.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:04.169047184Z [2024-04-15T01:00:04.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:04.177591454Z [2024-04-15T01:00:04.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6453f8d-9545-4b8b-898c-f90a2f5cf3bd 2024-04-15T01:00:04.177803034Z [2024-04-15T01:00:04.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T00:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:00:03.157825+00:00, run_end_date=2024-04-15 01:00:03.507878+00:00, run_duration=0.350053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:01.234496+00:00, queued_by_job_id=1, pid=9558 2024-04-15T01:00:05.039093525Z [2024-04-15T01:00:05.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:00:05.039311964Z [2024-04-15T01:00:05.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:59:00+00:00, run_id=scheduled__2024-04-15T00:59:00+00:00, run_start_date=2024-04-15 01:00:01.139620+00:00, run_end_date=2024-04-15 01:00:05.038829+00:00, run_duration=3.899209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:59:00+00:00, data_interval_end=2024-04-15 01:00:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:00:05.047221904Z [2024-04-15T01:00:05.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:01:00+00:00 2024-04-15T01:00:05.096682553Z [2024-04-15T01:00:05.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:59:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:05.103372454Z [2024-04-15T01:00:05.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:59:00+00:00, map_index=-1, run_start_date=2024-04-15 01:00:03.235910+00:00, run_end_date=2024-04-15 01:00:04.722602+00:00, run_duration=1.486692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:01.234496+00:00, queued_by_job_id=1, pid=9559 2024-04-15T01:00:06.167162950Z [2024-04-15T01:00:06.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:00:06.167403370Z [2024-04-15T01:00:06.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:59:00+00:00, run_id=scheduled__2024-04-15T00:59:00+00:00, run_start_date=2024-04-15 01:00:01.140802+00:00, run_end_date=2024-04-15 01:00:06.167055+00:00, run_duration=5.026253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:59:00+00:00, data_interval_end=2024-04-15 01:00:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:00:06.174989289Z [2024-04-15T01:00:06.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:01:00+00:00 2024-04-15T01:00:06.211923637Z [2024-04-15T01:00:06.211+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:00:06.211965158Z 2024-04-15T01:00:06.211973896Z [2024-04-15T01:00:06.211+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:00:06.212372769Z [2024-04-15T01:00:06.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:00:06.212389977Z 2024-04-15T01:00:06.214166931Z [2024-04-15T01:00:06.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:00:06.214219606Z [2024-04-15T01:00:06.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:00:06.255450944Z [2024-04-15T01:00:06.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:06.255516863Z [2024-04-15T01:00:06.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T00:59:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:06.261144113Z [2024-04-15T01:00:06.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T00:59:00+00:00, map_index=-1, run_start_date=2024-04-15 01:00:03.454500+00:00, run_end_date=2024-04-15 01:00:05.083233+00:00, run_duration=1.628733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:01.234496+00:00, queued_by_job_id=1, pid=9570 2024-04-15T01:00:06.261321336Z [2024-04-15T01:00:06.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 123a04e5-77d1-4138-abd1-aaae03110932 2024-04-15T01:00:06.323334432Z [2024-04-15T01:00:06.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:06.327922618Z [2024-04-15T01:00:06.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T00:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:00:05.698560+00:00, run_end_date=2024-04-15 01:00:06.081750+00:00, run_duration=0.38319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:04.098350+00:00, queued_by_job_id=1, pid=9588 2024-04-15T01:00:08.497342800Z [2024-04-15T01:00:08.496+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:00:08.497400822Z 2024-04-15T01:00:08.497436900Z [2024-04-15T01:00:08.497+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:00:08.498383665Z [2024-04-15T01:00:08.498+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:00:08.498400321Z 2024-04-15T01:00:08.501748794Z [2024-04-15T01:00:08.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:00:08.501957265Z [2024-04-15T01:00:08.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:00:08.572870849Z [2024-04-15T01:00:08.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:00:08.573276442Z [2024-04-15T01:00:08.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:08.580789019Z [2024-04-15T01:00:08.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f0df064-c7f3-49f6-87c4-91bc617c633a 2024-04-15T01:00:08.580996364Z [2024-04-15T01:00:08.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T00:55:00+00:00, map_index=0, run_start_date=2024-04-15 01:00:07.675030+00:00, run_end_date=2024-04-15 01:00:08.042908+00:00, run_duration=0.367878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:06.212580+00:00, queued_by_job_id=1, pid=9596 2024-04-15T01:00:11.302063651Z [2024-04-15T01:00:11.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:00:11.302666266Z [2024-04-15T01:00:11.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 00:55:00+00:00, run_id=scheduled__2024-04-15T00:55:00+00:00, run_start_date=2024-04-15 01:00:01.135606+00:00, run_end_date=2024-04-15 01:00:11.302182+00:00, run_duration=10.166576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 00:55:00+00:00, data_interval_end=2024-04-15 01:00:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:00:11.314563235Z [2024-04-15T01:00:11.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:00:00+00:00, run_after=2024-04-15T01:05:00+00:00 2024-04-15T01:00:11.358970270Z [2024-04-15T01:00:11.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T00:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:00:11.369871822Z [2024-04-15T01:00:11.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T00:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:00:10.004563+00:00, run_end_date=2024-04-15 01:00:10.405112+00:00, run_duration=0.400549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:00:08.499096+00:00, queued_by_job_id=1, pid=9604 2024-04-15T01:01:00.388547057Z [2024-04-15T01:01:00.386+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:01:00.415314246Z [2024-04-15T01:01:00.412+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:01:00+00:00, run_after=2024-04-15T01:02:00+00:00 2024-04-15T01:01:00.432007718Z [2024-04-15T01:01:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:01:00+00:00, run_after=2024-04-15T01:02:00+00:00 2024-04-15T01:01:00.497510357Z [2024-04-15T01:01:00.497+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:01:00.497527679Z 2024-04-15T01:01:00.497531069Z 2024-04-15T01:01:00.497534526Z 2024-04-15T01:01:00.497753123Z [2024-04-15T01:01:00.497+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:01:00.497965223Z [2024-04-15T01:01:00.497+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:01:00.498342624Z [2024-04-15T01:01:00.498+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:01:00.498939281Z [2024-04-15T01:01:00.498+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:01:00.498950034Z 2024-04-15T01:01:00.498953223Z 2024-04-15T01:01:00.498956521Z 2024-04-15T01:01:00.502987925Z [2024-04-15T01:01:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:01:00.503152960Z [2024-04-15T01:01:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:01:00.503420762Z [2024-04-15T01:01:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:01:00.503829217Z [2024-04-15T01:01:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:01:00.503990983Z [2024-04-15T01:01:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:01:00.504057147Z [2024-04-15T01:01:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:01:00.769694225Z [2024-04-15T01:01:00.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:01:00.770126477Z [2024-04-15T01:01:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:01:00.770525507Z [2024-04-15T01:01:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:01:00.784219421Z [2024-04-15T01:01:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4e27002-9308-4087-a3c9-0e513254bceb 2024-04-15T01:01:00.784500243Z [2024-04-15T01:01:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 252a2b50-e9ad-47aa-9884-a249b67a0817 2024-04-15T01:01:00.784751320Z [2024-04-15T01:01:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f0f6f96-a5ee-41ee-bf35-5defd5c683a4 2024-04-15T01:01:02.222559924Z [2024-04-15T01:01:02.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:01:02.222707359Z [2024-04-15T01:01:02.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:00:00+00:00, run_id=scheduled__2024-04-15T01:00:00+00:00, run_start_date=2024-04-15 01:01:00.443533+00:00, run_end_date=2024-04-15 01:01:02.222395+00:00, run_duration=1.778862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:00:00+00:00, data_interval_end=2024-04-15 01:01:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:01:02.234894995Z [2024-04-15T01:01:02.234+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:01:00+00:00, run_after=2024-04-15T01:02:00+00:00 2024-04-15T01:01:02.321804099Z [2024-04-15T01:01:02.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:01:02.331068358Z [2024-04-15T01:01:02.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=-1, run_start_date=2024-04-15 01:01:01.410862+00:00, run_end_date=2024-04-15 01:01:01.703238+00:00, run_duration=0.292376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:01:00.499703+00:00, queued_by_job_id=1, pid=9625 2024-04-15T01:01:03.461532828Z [2024-04-15T01:01:03.461+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:01:04.517057451Z [2024-04-15T01:01:04.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:01:04.517707698Z [2024-04-15T01:01:04.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:00:00+00:00, run_id=scheduled__2024-04-15T01:00:00+00:00, run_start_date=2024-04-15 01:01:00.445618+00:00, run_end_date=2024-04-15 01:01:04.516802+00:00, run_duration=4.071184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:00:00+00:00, data_interval_end=2024-04-15 01:01:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:01:04.532980437Z [2024-04-15T01:01:04.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:01:00+00:00, run_after=2024-04-15T01:02:00+00:00 2024-04-15T01:01:04.559585824Z [2024-04-15T01:01:04.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:01:04.559854965Z [2024-04-15T01:01:04.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:00:00+00:00, run_id=scheduled__2024-04-15T01:00:00+00:00, run_start_date=2024-04-15 01:01:00.444672+00:00, run_end_date=2024-04-15 01:01:04.559392+00:00, run_duration=4.11472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:00:00+00:00, data_interval_end=2024-04-15 01:01:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:01:04.569576291Z [2024-04-15T01:01:04.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:01:00+00:00, run_after=2024-04-15T01:02:00+00:00 2024-04-15T01:01:04.599710353Z [2024-04-15T01:01:04.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:01:04.599967702Z [2024-04-15T01:01:04.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:01:04.606288950Z [2024-04-15T01:01:04.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=-1, run_start_date=2024-04-15 01:01:02.218670+00:00, run_end_date=2024-04-15 01:01:03.431864+00:00, run_duration=1.213194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:01:00.499703+00:00, queued_by_job_id=1, pid=9643 2024-04-15T01:01:04.606805035Z [2024-04-15T01:01:04.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=-1, run_start_date=2024-04-15 01:01:02.350679+00:00, run_end_date=2024-04-15 01:01:04.118064+00:00, run_duration=1.767385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:01:00.499703+00:00, queued_by_job_id=1, pid=9644 2024-04-15T01:02:00.862019281Z [2024-04-15T01:02:00.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:02:00+00:00, run_after=2024-04-15T01:03:00+00:00 2024-04-15T01:02:00.869617819Z [2024-04-15T01:02:00.869+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:02:00.875723793Z [2024-04-15T01:02:00.875+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:02:00.885667736Z [2024-04-15T01:02:00.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:02:00+00:00, run_after=2024-04-15T01:03:00+00:00 2024-04-15T01:02:00.968580180Z [2024-04-15T01:02:00.968+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:02:00.968626634Z 2024-04-15T01:02:00.968633335Z 2024-04-15T01:02:00.968638222Z 2024-04-15T01:02:00.968642952Z 2024-04-15T01:02:00.968659452Z [2024-04-15T01:02:00.968+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:02:00.968713246Z [2024-04-15T01:02:00.968+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:02:00.968842660Z [2024-04-15T01:02:00.968+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:02:00.968922213Z [2024-04-15T01:02:00.968+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:02:00.969607396Z [2024-04-15T01:02:00.969+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:02:00.969618539Z 2024-04-15T01:02:00.969623661Z 2024-04-15T01:02:00.969628902Z 2024-04-15T01:02:00.969633915Z 2024-04-15T01:02:00.974084877Z [2024-04-15T01:02:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:02:00.974226119Z [2024-04-15T01:02:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:02:00.974437559Z [2024-04-15T01:02:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:02:00.974601697Z [2024-04-15T01:02:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:02:00.974784474Z [2024-04-15T01:02:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:02:00.975127034Z [2024-04-15T01:02:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:02:00.975377202Z [2024-04-15T01:02:00.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:02:00.975493814Z [2024-04-15T01:02:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:02:01.375213589Z [2024-04-15T01:02:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:02:01.375280349Z [2024-04-15T01:02:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:01:00+00:00 exited with status queued for try_number 1 2024-04-15T01:02:01.375383106Z [2024-04-15T01:02:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:01:00+00:00 exited with status queued for try_number 1 2024-04-15T01:02:01.375491358Z [2024-04-15T01:02:01.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:01:00+00:00 exited with status queued for try_number 1 2024-04-15T01:02:01.388473906Z [2024-04-15T01:02:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36b28375-a7b0-42b8-9bc1-ca06bb1d0782 2024-04-15T01:02:01.388581201Z [2024-04-15T01:02:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 619737fd-01b6-4790-85c2-37b4f9c11e0e 2024-04-15T01:02:01.388694826Z [2024-04-15T01:02:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a55122b-a1ff-4137-ad5f-63c635a383d4 2024-04-15T01:02:01.388823994Z [2024-04-15T01:02:01.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e594789-99c4-436a-984e-f36f2dd1ecbb 2024-04-15T01:02:03.231134072Z [2024-04-15T01:02:03.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:02:03.231306343Z [2024-04-15T01:02:03.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:01:00+00:00, run_id=scheduled__2024-04-15T01:01:00+00:00, run_start_date=2024-04-15 01:02:00.896860+00:00, run_end_date=2024-04-15 01:02:03.230982+00:00, run_duration=2.334122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:01:00+00:00, data_interval_end=2024-04-15 01:02:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:02:03.241415524Z [2024-04-15T01:02:03.241+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:02:00+00:00, run_after=2024-04-15T01:03:00+00:00 2024-04-15T01:02:03.256016422Z [2024-04-15T01:02:03.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:02:03.256066996Z [2024-04-15T01:02:03.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:00:00+00:00, run_id=scheduled__2024-04-15T01:00:00+00:00, run_start_date=2024-04-15 01:02:00.895745+00:00, run_end_date=2024-04-15 01:02:03.255871+00:00, run_duration=2.360126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:00:00+00:00, data_interval_end=2024-04-15 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:02:03.264142239Z [2024-04-15T01:02:03.263+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:02:00+00:00, run_after=2024-04-15T01:04:00+00:00 2024-04-15T01:02:03.339793480Z [2024-04-15T01:02:03.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:02:03.340007071Z [2024-04-15T01:02:03.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:01:00+00:00 exited with status success for try_number 1 2024-04-15T01:02:03.348346714Z [2024-04-15T01:02:03.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=-1, run_start_date=2024-04-15 01:02:01.991384+00:00, run_end_date=2024-04-15 01:02:02.672395+00:00, run_duration=0.681011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:02:00.970932+00:00, queued_by_job_id=1, pid=9679 2024-04-15T01:02:03.348903755Z [2024-04-15T01:02:03.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:01:00+00:00, map_index=-1, run_start_date=2024-04-15 01:02:01.865708+00:00, run_end_date=2024-04-15 01:02:02.470606+00:00, run_duration=0.604898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:02:00.970932+00:00, queued_by_job_id=1, pid=9678 2024-04-15T01:02:05.514664252Z [2024-04-15T01:02:05.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:02:05.514816890Z [2024-04-15T01:02:05.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:01:00+00:00, run_id=scheduled__2024-04-15T01:01:00+00:00, run_start_date=2024-04-15 01:02:00.897833+00:00, run_end_date=2024-04-15 01:02:05.514430+00:00, run_duration=4.616597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:01:00+00:00, data_interval_end=2024-04-15 01:02:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:02:05.526936333Z [2024-04-15T01:02:05.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:02:00+00:00, run_after=2024-04-15T01:03:00+00:00 2024-04-15T01:02:05.535605076Z [2024-04-15T01:02:05.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:02:05.535750361Z [2024-04-15T01:02:05.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:01:00+00:00, run_id=scheduled__2024-04-15T01:01:00+00:00, run_start_date=2024-04-15 01:02:00.898797+00:00, run_end_date=2024-04-15 01:02:05.535509+00:00, run_duration=4.636712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:01:00+00:00, data_interval_end=2024-04-15 01:02:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:02:05.544858819Z [2024-04-15T01:02:05.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:02:00+00:00, run_after=2024-04-15T01:03:00+00:00 2024-04-15T01:02:05.589123091Z [2024-04-15T01:02:05.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:01:00+00:00 exited with status success for try_number 1 2024-04-15T01:02:05.589617036Z [2024-04-15T01:02:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:01:00+00:00 exited with status success for try_number 1 2024-04-15T01:02:05.610125498Z [2024-04-15T01:02:05.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:01:00+00:00, map_index=-1, run_start_date=2024-04-15 01:02:03.508259+00:00, run_end_date=2024-04-15 01:02:05.208155+00:00, run_duration=1.699896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:02:00.970932+00:00, queued_by_job_id=1, pid=9703 2024-04-15T01:02:05.610753683Z [2024-04-15T01:02:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:01:00+00:00, map_index=-1, run_start_date=2024-04-15 01:02:03.255802+00:00, run_end_date=2024-04-15 01:02:05.290355+00:00, run_duration=2.034553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:02:00.970932+00:00, queued_by_job_id=1, pid=9697 2024-04-15T01:03:00.228956969Z [2024-04-15T01:03:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:03:00+00:00, run_after=2024-04-15T01:04:00+00:00 2024-04-15T01:03:00.243073371Z [2024-04-15T01:03:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:03:00+00:00, run_after=2024-04-15T01:04:00+00:00 2024-04-15T01:03:00.248738348Z [2024-04-15T01:03:00.248+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:03:00.302225063Z [2024-04-15T01:03:00.301+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:03:00.302252123Z 2024-04-15T01:03:00.302255882Z 2024-04-15T01:03:00.302258880Z 2024-04-15T01:03:00.302628613Z [2024-04-15T01:03:00.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:03:00.303160163Z [2024-04-15T01:03:00.302+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:03:00.303597296Z [2024-04-15T01:03:00.303+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:03:00.305366002Z [2024-04-15T01:03:00.304+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:03:00.305371959Z 2024-04-15T01:03:00.305375944Z 2024-04-15T01:03:00.305380160Z 2024-04-15T01:03:00.312366641Z [2024-04-15T01:03:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:03:00.312561600Z [2024-04-15T01:03:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:03:00.313098048Z [2024-04-15T01:03:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:03:00.313464875Z [2024-04-15T01:03:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:03:00.313989926Z [2024-04-15T01:03:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:03:00.314354692Z [2024-04-15T01:03:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:03:00.666030978Z [2024-04-15T01:03:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status queued for try_number 1 2024-04-15T01:03:00.666113584Z [2024-04-15T01:03:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status queued for try_number 1 2024-04-15T01:03:00.666204629Z [2024-04-15T01:03:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status queued for try_number 1 2024-04-15T01:03:00.672491724Z [2024-04-15T01:03:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22aac85d-ab1c-4bad-b7fe-0245a7917b5f 2024-04-15T01:03:00.672674068Z [2024-04-15T01:03:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to c388cc79-d861-46d4-9c19-9660e3efd413 2024-04-15T01:03:00.672820718Z [2024-04-15T01:03:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 518854d7-bc35-4655-865c-80a4e8973c09 2024-04-15T01:03:01.794544481Z [2024-04-15T01:03:01.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:03:01.794733720Z [2024-04-15T01:03:01.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:02:00+00:00, run_id=scheduled__2024-04-15T01:02:00+00:00, run_start_date=2024-04-15 01:03:00.256709+00:00, run_end_date=2024-04-15 01:03:01.794417+00:00, run_duration=1.537708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:02:00+00:00, data_interval_end=2024-04-15 01:03:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:03:01.808007321Z [2024-04-15T01:03:01.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:03:00+00:00, run_after=2024-04-15T01:04:00+00:00 2024-04-15T01:03:01.860782547Z [2024-04-15T01:03:01.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status success for try_number 1 2024-04-15T01:03:01.867924974Z [2024-04-15T01:03:01.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:02:00+00:00, map_index=-1, run_start_date=2024-04-15 01:03:01.119430+00:00, run_end_date=2024-04-15 01:03:01.509715+00:00, run_duration=0.390285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:03:00.307200+00:00, queued_by_job_id=1, pid=9735 2024-04-15T01:03:03.158540989Z [2024-04-15T01:03:03.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:03:03.158637436Z [2024-04-15T01:03:03.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:02:00+00:00, run_id=scheduled__2024-04-15T01:02:00+00:00, run_start_date=2024-04-15 01:03:00.257749+00:00, run_end_date=2024-04-15 01:03:03.156673+00:00, run_duration=2.898924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:02:00+00:00, data_interval_end=2024-04-15 01:03:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:03:03.170191061Z [2024-04-15T01:03:03.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:03:00+00:00, run_after=2024-04-15T01:04:00+00:00 2024-04-15T01:03:04.279518136Z [2024-04-15T01:03:04.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:03:04.279633565Z [2024-04-15T01:03:04.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:02:00+00:00, run_id=scheduled__2024-04-15T01:02:00+00:00, run_start_date=2024-04-15 01:03:00.258573+00:00, run_end_date=2024-04-15 01:03:04.279345+00:00, run_duration=4.020772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:02:00+00:00, data_interval_end=2024-04-15 01:03:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:03:04.288992620Z [2024-04-15T01:03:04.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:03:00+00:00, run_after=2024-04-15T01:04:00+00:00 2024-04-15T01:03:04.351940490Z [2024-04-15T01:03:04.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status success for try_number 1 2024-04-15T01:03:04.351973414Z [2024-04-15T01:03:04.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status success for try_number 1 2024-04-15T01:03:04.358330454Z [2024-04-15T01:03:04.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:02:00+00:00, map_index=-1, run_start_date=2024-04-15 01:03:01.863601+00:00, run_end_date=2024-04-15 01:03:03.127472+00:00, run_duration=1.263871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:03:00.307200+00:00, queued_by_job_id=1, pid=9753 2024-04-15T01:03:04.358625469Z [2024-04-15T01:03:04.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:02:00+00:00, map_index=-1, run_start_date=2024-04-15 01:03:01.904939+00:00, run_end_date=2024-04-15 01:03:03.576476+00:00, run_duration=1.671537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:03:00.307200+00:00, queued_by_job_id=1, pid=9754 2024-04-15T01:04:00.598139673Z [2024-04-15T01:04:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:04:00+00:00, run_after=2024-04-15T01:05:00+00:00 2024-04-15T01:04:00.605597199Z [2024-04-15T01:04:00.605+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:04:00.616086454Z [2024-04-15T01:04:00.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:04:00+00:00, run_after=2024-04-15T01:05:00+00:00 2024-04-15T01:04:00.622390673Z [2024-04-15T01:04:00.621+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:04:00.724522740Z [2024-04-15T01:04:00.724+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:04:00.724557157Z 2024-04-15T01:04:00.724565436Z 2024-04-15T01:04:00.724572299Z 2024-04-15T01:04:00.724578580Z 2024-04-15T01:04:00.724859201Z [2024-04-15T01:04:00.724+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:04:00.725144839Z [2024-04-15T01:04:00.724+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:04:00.725403677Z [2024-04-15T01:04:00.725+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:04:00.725684779Z [2024-04-15T01:04:00.725+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:04:00.726588787Z [2024-04-15T01:04:00.726+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:04:00.726622243Z 2024-04-15T01:04:00.726630496Z 2024-04-15T01:04:00.726637412Z 2024-04-15T01:04:00.726666005Z 2024-04-15T01:04:00.730848323Z [2024-04-15T01:04:00.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:04:00.731112388Z [2024-04-15T01:04:00.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:04:00.731442969Z [2024-04-15T01:04:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:04:00.731669372Z [2024-04-15T01:04:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:04:00.731989553Z [2024-04-15T01:04:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:04:00.732203793Z [2024-04-15T01:04:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:04:00.732507853Z [2024-04-15T01:04:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:04:00.732777903Z [2024-04-15T01:04:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:04:01.089181299Z [2024-04-15T01:04:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status queued for try_number 1 2024-04-15T01:04:01.089429630Z [2024-04-15T01:04:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:03:00+00:00 exited with status queued for try_number 1 2024-04-15T01:04:01.089632912Z [2024-04-15T01:04:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:03:00+00:00 exited with status queued for try_number 1 2024-04-15T01:04:01.089924567Z [2024-04-15T01:04:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:03:00+00:00 exited with status queued for try_number 1 2024-04-15T01:04:01.101252874Z [2024-04-15T01:04:01.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a57938b-2656-4b01-a1c0-51f47f3a4c3b 2024-04-15T01:04:01.101453602Z [2024-04-15T01:04:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fc5fb51-6454-4e24-86c7-9f21bc6150f8 2024-04-15T01:04:01.101609773Z [2024-04-15T01:04:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad2d052e-3877-41b7-8f6d-c3d251c2e5a4 2024-04-15T01:04:01.101763234Z [2024-04-15T01:04:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 773488e1-e079-42e8-83dd-3bcc5f65fcd4 2024-04-15T01:04:02.255956745Z [2024-04-15T01:04:02.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:04:02.256325579Z [2024-04-15T01:04:02.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:02:00+00:00, run_id=scheduled__2024-04-15T01:02:00+00:00, run_start_date=2024-04-15 01:04:00.648169+00:00, run_end_date=2024-04-15 01:04:02.255894+00:00, run_duration=1.607725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:02:00+00:00, data_interval_end=2024-04-15 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:04:02.265051371Z [2024-04-15T01:04:02.264+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:04:00+00:00, run_after=2024-04-15T01:06:00+00:00 2024-04-15T01:04:02.279474241Z [2024-04-15T01:04:02.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:04:02.279656688Z [2024-04-15T01:04:02.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:03:00+00:00, run_id=scheduled__2024-04-15T01:03:00+00:00, run_start_date=2024-04-15 01:04:00.650107+00:00, run_end_date=2024-04-15 01:04:02.279430+00:00, run_duration=1.629323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:03:00+00:00, data_interval_end=2024-04-15 01:04:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:04:02.291692712Z [2024-04-15T01:04:02.291+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:04:00+00:00, run_after=2024-04-15T01:05:00+00:00 2024-04-15T01:04:02.368712069Z [2024-04-15T01:04:02.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:02:00+00:00 exited with status success for try_number 1 2024-04-15T01:04:02.368746357Z [2024-04-15T01:04:02.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:03:00+00:00 exited with status success for try_number 1 2024-04-15T01:04:02.380493318Z [2024-04-15T01:04:02.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:03:00+00:00, map_index=-1, run_start_date=2024-04-15 01:04:01.465204+00:00, run_end_date=2024-04-15 01:04:01.775147+00:00, run_duration=0.309943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:04:00.727763+00:00, queued_by_job_id=1, pid=9787 2024-04-15T01:04:02.380802538Z [2024-04-15T01:04:02.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:02:00+00:00, map_index=-1, run_start_date=2024-04-15 01:04:01.478372+00:00, run_end_date=2024-04-15 01:04:01.849171+00:00, run_duration=0.370799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:04:00.727763+00:00, queued_by_job_id=1, pid=9788 2024-04-15T01:04:04.128031061Z [2024-04-15T01:04:04.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:04:04.135311566Z [2024-04-15T01:04:04.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:03:00+00:00, run_id=scheduled__2024-04-15T01:03:00+00:00, run_start_date=2024-04-15 01:04:00.652834+00:00, run_end_date=2024-04-15 01:04:04.128288+00:00, run_duration=3.475454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:03:00+00:00, data_interval_end=2024-04-15 01:04:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:04:04.148441403Z [2024-04-15T01:04:04.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:04:00+00:00, run_after=2024-04-15T01:05:00+00:00 2024-04-15T01:04:04.219043320Z [2024-04-15T01:04:04.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:03:00+00:00 exited with status success for try_number 1 2024-04-15T01:04:04.233279609Z [2024-04-15T01:04:04.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:03:00+00:00, map_index=-1, run_start_date=2024-04-15 01:04:02.538307+00:00, run_end_date=2024-04-15 01:04:04.007233+00:00, run_duration=1.468926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:04:00.727763+00:00, queued_by_job_id=1, pid=9812 2024-04-15T01:04:05.340078172Z [2024-04-15T01:04:05.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:04:05.340823779Z [2024-04-15T01:04:05.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:03:00+00:00, run_id=scheduled__2024-04-15T01:03:00+00:00, run_start_date=2024-04-15 01:04:00.654011+00:00, run_end_date=2024-04-15 01:04:05.339851+00:00, run_duration=4.68584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:03:00+00:00, data_interval_end=2024-04-15 01:04:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:04:05.350560388Z [2024-04-15T01:04:05.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:04:00+00:00, run_after=2024-04-15T01:05:00+00:00 2024-04-15T01:04:05.396207761Z [2024-04-15T01:04:05.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:03:00+00:00 exited with status success for try_number 1 2024-04-15T01:04:05.403231242Z [2024-04-15T01:04:05.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:03:00+00:00, map_index=-1, run_start_date=2024-04-15 01:04:02.454103+00:00, run_end_date=2024-04-15 01:04:04.247178+00:00, run_duration=1.793075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:04:00.727763+00:00, queued_by_job_id=1, pid=9811 2024-04-15T01:05:00.107521100Z [2024-04-15T01:05:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:05:00+00:00, run_after=2024-04-15T01:06:00+00:00 2024-04-15T01:05:00.116850397Z [2024-04-15T01:05:00.116+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:05:00.131303556Z [2024-04-15T01:05:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:05:00+00:00, run_after=2024-04-15T01:06:00+00:00 2024-04-15T01:05:00.144835966Z [2024-04-15T01:05:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:05:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:05:00.240190358Z [2024-04-15T01:05:00.239+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:05:00.240222555Z 2024-04-15T01:05:00.240248771Z 2024-04-15T01:05:00.240255530Z 2024-04-15T01:05:00.240261048Z 2024-04-15T01:05:00.240277709Z [2024-04-15T01:05:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:05:00.240395417Z [2024-04-15T01:05:00.240+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:05:00.240585782Z [2024-04-15T01:05:00.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:05:00.240809755Z [2024-04-15T01:05:00.240+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:05:00.241506618Z [2024-04-15T01:05:00.241+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:05:00.241514708Z 2024-04-15T01:05:00.241520460Z 2024-04-15T01:05:00.241541765Z 2024-04-15T01:05:00.241547350Z 2024-04-15T01:05:00.246376535Z [2024-04-15T01:05:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:05:00.246415864Z [2024-04-15T01:05:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:05:00.246759212Z [2024-04-15T01:05:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:05:00.246853391Z [2024-04-15T01:05:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:05:00.247173915Z [2024-04-15T01:05:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:05:00.247270669Z [2024-04-15T01:05:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:05:00.247537231Z [2024-04-15T01:05:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:05:00.247643187Z [2024-04-15T01:05:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:05:00.639925978Z [2024-04-15T01:05:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:05:00.640106654Z [2024-04-15T01:05:00.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status queued for try_number 1 2024-04-15T01:05:00.640214792Z [2024-04-15T01:05:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status queued for try_number 1 2024-04-15T01:05:00.640381028Z [2024-04-15T01:05:00.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status queued for try_number 1 2024-04-15T01:05:00.647322638Z [2024-04-15T01:05:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ddd7a01-5563-4fd4-a866-1d49f1fc7c91 2024-04-15T01:05:00.647530764Z [2024-04-15T01:05:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to d409a9e2-0b87-4e73-abcc-aff540354ea0 2024-04-15T01:05:00.647688999Z [2024-04-15T01:05:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bcd1b34-7a87-471e-ba17-e144e26d1586 2024-04-15T01:05:00.647827144Z [2024-04-15T01:05:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03b8ab3c-f429-47a9-8f1a-6094cd181846 2024-04-15T01:05:01.541628536Z [2024-04-15T01:05:01.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:05:01.542061525Z [2024-04-15T01:05:01.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:04:00+00:00, run_id=scheduled__2024-04-15T01:04:00+00:00, run_start_date=2024-04-15 01:05:00.158450+00:00, run_end_date=2024-04-15 01:05:01.541489+00:00, run_duration=1.383039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:04:00+00:00, data_interval_end=2024-04-15 01:05:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:05:01.550859491Z [2024-04-15T01:05:01.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:05:00+00:00, run_after=2024-04-15T01:06:00+00:00 2024-04-15T01:05:01.589114369Z [2024-04-15T01:05:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status success for try_number 1 2024-04-15T01:05:01.594440020Z [2024-04-15T01:05:01.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:04:00+00:00, map_index=-1, run_start_date=2024-04-15 01:05:01.015640+00:00, run_end_date=2024-04-15 01:05:01.354587+00:00, run_duration=0.338947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:05:00.242853+00:00, queued_by_job_id=1, pid=9846 2024-04-15T01:05:02.716859220Z [2024-04-15T01:05:02.716+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:05:02.716891990Z 2024-04-15T01:05:02.717466250Z [2024-04-15T01:05:02.717+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:05:02.719582084Z [2024-04-15T01:05:02.718+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:05:02.719634248Z 2024-04-15T01:05:02.725322625Z [2024-04-15T01:05:02.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:05:02.725788533Z [2024-04-15T01:05:02.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:05:02.792768208Z [2024-04-15T01:05:02.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:05:02.793155328Z [2024-04-15T01:05:02.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:05:02.801840770Z [2024-04-15T01:05:02.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3075af1d-8321-492f-b621-1e558aa483ca 2024-04-15T01:05:02.802242988Z [2024-04-15T01:05:02.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=-1, run_start_date=2024-04-15 01:05:01.936711+00:00, run_end_date=2024-04-15 01:05:02.218018+00:00, run_duration=0.281307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:05:00.242853+00:00, queued_by_job_id=1, pid=9870 2024-04-15T01:05:03.974255356Z [2024-04-15T01:05:03.973+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:05:03.974743977Z [2024-04-15T01:05:03.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:04:00+00:00, run_id=scheduled__2024-04-15T01:04:00+00:00, run_start_date=2024-04-15 01:05:00.159468+00:00, run_end_date=2024-04-15 01:05:03.974108+00:00, run_duration=3.81464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:04:00+00:00, data_interval_end=2024-04-15 01:05:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:05:03.983213701Z [2024-04-15T01:05:03.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:05:00+00:00, run_after=2024-04-15T01:06:00+00:00 2024-04-15T01:05:03.990856038Z [2024-04-15T01:05:03.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:05:03.991214239Z [2024-04-15T01:05:03.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:04:00+00:00, run_id=scheduled__2024-04-15T01:04:00+00:00, run_start_date=2024-04-15 01:05:00.160446+00:00, run_end_date=2024-04-15 01:05:03.990679+00:00, run_duration=3.830233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:04:00+00:00, data_interval_end=2024-04-15 01:05:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:05:04.002022052Z [2024-04-15T01:05:04.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:05:00+00:00, run_after=2024-04-15T01:06:00+00:00 2024-04-15T01:05:04.077024028Z [2024-04-15T01:05:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status success for try_number 1 2024-04-15T01:05:04.078019143Z [2024-04-15T01:05:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status success for try_number 1 2024-04-15T01:05:04.086617822Z [2024-04-15T01:05:04.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:04:00+00:00, map_index=-1, run_start_date=2024-04-15 01:05:01.962389+00:00, run_end_date=2024-04-15 01:05:03.171464+00:00, run_duration=1.209075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:05:00.242853+00:00, queued_by_job_id=1, pid=9871 2024-04-15T01:05:04.087052460Z [2024-04-15T01:05:04.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:04:00+00:00, map_index=-1, run_start_date=2024-04-15 01:05:02.012691+00:00, run_end_date=2024-04-15 01:05:03.503256+00:00, run_duration=1.490565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:05:00.242853+00:00, queued_by_job_id=1, pid=9872 2024-04-15T01:05:05.176708121Z [2024-04-15T01:05:05.175+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:05:05.176761671Z 2024-04-15T01:05:05.176766555Z [2024-04-15T01:05:05.175+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:05:05.176770918Z [2024-04-15T01:05:05.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:05:05.176775126Z 2024-04-15T01:05:05.178432197Z [2024-04-15T01:05:05.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:05:05.178635219Z [2024-04-15T01:05:05.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:05:05.246166313Z [2024-04-15T01:05:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:05:05.246313915Z [2024-04-15T01:05:05.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:05:05.258209005Z [2024-04-15T01:05:05.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e47a048-4967-4c52-ad87-6c878bc54917 2024-04-15T01:05:05.258308244Z [2024-04-15T01:05:05.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=-1, run_start_date=2024-04-15 01:05:04.240575+00:00, run_end_date=2024-04-15 01:05:04.716419+00:00, run_duration=0.475844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:05:02.720451+00:00, queued_by_job_id=1, pid=9895 2024-04-15T01:05:07.948417854Z [2024-04-15T01:05:07.947+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:05:07.948499860Z 2024-04-15T01:05:07.948555875Z [2024-04-15T01:05:07.948+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:05:07.949633478Z [2024-04-15T01:05:07.949+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:05:07.949687997Z 2024-04-15T01:05:07.953706045Z [2024-04-15T01:05:07.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:05:07.953855187Z [2024-04-15T01:05:07.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:05:08.013720019Z [2024-04-15T01:05:08.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status queued for try_number 1 2024-04-15T01:05:08.013956072Z [2024-04-15T01:05:08.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:05:08.021951102Z [2024-04-15T01:05:08.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48df4919-cb42-4446-b567-910786f3029b 2024-04-15T01:05:08.022267831Z [2024-04-15T01:05:08.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=0, run_start_date=2024-04-15 01:05:06.595367+00:00, run_end_date=2024-04-15 01:05:06.968181+00:00, run_duration=0.372814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:05:05.176570+00:00, queued_by_job_id=1, pid=9903 2024-04-15T01:05:10.275480484Z [2024-04-15T01:05:10.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:05:10.276056854Z [2024-04-15T01:05:10.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:00:00+00:00, run_id=scheduled__2024-04-15T01:00:00+00:00, run_start_date=2024-04-15 01:05:00.157326+00:00, run_end_date=2024-04-15 01:05:10.275587+00:00, run_duration=10.118261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:00:00+00:00, data_interval_end=2024-04-15 01:05:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:05:10.284408953Z [2024-04-15T01:05:10.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:05:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:05:10.341570016Z [2024-04-15T01:05:10.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:00:00+00:00 exited with status success for try_number 1 2024-04-15T01:05:10.351277406Z [2024-04-15T01:05:10.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:00:00+00:00, map_index=-1, run_start_date=2024-04-15 01:05:09.289520+00:00, run_end_date=2024-04-15 01:05:09.601789+00:00, run_duration=0.312269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:05:07.950255+00:00, queued_by_job_id=1, pid=9911 2024-04-15T01:06:00.058165200Z [2024-04-15T01:06:00.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:06:00.070046179Z [2024-04-15T01:06:00.069+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:06:00+00:00, run_after=2024-04-15T01:07:00+00:00 2024-04-15T01:06:00.075767075Z [2024-04-15T01:06:00.075+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:06:00.093040385Z [2024-04-15T01:06:00.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:06:00+00:00, run_after=2024-04-15T01:07:00+00:00 2024-04-15T01:06:00.197947403Z [2024-04-15T01:06:00.197+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:06:00.197983828Z 2024-04-15T01:06:00.197994505Z 2024-04-15T01:06:00.198001038Z 2024-04-15T01:06:00.198007283Z 2024-04-15T01:06:00.198430567Z [2024-04-15T01:06:00.198+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:06:00.198919828Z [2024-04-15T01:06:00.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:06:00.199421942Z [2024-04-15T01:06:00.199+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:06:00.199872231Z [2024-04-15T01:06:00.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:06:00.201388232Z [2024-04-15T01:06:00.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:06:00.201407784Z 2024-04-15T01:06:00.201414900Z 2024-04-15T01:06:00.201421151Z 2024-04-15T01:06:00.201427226Z 2024-04-15T01:06:00.208110404Z [2024-04-15T01:06:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:06:00.208534883Z [2024-04-15T01:06:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:06:00.208960171Z [2024-04-15T01:06:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:06:00.209201987Z [2024-04-15T01:06:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:06:00.209726472Z [2024-04-15T01:06:00.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:06:00.209961290Z [2024-04-15T01:06:00.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:06:00.210644953Z [2024-04-15T01:06:00.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:06:00.211044848Z [2024-04-15T01:06:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:06:00.659339036Z [2024-04-15T01:06:00.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status queued for try_number 1 2024-04-15T01:06:00.659440185Z [2024-04-15T01:06:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:06:00.659540623Z [2024-04-15T01:06:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:06:00.659655239Z [2024-04-15T01:06:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:06:00.668116669Z [2024-04-15T01:06:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21e71b8c-d2a2-4d5a-9eb0-0338697020f8 2024-04-15T01:06:00.668222907Z [2024-04-15T01:06:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0838028f-30eb-4e98-bfeb-f37933de5e88 2024-04-15T01:06:00.668348870Z [2024-04-15T01:06:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to db545881-6b80-40c7-ab7c-272e186d586a 2024-04-15T01:06:00.668461140Z [2024-04-15T01:06:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to d89babca-659e-433f-a961-488cba40fae1 2024-04-15T01:06:01.665133590Z [2024-04-15T01:06:01.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:06:01.665521158Z [2024-04-15T01:06:01.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:04:00+00:00, run_id=scheduled__2024-04-15T01:04:00+00:00, run_start_date=2024-04-15 01:06:00.105126+00:00, run_end_date=2024-04-15 01:06:01.665062+00:00, run_duration=1.559936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:04:00+00:00, data_interval_end=2024-04-15 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:06:01.672395430Z [2024-04-15T01:06:01.672+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:06:00+00:00, run_after=2024-04-15T01:08:00+00:00 2024-04-15T01:06:01.683676707Z [2024-04-15T01:06:01.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:06:01.684112062Z [2024-04-15T01:06:01.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:05:00+00:00, run_id=scheduled__2024-04-15T01:05:00+00:00, run_start_date=2024-04-15 01:06:00.106430+00:00, run_end_date=2024-04-15 01:06:01.683609+00:00, run_duration=1.577179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:05:00+00:00, data_interval_end=2024-04-15 01:06:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:06:01.693379417Z [2024-04-15T01:06:01.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:06:00+00:00, run_after=2024-04-15T01:07:00+00:00 2024-04-15T01:06:01.725746810Z [2024-04-15T01:06:01.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:04:00+00:00 exited with status success for try_number 1 2024-04-15T01:06:01.726032372Z [2024-04-15T01:06:01.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:06:01.732913920Z [2024-04-15T01:06:01.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:04:00+00:00, map_index=-1, run_start_date=2024-04-15 01:06:00.927670+00:00, run_end_date=2024-04-15 01:06:01.358954+00:00, run_duration=0.431284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:06:00.203454+00:00, queued_by_job_id=1, pid=9934 2024-04-15T01:06:01.733277690Z [2024-04-15T01:06:01.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:06:01.035981+00:00, run_end_date=2024-04-15 01:06:01.466758+00:00, run_duration=0.430777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:06:00.203454+00:00, queued_by_job_id=1, pid=9935 2024-04-15T01:06:03.588176399Z [2024-04-15T01:06:03.587+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:06:04.655102524Z [2024-04-15T01:06:04.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:06:04.655660710Z [2024-04-15T01:06:04.655+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:05:00+00:00, run_id=scheduled__2024-04-15T01:05:00+00:00, run_start_date=2024-04-15 01:06:00.108529+00:00, run_end_date=2024-04-15 01:06:04.654988+00:00, run_duration=4.546459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:05:00+00:00, data_interval_end=2024-04-15 01:06:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:06:04.666211815Z [2024-04-15T01:06:04.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:06:00+00:00, run_after=2024-04-15T01:07:00+00:00 2024-04-15T01:06:04.674303957Z [2024-04-15T01:06:04.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:06:04.674806169Z [2024-04-15T01:06:04.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:05:00+00:00, run_id=scheduled__2024-04-15T01:05:00+00:00, run_start_date=2024-04-15 01:06:00.107479+00:00, run_end_date=2024-04-15 01:06:04.674234+00:00, run_duration=4.566755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:05:00+00:00, data_interval_end=2024-04-15 01:06:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:06:04.685051891Z [2024-04-15T01:06:04.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:06:00+00:00, run_after=2024-04-15T01:07:00+00:00 2024-04-15T01:06:04.734277795Z [2024-04-15T01:06:04.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:06:04.734379758Z [2024-04-15T01:06:04.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:06:04.745461222Z [2024-04-15T01:06:04.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:06:02.085567+00:00, run_end_date=2024-04-15 01:06:03.696902+00:00, run_duration=1.611335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:06:00.203454+00:00, queued_by_job_id=1, pid=9958 2024-04-15T01:06:04.745652516Z [2024-04-15T01:06:04.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:06:02.091048+00:00, run_end_date=2024-04-15 01:06:04.172188+00:00, run_duration=2.08114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:06:00.203454+00:00, queued_by_job_id=1, pid=9959 2024-04-15T01:07:00.736836724Z [2024-04-15T01:07:00.736+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:07:00+00:00, run_after=2024-04-15T01:08:00+00:00 2024-04-15T01:07:00.752663181Z [2024-04-15T01:07:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:07:00+00:00, run_after=2024-04-15T01:08:00+00:00 2024-04-15T01:07:00.762344906Z [2024-04-15T01:07:00.761+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:07:00.850301425Z [2024-04-15T01:07:00.849+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:07:00.850335149Z 2024-04-15T01:07:00.850339278Z 2024-04-15T01:07:00.850343831Z 2024-04-15T01:07:00.850493035Z [2024-04-15T01:07:00.850+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:07:00.850754968Z [2024-04-15T01:07:00.850+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:07:00.850973068Z [2024-04-15T01:07:00.850+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:07:00.851752041Z [2024-04-15T01:07:00.851+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:07:00.851787451Z 2024-04-15T01:07:00.851797697Z 2024-04-15T01:07:00.851806423Z 2024-04-15T01:07:00.855728082Z [2024-04-15T01:07:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:07:00.855930305Z [2024-04-15T01:07:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:07:00.856436860Z [2024-04-15T01:07:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:07:00.856647645Z [2024-04-15T01:07:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:07:00.856885628Z [2024-04-15T01:07:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:07:00.857012880Z [2024-04-15T01:07:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:07:01.139716490Z [2024-04-15T01:07:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status queued for try_number 1 2024-04-15T01:07:01.139980540Z [2024-04-15T01:07:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status queued for try_number 1 2024-04-15T01:07:01.140316447Z [2024-04-15T01:07:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status queued for try_number 1 2024-04-15T01:07:01.156538689Z [2024-04-15T01:07:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e0405d9-647e-43a5-83f8-e79164ea331b 2024-04-15T01:07:01.156728145Z [2024-04-15T01:07:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd7edf4b-cf02-441f-bebe-735fa197703c 2024-04-15T01:07:01.156888200Z [2024-04-15T01:07:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe9580d7-a965-4d0e-8726-26cfb3286a8a 2024-04-15T01:07:02.356010516Z [2024-04-15T01:07:02.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:07:02.356614189Z [2024-04-15T01:07:02.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:06:00+00:00, run_id=scheduled__2024-04-15T01:06:00+00:00, run_start_date=2024-04-15 01:07:00.774712+00:00, run_end_date=2024-04-15 01:07:02.356095+00:00, run_duration=1.581383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:06:00+00:00, data_interval_end=2024-04-15 01:07:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:07:02.373564191Z [2024-04-15T01:07:02.373+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:07:00+00:00, run_after=2024-04-15T01:08:00+00:00 2024-04-15T01:07:02.438633712Z [2024-04-15T01:07:02.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status success for try_number 1 2024-04-15T01:07:02.444314291Z [2024-04-15T01:07:02.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:06:00+00:00, map_index=-1, run_start_date=2024-04-15 01:07:01.563983+00:00, run_end_date=2024-04-15 01:07:02.007508+00:00, run_duration=0.443525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:07:00.852523+00:00, queued_by_job_id=1, pid=9991 2024-04-15T01:07:04.785952808Z [2024-04-15T01:07:04.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:07:04.786207093Z [2024-04-15T01:07:04.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:06:00+00:00, run_id=scheduled__2024-04-15T01:06:00+00:00, run_start_date=2024-04-15 01:07:00.775968+00:00, run_end_date=2024-04-15 01:07:04.785628+00:00, run_duration=4.00966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:06:00+00:00, data_interval_end=2024-04-15 01:07:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:07:04.798504864Z [2024-04-15T01:07:04.798+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:07:00+00:00, run_after=2024-04-15T01:08:00+00:00 2024-04-15T01:07:04.859629569Z [2024-04-15T01:07:04.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status success for try_number 1 2024-04-15T01:07:04.868485617Z [2024-04-15T01:07:04.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:06:00+00:00, map_index=-1, run_start_date=2024-04-15 01:07:02.407568+00:00, run_end_date=2024-04-15 01:07:03.764572+00:00, run_duration=1.357004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:07:00.852523+00:00, queued_by_job_id=1, pid=10004 2024-04-15T01:07:05.935460284Z [2024-04-15T01:07:05.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:07:05.936220908Z [2024-04-15T01:07:05.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:06:00+00:00, run_id=scheduled__2024-04-15T01:06:00+00:00, run_start_date=2024-04-15 01:07:00.777121+00:00, run_end_date=2024-04-15 01:07:05.935584+00:00, run_duration=5.158463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:06:00+00:00, data_interval_end=2024-04-15 01:07:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:07:05.953728622Z [2024-04-15T01:07:05.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:07:00+00:00, run_after=2024-04-15T01:08:00+00:00 2024-04-15T01:07:06.009500958Z [2024-04-15T01:07:06.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status success for try_number 1 2024-04-15T01:07:06.019491400Z [2024-04-15T01:07:06.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:06:00+00:00, map_index=-1, run_start_date=2024-04-15 01:07:02.870777+00:00, run_end_date=2024-04-15 01:07:04.847868+00:00, run_duration=1.977091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:07:00.852523+00:00, queued_by_job_id=1, pid=10015 2024-04-15T01:08:00.633754963Z [2024-04-15T01:08:00.633+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:08:00.648936084Z [2024-04-15T01:08:00.648+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:08:00+00:00, run_after=2024-04-15T01:09:00+00:00 2024-04-15T01:08:00.654091997Z [2024-04-15T01:08:00.653+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:08:00.663177780Z [2024-04-15T01:08:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:08:00+00:00, run_after=2024-04-15T01:09:00+00:00 2024-04-15T01:08:00.758458830Z [2024-04-15T01:08:00.758+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:08:00.758498713Z 2024-04-15T01:08:00.758509344Z 2024-04-15T01:08:00.758518082Z 2024-04-15T01:08:00.758526787Z 2024-04-15T01:08:00.758568589Z [2024-04-15T01:08:00.758+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:08:00.758697119Z [2024-04-15T01:08:00.758+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:08:00.758991802Z [2024-04-15T01:08:00.758+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:08:00.759146042Z [2024-04-15T01:08:00.758+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:08:00.759814567Z [2024-04-15T01:08:00.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:08:00.759826963Z 2024-04-15T01:08:00.759831191Z 2024-04-15T01:08:00.759834735Z 2024-04-15T01:08:00.759838378Z 2024-04-15T01:08:00.764537567Z [2024-04-15T01:08:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:08:00.765238356Z [2024-04-15T01:08:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:08:00.766064759Z [2024-04-15T01:08:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:08:00.766589766Z [2024-04-15T01:08:00.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:08:00.767592805Z [2024-04-15T01:08:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:08:00.768040490Z [2024-04-15T01:08:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:08:00.768881260Z [2024-04-15T01:08:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:08:00.769677806Z [2024-04-15T01:08:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:08:01.285357777Z [2024-04-15T01:08:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status queued for try_number 1 2024-04-15T01:08:01.285442552Z [2024-04-15T01:08:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:07:00+00:00 exited with status queued for try_number 1 2024-04-15T01:08:01.285543645Z [2024-04-15T01:08:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:07:00+00:00 exited with status queued for try_number 1 2024-04-15T01:08:01.285595461Z [2024-04-15T01:08:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:07:00+00:00 exited with status queued for try_number 1 2024-04-15T01:08:01.299774118Z [2024-04-15T01:08:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to db7db5ff-6555-4922-b335-429c93bc4854 2024-04-15T01:08:01.300318000Z [2024-04-15T01:08:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 342f8450-7d07-4e1c-9459-3c3d8b67867f 2024-04-15T01:08:01.300469478Z [2024-04-15T01:08:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 209a3abf-a3b2-49e6-b079-19d1fc63734c 2024-04-15T01:08:01.300609391Z [2024-04-15T01:08:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbc5aae2-a541-4176-b44e-8d46e9f55e36 2024-04-15T01:08:02.440211077Z [2024-04-15T01:08:02.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:08:02.440684256Z [2024-04-15T01:08:02.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:06:00+00:00, run_id=scheduled__2024-04-15T01:06:00+00:00, run_start_date=2024-04-15 01:08:00.671142+00:00, run_end_date=2024-04-15 01:08:02.440183+00:00, run_duration=1.769041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:06:00+00:00, data_interval_end=2024-04-15 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:08:02.449329721Z [2024-04-15T01:08:02.449+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:08:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:08:02.456473653Z [2024-04-15T01:08:02.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:08:02.456970651Z [2024-04-15T01:08:02.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:07:00+00:00, run_id=scheduled__2024-04-15T01:07:00+00:00, run_start_date=2024-04-15 01:08:00.672045+00:00, run_end_date=2024-04-15 01:08:02.456485+00:00, run_duration=1.78444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:07:00+00:00, data_interval_end=2024-04-15 01:08:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:08:02.468194665Z [2024-04-15T01:08:02.467+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:08:00+00:00, run_after=2024-04-15T01:09:00+00:00 2024-04-15T01:08:02.525739063Z [2024-04-15T01:08:02.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:06:00+00:00 exited with status success for try_number 1 2024-04-15T01:08:02.525858998Z [2024-04-15T01:08:02.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:07:00+00:00 exited with status success for try_number 1 2024-04-15T01:08:02.534455958Z [2024-04-15T01:08:02.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:06:00+00:00, map_index=-1, run_start_date=2024-04-15 01:08:01.472573+00:00, run_end_date=2024-04-15 01:08:01.840601+00:00, run_duration=0.368028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:08:00.760781+00:00, queued_by_job_id=1, pid=10043 2024-04-15T01:08:02.534797940Z [2024-04-15T01:08:02.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:07:00+00:00, map_index=-1, run_start_date=2024-04-15 01:08:01.511095+00:00, run_end_date=2024-04-15 01:08:01.946438+00:00, run_duration=0.435343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:08:00.760781+00:00, queued_by_job_id=1, pid=10044 2024-04-15T01:08:04.717431368Z [2024-04-15T01:08:04.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:08:04.717739744Z [2024-04-15T01:08:04.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:07:00+00:00, run_id=scheduled__2024-04-15T01:07:00+00:00, run_start_date=2024-04-15 01:08:00.673831+00:00, run_end_date=2024-04-15 01:08:04.717295+00:00, run_duration=4.043464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:07:00+00:00, data_interval_end=2024-04-15 01:08:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:08:04.725618213Z [2024-04-15T01:08:04.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:08:00+00:00, run_after=2024-04-15T01:09:00+00:00 2024-04-15T01:08:04.730886302Z [2024-04-15T01:08:04.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:08:04.731389326Z [2024-04-15T01:08:04.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:07:00+00:00, run_id=scheduled__2024-04-15T01:07:00+00:00, run_start_date=2024-04-15 01:08:00.672922+00:00, run_end_date=2024-04-15 01:08:04.730741+00:00, run_duration=4.057819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:07:00+00:00, data_interval_end=2024-04-15 01:08:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:08:04.740468654Z [2024-04-15T01:08:04.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:08:00+00:00, run_after=2024-04-15T01:09:00+00:00 2024-04-15T01:08:04.800891691Z [2024-04-15T01:08:04.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:07:00+00:00 exited with status success for try_number 1 2024-04-15T01:08:04.801576875Z [2024-04-15T01:08:04.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:07:00+00:00 exited with status success for try_number 1 2024-04-15T01:08:04.813932471Z [2024-04-15T01:08:04.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:07:00+00:00, map_index=-1, run_start_date=2024-04-15 01:08:02.345732+00:00, run_end_date=2024-04-15 01:08:03.965825+00:00, run_duration=1.620093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:08:00.760781+00:00, queued_by_job_id=1, pid=10067 2024-04-15T01:08:04.814391823Z [2024-04-15T01:08:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:07:00+00:00, map_index=-1, run_start_date=2024-04-15 01:08:02.408869+00:00, run_end_date=2024-04-15 01:08:04.483222+00:00, run_duration=2.074353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:08:00.760781+00:00, queued_by_job_id=1, pid=10068 2024-04-15T01:09:00.614750711Z [2024-04-15T01:09:00.614+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:09:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:09:00.631770620Z [2024-04-15T01:09:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:09:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:09:00.644270072Z [2024-04-15T01:09:00.643+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:09:00.726431143Z [2024-04-15T01:09:00.726+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:09:00.726487859Z 2024-04-15T01:09:00.726493045Z 2024-04-15T01:09:00.726498153Z 2024-04-15T01:09:00.726742543Z [2024-04-15T01:09:00.726+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:09:00.727061307Z [2024-04-15T01:09:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:09:00.727260989Z [2024-04-15T01:09:00.726+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:09:00.728054118Z [2024-04-15T01:09:00.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:09:00.728068072Z 2024-04-15T01:09:00.728072997Z 2024-04-15T01:09:00.728077441Z 2024-04-15T01:09:00.732278117Z [2024-04-15T01:09:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:09:00.732321708Z [2024-04-15T01:09:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:09:00.732800757Z [2024-04-15T01:09:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:09:00.733056631Z [2024-04-15T01:09:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:09:00.733455277Z [2024-04-15T01:09:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:09:00.733852856Z [2024-04-15T01:09:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:09:00.942861036Z [2024-04-15T01:09:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status queued for try_number 1 2024-04-15T01:09:00.942931486Z [2024-04-15T01:09:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status queued for try_number 1 2024-04-15T01:09:00.943140368Z [2024-04-15T01:09:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status queued for try_number 1 2024-04-15T01:09:00.949494100Z [2024-04-15T01:09:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to d72bfbb5-42be-4b83-bf0d-ea6310523c74 2024-04-15T01:09:00.949726202Z [2024-04-15T01:09:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 021b8623-acc1-4439-9020-e2a4dfef9e7a 2024-04-15T01:09:00.949884777Z [2024-04-15T01:09:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5993f89c-48e3-4cc1-baba-cc55e945b35d 2024-04-15T01:09:02.727686851Z [2024-04-15T01:09:02.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:09:02.728459863Z [2024-04-15T01:09:02.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:08:00+00:00, run_id=scheduled__2024-04-15T01:08:00+00:00, run_start_date=2024-04-15 01:09:00.657919+00:00, run_end_date=2024-04-15 01:09:02.727796+00:00, run_duration=2.069877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:08:00+00:00, data_interval_end=2024-04-15 01:09:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:09:02.746720262Z [2024-04-15T01:09:02.746+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:09:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:09:02.807320933Z [2024-04-15T01:09:02.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status success for try_number 1 2024-04-15T01:09:02.814006032Z [2024-04-15T01:09:02.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:08:00+00:00, map_index=-1, run_start_date=2024-04-15 01:09:01.374205+00:00, run_end_date=2024-04-15 01:09:01.742511+00:00, run_duration=0.368306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:09:00.728954+00:00, queued_by_job_id=1, pid=10100 2024-04-15T01:09:03.481648663Z [2024-04-15T01:09:03.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:09:03.481866022Z [2024-04-15T01:09:03.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:08:00+00:00, run_id=scheduled__2024-04-15T01:08:00+00:00, run_start_date=2024-04-15 01:09:00.659461+00:00, run_end_date=2024-04-15 01:09:03.481471+00:00, run_duration=2.82201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:08:00+00:00, data_interval_end=2024-04-15 01:09:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:09:03.496056737Z [2024-04-15T01:09:03.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:09:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:09:04.593190106Z [2024-04-15T01:09:04.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:09:04.593237555Z [2024-04-15T01:09:04.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:08:00+00:00, run_id=scheduled__2024-04-15T01:08:00+00:00, run_start_date=2024-04-15 01:09:00.660608+00:00, run_end_date=2024-04-15 01:09:04.592851+00:00, run_duration=3.932243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:08:00+00:00, data_interval_end=2024-04-15 01:09:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:09:04.601129356Z [2024-04-15T01:09:04.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:09:00+00:00, run_after=2024-04-15T01:10:00+00:00 2024-04-15T01:09:04.640724187Z [2024-04-15T01:09:04.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status success for try_number 1 2024-04-15T01:09:04.640995613Z [2024-04-15T01:09:04.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status success for try_number 1 2024-04-15T01:09:04.649703502Z [2024-04-15T01:09:04.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:08:00+00:00, map_index=-1, run_start_date=2024-04-15 01:09:02.335723+00:00, run_end_date=2024-04-15 01:09:04.384736+00:00, run_duration=2.049013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:09:00.728954+00:00, queued_by_job_id=1, pid=10119 2024-04-15T01:09:04.650220847Z [2024-04-15T01:09:04.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:08:00+00:00, map_index=-1, run_start_date=2024-04-15 01:09:02.195608+00:00, run_end_date=2024-04-15 01:09:03.368997+00:00, run_duration=1.173389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:09:00.728954+00:00, queued_by_job_id=1, pid=10118 2024-04-15T01:10:00.538053470Z [2024-04-15T01:10:00.537+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:10:00.552109196Z [2024-04-15T01:10:00.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:11:00+00:00 2024-04-15T01:10:00.558651346Z [2024-04-15T01:10:00.558+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:10:00.568511300Z [2024-04-15T01:10:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:11:00+00:00 2024-04-15T01:10:00.578300274Z [2024-04-15T01:10:00.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:10:00.696464869Z [2024-04-15T01:10:00.696+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:10:00.696506375Z 2024-04-15T01:10:00.696516129Z 2024-04-15T01:10:00.696526889Z 2024-04-15T01:10:00.696535550Z 2024-04-15T01:10:00.696544763Z 2024-04-15T01:10:00.696602459Z [2024-04-15T01:10:00.696+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:10:00.696921355Z [2024-04-15T01:10:00.696+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:10:00.698299644Z [2024-04-15T01:10:00.696+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:10:00.698338333Z [2024-04-15T01:10:00.698+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:10:00.698577816Z [2024-04-15T01:10:00.698+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:10:00.699345281Z [2024-04-15T01:10:00.699+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:10:00.699371508Z 2024-04-15T01:10:00.699381956Z 2024-04-15T01:10:00.699391609Z 2024-04-15T01:10:00.699401081Z 2024-04-15T01:10:00.699409532Z 2024-04-15T01:10:00.703506538Z [2024-04-15T01:10:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:10:00.703601142Z [2024-04-15T01:10:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:10:00.703745901Z [2024-04-15T01:10:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:10:00.703886317Z [2024-04-15T01:10:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:10:00.703991639Z [2024-04-15T01:10:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:10:00.704014967Z [2024-04-15T01:10:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:10:00.704090442Z [2024-04-15T01:10:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:10:00.704140850Z [2024-04-15T01:10:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:10:00.704379763Z [2024-04-15T01:10:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:10:00.704447579Z [2024-04-15T01:10:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:10:01.305761762Z [2024-04-15T01:10:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:01.305927985Z [2024-04-15T01:10:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:01.306088815Z [2024-04-15T01:10:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:09:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:01.306234854Z [2024-04-15T01:10:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:09:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:01.306358064Z [2024-04-15T01:10:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:09:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:01.317720584Z [2024-04-15T01:10:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29e1893e-49b2-4d9b-acac-7615ae299735 2024-04-15T01:10:01.317795505Z [2024-04-15T01:10:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8643a07e-eeb8-42e0-83f8-28721d9c28f3 2024-04-15T01:10:01.317893842Z [2024-04-15T01:10:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbc8721b-e7e6-4038-b952-dc250883bf97 2024-04-15T01:10:01.318008481Z [2024-04-15T01:10:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ca7edb1-2cc4-476d-8986-a49eb4b42d9f 2024-04-15T01:10:01.318037257Z [2024-04-15T01:10:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d2011ce-f07b-4151-b64c-9ae835a36971 2024-04-15T01:10:01.938377319Z [2024-04-15T01:10:01.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:10:01.939275886Z [2024-04-15T01:10:01.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:09:00+00:00, run_id=scheduled__2024-04-15T01:09:00+00:00, run_start_date=2024-04-15 01:10:00.590762+00:00, run_end_date=2024-04-15 01:10:01.938567+00:00, run_duration=1.347805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:09:00+00:00, data_interval_end=2024-04-15 01:10:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:10:01.953797498Z [2024-04-15T01:10:01.953+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:11:00+00:00 2024-04-15T01:10:02.100481155Z [2024-04-15T01:10:02.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:09:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:02.109612549Z [2024-04-15T01:10:02.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:09:00+00:00, map_index=-1, run_start_date=2024-04-15 01:10:01.467497+00:00, run_end_date=2024-04-15 01:10:01.914825+00:00, run_duration=0.447328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:00.700269+00:00, queued_by_job_id=1, pid=10153 2024-04-15T01:10:03.183978945Z [2024-04-15T01:10:03.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:10:03.184277627Z [2024-04-15T01:10:03.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:08:00+00:00, run_id=scheduled__2024-04-15T01:08:00+00:00, run_start_date=2024-04-15 01:10:00.589745+00:00, run_end_date=2024-04-15 01:10:03.183880+00:00, run_duration=2.594135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:08:00+00:00, data_interval_end=2024-04-15 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:10:03.196054021Z [2024-04-15T01:10:03.195+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:12:00+00:00 2024-04-15T01:10:03.246650482Z [2024-04-15T01:10:03.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:08:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:03.250746196Z [2024-04-15T01:10:03.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:08:00+00:00, map_index=-1, run_start_date=2024-04-15 01:10:01.825430+00:00, run_end_date=2024-04-15 01:10:02.302986+00:00, run_duration=0.477556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:00.700269+00:00, queued_by_job_id=1, pid=10160 2024-04-15T01:10:04.003913772Z [2024-04-15T01:10:04.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:10:04.004254037Z [2024-04-15T01:10:04.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:09:00+00:00, run_id=scheduled__2024-04-15T01:09:00+00:00, run_start_date=2024-04-15 01:10:00.591828+00:00, run_end_date=2024-04-15 01:10:04.003962+00:00, run_duration=3.412134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:09:00+00:00, data_interval_end=2024-04-15 01:10:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:10:04.016850389Z [2024-04-15T01:10:04.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:11:00+00:00 2024-04-15T01:10:04.069238758Z [2024-04-15T01:10:04.067+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:10:04.069265783Z 2024-04-15T01:10:04.069271967Z [2024-04-15T01:10:04.068+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:10:04.069432955Z [2024-04-15T01:10:04.069+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:10:04.069443175Z 2024-04-15T01:10:04.073548112Z [2024-04-15T01:10:04.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:10:04.073593337Z [2024-04-15T01:10:04.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:10:04.151641811Z [2024-04-15T01:10:04.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:04.151662155Z [2024-04-15T01:10:04.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:04.151699231Z [2024-04-15T01:10:04.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:09:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:04.156954424Z [2024-04-15T01:10:04.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e89368e-4a81-4cdf-883d-5a98fc4253b8 2024-04-15T01:10:04.157106704Z [2024-04-15T01:10:04.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:10:02.934758+00:00, run_end_date=2024-04-15 01:10:03.299329+00:00, run_duration=0.364571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:00.700269+00:00, queued_by_job_id=1, pid=10187 2024-04-15T01:10:04.157271023Z [2024-04-15T01:10:04.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:09:00+00:00, map_index=-1, run_start_date=2024-04-15 01:10:02.645670+00:00, run_end_date=2024-04-15 01:10:03.915404+00:00, run_duration=1.269734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:00.700269+00:00, queued_by_job_id=1, pid=10178 2024-04-15T01:10:05.307955248Z [2024-04-15T01:10:05.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:10:05.308131502Z [2024-04-15T01:10:05.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:09:00+00:00, run_id=scheduled__2024-04-15T01:09:00+00:00, run_start_date=2024-04-15 01:10:00.592931+00:00, run_end_date=2024-04-15 01:10:05.307744+00:00, run_duration=4.714813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:09:00+00:00, data_interval_end=2024-04-15 01:10:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:10:05.318737481Z [2024-04-15T01:10:05.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:11:00+00:00 2024-04-15T01:10:05.382111516Z [2024-04-15T01:10:05.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:09:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:05.388099718Z [2024-04-15T01:10:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:09:00+00:00, map_index=-1, run_start_date=2024-04-15 01:10:02.724919+00:00, run_end_date=2024-04-15 01:10:04.429111+00:00, run_duration=1.704192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:00.700269+00:00, queued_by_job_id=1, pid=10184 2024-04-15T01:10:06.431618924Z [2024-04-15T01:10:06.430+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:10:06.431647421Z 2024-04-15T01:10:06.431652238Z [2024-04-15T01:10:06.431+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:10:06.432331785Z [2024-04-15T01:10:06.432+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:10:06.432347694Z 2024-04-15T01:10:06.435118015Z [2024-04-15T01:10:06.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:10:06.436176279Z [2024-04-15T01:10:06.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:10:06.496879427Z [2024-04-15T01:10:06.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:06.497265925Z [2024-04-15T01:10:06.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:06.504470049Z [2024-04-15T01:10:06.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to c46551a4-e5b0-41a7-ac93-6ad09b94177f 2024-04-15T01:10:06.504868714Z [2024-04-15T01:10:06.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:10:05.549082+00:00, run_end_date=2024-04-15 01:10:05.919095+00:00, run_duration=0.370013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:04.070027+00:00, queued_by_job_id=1, pid=10208 2024-04-15T01:10:08.771591505Z [2024-04-15T01:10:08.771+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:10:08.771624333Z 2024-04-15T01:10:08.771896300Z [2024-04-15T01:10:08.771+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:10:08.772970352Z [2024-04-15T01:10:08.772+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:10:08.772980999Z 2024-04-15T01:10:08.776360627Z [2024-04-15T01:10:08.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:10:08.776735774Z [2024-04-15T01:10:08.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:10:08.844090952Z [2024-04-15T01:10:08.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:10:08.844203572Z [2024-04-15T01:10:08.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:08.852503862Z [2024-04-15T01:10:08.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0b95e30-a19f-4973-b428-bc66cb8b3c9e 2024-04-15T01:10:08.852823430Z [2024-04-15T01:10:08.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=0, run_start_date=2024-04-15 01:10:07.922377+00:00, run_end_date=2024-04-15 01:10:08.275882+00:00, run_duration=0.353505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:06.432779+00:00, queued_by_job_id=1, pid=10216 2024-04-15T01:10:11.070661368Z [2024-04-15T01:10:11.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:10:11.070859848Z [2024-04-15T01:10:11.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:05:00+00:00, run_id=scheduled__2024-04-15T01:05:00+00:00, run_start_date=2024-04-15 01:10:00.588695+00:00, run_end_date=2024-04-15 01:10:11.070455+00:00, run_duration=10.48176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:05:00+00:00, data_interval_end=2024-04-15 01:10:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:10:11.079161814Z [2024-04-15T01:10:11.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:10:11.131780376Z [2024-04-15T01:10:11.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:10:11.140545351Z [2024-04-15T01:10:11.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:10:10.158676+00:00, run_end_date=2024-04-15 01:10:10.525628+00:00, run_duration=0.366952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:10:08.773624+00:00, queued_by_job_id=1, pid=10224 2024-04-15T01:11:00.440394786Z [2024-04-15T01:11:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:11:00+00:00, run_after=2024-04-15T01:12:00+00:00 2024-04-15T01:11:00.446230130Z [2024-04-15T01:11:00.446+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:11:00.456427746Z [2024-04-15T01:11:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:11:00+00:00, run_after=2024-04-15T01:12:00+00:00 2024-04-15T01:11:00.519935107Z [2024-04-15T01:11:00.519+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:11:00.519984044Z 2024-04-15T01:11:00.519993866Z 2024-04-15T01:11:00.520003620Z 2024-04-15T01:11:00.520113224Z [2024-04-15T01:11:00.519+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:11:00.520311575Z [2024-04-15T01:11:00.520+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:11:00.520538445Z [2024-04-15T01:11:00.520+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:11:00.521318501Z [2024-04-15T01:11:00.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:11:00.521336629Z 2024-04-15T01:11:00.521345397Z 2024-04-15T01:11:00.521354318Z 2024-04-15T01:11:00.525849105Z [2024-04-15T01:11:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:11:00.525978117Z [2024-04-15T01:11:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:11:00.526282688Z [2024-04-15T01:11:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:11:00.526437339Z [2024-04-15T01:11:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:11:00.526759568Z [2024-04-15T01:11:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:11:00.526940751Z [2024-04-15T01:11:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:11:00.742782732Z [2024-04-15T01:11:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:11:00.742887283Z [2024-04-15T01:11:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:11:00.743024349Z [2024-04-15T01:11:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:11:00.753293941Z [2024-04-15T01:11:00.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to d98cb2bc-6439-49e2-b0e0-30a3b16f1f29 2024-04-15T01:11:00.753364412Z [2024-04-15T01:11:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54ebb094-b483-46be-886e-89295a9480aa 2024-04-15T01:11:00.753455768Z [2024-04-15T01:11:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7559da03-27ca-4d77-92e9-d4da307bf5dd 2024-04-15T01:11:01.944065418Z [2024-04-15T01:11:01.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:11:01.944236772Z [2024-04-15T01:11:01.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:10:00+00:00, run_id=scheduled__2024-04-15T01:10:00+00:00, run_start_date=2024-04-15 01:11:00.466777+00:00, run_end_date=2024-04-15 01:11:01.943988+00:00, run_duration=1.477211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:10:00+00:00, data_interval_end=2024-04-15 01:11:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:11:01.968384051Z [2024-04-15T01:11:01.968+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:11:00+00:00, run_after=2024-04-15T01:12:00+00:00 2024-04-15T01:11:02.035783735Z [2024-04-15T01:11:02.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:11:02.042104226Z [2024-04-15T01:11:02.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=2024-04-15 01:11:01.256978+00:00, run_end_date=2024-04-15 01:11:01.564380+00:00, run_duration=0.307402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:11:00.522140+00:00, queued_by_job_id=1, pid=10246 2024-04-15T01:11:03.674448865Z [2024-04-15T01:11:03.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:11:03.674693217Z [2024-04-15T01:11:03.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:10:00+00:00, run_id=scheduled__2024-04-15T01:10:00+00:00, run_start_date=2024-04-15 01:11:00.467849+00:00, run_end_date=2024-04-15 01:11:03.674430+00:00, run_duration=3.206581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:10:00+00:00, data_interval_end=2024-04-15 01:11:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:11:03.683871272Z [2024-04-15T01:11:03.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:11:00+00:00, run_after=2024-04-15T01:12:00+00:00 2024-04-15T01:11:03.759079992Z [2024-04-15T01:11:03.758+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:11:04.503647801Z [2024-04-15T01:11:04.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:11:04.504249672Z [2024-04-15T01:11:04.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:10:00+00:00, run_id=scheduled__2024-04-15T01:10:00+00:00, run_start_date=2024-04-15 01:11:00.469191+00:00, run_end_date=2024-04-15 01:11:04.503511+00:00, run_duration=4.03432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:10:00+00:00, data_interval_end=2024-04-15 01:11:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:11:04.525804884Z [2024-04-15T01:11:04.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:11:00+00:00, run_after=2024-04-15T01:12:00+00:00 2024-04-15T01:11:04.577179978Z [2024-04-15T01:11:04.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:11:04.577250643Z [2024-04-15T01:11:04.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:11:04.588306384Z [2024-04-15T01:11:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=2024-04-15 01:11:02.310736+00:00, run_end_date=2024-04-15 01:11:03.612183+00:00, run_duration=1.301447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:11:00.522140+00:00, queued_by_job_id=1, pid=10265 2024-04-15T01:11:04.588508935Z [2024-04-15T01:11:04.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=2024-04-15 01:11:02.256842+00:00, run_end_date=2024-04-15 01:11:03.999275+00:00, run_duration=1.742433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:11:00.522140+00:00, queued_by_job_id=1, pid=10264 2024-04-15T01:12:00.431926414Z [2024-04-15T01:12:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:12:00+00:00, run_after=2024-04-15T01:13:00+00:00 2024-04-15T01:12:00.447450541Z [2024-04-15T01:12:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:12:00.460692275Z [2024-04-15T01:12:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:12:00+00:00, run_after=2024-04-15T01:13:00+00:00 2024-04-15T01:12:00.466540077Z [2024-04-15T01:12:00.466+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:12:00.528100033Z [2024-04-15T01:12:00.527+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:12:00.528129194Z 2024-04-15T01:12:00.528133703Z 2024-04-15T01:12:00.528136507Z 2024-04-15T01:12:00.528139228Z 2024-04-15T01:12:00.528699712Z [2024-04-15T01:12:00.528+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:12:00.529172794Z [2024-04-15T01:12:00.528+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:12:00.529608155Z [2024-04-15T01:12:00.529+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:12:00.530025760Z [2024-04-15T01:12:00.529+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:12:00.531483274Z [2024-04-15T01:12:00.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:12:00.531500240Z 2024-04-15T01:12:00.531503214Z 2024-04-15T01:12:00.531506227Z 2024-04-15T01:12:00.531508841Z 2024-04-15T01:12:00.538276497Z [2024-04-15T01:12:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:12:00.538755965Z [2024-04-15T01:12:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:12:00.539305312Z [2024-04-15T01:12:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:12:00.539734256Z [2024-04-15T01:12:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:12:00.540196792Z [2024-04-15T01:12:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:12:00.540486756Z [2024-04-15T01:12:00.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:12:00.541075892Z [2024-04-15T01:12:00.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:12:00.541371379Z [2024-04-15T01:12:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:12:00.826131791Z [2024-04-15T01:12:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:12:00.826370508Z [2024-04-15T01:12:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:11:00+00:00 exited with status queued for try_number 1 2024-04-15T01:12:00.826562420Z [2024-04-15T01:12:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:11:00+00:00 exited with status queued for try_number 1 2024-04-15T01:12:00.826638033Z [2024-04-15T01:12:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:11:00+00:00 exited with status queued for try_number 1 2024-04-15T01:12:00.841673715Z [2024-04-15T01:12:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to b01a6839-a0a2-46f0-871a-f4e6673e0842 2024-04-15T01:12:00.841864455Z [2024-04-15T01:12:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb051a68-2dd5-4e68-927d-aa5262725877 2024-04-15T01:12:00.842022622Z [2024-04-15T01:12:00.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69086b92-d510-436a-837e-5cd004448317 2024-04-15T01:12:00.842169893Z [2024-04-15T01:12:00.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3c093f9-4ee1-4e84-a2a5-1ace1eb251a5 2024-04-15T01:12:02.088827276Z [2024-04-15T01:12:02.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:12:02.088850328Z [2024-04-15T01:12:02.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:10:00+00:00, run_id=scheduled__2024-04-15T01:10:00+00:00, run_start_date=2024-04-15 01:12:00.474664+00:00, run_end_date=2024-04-15 01:12:02.087914+00:00, run_duration=1.61325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:10:00+00:00, data_interval_end=2024-04-15 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:12:02.094697086Z [2024-04-15T01:12:02.094+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:12:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:12:02.099781045Z [2024-04-15T01:12:02.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:12:02.099992406Z [2024-04-15T01:12:02.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:11:00+00:00, run_id=scheduled__2024-04-15T01:11:00+00:00, run_start_date=2024-04-15 01:12:00.475673+00:00, run_end_date=2024-04-15 01:12:02.099781+00:00, run_duration=1.624108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:11:00+00:00, data_interval_end=2024-04-15 01:12:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:12:02.107944715Z [2024-04-15T01:12:02.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:12:00+00:00, run_after=2024-04-15T01:13:00+00:00 2024-04-15T01:12:02.165975265Z [2024-04-15T01:12:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:12:02.166115957Z [2024-04-15T01:12:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:11:00+00:00 exited with status success for try_number 1 2024-04-15T01:12:02.171808738Z [2024-04-15T01:12:02.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=2024-04-15 01:12:01.284240+00:00, run_end_date=2024-04-15 01:12:01.575433+00:00, run_duration=0.291193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:12:00.533782+00:00, queued_by_job_id=1, pid=10299 2024-04-15T01:12:02.172139041Z [2024-04-15T01:12:02.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:11:00+00:00, map_index=-1, run_start_date=2024-04-15 01:12:01.268901+00:00, run_end_date=2024-04-15 01:12:01.615213+00:00, run_duration=0.346312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:12:00.533782+00:00, queued_by_job_id=1, pid=10298 2024-04-15T01:12:04.509074124Z [2024-04-15T01:12:04.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:12:04.509597955Z [2024-04-15T01:12:04.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:11:00+00:00, run_id=scheduled__2024-04-15T01:11:00+00:00, run_start_date=2024-04-15 01:12:00.477377+00:00, run_end_date=2024-04-15 01:12:04.509003+00:00, run_duration=4.031626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:11:00+00:00, data_interval_end=2024-04-15 01:12:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:12:04.522982872Z [2024-04-15T01:12:04.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:12:00+00:00, run_after=2024-04-15T01:13:00+00:00 2024-04-15T01:12:04.530770279Z [2024-04-15T01:12:04.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:12:04.531165751Z [2024-04-15T01:12:04.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:11:00+00:00, run_id=scheduled__2024-04-15T01:11:00+00:00, run_start_date=2024-04-15 01:12:00.476526+00:00, run_end_date=2024-04-15 01:12:04.530864+00:00, run_duration=4.054338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:11:00+00:00, data_interval_end=2024-04-15 01:12:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:12:04.541352747Z [2024-04-15T01:12:04.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:12:00+00:00, run_after=2024-04-15T01:13:00+00:00 2024-04-15T01:12:04.575344880Z [2024-04-15T01:12:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:11:00+00:00 exited with status success for try_number 1 2024-04-15T01:12:04.575636836Z [2024-04-15T01:12:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:11:00+00:00 exited with status success for try_number 1 2024-04-15T01:12:04.582091671Z [2024-04-15T01:12:04.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:11:00+00:00, map_index=-1, run_start_date=2024-04-15 01:12:02.381483+00:00, run_end_date=2024-04-15 01:12:03.763295+00:00, run_duration=1.381812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:12:00.533782+00:00, queued_by_job_id=1, pid=10323 2024-04-15T01:12:04.582478584Z [2024-04-15T01:12:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:11:00+00:00, map_index=-1, run_start_date=2024-04-15 01:12:02.292151+00:00, run_end_date=2024-04-15 01:12:04.155518+00:00, run_duration=1.863367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:12:00.533782+00:00, queued_by_job_id=1, pid=10322 2024-04-15T01:12:08.281178177Z [2024-04-15T01:12:08.280+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:12:08.281285922Z 2024-04-15T01:12:08.281327694Z [2024-04-15T01:12:08.281+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-15T01:12:08.282352250Z [2024-04-15T01:12:08.281+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:12:08.282390518Z 2024-04-15T01:12:08.286145163Z [2024-04-15T01:12:08.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240415011207_055157', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:12:08.286439207Z [2024-04-15T01:12:08.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240415011207_055157', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-15T01:12:08.342340440Z [2024-04-15T01:12:08.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415011207_055157 exited with status queued for try_number 1 2024-04-15T01:12:08.353664834Z [2024-04-15T01:12:08.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c77ede2-b729-4b3e-8834-a0861adfe01f 2024-04-15T01:12:09.548299643Z [2024-04-15T01:12:09.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:12:09.549130823Z [2024-04-15T01:12:09.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-15 01:12:07.992474+00:00, run_id=vdu_down_20240415011207_055157, run_start_date=2024-04-15 01:12:08.236095+00:00, run_end_date=2024-04-15 01:12:09.548488+00:00, run_duration=1.312393, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 01:12:07.992474+00:00, data_interval_end=2024-04-15 01:12:07.992474+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-15T01:12:09.554681964Z [2024-04-15T01:12:09.554+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-15T01:12:09.584081390Z [2024-04-15T01:12:09.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415011207_055157 exited with status success for try_number 1 2024-04-15T01:12:09.592512403Z [2024-04-15T01:12:09.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240415011207_055157, map_index=-1, run_start_date=2024-04-15 01:12:08.939256+00:00, run_end_date=2024-04-15 01:12:09.321037+00:00, run_duration=0.381781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:12:08.282795+00:00, queued_by_job_id=1, pid=10335 2024-04-15T01:13:00.321553724Z [2024-04-15T01:13:00.320+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:13:00.364106364Z [2024-04-15T01:13:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:00.382836236Z [2024-04-15T01:13:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:00.465222905Z [2024-04-15T01:13:00.464+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:13:00.465256181Z 2024-04-15T01:13:00.465265027Z 2024-04-15T01:13:00.465269171Z 2024-04-15T01:13:00.465386142Z [2024-04-15T01:13:00.465+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:13:00.465694391Z [2024-04-15T01:13:00.465+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:13:00.465957613Z [2024-04-15T01:13:00.465+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:13:00.466865157Z [2024-04-15T01:13:00.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:13:00.466927995Z 2024-04-15T01:13:00.466936198Z 2024-04-15T01:13:00.466941579Z 2024-04-15T01:13:00.474048537Z [2024-04-15T01:13:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:13:00.474593692Z [2024-04-15T01:13:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:13:00.475598835Z [2024-04-15T01:13:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:13:00.476323560Z [2024-04-15T01:13:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:13:00.477474320Z [2024-04-15T01:13:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:13:00.477880976Z [2024-04-15T01:13:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:13:00.716123290Z [2024-04-15T01:13:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:00.716233589Z [2024-04-15T01:13:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:00.716376207Z [2024-04-15T01:13:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:00.723630972Z [2024-04-15T01:13:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3d6a0c3-dd74-48eb-8889-5c3a6ed08b14 2024-04-15T01:13:00.723827880Z [2024-04-15T01:13:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57679562-f3ba-4e0d-9ce8-d5412e3a8e15 2024-04-15T01:13:00.724014913Z [2024-04-15T01:13:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bbf6b91-1dd3-4035-8f83-a092b8fa4d80 2024-04-15T01:13:01.862834438Z [2024-04-15T01:13:01.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:13:01.863407094Z [2024-04-15T01:13:01.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:12:00+00:00, run_id=scheduled__2024-04-15T01:12:00+00:00, run_start_date=2024-04-15 01:13:00.385434+00:00, run_end_date=2024-04-15 01:13:01.862732+00:00, run_duration=1.477298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:12:00+00:00, data_interval_end=2024-04-15 01:13:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:13:01.874459839Z [2024-04-15T01:13:01.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:01.955761492Z [2024-04-15T01:13:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:01.962560929Z [2024-04-15T01:13:01.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:12:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:01.194437+00:00, run_end_date=2024-04-15 01:13:01.554949+00:00, run_duration=0.360512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:00.468001+00:00, queued_by_job_id=1, pid=10362 2024-04-15T01:13:04.156414032Z [2024-04-15T01:13:04.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:13:04.157874167Z [2024-04-15T01:13:04.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:12:00+00:00, run_id=scheduled__2024-04-15T01:12:00+00:00, run_start_date=2024-04-15 01:13:00.386505+00:00, run_end_date=2024-04-15 01:13:04.156328+00:00, run_duration=3.769823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:12:00+00:00, data_interval_end=2024-04-15 01:13:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:13:04.165495706Z [2024-04-15T01:13:04.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:04.208709872Z [2024-04-15T01:13:04.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:04.215755931Z [2024-04-15T01:13:04.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:12:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:02.038149+00:00, run_end_date=2024-04-15 01:13:03.215188+00:00, run_duration=1.177039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:00.468001+00:00, queued_by_job_id=1, pid=10380 2024-04-15T01:13:05.474958727Z [2024-04-15T01:13:05.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:13:05.475541044Z [2024-04-15T01:13:05.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:12:00+00:00, run_id=scheduled__2024-04-15T01:12:00+00:00, run_start_date=2024-04-15 01:13:00.387347+00:00, run_end_date=2024-04-15 01:13:05.474666+00:00, run_duration=5.087319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:12:00+00:00, data_interval_end=2024-04-15 01:13:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:13:05.489423673Z [2024-04-15T01:13:05.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:05.538757852Z [2024-04-15T01:13:05.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:05.545978195Z [2024-04-15T01:13:05.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:12:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:02.103165+00:00, run_end_date=2024-04-15 01:13:04.825313+00:00, run_duration=2.722148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:00.468001+00:00, queued_by_job_id=1, pid=10381 2024-04-15T01:13:42.111478611Z [2024-04-15T01:13:42.111+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:13:42.123442478Z [2024-04-15T01:13:42.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:42.164507221Z [2024-04-15T01:13:42.164+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-15T01:13:42.164597095Z 2024-04-15T01:13:42.164626796Z 2024-04-15T01:13:42.164667063Z [2024-04-15T01:13:42.164+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:13:42.164884070Z [2024-04-15T01:13:42.164+0000] {scheduler_job.py:425} INFO - DAG vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:13:42.165434673Z [2024-04-15T01:13:42.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:13:42.165469578Z 2024-04-15T01:13:42.165496781Z 2024-04-15T01:13:42.167540696Z [2024-04-15T01:13:42.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:13:42.167594739Z [2024-04-15T01:13:42.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:13:42.167699135Z [2024-04-15T01:13:42.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:13:42.167856948Z [2024-04-15T01:13:42.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:13:42.369461460Z [2024-04-15T01:13:42.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:42.369513963Z [2024-04-15T01:13:42.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:42.380406954Z [2024-04-15T01:13:42.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ca287d3-0640-4a87-924d-b0fccc27850a 2024-04-15T01:13:42.380567725Z [2024-04-15T01:13:42.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89ed3d38-ab6b-43fc-9f20-f5447a71e782 2024-04-15T01:13:45.825960092Z [2024-04-15T01:13:45.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:13:45.852625243Z [2024-04-15T01:13:45.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:13:45.852795754Z [2024-04-15T01:13:45.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:12:00+00:00, run_id=scheduled__2024-04-15T01:12:00+00:00, run_start_date=2024-04-15 01:13:42.135505+00:00, run_end_date=2024-04-15 01:13:45.852297+00:00, run_duration=3.716792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:12:00+00:00, data_interval_end=2024-04-15 01:13:00+00:00, dag_hash=1037c68f4a408f6e4179ca37efbdad63 2024-04-15T01:13:45.860873347Z [2024-04-15T01:13:45.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:45.865522718Z [2024-04-15T01:13:45.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:13:45.865746780Z [2024-04-15T01:13:45.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:12:00+00:00, run_id=scheduled__2024-04-15T01:12:00+00:00, run_start_date=2024-04-15 01:13:42.135850+00:00, run_end_date=2024-04-15 01:13:45.865498+00:00, run_duration=3.729648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:12:00+00:00, data_interval_end=2024-04-15 01:13:00+00:00, dag_hash=d627059cd629f38f998725f73bd813a5 2024-04-15T01:13:45.874076412Z [2024-04-15T01:13:45.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:13:00+00:00, run_after=2024-04-15T01:14:00+00:00 2024-04-15T01:13:45.897583455Z [2024-04-15T01:13:45.897+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:13:45.897621826Z 2024-04-15T01:13:45.897764406Z [2024-04-15T01:13:45.897+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:13:45.898521251Z [2024-04-15T01:13:45.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:13:45.898531168Z 2024-04-15T01:13:45.901468130Z [2024-04-15T01:13:45.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:13:45.901765709Z [2024-04-15T01:13:45.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:13:45.966683513Z [2024-04-15T01:13:45.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:45.967659635Z [2024-04-15T01:13:45.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:45.967870528Z [2024-04-15T01:13:45.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:45.978230350Z [2024-04-15T01:13:45.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0849985-50c3-4c49-b401-a1da70763af0 2024-04-15T01:13:45.978546104Z [2024-04-15T01:13:45.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:12:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:43.777758+00:00, run_end_date=2024-04-15 01:13:45.104539+00:00, run_duration=1.326781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:42.165794+00:00, queued_by_job_id=1, pid=10406 2024-04-15T01:13:45.978811085Z [2024-04-15T01:13:45.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:12:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:43.924991+00:00, run_end_date=2024-04-15 01:13:45.575829+00:00, run_duration=1.650838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:42.165794+00:00, queued_by_job_id=1, pid=10407 2024-04-15T01:13:48.281860660Z [2024-04-15T01:13:48.281+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:13:48.281914732Z 2024-04-15T01:13:48.282096456Z [2024-04-15T01:13:48.281+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:13:48.283937252Z [2024-04-15T01:13:48.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:13:48.283954466Z 2024-04-15T01:13:48.286006060Z [2024-04-15T01:13:48.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='split_metrics', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:13:48.286492503Z [2024-04-15T01:13:48.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'split_metrics', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:13:48.335656396Z [2024-04-15T01:13:48.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.split_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:48.336003133Z [2024-04-15T01:13:48.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:48.341139100Z [2024-04-15T01:13:48.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a67a5c9-cc40-4f9e-8359-6196fe3faf55 2024-04-15T01:13:48.341402841Z [2024-04-15T01:13:48.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:47.228268+00:00, run_end_date=2024-04-15 01:13:47.565038+00:00, run_duration=0.33677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:45.899052+00:00, queued_by_job_id=1, pid=10439 2024-04-15T01:13:50.285408379Z [2024-04-15T01:13:50.284+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:13:50.285454157Z 2024-04-15T01:13:50.285938134Z [2024-04-15T01:13:50.285+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:13:50.287569300Z [2024-04-15T01:13:50.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:13:50.287598835Z 2024-04-15T01:13:50.292432675Z [2024-04-15T01:13:50.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:13:50.293242004Z [2024-04-15T01:13:50.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'collect_metrics', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:13:50.420691601Z [2024-04-15T01:13:50.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.collect_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:50.421430783Z [2024-04-15T01:13:50.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.split_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:50.436427563Z [2024-04-15T01:13:50.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dbbe092-8f49-4683-861c-8dcac8d3ce38 2024-04-15T01:13:50.436666144Z [2024-04-15T01:13:50.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=split_metrics, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:49.673933+00:00, run_end_date=2024-04-15 01:13:49.918004+00:00, run_duration=0.244071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:48.283491+00:00, queued_by_job_id=1, pid=10452 2024-04-15T01:13:52.709029215Z [2024-04-15T01:13:52.708+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:13:52.709085436Z 2024-04-15T01:13:52.709291861Z [2024-04-15T01:13:52.708+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:13:52.710554996Z [2024-04-15T01:13:52.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:13:52.710582578Z 2024-04-15T01:13:52.714698216Z [2024-04-15T01:13:52.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:13:52.715243615Z [2024-04-15T01:13:52.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'send_prometheus', 'scheduled__2024-04-15T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:13:52.795395358Z [2024-04-15T01:13:52.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.send_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status queued for try_number 1 2024-04-15T01:13:52.795619595Z [2024-04-15T01:13:52.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.collect_metrics run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:52.804374891Z [2024-04-15T01:13:52.804+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c4b9433-32b5-4290-b962-d22f78ea1e15 2024-04-15T01:13:52.804869171Z [2024-04-15T01:13:52.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=0, run_start_date=2024-04-15 01:13:51.892141+00:00, run_end_date=2024-04-15 01:13:52.212104+00:00, run_duration=0.319963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:50.288618+00:00, queued_by_job_id=1, pid=10460 2024-04-15T01:13:55.004817901Z [2024-04-15T01:13:55.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:13:55.005495738Z [2024-04-15T01:13:55.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:05:00+00:00, run_id=scheduled__2024-04-15T01:05:00+00:00, run_start_date=2024-04-15 01:13:45.833984+00:00, run_end_date=2024-04-15 01:13:55.004690+00:00, run_duration=9.170706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:05:00+00:00, data_interval_end=2024-04-15 01:10:00+00:00, dag_hash=61b9a021be111d9080a116bb4c54a554 2024-04-15T01:13:55.013872366Z [2024-04-15T01:13:55.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:10:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:13:55.062310778Z [2024-04-15T01:13:55.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.send_prometheus run_id=scheduled__2024-04-15T01:05:00+00:00 exited with status success for try_number 1 2024-04-15T01:13:55.067418895Z [2024-04-15T01:13:55.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:05:00+00:00, map_index=-1, run_start_date=2024-04-15 01:13:54.195890+00:00, run_end_date=2024-04-15 01:13:54.581442+00:00, run_duration=0.385552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:13:52.711441+00:00, queued_by_job_id=1, pid=10468 2024-04-15T01:14:00.277646568Z [2024-04-15T01:14:00.276+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:14:00.287367106Z [2024-04-15T01:14:00.287+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:14:00.304601480Z [2024-04-15T01:14:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:00.313319303Z [2024-04-15T01:14:00.313+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:14:00.328441990Z [2024-04-15T01:14:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:00.343358809Z [2024-04-15T01:14:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:00.435741958Z [2024-04-15T01:14:00.435+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-15T01:14:00.435766747Z 2024-04-15T01:14:00.435770460Z 2024-04-15T01:14:00.435773734Z 2024-04-15T01:14:00.435776485Z 2024-04-15T01:14:00.435779536Z 2024-04-15T01:14:00.435782429Z 2024-04-15T01:14:00.435965725Z [2024-04-15T01:14:00.435+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:14:00.436148968Z [2024-04-15T01:14:00.436+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:14:00.436297919Z [2024-04-15T01:14:00.436+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:14:00.436483215Z [2024-04-15T01:14:00.436+0000] {scheduler_job.py:425} INFO - DAG vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:14:00.436649720Z [2024-04-15T01:14:00.436+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:14:00.436794663Z [2024-04-15T01:14:00.436+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:14:00.437326343Z [2024-04-15T01:14:00.437+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:14:00.437336492Z 2024-04-15T01:14:00.437339996Z 2024-04-15T01:14:00.437343057Z 2024-04-15T01:14:00.437345950Z 2024-04-15T01:14:00.437349145Z 2024-04-15T01:14:00.437351970Z 2024-04-15T01:14:00.441027125Z [2024-04-15T01:14:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:14:00.441199741Z [2024-04-15T01:14:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:14:00.441513418Z [2024-04-15T01:14:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:14:00.441774681Z [2024-04-15T01:14:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:14:00.441979624Z [2024-04-15T01:14:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:14:00.442087779Z [2024-04-15T01:14:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:14:00.442306581Z [2024-04-15T01:14:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:14:00.442415713Z [2024-04-15T01:14:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:14:00.442606154Z [2024-04-15T01:14:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:14:00.442735869Z [2024-04-15T01:14:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:14:00.443052484Z [2024-04-15T01:14:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:14:00.443168517Z [2024-04-15T01:14:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:14:01.151450935Z [2024-04-15T01:14:01.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status queued for try_number 1 2024-04-15T01:14:01.151524103Z [2024-04-15T01:14:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status queued for try_number 1 2024-04-15T01:14:01.151582634Z [2024-04-15T01:14:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status queued for try_number 1 2024-04-15T01:14:01.151630139Z [2024-04-15T01:14:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status queued for try_number 1 2024-04-15T01:14:01.151685386Z [2024-04-15T01:14:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status queued for try_number 1 2024-04-15T01:14:01.151753887Z [2024-04-15T01:14:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status queued for try_number 1 2024-04-15T01:14:01.164495194Z [2024-04-15T01:14:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17c934e8-f470-4261-83a5-d1a749807155 2024-04-15T01:14:01.164592868Z [2024-04-15T01:14:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to eef6cf5e-ba60-49c2-a032-d5e567926c8b 2024-04-15T01:14:01.164693381Z [2024-04-15T01:14:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52559a8d-f9be-44ab-acb2-5af0fddc4b12 2024-04-15T01:14:01.164775095Z [2024-04-15T01:14:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2700788f-60ba-4a53-ada4-52f2a9cf0077 2024-04-15T01:14:01.166283741Z [2024-04-15T01:14:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e844874-f7f2-46a8-aab3-99ae63f8e4d7 2024-04-15T01:14:01.166403312Z [2024-04-15T01:14:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee2853cd-717f-4dd1-984a-cf0f6392bd60 2024-04-15T01:14:02.434946788Z [2024-04-15T01:14:02.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:14:02.435113492Z [2024-04-15T01:14:02.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:12:00+00:00, run_id=scheduled__2024-04-15T01:12:00+00:00, run_start_date=2024-04-15 01:14:00.356409+00:00, run_end_date=2024-04-15 01:14:02.434820+00:00, run_duration=2.078411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:12:00+00:00, data_interval_end=2024-04-15 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:14:02.444673862Z [2024-04-15T01:14:02.444+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:14:02.458898021Z [2024-04-15T01:14:02.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:14:02.462991312Z [2024-04-15T01:14:02.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:13:00+00:00, run_id=scheduled__2024-04-15T01:13:00+00:00, run_start_date=2024-04-15 01:14:00.357395+00:00, run_end_date=2024-04-15 01:14:02.458811+00:00, run_duration=2.101416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:13:00+00:00, data_interval_end=2024-04-15 01:14:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:14:02.478679162Z [2024-04-15T01:14:02.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:02.599144506Z [2024-04-15T01:14:02.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:12:00+00:00 exited with status success for try_number 1 2024-04-15T01:14:02.599174950Z [2024-04-15T01:14:02.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status success for try_number 1 2024-04-15T01:14:02.633247261Z [2024-04-15T01:14:02.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:12:00+00:00, map_index=-1, run_start_date=2024-04-15 01:14:01.132408+00:00, run_end_date=2024-04-15 01:14:01.546250+00:00, run_duration=0.413842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:14:00.438358+00:00, queued_by_job_id=1, pid=10475 2024-04-15T01:14:02.633348941Z [2024-04-15T01:14:02.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:13:00+00:00, map_index=-1, run_start_date=2024-04-15 01:14:01.633999+00:00, run_end_date=2024-04-15 01:14:02.040363+00:00, run_duration=0.406364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:14:00.438358+00:00, queued_by_job_id=1, pid=10487 2024-04-15T01:14:04.493333564Z [2024-04-15T01:14:04.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:14:04.493691106Z [2024-04-15T01:14:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:13:00+00:00, run_id=scheduled__2024-04-15T01:13:00+00:00, run_start_date=2024-04-15 01:14:00.359232+00:00, run_end_date=2024-04-15 01:14:04.493232+00:00, run_duration=4.134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:13:00+00:00, data_interval_end=2024-04-15 01:14:00+00:00, dag_hash=1037c68f4a408f6e4179ca37efbdad63 2024-04-15T01:14:04.501637792Z [2024-04-15T01:14:04.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:04.508573209Z [2024-04-15T01:14:04.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:14:04.508989745Z [2024-04-15T01:14:04.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:13:00+00:00, run_id=scheduled__2024-04-15T01:13:00+00:00, run_start_date=2024-04-15 01:14:00.361012+00:00, run_end_date=2024-04-15 01:14:04.508487+00:00, run_duration=4.147475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:13:00+00:00, data_interval_end=2024-04-15 01:14:00+00:00, dag_hash=d627059cd629f38f998725f73bd813a5 2024-04-15T01:14:04.517388660Z [2024-04-15T01:14:04.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:04.575772178Z [2024-04-15T01:14:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status success for try_number 1 2024-04-15T01:14:04.575807747Z [2024-04-15T01:14:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status success for try_number 1 2024-04-15T01:14:04.589090208Z [2024-04-15T01:14:04.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:13:00+00:00, map_index=-1, run_start_date=2024-04-15 01:14:02.309902+00:00, run_end_date=2024-04-15 01:14:04.135745+00:00, run_duration=1.825843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:14:00.438358+00:00, queued_by_job_id=1, pid=10501 2024-04-15T01:14:04.589294118Z [2024-04-15T01:14:04.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:13:00+00:00, map_index=-1, run_start_date=2024-04-15 01:14:02.611536+00:00, run_end_date=2024-04-15 01:14:04.156273+00:00, run_duration=1.544737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:14:00.438358+00:00, queued_by_job_id=1, pid=10512 2024-04-15T01:14:05.652309222Z [2024-04-15T01:14:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:14:05.652450880Z [2024-04-15T01:14:05.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:13:00+00:00, run_id=scheduled__2024-04-15T01:13:00+00:00, run_start_date=2024-04-15 01:14:00.360104+00:00, run_end_date=2024-04-15 01:14:05.652160+00:00, run_duration=5.292056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:13:00+00:00, data_interval_end=2024-04-15 01:14:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:14:05.660945618Z [2024-04-15T01:14:05.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:05.668002303Z [2024-04-15T01:14:05.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:14:05.668054659Z [2024-04-15T01:14:05.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:13:00+00:00, run_id=scheduled__2024-04-15T01:13:00+00:00, run_start_date=2024-04-15 01:14:00.358280+00:00, run_end_date=2024-04-15 01:14:05.667743+00:00, run_duration=5.309463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:13:00+00:00, data_interval_end=2024-04-15 01:14:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:14:05.676796400Z [2024-04-15T01:14:05.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:14:00+00:00, run_after=2024-04-15T01:15:00+00:00 2024-04-15T01:14:05.713126129Z [2024-04-15T01:14:05.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status success for try_number 1 2024-04-15T01:14:05.713181004Z [2024-04-15T01:14:05.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:13:00+00:00 exited with status success for try_number 1 2024-04-15T01:14:05.723833277Z [2024-04-15T01:14:05.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:13:00+00:00, map_index=-1, run_start_date=2024-04-15 01:14:03.330100+00:00, run_end_date=2024-04-15 01:14:04.616433+00:00, run_duration=1.286333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:14:00.438358+00:00, queued_by_job_id=1, pid=10534 2024-04-15T01:14:05.724136489Z [2024-04-15T01:14:05.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:13:00+00:00, map_index=-1, run_start_date=2024-04-15 01:14:02.712707+00:00, run_end_date=2024-04-15 01:14:04.496333+00:00, run_duration=1.783626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:14:00.438358+00:00, queued_by_job_id=1, pid=10518 2024-04-15T01:15:00.366189140Z [2024-04-15T01:15:00.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:15:00.391117311Z [2024-04-15T01:15:00.388+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:00.409301735Z [2024-04-15T01:15:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:00.423284296Z [2024-04-15T01:15:00.417+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:15:00.428915222Z [2024-04-15T01:15:00.428+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:15:00.449368270Z [2024-04-15T01:15:00.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:00.466349436Z [2024-04-15T01:15:00.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:15:00.576506069Z [2024-04-15T01:15:00.576+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-15T01:15:00.576539004Z 2024-04-15T01:15:00.576546210Z 2024-04-15T01:15:00.576552566Z 2024-04-15T01:15:00.576558486Z 2024-04-15T01:15:00.576564507Z 2024-04-15T01:15:00.576578125Z 2024-04-15T01:15:00.576587797Z 2024-04-15T01:15:00.576689570Z [2024-04-15T01:15:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:15:00.576698215Z [2024-04-15T01:15:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:15:00.576827142Z [2024-04-15T01:15:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:15:00.576912860Z [2024-04-15T01:15:00.576+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:15:00.577016784Z [2024-04-15T01:15:00.576+0000] {scheduler_job.py:425} INFO - DAG vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:15:00.577075363Z [2024-04-15T01:15:00.576+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:15:00.577152737Z [2024-04-15T01:15:00.577+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:15:00.578182951Z [2024-04-15T01:15:00.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:15:00.578202340Z 2024-04-15T01:15:00.578228226Z 2024-04-15T01:15:00.578235166Z 2024-04-15T01:15:00.578241388Z 2024-04-15T01:15:00.578247237Z 2024-04-15T01:15:00.578253112Z 2024-04-15T01:15:00.578258908Z 2024-04-15T01:15:00.583625647Z [2024-04-15T01:15:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:15:00.583681310Z [2024-04-15T01:15:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:15:00.583850366Z [2024-04-15T01:15:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:15:00.584008305Z [2024-04-15T01:15:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:15:00.584262177Z [2024-04-15T01:15:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:00.584432192Z [2024-04-15T01:15:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:15:00.584705918Z [2024-04-15T01:15:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:00.584884554Z [2024-04-15T01:15:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:15:00.585120005Z [2024-04-15T01:15:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:00.585370008Z [2024-04-15T01:15:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:15:00.585588783Z [2024-04-15T01:15:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:00.585726391Z [2024-04-15T01:15:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:15:00.585904152Z [2024-04-15T01:15:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:00.585961039Z [2024-04-15T01:15:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:15:01.015585738Z [2024-04-15T01:15:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:01.015723657Z [2024-04-15T01:15:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:01.015852578Z [2024-04-15T01:15:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:01.015987886Z [2024-04-15T01:15:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:01.016110722Z [2024-04-15T01:15:01.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:01.016184033Z [2024-04-15T01:15:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:01.016279820Z [2024-04-15T01:15:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:01.024419853Z [2024-04-15T01:15:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea86983-c7c0-428d-8190-5acd5db0c93d 2024-04-15T01:15:01.024638317Z [2024-04-15T01:15:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb270d7e-20bd-4afd-a2c3-292eff9d56b3 2024-04-15T01:15:01.024793387Z [2024-04-15T01:15:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87de428f-44c5-4275-ba84-31161f5f3989 2024-04-15T01:15:01.024912811Z [2024-04-15T01:15:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7337dd68-774b-42b7-a1ab-e32eb1b382b5 2024-04-15T01:15:01.025023299Z [2024-04-15T01:15:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to a47a0538-f8c6-48c2-b0ec-6493bef92ac0 2024-04-15T01:15:01.025168098Z [2024-04-15T01:15:01.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad9b395f-b55b-49cc-9b21-b3077e54d666 2024-04-15T01:15:01.025307015Z [2024-04-15T01:15:01.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bd810f4-7856-43c2-9a63-301cd1177ff6 2024-04-15T01:15:02.282497523Z [2024-04-15T01:15:02.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:15:02.282793032Z [2024-04-15T01:15:02.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:14:00+00:00, run_id=scheduled__2024-04-15T01:14:00+00:00, run_start_date=2024-04-15 01:15:00.493827+00:00, run_end_date=2024-04-15 01:15:02.282412+00:00, run_duration=1.788585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:14:00+00:00, data_interval_end=2024-04-15 01:15:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:15:02.293040495Z [2024-04-15T01:15:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:02.419679041Z [2024-04-15T01:15:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status success for try_number 1 2024-04-15T01:15:02.436248584Z [2024-04-15T01:15:02.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=2024-04-15 01:15:01.476977+00:00, run_end_date=2024-04-15 01:15:02.058211+00:00, run_duration=0.581234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:00.579311+00:00, queued_by_job_id=1, pid=10565 2024-04-15T01:15:03.618638790Z [2024-04-15T01:15:03.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status failed for try_number 1 2024-04-15T01:15:03.618824415Z [2024-04-15T01:15:03.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status failed for try_number 1 2024-04-15T01:15:03.619083860Z [2024-04-15T01:15:03.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status failed for try_number 1 2024-04-15T01:15:03.627340546Z [2024-04-15T01:15:03.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:00.579311+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:15:03.627831282Z [2024-04-15T01:15:03.627+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:03.629880710Z [2024-04-15T01:15:03.629+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:03.643306895Z [2024-04-15T01:15:03.643+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T011400, start_date=, end_date=20240415T011503 2024-04-15T01:15:03.657020557Z [2024-04-15T01:15:03.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:00.579311+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:15:03.658943753Z [2024-04-15T01:15:03.658+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:03.665347744Z [2024-04-15T01:15:03.664+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:03.682829390Z [2024-04-15T01:15:03.681+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=extract_metrics_from_vnfrs, execution_date=20240415T011000, start_date=, end_date=20240415T011503 2024-04-15T01:15:03.691676563Z [2024-04-15T01:15:03.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:00.579311+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:15:03.692052381Z [2024-04-15T01:15:03.691+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:03.695585583Z [2024-04-15T01:15:03.695+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:03.706197716Z [2024-04-15T01:15:03.705+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T011400, start_date=, end_date=20240415T011503 2024-04-15T01:15:04.792739769Z [2024-04-15T01:15:04.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:15:04.793342748Z [2024-04-15T01:15:04.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:14:00+00:00, run_id=scheduled__2024-04-15T01:14:00+00:00, run_start_date=2024-04-15 01:15:00.498509+00:00, run_end_date=2024-04-15 01:15:04.792901+00:00, run_duration=4.294392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:14:00+00:00, data_interval_end=2024-04-15 01:15:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:15:04.805204840Z [2024-04-15T01:15:04.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:04.874285451Z [2024-04-15T01:15:04.873+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:15:04.874313089Z 2024-04-15T01:15:04.874741291Z [2024-04-15T01:15:04.874+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:15:04.875775799Z [2024-04-15T01:15:04.875+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:15:04.875797218Z 2024-04-15T01:15:04.879235070Z [2024-04-15T01:15:04.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:15:04.879790443Z [2024-04-15T01:15:04.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:15:04.947656662Z [2024-04-15T01:15:04.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:04.947818662Z [2024-04-15T01:15:04.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:15:04.948016690Z [2024-04-15T01:15:04.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status success for try_number 1 2024-04-15T01:15:04.960541416Z [2024-04-15T01:15:04.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=2024-04-15 01:15:02.962042+00:00, run_end_date=2024-04-15 01:15:04.153969+00:00, run_duration=1.191927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:00.579311+00:00, queued_by_job_id=1, pid=10598 2024-04-15T01:15:04.960803710Z [2024-04-15T01:15:04.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d61888c-cb1b-42d6-8ad1-ea567936fde1 2024-04-15T01:15:04.961060667Z [2024-04-15T01:15:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=2024-04-15 01:15:03.407622+00:00, run_end_date=2024-04-15 01:15:03.709435+00:00, run_duration=0.301813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:00.579311+00:00, queued_by_job_id=1, pid=10629 2024-04-15T01:15:06.185991268Z [2024-04-15T01:15:06.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:15:06.186267207Z [2024-04-15T01:15:06.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:14:00+00:00, run_id=scheduled__2024-04-15T01:14:00+00:00, run_start_date=2024-04-15 01:15:00.497054+00:00, run_end_date=2024-04-15 01:15:06.185957+00:00, run_duration=5.688903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:14:00+00:00, data_interval_end=2024-04-15 01:15:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:15:06.194360665Z [2024-04-15T01:15:06.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:06.297896243Z [2024-04-15T01:15:06.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status success for try_number 1 2024-04-15T01:15:06.309183543Z [2024-04-15T01:15:06.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=2024-04-15 01:15:03.309604+00:00, run_end_date=2024-04-15 01:15:05.020914+00:00, run_duration=1.71131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:00.579311+00:00, queued_by_job_id=1, pid=10628 2024-04-15T01:15:07.596279206Z [2024-04-15T01:15:07.595+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:15:07.596327605Z 2024-04-15T01:15:07.597119136Z [2024-04-15T01:15:07.596+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:15:07.598386988Z [2024-04-15T01:15:07.598+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:15:07.598397979Z 2024-04-15T01:15:07.602328099Z [2024-04-15T01:15:07.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:15:07.602710774Z [2024-04-15T01:15:07.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:15:07.658404112Z [2024-04-15T01:15:07.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:07.658632301Z [2024-04-15T01:15:07.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:15:07.666856638Z [2024-04-15T01:15:07.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b83364b-074e-4711-8fd5-546377bb0177 2024-04-15T01:15:07.667030350Z [2024-04-15T01:15:07.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=2024-04-15 01:15:06.390546+00:00, run_end_date=2024-04-15 01:15:06.721314+00:00, run_duration=0.330768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:04.876561+00:00, queued_by_job_id=1, pid=10647 2024-04-15T01:15:10.072757013Z [2024-04-15T01:15:10.072+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:15:10.072806380Z 2024-04-15T01:15:10.072976539Z [2024-04-15T01:15:10.072+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:15:10.074047793Z [2024-04-15T01:15:10.073+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:15:10.074063932Z 2024-04-15T01:15:10.077591352Z [2024-04-15T01:15:10.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:10.077925723Z [2024-04-15T01:15:10.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:15:10.147857913Z [2024-04-15T01:15:10.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 1 2024-04-15T01:15:10.150404093Z [2024-04-15T01:15:10.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:15:10.156251913Z [2024-04-15T01:15:10.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to d37a2d58-e781-49cf-98e4-f804c5ffa286 2024-04-15T01:15:10.156431714Z [2024-04-15T01:15:10.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=0, run_start_date=2024-04-15 01:15:09.171858+00:00, run_end_date=2024-04-15 01:15:09.542370+00:00, run_duration=0.370512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:07.599188+00:00, queued_by_job_id=1, pid=10655 2024-04-15T01:15:12.447850945Z [2024-04-15T01:15:12.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:15:12.448246742Z [2024-04-15T01:15:12.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:10:00+00:00, run_id=scheduled__2024-04-15T01:10:00+00:00, run_start_date=2024-04-15 01:15:00.487898+00:00, run_end_date=2024-04-15 01:15:12.447702+00:00, run_duration=11.959804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:10:00+00:00, data_interval_end=2024-04-15 01:15:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:15:12.463883642Z [2024-04-15T01:15:12.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:15:12.557105069Z [2024-04-15T01:15:12.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status success for try_number 1 2024-04-15T01:15:12.564797705Z [2024-04-15T01:15:12.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=2024-04-15 01:15:11.513225+00:00, run_end_date=2024-04-15 01:15:11.857273+00:00, run_duration=0.344048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:10.074660+00:00, queued_by_job_id=1, pid=10663 2024-04-15T01:15:13.944424192Z [2024-04-15T01:15:13.943+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:15:13.944495811Z 2024-04-15T01:15:13.944506486Z 2024-04-15T01:15:13.944515307Z 2024-04-15T01:15:13.944841306Z [2024-04-15T01:15:13.944+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:15:13.945172286Z [2024-04-15T01:15:13.944+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:15:13.945547795Z [2024-04-15T01:15:13.945+0000] {scheduler_job.py:425} INFO - DAG vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:15:13.946906195Z [2024-04-15T01:15:13.946+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:15:13.946933098Z 2024-04-15T01:15:13.946942494Z 2024-04-15T01:15:13.946951046Z 2024-04-15T01:15:13.953038638Z [2024-04-15T01:15:13.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:10:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:15:13.953338728Z [2024-04-15T01:15:13.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:15:13.953791242Z [2024-04-15T01:15:13.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:13.954070465Z [2024-04-15T01:15:13.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:15:13.954483231Z [2024-04-15T01:15:13.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:15:13.954708119Z [2024-04-15T01:15:13.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:15:14.115200000Z [2024-04-15T01:15:14.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status queued for try_number 2 2024-04-15T01:15:14.115449663Z [2024-04-15T01:15:14.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 2 2024-04-15T01:15:14.115616054Z [2024-04-15T01:15:14.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 2 2024-04-15T01:15:14.124405227Z [2024-04-15T01:15:14.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2b35848-c7de-4f73-b470-9feebba1bc77 2024-04-15T01:15:14.124650104Z [2024-04-15T01:15:14.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to e22e2462-293e-4917-8c20-630745dd3cdf 2024-04-15T01:15:14.124853806Z [2024-04-15T01:15:14.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe2c3ac1-c004-4692-aabc-6ddf7a1b0278 2024-04-15T01:15:16.427759086Z [2024-04-15T01:15:16.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:10:00+00:00 exited with status failed for try_number 2 2024-04-15T01:15:16.428046162Z [2024-04-15T01:15:16.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status failed for try_number 2 2024-04-15T01:15:16.428226559Z [2024-04-15T01:15:16.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status failed for try_number 2 2024-04-15T01:15:16.437782922Z [2024-04-15T01:15:16.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 01:15:03.634103+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:13.948534+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:15:16.438308456Z [2024-04-15T01:15:16.438+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:16.440662420Z [2024-04-15T01:15:16.440+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:16.452324929Z [2024-04-15T01:15:16.452+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240415T011400, start_date=, end_date=20240415T011516 2024-04-15T01:15:16.458819189Z [2024-04-15T01:15:16.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:10:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 01:15:03.669681+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:13.948534+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:15:16.459206465Z [2024-04-15T01:15:16.459+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:16.462169893Z [2024-04-15T01:15:16.461+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:16.471439014Z [2024-04-15T01:15:16.471+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=extract_metrics_from_vnfrs, execution_date=20240415T011000, start_date=, end_date=20240415T011516 2024-04-15T01:15:16.477672082Z [2024-04-15T01:15:16.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-15 01:15:03.697674+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:15:13.948534+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:15:16.478063093Z [2024-04-15T01:15:16.477+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:16.480416177Z [2024-04-15T01:15:16.480+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:15:16.490241330Z [2024-04-15T01:15:16.490+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240415T011400, start_date=, end_date=20240415T011516 2024-04-15T01:15:16.695113565Z [2024-04-15T01:15:16.694+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:15:16.695490186Z [2024-04-15T01:15:16.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:14:00+00:00, run_id=scheduled__2024-04-15T01:14:00+00:00, run_start_date=2024-04-15 01:15:00.492179+00:00, run_end_date=2024-04-15 01:15:16.695199+00:00, run_duration=16.20302, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:14:00+00:00, data_interval_end=2024-04-15 01:15:00+00:00, dag_hash=1037c68f4a408f6e4179ca37efbdad63 2024-04-15T01:15:16.704381398Z [2024-04-15T01:15:16.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:16.710238167Z [2024-04-15T01:15:16.710+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:15:16.710576969Z [2024-04-15T01:15:16.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:14:00+00:00, run_id=scheduled__2024-04-15T01:14:00+00:00, run_start_date=2024-04-15 01:15:00.495446+00:00, run_end_date=2024-04-15 01:15:16.710330+00:00, run_duration=16.214884, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:14:00+00:00, data_interval_end=2024-04-15 01:15:00+00:00, dag_hash=d627059cd629f38f998725f73bd813a5 2024-04-15T01:15:16.718501995Z [2024-04-15T01:15:16.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:16:00+00:00 2024-04-15T01:15:19.876455715Z [2024-04-15T01:15:19.875+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-15T01:15:19.876883853Z [2024-04-15T01:15:19.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, execution_date=2024-04-15 01:10:00+00:00, run_id=scheduled__2024-04-15T01:10:00+00:00, run_start_date=2024-04-15 01:15:00.490536+00:00, run_end_date=2024-04-15 01:15:19.876442+00:00, run_duration=19.385906, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:10:00+00:00, data_interval_end=2024-04-15 01:15:00+00:00, dag_hash=61b9a021be111d9080a116bb4c54a554 2024-04-15T01:15:19.884272731Z [2024-04-15T01:15:19.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:15:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:16:00.590741946Z [2024-04-15T01:16:00.589+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:16:00+00:00, run_after=2024-04-15T01:17:00+00:00 2024-04-15T01:16:00.620892087Z [2024-04-15T01:16:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f to 2024-04-15T01:16:00+00:00, run_after=2024-04-15T01:17:00+00:00 2024-04-15T01:16:00.631304867Z [2024-04-15T01:16:00.630+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:16:00.637653327Z [2024-04-15T01:16:00.637+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:16:00.647922293Z [2024-04-15T01:16:00.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:16:00+00:00, run_after=2024-04-15T01:17:00+00:00 2024-04-15T01:16:00.654600638Z [2024-04-15T01:16:00.654+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:16:00.773786550Z [2024-04-15T01:16:00.773+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-15T01:16:00.773815856Z 2024-04-15T01:16:00.773824982Z 2024-04-15T01:16:00.773830914Z 2024-04-15T01:16:00.773836548Z 2024-04-15T01:16:00.773842049Z 2024-04-15T01:16:00.773847604Z 2024-04-15T01:16:00.774060587Z [2024-04-15T01:16:00.773+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:16:00.774294158Z [2024-04-15T01:16:00.774+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:16:00.774525603Z [2024-04-15T01:16:00.774+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:16:00.774752876Z [2024-04-15T01:16:00.774+0000] {scheduler_job.py:425} INFO - DAG vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f has 0/16 running and queued tasks 2024-04-15T01:16:00.775007814Z [2024-04-15T01:16:00.774+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:16:00.775253642Z [2024-04-15T01:16:00.774+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:16:00.776210288Z [2024-04-15T01:16:00.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:16:00.776218897Z 2024-04-15T01:16:00.776224641Z 2024-04-15T01:16:00.776230188Z 2024-04-15T01:16:00.776235882Z 2024-04-15T01:16:00.776241452Z 2024-04-15T01:16:00.776263984Z 2024-04-15T01:16:00.782616271Z [2024-04-15T01:16:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:16:00.782648854Z [2024-04-15T01:16:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:16:00.782952086Z [2024-04-15T01:16:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:16:00.783180107Z [2024-04-15T01:16:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:16:00.783499971Z [2024-04-15T01:16:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:16:00.783684508Z [2024-04-15T01:16:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:16:00.784010750Z [2024-04-15T01:16:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:16:00.784201958Z [2024-04-15T01:16:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:16:00.784540723Z [2024-04-15T01:16:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:16:00.784746421Z [2024-04-15T01:16:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:16:00.785078207Z [2024-04-15T01:16:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:16:00.785257290Z [2024-04-15T01:16:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:16:01.462319480Z [2024-04-15T01:16:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status queued for try_number 1 2024-04-15T01:16:01.462380701Z [2024-04-15T01:16:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:16:01.462497383Z [2024-04-15T01:16:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:16:01.462560594Z [2024-04-15T01:16:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:16:01.462664869Z [2024-04-15T01:16:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:16:01.462756507Z [2024-04-15T01:16:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:16:01.475960248Z [2024-04-15T01:16:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52769746-bbbb-4336-a1a2-bbb749f16aea 2024-04-15T01:16:01.476174584Z [2024-04-15T01:16:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2dceb23-b39b-4507-ad6f-917d67cbfb8b 2024-04-15T01:16:01.476399339Z [2024-04-15T01:16:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dd931db-1812-4030-bb3b-0b8ccccda395 2024-04-15T01:16:01.476553199Z [2024-04-15T01:16:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to e41baea6-380a-4e3b-9d07-a6f2937fd67b 2024-04-15T01:16:01.476747919Z [2024-04-15T01:16:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4de7454-3eee-4ded-bd17-505bb1fa214a 2024-04-15T01:16:01.476970464Z [2024-04-15T01:16:01.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to f69acee1-5178-4484-8e15-aaa759a19f2b 2024-04-15T01:16:02.797342810Z [2024-04-15T01:16:02.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:16:02.797609878Z [2024-04-15T01:16:02.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:14:00+00:00, run_id=scheduled__2024-04-15T01:14:00+00:00, run_start_date=2024-04-15 01:16:00.666266+00:00, run_end_date=2024-04-15 01:16:02.797268+00:00, run_duration=2.131002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:14:00+00:00, data_interval_end=2024-04-15 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:16:02.804569214Z [2024-04-15T01:16:02.804+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:16:00+00:00, run_after=2024-04-15T01:18:00+00:00 2024-04-15T01:16:02.812490186Z [2024-04-15T01:16:02.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:16:02.812706991Z [2024-04-15T01:16:02.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:15:00+00:00, run_id=scheduled__2024-04-15T01:15:00+00:00, run_start_date=2024-04-15 01:16:00.667400+00:00, run_end_date=2024-04-15 01:16:02.812409+00:00, run_duration=2.145009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:15:00+00:00, data_interval_end=2024-04-15 01:16:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:16:02.821507178Z [2024-04-15T01:16:02.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:16:00+00:00, run_after=2024-04-15T01:17:00+00:00 2024-04-15T01:16:02.931090454Z [2024-04-15T01:16:02.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:14:00+00:00 exited with status success for try_number 1 2024-04-15T01:16:02.931151499Z [2024-04-15T01:16:02.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status success for try_number 1 2024-04-15T01:16:02.939444184Z [2024-04-15T01:16:02.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:14:00+00:00, map_index=-1, run_start_date=2024-04-15 01:16:01.758439+00:00, run_end_date=2024-04-15 01:16:02.237088+00:00, run_duration=0.478649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:16:00.778113+00:00, queued_by_job_id=1, pid=10725 2024-04-15T01:16:02.940886060Z [2024-04-15T01:16:02.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=2024-04-15 01:16:01.952671+00:00, run_end_date=2024-04-15 01:16:02.431301+00:00, run_duration=0.47863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:16:00.778113+00:00, queued_by_job_id=1, pid=10726 2024-04-15T01:16:03.587521316Z [2024-04-15T01:16:03.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status failed for try_number 1 2024-04-15T01:16:03.587860804Z [2024-04-15T01:16:03.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status failed for try_number 1 2024-04-15T01:16:03.598328841Z [2024-04-15T01:16:03.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:16:00.778113+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:16:03.598775249Z [2024-04-15T01:16:03.598+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:16:03.600760042Z [2024-04-15T01:16:03.600+0000] {dagbag.py:207} WARNING - Serialized DAG vim_status_4e190dbe-d27a-4226-9c2b-a7c75c778f7f no longer exists 2024-04-15T01:16:03.605329400Z [2024-04-15T01:16:03.602+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-15T01:16:03.605365195Z Traceback (most recent call last): 2024-04-15T01:16:03.605376031Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-15T01:16:03.605388887Z task = dag.get_task(ti.task_id) 2024-04-15T01:16:03.605398978Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-15T01:16:03.618793399Z [2024-04-15T01:16:03.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:16:00.778113+00:00, queued_by_job_id=1, pid=None 2024-04-15T01:16:03.619260628Z [2024-04-15T01:16:03.618+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-15T01:16:03.621330649Z [2024-04-15T01:16:03.620+0000] {dagbag.py:207} WARNING - Serialized DAG vm_status_vim_4e190dbe-d27a-4226-9c2b-a7c75c778f7f no longer exists 2024-04-15T01:16:03.628941272Z [2024-04-15T01:16:03.622+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-15T01:16:03.628979047Z Traceback (most recent call last): 2024-04-15T01:16:03.628993625Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-15T01:16:03.629006006Z task = dag.get_task(ti.task_id) 2024-04-15T01:16:03.629019147Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-15T01:16:03.876300640Z [2024-04-15T01:16:03.875+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:16:05.104958708Z [2024-04-15T01:16:05.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:16:05.105054994Z [2024-04-15T01:16:05.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:15:00+00:00, run_id=scheduled__2024-04-15T01:15:00+00:00, run_start_date=2024-04-15 01:16:00.668515+00:00, run_end_date=2024-04-15 01:16:05.104682+00:00, run_duration=4.436167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:15:00+00:00, data_interval_end=2024-04-15 01:16:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:16:05.118396558Z [2024-04-15T01:16:05.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:16:00+00:00, run_after=2024-04-15T01:17:00+00:00 2024-04-15T01:16:05.126320777Z [2024-04-15T01:16:05.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:16:05.126384706Z [2024-04-15T01:16:05.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:15:00+00:00, run_id=scheduled__2024-04-15T01:15:00+00:00, run_start_date=2024-04-15 01:16:00.671080+00:00, run_end_date=2024-04-15 01:16:05.126095+00:00, run_duration=4.455015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:15:00+00:00, data_interval_end=2024-04-15 01:16:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:16:05.135107421Z [2024-04-15T01:16:05.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:16:00+00:00, run_after=2024-04-15T01:17:00+00:00 2024-04-15T01:16:05.176480598Z [2024-04-15T01:16:05.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status success for try_number 1 2024-04-15T01:16:05.176520596Z [2024-04-15T01:16:05.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status success for try_number 1 2024-04-15T01:16:05.183980546Z [2024-04-15T01:16:05.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=2024-04-15 01:16:02.975294+00:00, run_end_date=2024-04-15 01:16:04.169730+00:00, run_duration=1.194436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:16:00.778113+00:00, queued_by_job_id=1, pid=10771 2024-04-15T01:16:05.184132687Z [2024-04-15T01:16:05.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=2024-04-15 01:16:02.750392+00:00, run_end_date=2024-04-15 01:16:04.388521+00:00, run_duration=1.638129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:16:00.778113+00:00, queued_by_job_id=1, pid=10749 2024-04-15T01:16:08.191031323Z [2024-04-15T01:16:08.190+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:16:08.191076729Z 2024-04-15T01:16:08.191475815Z [2024-04-15T01:16:08.191+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-15T01:16:08.193057352Z [2024-04-15T01:16:08.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:16:08.193071813Z 2024-04-15T01:16:08.198130821Z [2024-04-15T01:16:08.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240415011607_689914', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:16:08.198776051Z [2024-04-15T01:16:08.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240415011607_689914', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-15T01:16:08.270643301Z [2024-04-15T01:16:08.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415011607_689914 exited with status queued for try_number 1 2024-04-15T01:16:08.279123537Z [2024-04-15T01:16:08.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1be25b7-5e81-40ff-8204-6a0d3c578b58 2024-04-15T01:16:09.839844160Z [2024-04-15T01:16:09.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:16:09.840108698Z [2024-04-15T01:16:09.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-15 01:16:07.977071+00:00, run_id=vdu_down_20240415011607_689914, run_start_date=2024-04-15 01:16:08.159224+00:00, run_end_date=2024-04-15 01:16:09.839772+00:00, run_duration=1.680548, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 01:16:07.977071+00:00, data_interval_end=2024-04-15 01:16:07.977071+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-15T01:16:09.844391152Z [2024-04-15T01:16:09.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-15T01:16:09.879591682Z [2024-04-15T01:16:09.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240415011607_689914 exited with status success for try_number 1 2024-04-15T01:16:09.885738093Z [2024-04-15T01:16:09.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240415011607_689914, map_index=-1, run_start_date=2024-04-15 01:16:08.889981+00:00, run_end_date=2024-04-15 01:16:09.243383+00:00, run_duration=0.353402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:16:08.195091+00:00, queued_by_job_id=1, pid=10783 2024-04-15T01:17:00.636850054Z [2024-04-15T01:17:00.636+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:17:00.647360715Z [2024-04-15T01:17:00.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:17:00+00:00, run_after=2024-04-15T01:18:00+00:00 2024-04-15T01:17:00.657275335Z [2024-04-15T01:17:00.657+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:17:00+00:00, run_after=2024-04-15T01:18:00+00:00 2024-04-15T01:17:00.709309628Z [2024-04-15T01:17:00.708+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:17:00.709371076Z 2024-04-15T01:17:00.709382379Z 2024-04-15T01:17:00.709391024Z 2024-04-15T01:17:00.709413169Z [2024-04-15T01:17:00.709+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:17:00.709684272Z [2024-04-15T01:17:00.709+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:17:00.709883372Z [2024-04-15T01:17:00.709+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:17:00.711168991Z [2024-04-15T01:17:00.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:17:00.711198083Z 2024-04-15T01:17:00.711210787Z 2024-04-15T01:17:00.711222435Z 2024-04-15T01:17:00.716690408Z [2024-04-15T01:17:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:17:00.716934889Z [2024-04-15T01:17:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:17:00.717425836Z [2024-04-15T01:17:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:17:00.717640409Z [2024-04-15T01:17:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:17:00.718067152Z [2024-04-15T01:17:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:17:00.718297365Z [2024-04-15T01:17:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:17:00.909970154Z [2024-04-15T01:17:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status queued for try_number 1 2024-04-15T01:17:00.910092415Z [2024-04-15T01:17:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status queued for try_number 1 2024-04-15T01:17:00.910201643Z [2024-04-15T01:17:00.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status queued for try_number 1 2024-04-15T01:17:00.917606441Z [2024-04-15T01:17:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa0af91f-2de6-4ce4-8366-738f077a7503 2024-04-15T01:17:00.917860931Z [2024-04-15T01:17:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e255179-42ac-4d24-9bfe-69d57cda972a 2024-04-15T01:17:00.918003039Z [2024-04-15T01:17:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to e44ba241-532e-412d-ac02-fd72c61eb26c 2024-04-15T01:17:02.049673765Z [2024-04-15T01:17:02.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:17:02.049774899Z [2024-04-15T01:17:02.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:16:00+00:00, run_id=scheduled__2024-04-15T01:16:00+00:00, run_start_date=2024-04-15 01:17:00.664984+00:00, run_end_date=2024-04-15 01:17:02.049448+00:00, run_duration=1.384464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:16:00+00:00, data_interval_end=2024-04-15 01:17:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:17:02.058544629Z [2024-04-15T01:17:02.058+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:17:00+00:00, run_after=2024-04-15T01:18:00+00:00 2024-04-15T01:17:02.103404252Z [2024-04-15T01:17:02.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status success for try_number 1 2024-04-15T01:17:02.112884860Z [2024-04-15T01:17:02.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:16:00+00:00, map_index=-1, run_start_date=2024-04-15 01:17:01.401397+00:00, run_end_date=2024-04-15 01:17:01.741004+00:00, run_duration=0.339607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:17:00.712627+00:00, queued_by_job_id=1, pid=10811 2024-04-15T01:17:04.292858350Z [2024-04-15T01:17:04.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:17:04.293166128Z [2024-04-15T01:17:04.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:16:00+00:00, run_id=scheduled__2024-04-15T01:16:00+00:00, run_start_date=2024-04-15 01:17:00.667209+00:00, run_end_date=2024-04-15 01:17:04.292838+00:00, run_duration=3.625629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:16:00+00:00, data_interval_end=2024-04-15 01:17:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:17:04.315665534Z [2024-04-15T01:17:04.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:17:00+00:00, run_after=2024-04-15T01:18:00+00:00 2024-04-15T01:17:04.397277625Z [2024-04-15T01:17:04.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status success for try_number 1 2024-04-15T01:17:04.403598397Z [2024-04-15T01:17:04.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:16:00+00:00, map_index=-1, run_start_date=2024-04-15 01:17:02.269882+00:00, run_end_date=2024-04-15 01:17:03.587103+00:00, run_duration=1.317221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:17:00.712627+00:00, queued_by_job_id=1, pid=10829 2024-04-15T01:17:04.643066605Z [2024-04-15T01:17:04.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:17:04.643111425Z [2024-04-15T01:17:04.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:16:00+00:00, run_id=scheduled__2024-04-15T01:16:00+00:00, run_start_date=2024-04-15 01:17:00.667998+00:00, run_end_date=2024-04-15 01:17:04.639772+00:00, run_duration=3.971774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:16:00+00:00, data_interval_end=2024-04-15 01:17:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:17:04.650116842Z [2024-04-15T01:17:04.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:17:00+00:00, run_after=2024-04-15T01:18:00+00:00 2024-04-15T01:17:04.692820263Z [2024-04-15T01:17:04.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status success for try_number 1 2024-04-15T01:17:04.701115828Z [2024-04-15T01:17:04.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:16:00+00:00, map_index=-1, run_start_date=2024-04-15 01:17:02.354517+00:00, run_end_date=2024-04-15 01:17:04.319382+00:00, run_duration=1.964865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:17:00.712627+00:00, queued_by_job_id=1, pid=10830 2024-04-15T01:18:00.531627123Z [2024-04-15T01:18:00.531+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:18:00.548137758Z [2024-04-15T01:18:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:18:00+00:00, run_after=2024-04-15T01:19:00+00:00 2024-04-15T01:18:00.559880216Z [2024-04-15T01:18:00.559+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:18:00+00:00, run_after=2024-04-15T01:19:00+00:00 2024-04-15T01:18:00.565867737Z [2024-04-15T01:18:00.565+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:18:00.629410574Z [2024-04-15T01:18:00.629+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:18:00.629433011Z 2024-04-15T01:18:00.629437648Z 2024-04-15T01:18:00.629441317Z 2024-04-15T01:18:00.629444900Z 2024-04-15T01:18:00.629728023Z [2024-04-15T01:18:00.629+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:18:00.629961450Z [2024-04-15T01:18:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:18:00.630197442Z [2024-04-15T01:18:00.630+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:18:00.630412780Z [2024-04-15T01:18:00.630+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:18:00.631100613Z [2024-04-15T01:18:00.630+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:18:00.631113237Z 2024-04-15T01:18:00.631117256Z 2024-04-15T01:18:00.631120599Z 2024-04-15T01:18:00.631124046Z 2024-04-15T01:18:00.634927040Z [2024-04-15T01:18:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:18:00.635218384Z [2024-04-15T01:18:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:18:00.635594204Z [2024-04-15T01:18:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:18:00.635869197Z [2024-04-15T01:18:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:18:00.636204033Z [2024-04-15T01:18:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:18:00.636648039Z [2024-04-15T01:18:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:18:00.637043562Z [2024-04-15T01:18:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:18:00.637287680Z [2024-04-15T01:18:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:18:01.107901492Z [2024-04-15T01:18:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status queued for try_number 1 2024-04-15T01:18:01.107996903Z [2024-04-15T01:18:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:17:00+00:00 exited with status queued for try_number 1 2024-04-15T01:18:01.108111314Z [2024-04-15T01:18:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:17:00+00:00 exited with status queued for try_number 1 2024-04-15T01:18:01.108177868Z [2024-04-15T01:18:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:17:00+00:00 exited with status queued for try_number 1 2024-04-15T01:18:01.123977089Z [2024-04-15T01:18:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a0eed5a-d56a-4049-8718-237dd58cfebb 2024-04-15T01:18:01.124126464Z [2024-04-15T01:18:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to de54d598-8b7e-44cc-a1e0-6781d3778ef0 2024-04-15T01:18:01.124255010Z [2024-04-15T01:18:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c10180c-5271-4300-92dc-e11113c0e5d5 2024-04-15T01:18:01.124415592Z [2024-04-15T01:18:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec143ded-4851-4acb-8e23-cb92a83973b8 2024-04-15T01:18:02.461794930Z [2024-04-15T01:18:02.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:18:02.462024146Z [2024-04-15T01:18:02.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:16:00+00:00, run_id=scheduled__2024-04-15T01:16:00+00:00, run_start_date=2024-04-15 01:18:00.575233+00:00, run_end_date=2024-04-15 01:18:02.461713+00:00, run_duration=1.88648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:16:00+00:00, data_interval_end=2024-04-15 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:18:02.470044554Z [2024-04-15T01:18:02.469+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:18:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:18:02.485035834Z [2024-04-15T01:18:02.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:18:02.487656816Z [2024-04-15T01:18:02.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:17:00+00:00, run_id=scheduled__2024-04-15T01:17:00+00:00, run_start_date=2024-04-15 01:18:00.576274+00:00, run_end_date=2024-04-15 01:18:02.484964+00:00, run_duration=1.90869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:17:00+00:00, data_interval_end=2024-04-15 01:18:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:18:02.500575830Z [2024-04-15T01:18:02.500+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:18:00+00:00, run_after=2024-04-15T01:19:00+00:00 2024-04-15T01:18:02.578852430Z [2024-04-15T01:18:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:16:00+00:00 exited with status success for try_number 1 2024-04-15T01:18:02.578929909Z [2024-04-15T01:18:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:17:00+00:00 exited with status success for try_number 1 2024-04-15T01:18:02.584225194Z [2024-04-15T01:18:02.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:17:00+00:00, map_index=-1, run_start_date=2024-04-15 01:18:01.487670+00:00, run_end_date=2024-04-15 01:18:01.858836+00:00, run_duration=0.371166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:18:00.632169+00:00, queued_by_job_id=1, pid=10863 2024-04-15T01:18:02.584435746Z [2024-04-15T01:18:02.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:16:00+00:00, map_index=-1, run_start_date=2024-04-15 01:18:01.815090+00:00, run_end_date=2024-04-15 01:18:02.167385+00:00, run_duration=0.352295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:18:00.632169+00:00, queued_by_job_id=1, pid=10869 2024-04-15T01:18:04.665507008Z [2024-04-15T01:18:04.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:18:04.665774281Z [2024-04-15T01:18:04.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:17:00+00:00, run_id=scheduled__2024-04-15T01:17:00+00:00, run_start_date=2024-04-15 01:18:00.577279+00:00, run_end_date=2024-04-15 01:18:04.665311+00:00, run_duration=4.088032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:17:00+00:00, data_interval_end=2024-04-15 01:18:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:18:04.675800081Z [2024-04-15T01:18:04.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:18:00+00:00, run_after=2024-04-15T01:19:00+00:00 2024-04-15T01:18:04.684651799Z [2024-04-15T01:18:04.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:18:04.684717112Z [2024-04-15T01:18:04.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:17:00+00:00, run_id=scheduled__2024-04-15T01:17:00+00:00, run_start_date=2024-04-15 01:18:00.578170+00:00, run_end_date=2024-04-15 01:18:04.684194+00:00, run_duration=4.106024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:17:00+00:00, data_interval_end=2024-04-15 01:18:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:18:04.697618585Z [2024-04-15T01:18:04.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:18:00+00:00, run_after=2024-04-15T01:19:00+00:00 2024-04-15T01:18:04.749436880Z [2024-04-15T01:18:04.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:17:00+00:00 exited with status success for try_number 1 2024-04-15T01:18:04.749497642Z [2024-04-15T01:18:04.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:17:00+00:00 exited with status success for try_number 1 2024-04-15T01:18:04.760633461Z [2024-04-15T01:18:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:17:00+00:00, map_index=-1, run_start_date=2024-04-15 01:18:02.741037+00:00, run_end_date=2024-04-15 01:18:04.316558+00:00, run_duration=1.575521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:18:00.632169+00:00, queued_by_job_id=1, pid=10887 2024-04-15T01:18:04.761097641Z [2024-04-15T01:18:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:17:00+00:00, map_index=-1, run_start_date=2024-04-15 01:18:02.945043+00:00, run_end_date=2024-04-15 01:18:04.272284+00:00, run_duration=1.327241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:18:00.632169+00:00, queued_by_job_id=1, pid=10888 2024-04-15T01:19:00.448798993Z [2024-04-15T01:19:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:19:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:19:00.459868115Z [2024-04-15T01:19:00.459+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:19:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:19:00.468356478Z [2024-04-15T01:19:00.468+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:19:00.550038497Z [2024-04-15T01:19:00.549+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:19:00.550076160Z 2024-04-15T01:19:00.550083879Z 2024-04-15T01:19:00.550090881Z 2024-04-15T01:19:00.550647306Z [2024-04-15T01:19:00.550+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:19:00.551257591Z [2024-04-15T01:19:00.550+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:19:00.551551844Z [2024-04-15T01:19:00.551+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:19:00.552558446Z [2024-04-15T01:19:00.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:19:00.552569399Z 2024-04-15T01:19:00.552576239Z 2024-04-15T01:19:00.552583265Z 2024-04-15T01:19:00.558291707Z [2024-04-15T01:19:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:19:00.558523168Z [2024-04-15T01:19:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:19:00.558954762Z [2024-04-15T01:19:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:19:00.559233249Z [2024-04-15T01:19:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:19:00.559642933Z [2024-04-15T01:19:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:19:00.559880253Z [2024-04-15T01:19:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:19:00.756465984Z [2024-04-15T01:19:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status queued for try_number 1 2024-04-15T01:19:00.756511716Z [2024-04-15T01:19:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status queued for try_number 1 2024-04-15T01:19:00.756515679Z [2024-04-15T01:19:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status queued for try_number 1 2024-04-15T01:19:00.767239206Z [2024-04-15T01:19:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 288b19a5-77c3-4f7d-89d6-9cd47b002370 2024-04-15T01:19:00.767462353Z [2024-04-15T01:19:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to c72ea1ec-906b-4eb1-9a68-f4d68b8da84b 2024-04-15T01:19:00.767650786Z [2024-04-15T01:19:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64253668-d5a9-4241-9399-3684ca83ba10 2024-04-15T01:19:01.892384135Z [2024-04-15T01:19:01.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:19:01.892667970Z [2024-04-15T01:19:01.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:18:00+00:00, run_id=scheduled__2024-04-15T01:18:00+00:00, run_start_date=2024-04-15 01:19:00.481034+00:00, run_end_date=2024-04-15 01:19:01.892174+00:00, run_duration=1.41114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:18:00+00:00, data_interval_end=2024-04-15 01:19:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:19:01.901899702Z [2024-04-15T01:19:01.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:19:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:19:01.944487451Z [2024-04-15T01:19:01.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status success for try_number 1 2024-04-15T01:19:01.948822391Z [2024-04-15T01:19:01.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:18:00+00:00, map_index=-1, run_start_date=2024-04-15 01:19:01.224173+00:00, run_end_date=2024-04-15 01:19:01.533268+00:00, run_duration=0.309095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:19:00.554291+00:00, queued_by_job_id=1, pid=10920 2024-04-15T01:19:04.296324851Z [2024-04-15T01:19:04.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:19:04.296650782Z [2024-04-15T01:19:04.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:18:00+00:00, run_id=scheduled__2024-04-15T01:18:00+00:00, run_start_date=2024-04-15 01:19:00.484621+00:00, run_end_date=2024-04-15 01:19:04.296227+00:00, run_duration=3.811606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:18:00+00:00, data_interval_end=2024-04-15 01:19:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:19:04.304187458Z [2024-04-15T01:19:04.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:19:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:19:04.313911565Z [2024-04-15T01:19:04.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:19:04.313958163Z [2024-04-15T01:19:04.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:18:00+00:00, run_id=scheduled__2024-04-15T01:18:00+00:00, run_start_date=2024-04-15 01:19:00.483275+00:00, run_end_date=2024-04-15 01:19:04.313335+00:00, run_duration=3.83006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:18:00+00:00, data_interval_end=2024-04-15 01:19:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:19:04.346612783Z [2024-04-15T01:19:04.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:19:00+00:00, run_after=2024-04-15T01:20:00+00:00 2024-04-15T01:19:04.401670928Z [2024-04-15T01:19:04.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status success for try_number 1 2024-04-15T01:19:04.402133574Z [2024-04-15T01:19:04.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status success for try_number 1 2024-04-15T01:19:04.414222209Z [2024-04-15T01:19:04.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:18:00+00:00, map_index=-1, run_start_date=2024-04-15 01:19:02.114753+00:00, run_end_date=2024-04-15 01:19:03.665375+00:00, run_duration=1.550622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:19:00.554291+00:00, queued_by_job_id=1, pid=10939 2024-04-15T01:19:04.414730936Z [2024-04-15T01:19:04.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:18:00+00:00, map_index=-1, run_start_date=2024-04-15 01:19:02.079425+00:00, run_end_date=2024-04-15 01:19:03.267550+00:00, run_duration=1.188125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:19:00.554291+00:00, queued_by_job_id=1, pid=10938 2024-04-15T01:20:00.834688261Z [2024-04-15T01:20:00.834+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:20:00.846007277Z [2024-04-15T01:20:00.845+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:20:00.865927208Z [2024-04-15T01:20:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:21:00+00:00 2024-04-15T01:20:00.882690008Z [2024-04-15T01:20:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:21:00+00:00 2024-04-15T01:20:00.897162691Z [2024-04-15T01:20:00.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:25:00+00:00 2024-04-15T01:20:00.986532119Z [2024-04-15T01:20:00.986+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:20:00.986578775Z 2024-04-15T01:20:00.986586186Z 2024-04-15T01:20:00.986592445Z 2024-04-15T01:20:00.986598378Z 2024-04-15T01:20:00.986604434Z 2024-04-15T01:20:00.986610669Z [2024-04-15T01:20:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:20:00.986748475Z [2024-04-15T01:20:00.986+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:20:00.986759660Z [2024-04-15T01:20:00.986+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:20:00.986765855Z [2024-04-15T01:20:00.986+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:20:00.986772398Z [2024-04-15T01:20:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:20:00.987372274Z [2024-04-15T01:20:00.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:20:00.987394008Z 2024-04-15T01:20:00.987429770Z 2024-04-15T01:20:00.987436406Z 2024-04-15T01:20:00.987442289Z 2024-04-15T01:20:00.987447892Z 2024-04-15T01:20:00.992098982Z [2024-04-15T01:20:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:20:00.992219332Z [2024-04-15T01:20:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:20:00.992428366Z [2024-04-15T01:20:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:20:00.992508079Z [2024-04-15T01:20:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:20:00.992715939Z [2024-04-15T01:20:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:20:00.992790467Z [2024-04-15T01:20:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:20:00.993000023Z [2024-04-15T01:20:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:20:00.993064821Z [2024-04-15T01:20:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:20:00.993405187Z [2024-04-15T01:20:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:20:00.993583893Z [2024-04-15T01:20:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:20:01.716174748Z [2024-04-15T01:20:01.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:01.716233436Z [2024-04-15T01:20:01.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:01.716267707Z [2024-04-15T01:20:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:19:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:01.716271426Z [2024-04-15T01:20:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:19:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:01.716274853Z [2024-04-15T01:20:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:19:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:01.728523311Z [2024-04-15T01:20:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a285450-736c-4d52-b2cb-3253b4cd157a 2024-04-15T01:20:01.728561771Z [2024-04-15T01:20:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to d95c41d6-c45f-459a-89d7-8e47f9adb57c 2024-04-15T01:20:01.728613342Z [2024-04-15T01:20:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e9d6bb7-1dba-498a-90a6-691f4a6808bb 2024-04-15T01:20:01.728727335Z [2024-04-15T01:20:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f60633f-dd7a-4370-92c6-ba1a431d78dc 2024-04-15T01:20:01.728806044Z [2024-04-15T01:20:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8039a8c6-a129-441a-92a3-e8fbdbc621f3 2024-04-15T01:20:03.057365321Z [2024-04-15T01:20:03.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:20:03.057593712Z [2024-04-15T01:20:03.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:18:00+00:00, run_id=scheduled__2024-04-15T01:18:00+00:00, run_start_date=2024-04-15 01:20:00.912186+00:00, run_end_date=2024-04-15 01:20:03.057288+00:00, run_duration=2.145102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:18:00+00:00, data_interval_end=2024-04-15 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:20:03.072728018Z [2024-04-15T01:20:03.072+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:22:00+00:00 2024-04-15T01:20:03.228411158Z [2024-04-15T01:20:03.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:18:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:03.235155026Z [2024-04-15T01:20:03.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:18:00+00:00, map_index=-1, run_start_date=2024-04-15 01:20:01.834444+00:00, run_end_date=2024-04-15 01:20:02.511038+00:00, run_duration=0.676594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:00.988227+00:00, queued_by_job_id=1, pid=10967 2024-04-15T01:20:04.354981717Z [2024-04-15T01:20:04.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:20:04.355005790Z [2024-04-15T01:20:04.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:19:00+00:00, run_id=scheduled__2024-04-15T01:19:00+00:00, run_start_date=2024-04-15 01:20:00.913482+00:00, run_end_date=2024-04-15 01:20:04.350615+00:00, run_duration=3.437133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:19:00+00:00, data_interval_end=2024-04-15 01:20:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:20:04.383030066Z [2024-04-15T01:20:04.381+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:21:00+00:00 2024-04-15T01:20:04.532056963Z [2024-04-15T01:20:04.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:19:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:04.541699569Z [2024-04-15T01:20:04.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:19:00+00:00, map_index=-1, run_start_date=2024-04-15 01:20:02.536741+00:00, run_end_date=2024-04-15 01:20:03.223133+00:00, run_duration=0.686392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:00.988227+00:00, queued_by_job_id=1, pid=10979 2024-04-15T01:20:05.271770222Z [2024-04-15T01:20:05.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:20:05.272118451Z [2024-04-15T01:20:05.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:19:00+00:00, run_id=scheduled__2024-04-15T01:19:00+00:00, run_start_date=2024-04-15 01:20:00.914621+00:00, run_end_date=2024-04-15 01:20:05.271824+00:00, run_duration=4.357203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:19:00+00:00, data_interval_end=2024-04-15 01:20:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:20:05.280401139Z [2024-04-15T01:20:05.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:21:00+00:00 2024-04-15T01:20:05.326668648Z [2024-04-15T01:20:05.326+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:20:05.326699091Z 2024-04-15T01:20:05.326738655Z [2024-04-15T01:20:05.326+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:20:05.327425729Z [2024-04-15T01:20:05.327+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:20:05.327459873Z 2024-04-15T01:20:05.331859712Z [2024-04-15T01:20:05.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:20:05.332968361Z [2024-04-15T01:20:05.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:20:05.422359958Z [2024-04-15T01:20:05.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:05.422549012Z [2024-04-15T01:20:05.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:05.422804306Z [2024-04-15T01:20:05.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:19:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:05.431884240Z [2024-04-15T01:20:05.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:19:00+00:00, map_index=-1, run_start_date=2024-04-15 01:20:03.704903+00:00, run_end_date=2024-04-15 01:20:05.078921+00:00, run_duration=1.374018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:00.988227+00:00, queued_by_job_id=1, pid=10992 2024-04-15T01:20:05.432199459Z [2024-04-15T01:20:05.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=2024-04-15 01:20:04.759470+00:00, run_end_date=2024-04-15 01:20:05.173913+00:00, run_duration=0.414443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:00.988227+00:00, queued_by_job_id=1, pid=11014 2024-04-15T01:20:05.432807286Z [2024-04-15T01:20:05.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 949fb98e-2635-4117-8546-fc2193859a40 2024-04-15T01:20:06.607380987Z [2024-04-15T01:20:06.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:20:06.607811391Z [2024-04-15T01:20:06.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:19:00+00:00, run_id=scheduled__2024-04-15T01:19:00+00:00, run_start_date=2024-04-15 01:20:00.915759+00:00, run_end_date=2024-04-15 01:20:06.607287+00:00, run_duration=5.691528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:19:00+00:00, data_interval_end=2024-04-15 01:20:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:20:06.618505363Z [2024-04-15T01:20:06.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:21:00+00:00 2024-04-15T01:20:06.677332012Z [2024-04-15T01:20:06.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:19:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:06.684620548Z [2024-04-15T01:20:06.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:19:00+00:00, map_index=-1, run_start_date=2024-04-15 01:20:04.240057+00:00, run_end_date=2024-04-15 01:20:05.923178+00:00, run_duration=1.683121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:00.988227+00:00, queued_by_job_id=1, pid=11003 2024-04-15T01:20:07.771861082Z [2024-04-15T01:20:07.771+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:20:07.771910734Z 2024-04-15T01:20:07.771936499Z [2024-04-15T01:20:07.771+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:20:07.773198530Z [2024-04-15T01:20:07.772+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:20:07.773218351Z 2024-04-15T01:20:07.777937742Z [2024-04-15T01:20:07.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:20:07.778041150Z [2024-04-15T01:20:07.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:20:07.855724165Z [2024-04-15T01:20:07.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:07.856184366Z [2024-04-15T01:20:07.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:07.863225490Z [2024-04-15T01:20:07.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to 110d0ada-89e5-40b6-a3ab-a555104ccdbc 2024-04-15T01:20:07.863404456Z [2024-04-15T01:20:07.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=2024-04-15 01:20:07.113467+00:00, run_end_date=2024-04-15 01:20:07.436606+00:00, run_duration=0.323139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:05.329108+00:00, queued_by_job_id=1, pid=11027 2024-04-15T01:20:09.890268500Z [2024-04-15T01:20:09.889+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:20:09.890293586Z 2024-04-15T01:20:09.890557060Z [2024-04-15T01:20:09.890+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:20:09.891577575Z [2024-04-15T01:20:09.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:20:09.891591170Z 2024-04-15T01:20:09.894153937Z [2024-04-15T01:20:09.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:20:09.894408803Z [2024-04-15T01:20:09.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:20:10.003434580Z [2024-04-15T01:20:10.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status queued for try_number 1 2024-04-15T01:20:10.008458252Z [2024-04-15T01:20:10.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:10.012340530Z [2024-04-15T01:20:10.012+0000] {scheduler_job.py:635} INFO - Setting external_id for to f886587b-558c-4c6d-8de9-613ac20b1aaf 2024-04-15T01:20:10.012678599Z [2024-04-15T01:20:10.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=0, run_start_date=2024-04-15 01:20:09.287170+00:00, run_end_date=2024-04-15 01:20:09.643083+00:00, run_duration=0.355913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:07.773926+00:00, queued_by_job_id=1, pid=11035 2024-04-15T01:20:12.266280462Z [2024-04-15T01:20:12.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:20:12.266554792Z [2024-04-15T01:20:12.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:15:00+00:00, run_id=scheduled__2024-04-15T01:15:00+00:00, run_start_date=2024-04-15 01:20:00.910738+00:00, run_end_date=2024-04-15 01:20:12.266103+00:00, run_duration=11.355365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:15:00+00:00, data_interval_end=2024-04-15 01:20:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:20:12.272963098Z [2024-04-15T01:20:12.272+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:20:00+00:00, run_after=2024-04-15T01:25:00+00:00 2024-04-15T01:20:12.309238490Z [2024-04-15T01:20:12.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:15:00+00:00 exited with status success for try_number 1 2024-04-15T01:20:12.317310916Z [2024-04-15T01:20:12.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:15:00+00:00, map_index=-1, run_start_date=2024-04-15 01:20:11.517460+00:00, run_end_date=2024-04-15 01:20:11.869307+00:00, run_duration=0.351847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:20:09.892014+00:00, queued_by_job_id=1, pid=11043 2024-04-15T01:21:00.175202360Z [2024-04-15T01:21:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:21:00+00:00, run_after=2024-04-15T01:22:00+00:00 2024-04-15T01:21:00.186242231Z [2024-04-15T01:21:00.185+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:21:00.208856055Z [2024-04-15T01:21:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:21:00+00:00, run_after=2024-04-15T01:22:00+00:00 2024-04-15T01:21:00.300280381Z [2024-04-15T01:21:00.299+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:21:00.300311822Z 2024-04-15T01:21:00.300320369Z 2024-04-15T01:21:00.300328278Z 2024-04-15T01:21:00.300760463Z [2024-04-15T01:21:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:21:00.301076413Z [2024-04-15T01:21:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:21:00.301330996Z [2024-04-15T01:21:00.301+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:21:00.302272235Z [2024-04-15T01:21:00.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:21:00.302288290Z 2024-04-15T01:21:00.302293298Z 2024-04-15T01:21:00.302317922Z 2024-04-15T01:21:00.307273429Z [2024-04-15T01:21:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:21:00.307687830Z [2024-04-15T01:21:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:21:00.308086245Z [2024-04-15T01:21:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:21:00.308415185Z [2024-04-15T01:21:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:21:00.308763669Z [2024-04-15T01:21:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:21:00.308942288Z [2024-04-15T01:21:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:21:00.627006650Z [2024-04-15T01:21:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:21:00.627220755Z [2024-04-15T01:21:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:21:00.627383908Z [2024-04-15T01:21:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:21:00.635234584Z [2024-04-15T01:21:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to f68fb0a8-b6b6-45dc-b4aa-eba6357aed98 2024-04-15T01:21:00.635461483Z [2024-04-15T01:21:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90b9a34c-99ef-4982-bedc-3887f4a607ae 2024-04-15T01:21:00.635607999Z [2024-04-15T01:21:00.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff496b46-e06a-47ed-8c36-a8120c4d290a 2024-04-15T01:21:01.751580325Z [2024-04-15T01:21:01.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:21:01.751871916Z [2024-04-15T01:21:01.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:20:00+00:00, run_id=scheduled__2024-04-15T01:20:00+00:00, run_start_date=2024-04-15 01:21:00.223818+00:00, run_end_date=2024-04-15 01:21:01.751522+00:00, run_duration=1.527704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:20:00+00:00, data_interval_end=2024-04-15 01:21:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:21:01.761930516Z [2024-04-15T01:21:01.761+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:21:00+00:00, run_after=2024-04-15T01:22:00+00:00 2024-04-15T01:21:01.804194912Z [2024-04-15T01:21:01.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:21:01.810977266Z [2024-04-15T01:21:01.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=-1, run_start_date=2024-04-15 01:21:01.093932+00:00, run_end_date=2024-04-15 01:21:01.443488+00:00, run_duration=0.349556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:21:00.303593+00:00, queued_by_job_id=1, pid=11065 2024-04-15T01:21:03.917339678Z [2024-04-15T01:21:03.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:21:03.917586711Z [2024-04-15T01:21:03.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:20:00+00:00, run_id=scheduled__2024-04-15T01:20:00+00:00, run_start_date=2024-04-15 01:21:00.226840+00:00, run_end_date=2024-04-15 01:21:03.917282+00:00, run_duration=3.690442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:20:00+00:00, data_interval_end=2024-04-15 01:21:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:21:03.926436390Z [2024-04-15T01:21:03.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:21:00+00:00, run_after=2024-04-15T01:22:00+00:00 2024-04-15T01:21:03.933351932Z [2024-04-15T01:21:03.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:21:03.933599282Z [2024-04-15T01:21:03.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:20:00+00:00, run_id=scheduled__2024-04-15T01:20:00+00:00, run_start_date=2024-04-15 01:21:00.225548+00:00, run_end_date=2024-04-15 01:21:03.933242+00:00, run_duration=3.707694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:20:00+00:00, data_interval_end=2024-04-15 01:21:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:21:03.943452996Z [2024-04-15T01:21:03.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:21:00+00:00, run_after=2024-04-15T01:22:00+00:00 2024-04-15T01:21:04.006221750Z [2024-04-15T01:21:04.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:21:04.006397999Z [2024-04-15T01:21:04.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:21:04.014246717Z [2024-04-15T01:21:04.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=-1, run_start_date=2024-04-15 01:21:01.990811+00:00, run_end_date=2024-04-15 01:21:03.206367+00:00, run_duration=1.215556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:21:00.303593+00:00, queued_by_job_id=1, pid=11083 2024-04-15T01:21:04.014790012Z [2024-04-15T01:21:04.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=-1, run_start_date=2024-04-15 01:21:02.063384+00:00, run_end_date=2024-04-15 01:21:03.604082+00:00, run_duration=1.540698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:21:00.303593+00:00, queued_by_job_id=1, pid=11084 2024-04-15T01:21:04.030408249Z [2024-04-15T01:21:04.029+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:22:01.106137081Z [2024-04-15T01:22:01.105+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:22:01.115564669Z [2024-04-15T01:22:01.115+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:22:01.130769406Z [2024-04-15T01:22:01.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:22:00+00:00, run_after=2024-04-15T01:23:00+00:00 2024-04-15T01:22:01.142298522Z [2024-04-15T01:22:01.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:22:00+00:00, run_after=2024-04-15T01:23:00+00:00 2024-04-15T01:22:01.265159460Z [2024-04-15T01:22:01.264+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:22:01.265182782Z 2024-04-15T01:22:01.265188134Z 2024-04-15T01:22:01.265192544Z 2024-04-15T01:22:01.265196853Z 2024-04-15T01:22:01.265548156Z [2024-04-15T01:22:01.265+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:22:01.265905319Z [2024-04-15T01:22:01.265+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:22:01.266252504Z [2024-04-15T01:22:01.266+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:22:01.266589873Z [2024-04-15T01:22:01.266+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:22:01.267801569Z [2024-04-15T01:22:01.267+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:22:01.267810688Z 2024-04-15T01:22:01.267814901Z 2024-04-15T01:22:01.267818657Z 2024-04-15T01:22:01.267822421Z 2024-04-15T01:22:01.275894753Z [2024-04-15T01:22:01.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:22:01.276313614Z [2024-04-15T01:22:01.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:22:01.276788203Z [2024-04-15T01:22:01.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:22:01.277043305Z [2024-04-15T01:22:01.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:22:01.277399473Z [2024-04-15T01:22:01.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:22:01.277646353Z [2024-04-15T01:22:01.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:22:01.278003564Z [2024-04-15T01:22:01.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:22:01.278254091Z [2024-04-15T01:22:01.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:22:01.661202589Z [2024-04-15T01:22:01.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:22:01.661362712Z [2024-04-15T01:22:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:21:00+00:00 exited with status queued for try_number 1 2024-04-15T01:22:01.661520436Z [2024-04-15T01:22:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:21:00+00:00 exited with status queued for try_number 1 2024-04-15T01:22:01.661587423Z [2024-04-15T01:22:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:21:00+00:00 exited with status queued for try_number 1 2024-04-15T01:22:01.675303443Z [2024-04-15T01:22:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7860713d-c103-4399-a1ba-0e1144c9606c 2024-04-15T01:22:01.675503900Z [2024-04-15T01:22:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4eaacab-ebf0-4470-b777-127c1de0fb27 2024-04-15T01:22:01.675601302Z [2024-04-15T01:22:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c986463-e269-4bd7-9b61-61285b0e4c6e 2024-04-15T01:22:01.675682511Z [2024-04-15T01:22:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to da2ec224-e70b-452b-bd1b-ac493130edb6 2024-04-15T01:22:03.014449212Z [2024-04-15T01:22:03.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:22:03.015089566Z [2024-04-15T01:22:03.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:20:00+00:00, run_id=scheduled__2024-04-15T01:20:00+00:00, run_start_date=2024-04-15 01:22:01.159372+00:00, run_end_date=2024-04-15 01:22:03.014607+00:00, run_duration=1.855235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:20:00+00:00, data_interval_end=2024-04-15 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:22:03.024897823Z [2024-04-15T01:22:03.024+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:22:00+00:00, run_after=2024-04-15T01:24:00+00:00 2024-04-15T01:22:03.048778656Z [2024-04-15T01:22:03.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:22:03.049084519Z [2024-04-15T01:22:03.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:21:00+00:00, run_id=scheduled__2024-04-15T01:21:00+00:00, run_start_date=2024-04-15 01:22:01.161126+00:00, run_end_date=2024-04-15 01:22:03.048770+00:00, run_duration=1.887644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:21:00+00:00, data_interval_end=2024-04-15 01:22:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:22:03.060424159Z [2024-04-15T01:22:03.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:22:00+00:00, run_after=2024-04-15T01:23:00+00:00 2024-04-15T01:22:03.108049159Z [2024-04-15T01:22:03.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:22:03.108226125Z [2024-04-15T01:22:03.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:21:00+00:00 exited with status success for try_number 1 2024-04-15T01:22:03.117151009Z [2024-04-15T01:22:03.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:21:00+00:00, map_index=-1, run_start_date=2024-04-15 01:22:02.122651+00:00, run_end_date=2024-04-15 01:22:02.474083+00:00, run_duration=0.351432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:22:01.269547+00:00, queued_by_job_id=1, pid=11118 2024-04-15T01:22:03.117524297Z [2024-04-15T01:22:03.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=-1, run_start_date=2024-04-15 01:22:01.977824+00:00, run_end_date=2024-04-15 01:22:02.364247+00:00, run_duration=0.386423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:22:01.269547+00:00, queued_by_job_id=1, pid=11117 2024-04-15T01:22:05.118562086Z [2024-04-15T01:22:05.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:22:05.118914492Z [2024-04-15T01:22:05.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:21:00+00:00, run_id=scheduled__2024-04-15T01:21:00+00:00, run_start_date=2024-04-15 01:22:01.163199+00:00, run_end_date=2024-04-15 01:22:05.118465+00:00, run_duration=3.955266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:21:00+00:00, data_interval_end=2024-04-15 01:22:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:22:05.130662990Z [2024-04-15T01:22:05.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:22:00+00:00, run_after=2024-04-15T01:23:00+00:00 2024-04-15T01:22:05.182742353Z [2024-04-15T01:22:05.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:21:00+00:00 exited with status success for try_number 1 2024-04-15T01:22:05.187883160Z [2024-04-15T01:22:05.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:21:00+00:00, map_index=-1, run_start_date=2024-04-15 01:22:03.343759+00:00, run_end_date=2024-04-15 01:22:04.997739+00:00, run_duration=1.65398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:22:01.269547+00:00, queued_by_job_id=1, pid=11142 2024-04-15T01:22:05.953789217Z [2024-04-15T01:22:05.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:22:05.953927725Z [2024-04-15T01:22:05.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:21:00+00:00, run_id=scheduled__2024-04-15T01:21:00+00:00, run_start_date=2024-04-15 01:22:01.164302+00:00, run_end_date=2024-04-15 01:22:05.953583+00:00, run_duration=4.789281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:21:00+00:00, data_interval_end=2024-04-15 01:22:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:22:05.966399381Z [2024-04-15T01:22:05.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:22:00+00:00, run_after=2024-04-15T01:23:00+00:00 2024-04-15T01:22:06.014471347Z [2024-04-15T01:22:06.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:21:00+00:00 exited with status success for try_number 1 2024-04-15T01:22:06.021385268Z [2024-04-15T01:22:06.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:21:00+00:00, map_index=-1, run_start_date=2024-04-15 01:22:03.278023+00:00, run_end_date=2024-04-15 01:22:05.182421+00:00, run_duration=1.904398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:22:01.269547+00:00, queued_by_job_id=1, pid=11141 2024-04-15T01:23:01.002369187Z [2024-04-15T01:23:01.001+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:23:00+00:00, run_after=2024-04-15T01:24:00+00:00 2024-04-15T01:23:01.012563650Z [2024-04-15T01:23:01.012+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:23:01.023726124Z [2024-04-15T01:23:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:23:00+00:00, run_after=2024-04-15T01:24:00+00:00 2024-04-15T01:23:01.102494935Z [2024-04-15T01:23:01.102+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:23:01.102543211Z 2024-04-15T01:23:01.102553107Z 2024-04-15T01:23:01.102562007Z 2024-04-15T01:23:01.102666799Z [2024-04-15T01:23:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:23:01.102792934Z [2024-04-15T01:23:01.102+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:23:01.103052404Z [2024-04-15T01:23:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:23:01.103924534Z [2024-04-15T01:23:01.103+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:23:01.103931674Z 2024-04-15T01:23:01.103934881Z 2024-04-15T01:23:01.103937912Z 2024-04-15T01:23:01.108499624Z [2024-04-15T01:23:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:23:01.108674944Z [2024-04-15T01:23:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:23:01.108955792Z [2024-04-15T01:23:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:23:01.109149839Z [2024-04-15T01:23:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:23:01.109551806Z [2024-04-15T01:23:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:23:01.109783832Z [2024-04-15T01:23:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:23:01.308440349Z [2024-04-15T01:23:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status queued for try_number 1 2024-04-15T01:23:01.308618888Z [2024-04-15T01:23:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status queued for try_number 1 2024-04-15T01:23:01.308758637Z [2024-04-15T01:23:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status queued for try_number 1 2024-04-15T01:23:01.315731855Z [2024-04-15T01:23:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49da9ba5-2e1a-4ad8-9843-c7068c5618b8 2024-04-15T01:23:01.315871472Z [2024-04-15T01:23:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09a76201-1380-4828-9ef8-88ee6e07f9c0 2024-04-15T01:23:01.316021369Z [2024-04-15T01:23:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bd73480-e606-4904-9e2b-ea584d3257e2 2024-04-15T01:23:02.496131058Z [2024-04-15T01:23:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:23:02.496410603Z [2024-04-15T01:23:02.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:22:00+00:00, run_id=scheduled__2024-04-15T01:22:00+00:00, run_start_date=2024-04-15 01:23:01.032280+00:00, run_end_date=2024-04-15 01:23:02.496064+00:00, run_duration=1.463784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:22:00+00:00, data_interval_end=2024-04-15 01:23:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:23:02.507196143Z [2024-04-15T01:23:02.506+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:23:00+00:00, run_after=2024-04-15T01:24:00+00:00 2024-04-15T01:23:02.587449484Z [2024-04-15T01:23:02.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status success for try_number 1 2024-04-15T01:23:02.607747649Z [2024-04-15T01:23:02.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:22:00+00:00, map_index=-1, run_start_date=2024-04-15 01:23:01.892546+00:00, run_end_date=2024-04-15 01:23:02.257851+00:00, run_duration=0.365305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:23:01.105142+00:00, queued_by_job_id=1, pid=11175 2024-04-15T01:23:04.806307792Z [2024-04-15T01:23:04.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:23:04.807324594Z [2024-04-15T01:23:04.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:22:00+00:00, run_id=scheduled__2024-04-15T01:22:00+00:00, run_start_date=2024-04-15 01:23:01.033442+00:00, run_end_date=2024-04-15 01:23:04.806144+00:00, run_duration=3.772702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:22:00+00:00, data_interval_end=2024-04-15 01:23:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:23:04.825661679Z [2024-04-15T01:23:04.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:23:00+00:00, run_after=2024-04-15T01:24:00+00:00 2024-04-15T01:23:04.838141957Z [2024-04-15T01:23:04.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:23:04.838201493Z [2024-04-15T01:23:04.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:22:00+00:00, run_id=scheduled__2024-04-15T01:22:00+00:00, run_start_date=2024-04-15 01:23:01.034353+00:00, run_end_date=2024-04-15 01:23:04.837841+00:00, run_duration=3.803488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:22:00+00:00, data_interval_end=2024-04-15 01:23:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:23:04.852091516Z [2024-04-15T01:23:04.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:23:00+00:00, run_after=2024-04-15T01:24:00+00:00 2024-04-15T01:23:04.903856246Z [2024-04-15T01:23:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status success for try_number 1 2024-04-15T01:23:04.910414903Z [2024-04-15T01:23:04.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:22:00+00:00, map_index=-1, run_start_date=2024-04-15 01:23:02.769891+00:00, run_end_date=2024-04-15 01:23:04.202282+00:00, run_duration=1.432391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:23:01.105142+00:00, queued_by_job_id=1, pid=11193 2024-04-15T01:23:05.989034496Z [2024-04-15T01:23:05.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status success for try_number 1 2024-04-15T01:23:05.997703015Z [2024-04-15T01:23:05.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:22:00+00:00, map_index=-1, run_start_date=2024-04-15 01:23:02.850601+00:00, run_end_date=2024-04-15 01:23:04.696893+00:00, run_duration=1.846292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:23:01.105142+00:00, queued_by_job_id=1, pid=11194 2024-04-15T01:24:00.387199203Z [2024-04-15T01:24:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:24:00+00:00, run_after=2024-04-15T01:25:00+00:00 2024-04-15T01:24:00.402738887Z [2024-04-15T01:24:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:24:00+00:00, run_after=2024-04-15T01:25:00+00:00 2024-04-15T01:24:00.408264605Z [2024-04-15T01:24:00.408+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:24:00.415630471Z [2024-04-15T01:24:00.415+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:24:00.520433168Z [2024-04-15T01:24:00.520+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:24:00.520463318Z 2024-04-15T01:24:00.520482157Z 2024-04-15T01:24:00.520487164Z 2024-04-15T01:24:00.520491346Z 2024-04-15T01:24:00.520592556Z [2024-04-15T01:24:00.520+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:24:00.520742577Z [2024-04-15T01:24:00.520+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:24:00.520847026Z [2024-04-15T01:24:00.520+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:24:00.520975564Z [2024-04-15T01:24:00.520+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:24:00.521502659Z [2024-04-15T01:24:00.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:24:00.521509763Z 2024-04-15T01:24:00.521521802Z 2024-04-15T01:24:00.521530407Z 2024-04-15T01:24:00.521534725Z 2024-04-15T01:24:00.524751263Z [2024-04-15T01:24:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:24:00.524924941Z [2024-04-15T01:24:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:24:00.525178028Z [2024-04-15T01:24:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:24:00.525318367Z [2024-04-15T01:24:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:24:00.525517251Z [2024-04-15T01:24:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:24:00.525643450Z [2024-04-15T01:24:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:24:00.525834119Z [2024-04-15T01:24:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:24:00.525945285Z [2024-04-15T01:24:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:24:00.833218838Z [2024-04-15T01:24:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status queued for try_number 1 2024-04-15T01:24:00.833382044Z [2024-04-15T01:24:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:23:00+00:00 exited with status queued for try_number 1 2024-04-15T01:24:00.833518229Z [2024-04-15T01:24:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:23:00+00:00 exited with status queued for try_number 1 2024-04-15T01:24:00.833668193Z [2024-04-15T01:24:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:23:00+00:00 exited with status queued for try_number 1 2024-04-15T01:24:00.848680082Z [2024-04-15T01:24:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to f07bfe06-944d-4e9f-aae2-a497bbe42d52 2024-04-15T01:24:00.848870329Z [2024-04-15T01:24:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5437a624-c8d3-466e-9804-fd7d4d9ceb2e 2024-04-15T01:24:00.849060550Z [2024-04-15T01:24:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac2905d4-e506-4288-a0be-0369c0500861 2024-04-15T01:24:00.849222553Z [2024-04-15T01:24:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to cff2a4e7-180c-4d80-bfc0-58edc1287700 2024-04-15T01:24:02.017192204Z [2024-04-15T01:24:02.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:24:02.017451785Z [2024-04-15T01:24:02.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:22:00+00:00, run_id=scheduled__2024-04-15T01:22:00+00:00, run_start_date=2024-04-15 01:24:00.425071+00:00, run_end_date=2024-04-15 01:24:02.017017+00:00, run_duration=1.591946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:22:00+00:00, data_interval_end=2024-04-15 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:24:02.023929650Z [2024-04-15T01:24:02.023+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:24:00+00:00, run_after=2024-04-15T01:26:00+00:00 2024-04-15T01:24:02.029414391Z [2024-04-15T01:24:02.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:24:02.029664466Z [2024-04-15T01:24:02.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:23:00+00:00, run_id=scheduled__2024-04-15T01:23:00+00:00, run_start_date=2024-04-15 01:24:00.426166+00:00, run_end_date=2024-04-15 01:24:02.029278+00:00, run_duration=1.603112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:23:00+00:00, data_interval_end=2024-04-15 01:24:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:24:02.039646840Z [2024-04-15T01:24:02.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:24:00+00:00, run_after=2024-04-15T01:25:00+00:00 2024-04-15T01:24:02.083603088Z [2024-04-15T01:24:02.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:22:00+00:00 exited with status success for try_number 1 2024-04-15T01:24:02.083973201Z [2024-04-15T01:24:02.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:23:00+00:00 exited with status success for try_number 1 2024-04-15T01:24:02.093686805Z [2024-04-15T01:24:02.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:22:00+00:00, map_index=-1, run_start_date=2024-04-15 01:24:01.311676+00:00, run_end_date=2024-04-15 01:24:01.683917+00:00, run_duration=0.372241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:24:00.522216+00:00, queued_by_job_id=1, pid=11227 2024-04-15T01:24:02.094147169Z [2024-04-15T01:24:02.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:23:00+00:00, map_index=-1, run_start_date=2024-04-15 01:24:01.353049+00:00, run_end_date=2024-04-15 01:24:01.727461+00:00, run_duration=0.374412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:24:00.522216+00:00, queued_by_job_id=1, pid=11228 2024-04-15T01:24:04.516317253Z [2024-04-15T01:24:04.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:24:04.516659136Z [2024-04-15T01:24:04.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:23:00+00:00, run_id=scheduled__2024-04-15T01:23:00+00:00, run_start_date=2024-04-15 01:24:00.427140+00:00, run_end_date=2024-04-15 01:24:04.516197+00:00, run_duration=4.089057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:23:00+00:00, data_interval_end=2024-04-15 01:24:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:24:04.553897350Z [2024-04-15T01:24:04.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:24:00+00:00, run_after=2024-04-15T01:25:00+00:00 2024-04-15T01:24:04.564331473Z [2024-04-15T01:24:04.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:24:04.564891348Z [2024-04-15T01:24:04.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:23:00+00:00, run_id=scheduled__2024-04-15T01:23:00+00:00, run_start_date=2024-04-15 01:24:00.428022+00:00, run_end_date=2024-04-15 01:24:04.564402+00:00, run_duration=4.13638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:23:00+00:00, data_interval_end=2024-04-15 01:24:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:24:04.583903889Z [2024-04-15T01:24:04.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:24:00+00:00, run_after=2024-04-15T01:25:00+00:00 2024-04-15T01:24:04.643909049Z [2024-04-15T01:24:04.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:23:00+00:00 exited with status success for try_number 1 2024-04-15T01:24:04.644266567Z [2024-04-15T01:24:04.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:23:00+00:00 exited with status success for try_number 1 2024-04-15T01:24:04.652925853Z [2024-04-15T01:24:04.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:23:00+00:00, map_index=-1, run_start_date=2024-04-15 01:24:02.417322+00:00, run_end_date=2024-04-15 01:24:03.619004+00:00, run_duration=1.201682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:24:00.522216+00:00, queued_by_job_id=1, pid=11252 2024-04-15T01:24:04.653356705Z [2024-04-15T01:24:04.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:23:00+00:00, map_index=-1, run_start_date=2024-04-15 01:24:02.330751+00:00, run_end_date=2024-04-15 01:24:03.951031+00:00, run_duration=1.62028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:24:00.522216+00:00, queued_by_job_id=1, pid=11251 2024-04-15T01:25:00.309262236Z [2024-04-15T01:25:00.308+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:25:00+00:00, run_after=2024-04-15T01:26:00+00:00 2024-04-15T01:25:00.322645515Z [2024-04-15T01:25:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:25:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:25:00.328590218Z [2024-04-15T01:25:00.327+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:25:00.339273023Z [2024-04-15T01:25:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:25:00+00:00, run_after=2024-04-15T01:26:00+00:00 2024-04-15T01:25:00.439000631Z [2024-04-15T01:25:00.438+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:25:00.439036978Z 2024-04-15T01:25:00.439043812Z 2024-04-15T01:25:00.439048376Z 2024-04-15T01:25:00.439052490Z 2024-04-15T01:25:00.439235014Z [2024-04-15T01:25:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:25:00.439398344Z [2024-04-15T01:25:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:25:00.439779648Z [2024-04-15T01:25:00.439+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:25:00.439950124Z [2024-04-15T01:25:00.439+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:25:00.440521784Z [2024-04-15T01:25:00.440+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:25:00.440530383Z 2024-04-15T01:25:00.440533881Z 2024-04-15T01:25:00.440537032Z 2024-04-15T01:25:00.440540127Z 2024-04-15T01:25:00.444980217Z [2024-04-15T01:25:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:25:00.445157682Z [2024-04-15T01:25:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:25:00.445436562Z [2024-04-15T01:25:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:25:00.445576916Z [2024-04-15T01:25:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:25:00.445777088Z [2024-04-15T01:25:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:25:00.445890665Z [2024-04-15T01:25:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:25:00.446072743Z [2024-04-15T01:25:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:25:00.446200140Z [2024-04-15T01:25:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:25:00.934289668Z [2024-04-15T01:25:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:00.934383414Z [2024-04-15T01:25:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:00.934479177Z [2024-04-15T01:25:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:00.934582459Z [2024-04-15T01:25:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:00.951990942Z [2024-04-15T01:25:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47721ee7-8cd4-413a-92b7-6712bcd84921 2024-04-15T01:25:00.952129334Z [2024-04-15T01:25:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8804b90d-93e1-4d66-ad98-008e7704a9aa 2024-04-15T01:25:00.952263201Z [2024-04-15T01:25:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 777dbfa8-5447-4b26-8f9c-5a1e68cfb28a 2024-04-15T01:25:00.952395560Z [2024-04-15T01:25:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2539bfe1-1f93-4ef4-9687-be857cfe6579 2024-04-15T01:25:02.415368809Z [2024-04-15T01:25:02.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:25:02.415749042Z [2024-04-15T01:25:02.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:24:00+00:00, run_id=scheduled__2024-04-15T01:24:00+00:00, run_start_date=2024-04-15 01:25:00.360704+00:00, run_end_date=2024-04-15 01:25:02.415284+00:00, run_duration=2.05458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:24:00+00:00, data_interval_end=2024-04-15 01:25:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:25:02.424177423Z [2024-04-15T01:25:02.423+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:25:00+00:00, run_after=2024-04-15T01:26:00+00:00 2024-04-15T01:25:02.516336088Z [2024-04-15T01:25:02.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status success for try_number 1 2024-04-15T01:25:02.521259359Z [2024-04-15T01:25:02.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:24:00+00:00, map_index=-1, run_start_date=2024-04-15 01:25:01.175454+00:00, run_end_date=2024-04-15 01:25:01.622488+00:00, run_duration=0.447034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:00.441379+00:00, queued_by_job_id=1, pid=11285 2024-04-15T01:25:03.281227769Z [2024-04-15T01:25:03.280+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:25:03.281283903Z 2024-04-15T01:25:03.281295435Z [2024-04-15T01:25:03.281+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:25:03.281823521Z [2024-04-15T01:25:03.281+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:25:03.281844390Z 2024-04-15T01:25:03.283935780Z [2024-04-15T01:25:03.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:25:03.283989084Z [2024-04-15T01:25:03.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:25:03.340074419Z [2024-04-15T01:25:03.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:03.340485955Z [2024-04-15T01:25:03.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:25:03.349166972Z [2024-04-15T01:25:03.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7b37587-a4fc-4d98-9672-2842a00099e7 2024-04-15T01:25:03.349413023Z [2024-04-15T01:25:03.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=-1, run_start_date=2024-04-15 01:25:02.169609+00:00, run_end_date=2024-04-15 01:25:02.505921+00:00, run_duration=0.336312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:00.441379+00:00, queued_by_job_id=1, pid=11305 2024-04-15T01:25:04.533938858Z [2024-04-15T01:25:04.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:25:04.534353689Z [2024-04-15T01:25:04.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:24:00+00:00, run_id=scheduled__2024-04-15T01:24:00+00:00, run_start_date=2024-04-15 01:25:00.361791+00:00, run_end_date=2024-04-15 01:25:04.534054+00:00, run_duration=4.172263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:24:00+00:00, data_interval_end=2024-04-15 01:25:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:25:04.544385144Z [2024-04-15T01:25:04.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:25:00+00:00, run_after=2024-04-15T01:26:00+00:00 2024-04-15T01:25:04.550919776Z [2024-04-15T01:25:04.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:25:04.551349768Z [2024-04-15T01:25:04.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:24:00+00:00, run_id=scheduled__2024-04-15T01:24:00+00:00, run_start_date=2024-04-15 01:25:00.364553+00:00, run_end_date=2024-04-15 01:25:04.551064+00:00, run_duration=4.186511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:24:00+00:00, data_interval_end=2024-04-15 01:25:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:25:04.560014034Z [2024-04-15T01:25:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:25:00+00:00, run_after=2024-04-15T01:26:00+00:00 2024-04-15T01:25:04.600798253Z [2024-04-15T01:25:04.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status success for try_number 1 2024-04-15T01:25:04.601269913Z [2024-04-15T01:25:04.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status success for try_number 1 2024-04-15T01:25:04.607137502Z [2024-04-15T01:25:04.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:24:00+00:00, map_index=-1, run_start_date=2024-04-15 01:25:02.159120+00:00, run_end_date=2024-04-15 01:25:03.419485+00:00, run_duration=1.260365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:00.441379+00:00, queued_by_job_id=1, pid=11304 2024-04-15T01:25:04.607773096Z [2024-04-15T01:25:04.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:24:00+00:00, map_index=-1, run_start_date=2024-04-15 01:25:02.413850+00:00, run_end_date=2024-04-15 01:25:04.030020+00:00, run_duration=1.61617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:00.441379+00:00, queued_by_job_id=1, pid=11311 2024-04-15T01:25:05.681084181Z [2024-04-15T01:25:05.680+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:25:05.681179327Z 2024-04-15T01:25:05.681192336Z [2024-04-15T01:25:05.680+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:25:05.681701435Z [2024-04-15T01:25:05.681+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:25:05.681729085Z 2024-04-15T01:25:05.683845393Z [2024-04-15T01:25:05.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:25:05.684248426Z [2024-04-15T01:25:05.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:25:05.735636025Z [2024-04-15T01:25:05.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:05.735897346Z [2024-04-15T01:25:05.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:25:05.742756203Z [2024-04-15T01:25:05.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to bee7f9b2-851d-46b6-a994-f19a43cc8191 2024-04-15T01:25:05.743188494Z [2024-04-15T01:25:05.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=-1, run_start_date=2024-04-15 01:25:04.880622+00:00, run_end_date=2024-04-15 01:25:05.270193+00:00, run_duration=0.389571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:03.281869+00:00, queued_by_job_id=1, pid=11334 2024-04-15T01:25:07.964515396Z [2024-04-15T01:25:07.964+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:25:07.964562256Z 2024-04-15T01:25:07.964727880Z [2024-04-15T01:25:07.964+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:25:07.965652441Z [2024-04-15T01:25:07.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:25:07.965668805Z 2024-04-15T01:25:07.968771172Z [2024-04-15T01:25:07.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:25:07.968972788Z [2024-04-15T01:25:07.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:25:08.027199931Z [2024-04-15T01:25:08.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status queued for try_number 1 2024-04-15T01:25:08.027231982Z [2024-04-15T01:25:08.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:25:08.033895673Z [2024-04-15T01:25:08.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8f32ad1-2787-4b32-ae75-84c51e2a64d2 2024-04-15T01:25:08.034498879Z [2024-04-15T01:25:08.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=0, run_start_date=2024-04-15 01:25:07.352446+00:00, run_end_date=2024-04-15 01:25:07.733792+00:00, run_duration=0.381346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:05.681969+00:00, queued_by_job_id=1, pid=11342 2024-04-15T01:25:10.641162286Z [2024-04-15T01:25:10.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:25:10.641789624Z [2024-04-15T01:25:10.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:20:00+00:00, run_id=scheduled__2024-04-15T01:20:00+00:00, run_start_date=2024-04-15 01:25:00.359212+00:00, run_end_date=2024-04-15 01:25:10.641038+00:00, run_duration=10.281826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:20:00+00:00, data_interval_end=2024-04-15 01:25:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:25:10.653621673Z [2024-04-15T01:25:10.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:25:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:25:10.704930050Z [2024-04-15T01:25:10.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:20:00+00:00 exited with status success for try_number 1 2024-04-15T01:25:10.715924804Z [2024-04-15T01:25:10.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:20:00+00:00, map_index=-1, run_start_date=2024-04-15 01:25:09.389072+00:00, run_end_date=2024-04-15 01:25:09.761421+00:00, run_duration=0.372349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:25:07.966269+00:00, queued_by_job_id=1, pid=11350 2024-04-15T01:26:00.306298066Z [2024-04-15T01:26:00.305+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:26:00.318340699Z [2024-04-15T01:26:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:26:00+00:00, run_after=2024-04-15T01:27:00+00:00 2024-04-15T01:26:00.332453617Z [2024-04-15T01:26:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:26:00+00:00, run_after=2024-04-15T01:27:00+00:00 2024-04-15T01:26:00.338132998Z [2024-04-15T01:26:00.337+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:26:00.405522918Z [2024-04-15T01:26:00.405+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:26:00.405537644Z 2024-04-15T01:26:00.405542254Z 2024-04-15T01:26:00.405545639Z 2024-04-15T01:26:00.405548909Z 2024-04-15T01:26:00.405711520Z [2024-04-15T01:26:00.405+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:26:00.405815215Z [2024-04-15T01:26:00.405+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:26:00.405969800Z [2024-04-15T01:26:00.405+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:26:00.406096678Z [2024-04-15T01:26:00.405+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:26:00.406692508Z [2024-04-15T01:26:00.406+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:26:00.406707420Z 2024-04-15T01:26:00.406713448Z 2024-04-15T01:26:00.406727453Z 2024-04-15T01:26:00.406732888Z 2024-04-15T01:26:00.410714531Z [2024-04-15T01:26:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:26:00.410729335Z [2024-04-15T01:26:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:26:00.411090337Z [2024-04-15T01:26:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:26:00.411223926Z [2024-04-15T01:26:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:26:00.411490252Z [2024-04-15T01:26:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:26:00.411633454Z [2024-04-15T01:26:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:26:00.411924878Z [2024-04-15T01:26:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:26:00.412170502Z [2024-04-15T01:26:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:26:00.946762149Z [2024-04-15T01:26:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status queued for try_number 1 2024-04-15T01:26:00.947179549Z [2024-04-15T01:26:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:26:00.947381189Z [2024-04-15T01:26:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:26:00.947582975Z [2024-04-15T01:26:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:26:00.978558122Z [2024-04-15T01:26:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23e5cfa5-154d-441e-8061-ce4b0b088880 2024-04-15T01:26:00.978851958Z [2024-04-15T01:26:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to df5cc0ad-3ef4-452b-af74-52696943c0b3 2024-04-15T01:26:00.979072990Z [2024-04-15T01:26:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8a48b6b-665f-4570-9040-632371e163c7 2024-04-15T01:26:00.979285376Z [2024-04-15T01:26:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96c1f970-814d-408d-9b0b-afe2f0099e9a 2024-04-15T01:26:01.799538510Z [2024-04-15T01:26:01.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:26:01.800098937Z [2024-04-15T01:26:01.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:24:00+00:00, run_id=scheduled__2024-04-15T01:24:00+00:00, run_start_date=2024-04-15 01:26:00.348655+00:00, run_end_date=2024-04-15 01:26:01.799706+00:00, run_duration=1.451051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:24:00+00:00, data_interval_end=2024-04-15 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:26:01.829510102Z [2024-04-15T01:26:01.829+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:26:00+00:00, run_after=2024-04-15T01:28:00+00:00 2024-04-15T01:26:01.933877069Z [2024-04-15T01:26:01.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:24:00+00:00 exited with status success for try_number 1 2024-04-15T01:26:01.949740959Z [2024-04-15T01:26:01.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:24:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:01.405268+00:00, run_end_date=2024-04-15 01:26:01.679603+00:00, run_duration=0.274335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:26:00.408092+00:00, queued_by_job_id=1, pid=11373 2024-04-15T01:26:03.006319366Z [2024-04-15T01:26:03.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:26:03.006750771Z [2024-04-15T01:26:03.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:25:00+00:00, run_id=scheduled__2024-04-15T01:25:00+00:00, run_start_date=2024-04-15 01:26:00.349860+00:00, run_end_date=2024-04-15 01:26:03.006171+00:00, run_duration=2.656311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:25:00+00:00, data_interval_end=2024-04-15 01:26:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:26:03.019107158Z [2024-04-15T01:26:03.018+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:26:00+00:00, run_after=2024-04-15T01:27:00+00:00 2024-04-15T01:26:03.087198877Z [2024-04-15T01:26:03.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:26:03.098210423Z [2024-04-15T01:26:03.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:01.424554+00:00, run_end_date=2024-04-15 01:26:01.838355+00:00, run_duration=0.413801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:26:00.408092+00:00, queued_by_job_id=1, pid=11374 2024-04-15T01:26:04.074960199Z [2024-04-15T01:26:04.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:26:04.075343948Z [2024-04-15T01:26:04.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:25:00+00:00, run_id=scheduled__2024-04-15T01:25:00+00:00, run_start_date=2024-04-15 01:26:00.350767+00:00, run_end_date=2024-04-15 01:26:04.074822+00:00, run_duration=3.724055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:25:00+00:00, data_interval_end=2024-04-15 01:26:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:26:04.093250265Z [2024-04-15T01:26:04.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:26:00+00:00, run_after=2024-04-15T01:27:00+00:00 2024-04-15T01:26:04.101770879Z [2024-04-15T01:26:04.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:26:04.102150743Z [2024-04-15T01:26:04.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:25:00+00:00, run_id=scheduled__2024-04-15T01:25:00+00:00, run_start_date=2024-04-15 01:26:00.351787+00:00, run_end_date=2024-04-15 01:26:04.101649+00:00, run_duration=3.749862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:25:00+00:00, data_interval_end=2024-04-15 01:26:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:26:04.113519134Z [2024-04-15T01:26:04.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:26:00+00:00, run_after=2024-04-15T01:27:00+00:00 2024-04-15T01:26:04.157882694Z [2024-04-15T01:26:04.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:26:04.166569925Z [2024-04-15T01:26:04.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:02.242068+00:00, run_end_date=2024-04-15 01:26:03.811517+00:00, run_duration=1.569449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:26:00.408092+00:00, queued_by_job_id=1, pid=11392 2024-04-15T01:26:04.179224924Z [2024-04-15T01:26:04.178+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:26:04.372095623Z [2024-04-15T01:26:04.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:26:04.381890905Z [2024-04-15T01:26:04.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:26:02.478248+00:00, run_end_date=2024-04-15 01:26:04.046445+00:00, run_duration=1.568197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:26:00.408092+00:00, queued_by_job_id=1, pid=11398 2024-04-15T01:27:00.251418801Z [2024-04-15T01:27:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:27:00+00:00, run_after=2024-04-15T01:28:00+00:00 2024-04-15T01:27:00.265761765Z [2024-04-15T01:27:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:27:00+00:00, run_after=2024-04-15T01:28:00+00:00 2024-04-15T01:27:00.271757492Z [2024-04-15T01:27:00.271+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:27:00.320122897Z [2024-04-15T01:27:00.319+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:27:00.320175555Z 2024-04-15T01:27:00.320185912Z 2024-04-15T01:27:00.320195361Z 2024-04-15T01:27:00.320240280Z [2024-04-15T01:27:00.319+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:27:00.320320897Z [2024-04-15T01:27:00.320+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:27:00.320360704Z [2024-04-15T01:27:00.320+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:27:00.320948346Z [2024-04-15T01:27:00.320+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:27:00.320968182Z 2024-04-15T01:27:00.320977455Z 2024-04-15T01:27:00.320986087Z 2024-04-15T01:27:00.325283766Z [2024-04-15T01:27:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:27:00.325366210Z [2024-04-15T01:27:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:27:00.325381395Z [2024-04-15T01:27:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:27:00.325467722Z [2024-04-15T01:27:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:27:00.325480794Z [2024-04-15T01:27:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:27:00.325493040Z [2024-04-15T01:27:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:27:00.882137257Z [2024-04-15T01:27:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status queued for try_number 1 2024-04-15T01:27:00.882408681Z [2024-04-15T01:27:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status queued for try_number 1 2024-04-15T01:27:00.882690968Z [2024-04-15T01:27:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status queued for try_number 1 2024-04-15T01:27:00.907898218Z [2024-04-15T01:27:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c4825de-1970-40fe-b86d-fc73b163fbc6 2024-04-15T01:27:00.908042815Z [2024-04-15T01:27:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 061f54d6-485d-4493-9270-523a6dbea7e4 2024-04-15T01:27:00.908166043Z [2024-04-15T01:27:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22aa9688-8ad7-40d3-a6b1-818919161fc0 2024-04-15T01:27:02.084799107Z [2024-04-15T01:27:02.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:27:02.085052346Z [2024-04-15T01:27:02.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:26:00+00:00, run_id=scheduled__2024-04-15T01:26:00+00:00, run_start_date=2024-04-15 01:27:00.279721+00:00, run_end_date=2024-04-15 01:27:02.084628+00:00, run_duration=1.804907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:26:00+00:00, data_interval_end=2024-04-15 01:27:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:27:02.094212567Z [2024-04-15T01:27:02.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:27:00+00:00, run_after=2024-04-15T01:28:00+00:00 2024-04-15T01:27:02.141428254Z [2024-04-15T01:27:02.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status success for try_number 1 2024-04-15T01:27:02.148933957Z [2024-04-15T01:27:02.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:26:00+00:00, map_index=-1, run_start_date=2024-04-15 01:27:01.145104+00:00, run_end_date=2024-04-15 01:27:01.478497+00:00, run_duration=0.333393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:27:00.321576+00:00, queued_by_job_id=1, pid=11431 2024-04-15T01:27:03.497355573Z [2024-04-15T01:27:03.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:27:03.497650273Z [2024-04-15T01:27:03.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:26:00+00:00, run_id=scheduled__2024-04-15T01:26:00+00:00, run_start_date=2024-04-15 01:27:00.280741+00:00, run_end_date=2024-04-15 01:27:03.497134+00:00, run_duration=3.216393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:26:00+00:00, data_interval_end=2024-04-15 01:27:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:27:03.513457622Z [2024-04-15T01:27:03.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:27:00+00:00, run_after=2024-04-15T01:28:00+00:00 2024-04-15T01:27:03.567593203Z [2024-04-15T01:27:03.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status success for try_number 1 2024-04-15T01:27:03.578828200Z [2024-04-15T01:27:03.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:26:00+00:00, map_index=-1, run_start_date=2024-04-15 01:27:01.997468+00:00, run_end_date=2024-04-15 01:27:03.263071+00:00, run_duration=1.265603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:27:00.321576+00:00, queued_by_job_id=1, pid=11449 2024-04-15T01:27:04.652025517Z [2024-04-15T01:27:04.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:27:04.652505640Z [2024-04-15T01:27:04.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:26:00+00:00, run_id=scheduled__2024-04-15T01:26:00+00:00, run_start_date=2024-04-15 01:27:00.281701+00:00, run_end_date=2024-04-15 01:27:04.651900+00:00, run_duration=4.370199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:26:00+00:00, data_interval_end=2024-04-15 01:27:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:27:04.662417955Z [2024-04-15T01:27:04.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:27:00+00:00, run_after=2024-04-15T01:28:00+00:00 2024-04-15T01:27:04.709990006Z [2024-04-15T01:27:04.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status success for try_number 1 2024-04-15T01:27:04.715782191Z [2024-04-15T01:27:04.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:26:00+00:00, map_index=-1, run_start_date=2024-04-15 01:27:02.107840+00:00, run_end_date=2024-04-15 01:27:03.705463+00:00, run_duration=1.597623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:27:00.321576+00:00, queued_by_job_id=1, pid=11450 2024-04-15T01:28:00.975789423Z [2024-04-15T01:28:00.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:28:00+00:00, run_after=2024-04-15T01:29:00+00:00 2024-04-15T01:28:00.990217026Z [2024-04-15T01:28:00.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:28:00+00:00, run_after=2024-04-15T01:29:00+00:00 2024-04-15T01:28:00.998475003Z [2024-04-15T01:28:00.998+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:28:01.008841718Z [2024-04-15T01:28:01.008+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:28:01.096759607Z [2024-04-15T01:28:01.096+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:28:01.096784633Z 2024-04-15T01:28:01.096788887Z 2024-04-15T01:28:01.096792142Z 2024-04-15T01:28:01.096795299Z 2024-04-15T01:28:01.098574730Z [2024-04-15T01:28:01.096+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:28:01.099340597Z [2024-04-15T01:28:01.099+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:28:01.099965071Z [2024-04-15T01:28:01.099+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:28:01.100251628Z [2024-04-15T01:28:01.100+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:28:01.101684455Z [2024-04-15T01:28:01.101+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:28:01.101695507Z 2024-04-15T01:28:01.101699043Z 2024-04-15T01:28:01.101716306Z 2024-04-15T01:28:01.101719285Z 2024-04-15T01:28:01.106362277Z [2024-04-15T01:28:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:28:01.106730458Z [2024-04-15T01:28:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:28:01.107115614Z [2024-04-15T01:28:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:28:01.107313349Z [2024-04-15T01:28:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:28:01.107604502Z [2024-04-15T01:28:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:28:01.107772872Z [2024-04-15T01:28:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:28:01.108060339Z [2024-04-15T01:28:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:28:01.108228920Z [2024-04-15T01:28:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:28:01.520392698Z [2024-04-15T01:28:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status queued for try_number 1 2024-04-15T01:28:01.520492799Z [2024-04-15T01:28:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:27:00+00:00 exited with status queued for try_number 1 2024-04-15T01:28:01.520641021Z [2024-04-15T01:28:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:27:00+00:00 exited with status queued for try_number 1 2024-04-15T01:28:01.520771056Z [2024-04-15T01:28:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:27:00+00:00 exited with status queued for try_number 1 2024-04-15T01:28:01.549785623Z [2024-04-15T01:28:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to fab33ba2-86e4-4f00-95d8-c697c7c66f5e 2024-04-15T01:28:01.549835144Z [2024-04-15T01:28:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e43b57a-eb40-4411-a90a-dceb1b7f0a89 2024-04-15T01:28:01.549933312Z [2024-04-15T01:28:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4741ce5-0473-4301-a915-160365975519 2024-04-15T01:28:01.550012226Z [2024-04-15T01:28:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8fa0d5b-9fa2-4770-b25e-e3f086a57fc9 2024-04-15T01:28:02.863988634Z [2024-04-15T01:28:02.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:28:02.864013065Z [2024-04-15T01:28:02.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:26:00+00:00, run_id=scheduled__2024-04-15T01:26:00+00:00, run_start_date=2024-04-15 01:28:01.020127+00:00, run_end_date=2024-04-15 01:28:02.860956+00:00, run_duration=1.840829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:26:00+00:00, data_interval_end=2024-04-15 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:28:02.879234158Z [2024-04-15T01:28:02.877+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:28:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:28:03.000749661Z [2024-04-15T01:28:03.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:26:00+00:00 exited with status success for try_number 1 2024-04-15T01:28:03.019083645Z [2024-04-15T01:28:03.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:26:00+00:00, map_index=-1, run_start_date=2024-04-15 01:28:02.183374+00:00, run_end_date=2024-04-15 01:28:02.761422+00:00, run_duration=0.578048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:28:01.103266+00:00, queued_by_job_id=1, pid=11483 2024-04-15T01:28:04.082325364Z [2024-04-15T01:28:04.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:28:04.082442448Z [2024-04-15T01:28:04.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:27:00+00:00, run_id=scheduled__2024-04-15T01:27:00+00:00, run_start_date=2024-04-15 01:28:01.021477+00:00, run_end_date=2024-04-15 01:28:04.082237+00:00, run_duration=3.06076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:27:00+00:00, data_interval_end=2024-04-15 01:28:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:28:04.090115454Z [2024-04-15T01:28:04.089+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:28:00+00:00, run_after=2024-04-15T01:29:00+00:00 2024-04-15T01:28:04.187864429Z [2024-04-15T01:28:04.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:27:00+00:00 exited with status success for try_number 1 2024-04-15T01:28:04.194332732Z [2024-04-15T01:28:04.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:27:00+00:00, map_index=-1, run_start_date=2024-04-15 01:28:02.631338+00:00, run_end_date=2024-04-15 01:28:03.284706+00:00, run_duration=0.653368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:28:01.103266+00:00, queued_by_job_id=1, pid=11487 2024-04-15T01:28:05.251674671Z [2024-04-15T01:28:05.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:28:05.251860336Z [2024-04-15T01:28:05.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:27:00+00:00, run_id=scheduled__2024-04-15T01:27:00+00:00, run_start_date=2024-04-15 01:28:01.022536+00:00, run_end_date=2024-04-15 01:28:05.251577+00:00, run_duration=4.229041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:27:00+00:00, data_interval_end=2024-04-15 01:28:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:28:05.260843712Z [2024-04-15T01:28:05.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:28:00+00:00, run_after=2024-04-15T01:29:00+00:00 2024-04-15T01:28:05.299745269Z [2024-04-15T01:28:05.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:27:00+00:00 exited with status success for try_number 1 2024-04-15T01:28:05.304179560Z [2024-04-15T01:28:05.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:27:00+00:00, map_index=-1, run_start_date=2024-04-15 01:28:03.786913+00:00, run_end_date=2024-04-15 01:28:05.143646+00:00, run_duration=1.356733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:28:01.103266+00:00, queued_by_job_id=1, pid=11508 2024-04-15T01:28:06.361956029Z [2024-04-15T01:28:06.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:28:06.362631258Z [2024-04-15T01:28:06.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:27:00+00:00, run_id=scheduled__2024-04-15T01:27:00+00:00, run_start_date=2024-04-15 01:28:01.023566+00:00, run_end_date=2024-04-15 01:28:06.362099+00:00, run_duration=5.338533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:27:00+00:00, data_interval_end=2024-04-15 01:28:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:28:06.377130434Z [2024-04-15T01:28:06.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:28:00+00:00, run_after=2024-04-15T01:29:00+00:00 2024-04-15T01:28:06.423447286Z [2024-04-15T01:28:06.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:27:00+00:00 exited with status success for try_number 1 2024-04-15T01:28:06.434668533Z [2024-04-15T01:28:06.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:27:00+00:00, map_index=-1, run_start_date=2024-04-15 01:28:03.542490+00:00, run_end_date=2024-04-15 01:28:05.503778+00:00, run_duration=1.961288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:28:01.103266+00:00, queued_by_job_id=1, pid=11507 2024-04-15T01:29:00.921075581Z [2024-04-15T01:29:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:29:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:29:00.930075064Z [2024-04-15T01:29:00.929+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:29:00.954255354Z [2024-04-15T01:29:00.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:29:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:29:01.030826096Z [2024-04-15T01:29:01.030+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:29:01.030867685Z 2024-04-15T01:29:01.030927555Z 2024-04-15T01:29:01.030936684Z 2024-04-15T01:29:01.031290937Z [2024-04-15T01:29:01.030+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:29:01.031950539Z [2024-04-15T01:29:01.031+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:29:01.032617163Z [2024-04-15T01:29:01.032+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:29:01.034592211Z [2024-04-15T01:29:01.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:29:01.034615729Z 2024-04-15T01:29:01.034625136Z 2024-04-15T01:29:01.034634080Z 2024-04-15T01:29:01.040564764Z [2024-04-15T01:29:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:29:01.041019725Z [2024-04-15T01:29:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:29:01.041596612Z [2024-04-15T01:29:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:29:01.042051617Z [2024-04-15T01:29:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:29:01.042582569Z [2024-04-15T01:29:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:29:01.042754650Z [2024-04-15T01:29:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:29:01.279588311Z [2024-04-15T01:29:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status queued for try_number 1 2024-04-15T01:29:01.279926477Z [2024-04-15T01:29:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status queued for try_number 1 2024-04-15T01:29:01.280201369Z [2024-04-15T01:29:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status queued for try_number 1 2024-04-15T01:29:01.287428893Z [2024-04-15T01:29:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to 974e0626-cd6b-4606-981b-14578cbfba3c 2024-04-15T01:29:01.287617049Z [2024-04-15T01:29:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf352f4a-0b8c-4894-b93c-b353e0e6029b 2024-04-15T01:29:01.287803809Z [2024-04-15T01:29:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07eac8bc-0ec8-4ad8-98ff-8358835a9e72 2024-04-15T01:29:02.406476085Z [2024-04-15T01:29:02.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:29:02.406864195Z [2024-04-15T01:29:02.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:28:00+00:00, run_id=scheduled__2024-04-15T01:28:00+00:00, run_start_date=2024-04-15 01:29:00.972075+00:00, run_end_date=2024-04-15 01:29:02.406252+00:00, run_duration=1.434177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:28:00+00:00, data_interval_end=2024-04-15 01:29:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:29:02.416179927Z [2024-04-15T01:29:02.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:29:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:29:02.480861955Z [2024-04-15T01:29:02.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status success for try_number 1 2024-04-15T01:29:02.488380879Z [2024-04-15T01:29:02.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:28:00+00:00, map_index=-1, run_start_date=2024-04-15 01:29:01.746694+00:00, run_end_date=2024-04-15 01:29:02.122744+00:00, run_duration=0.37605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:29:01.036286+00:00, queued_by_job_id=1, pid=11540 2024-04-15T01:29:04.761108625Z [2024-04-15T01:29:04.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:29:04.761395509Z [2024-04-15T01:29:04.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:28:00+00:00, run_id=scheduled__2024-04-15T01:28:00+00:00, run_start_date=2024-04-15 01:29:00.974082+00:00, run_end_date=2024-04-15 01:29:04.760962+00:00, run_duration=3.78688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:28:00+00:00, data_interval_end=2024-04-15 01:29:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:29:04.771084626Z [2024-04-15T01:29:04.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:29:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:29:04.779102394Z [2024-04-15T01:29:04.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:29:04.779150607Z [2024-04-15T01:29:04.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:28:00+00:00, run_id=scheduled__2024-04-15T01:28:00+00:00, run_start_date=2024-04-15 01:29:00.975948+00:00, run_end_date=2024-04-15 01:29:04.778743+00:00, run_duration=3.802795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:28:00+00:00, data_interval_end=2024-04-15 01:29:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:29:04.802178809Z [2024-04-15T01:29:04.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:29:00+00:00, run_after=2024-04-15T01:30:00+00:00 2024-04-15T01:29:04.847164680Z [2024-04-15T01:29:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status success for try_number 1 2024-04-15T01:29:04.847589224Z [2024-04-15T01:29:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status success for try_number 1 2024-04-15T01:29:04.859151607Z [2024-04-15T01:29:04.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:28:00+00:00, map_index=-1, run_start_date=2024-04-15 01:29:02.640939+00:00, run_end_date=2024-04-15 01:29:04.258761+00:00, run_duration=1.617822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:29:01.036286+00:00, queued_by_job_id=1, pid=11558 2024-04-15T01:29:04.859583468Z [2024-04-15T01:29:04.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:28:00+00:00, map_index=-1, run_start_date=2024-04-15 01:29:02.651193+00:00, run_end_date=2024-04-15 01:29:03.957718+00:00, run_duration=1.306525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:29:01.036286+00:00, queued_by_job_id=1, pid=11559 2024-04-15T01:30:00.747277653Z [2024-04-15T01:30:00.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:31:00+00:00 2024-04-15T01:30:00.756272487Z [2024-04-15T01:30:00.755+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:30:00.765241676Z [2024-04-15T01:30:00.764+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:30:00.788819775Z [2024-04-15T01:30:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:30:00.811657445Z [2024-04-15T01:30:00.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:31:00+00:00 2024-04-15T01:30:00.943456762Z [2024-04-15T01:30:00.942+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:30:00.943489171Z 2024-04-15T01:30:00.943495814Z 2024-04-15T01:30:00.943502845Z 2024-04-15T01:30:00.943508614Z 2024-04-15T01:30:00.943514366Z 2024-04-15T01:30:00.943872189Z [2024-04-15T01:30:00.943+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:30:00.944168218Z [2024-04-15T01:30:00.943+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:30:00.944428739Z [2024-04-15T01:30:00.944+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:30:00.944718190Z [2024-04-15T01:30:00.944+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:30:00.945028881Z [2024-04-15T01:30:00.944+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:30:00.946052284Z [2024-04-15T01:30:00.945+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:30:00.946074543Z 2024-04-15T01:30:00.946084617Z 2024-04-15T01:30:00.946094492Z 2024-04-15T01:30:00.946106984Z 2024-04-15T01:30:00.946119884Z 2024-04-15T01:30:00.952630542Z [2024-04-15T01:30:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:30:00.952801294Z [2024-04-15T01:30:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:30:00.953156222Z [2024-04-15T01:30:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:30:00.953343615Z [2024-04-15T01:30:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:30:00.953769209Z [2024-04-15T01:30:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:30:00.954012194Z [2024-04-15T01:30:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:30:00.954343407Z [2024-04-15T01:30:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:30:00.954550480Z [2024-04-15T01:30:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:30:00.954858240Z [2024-04-15T01:30:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:30:00.955035749Z [2024-04-15T01:30:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:30:01.287101110Z [2024-04-15T01:30:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:01.289085625Z [2024-04-15T01:30:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:01.289195866Z [2024-04-15T01:30:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:29:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:01.289304588Z [2024-04-15T01:30:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:29:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:01.289419037Z [2024-04-15T01:30:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:29:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:01.304347891Z [2024-04-15T01:30:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b7b23e2-50bc-4699-89e6-6ba8df36c454 2024-04-15T01:30:01.304458678Z [2024-04-15T01:30:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to f307bd44-94e5-46a3-a6a7-84b0f24490bb 2024-04-15T01:30:01.304620463Z [2024-04-15T01:30:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cf3342a-c7a2-4ce5-8c2e-dcbd9bd63f0b 2024-04-15T01:30:01.304758807Z [2024-04-15T01:30:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to adb87a75-0eae-477b-85b4-5c3857ff5006 2024-04-15T01:30:01.304891360Z [2024-04-15T01:30:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e82b543-0ede-484b-af41-77e5fabb1aa6 2024-04-15T01:30:02.663951908Z [2024-04-15T01:30:02.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:30:02.664189106Z [2024-04-15T01:30:02.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:28:00+00:00, run_id=scheduled__2024-04-15T01:28:00+00:00, run_start_date=2024-04-15 01:30:00.828977+00:00, run_end_date=2024-04-15 01:30:02.663643+00:00, run_duration=1.834666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:28:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:30:02.672341548Z [2024-04-15T01:30:02.672+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:32:00+00:00 2024-04-15T01:30:02.679751151Z [2024-04-15T01:30:02.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:30:02.679904858Z [2024-04-15T01:30:02.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:29:00+00:00, run_id=scheduled__2024-04-15T01:29:00+00:00, run_start_date=2024-04-15 01:30:00.830299+00:00, run_end_date=2024-04-15 01:30:02.679563+00:00, run_duration=1.849264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:29:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:30:02.691226536Z [2024-04-15T01:30:02.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:31:00+00:00 2024-04-15T01:30:02.775416664Z [2024-04-15T01:30:02.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:29:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:02.781898943Z [2024-04-15T01:30:02.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:29:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:02.062827+00:00, run_end_date=2024-04-15 01:30:02.567935+00:00, run_duration=0.505108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:00.947809+00:00, queued_by_job_id=1, pid=11593 2024-04-15T01:30:03.729613462Z [2024-04-15T01:30:03.729+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:30:03.729635914Z 2024-04-15T01:30:03.729738256Z [2024-04-15T01:30:03.729+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:30:03.730564851Z [2024-04-15T01:30:03.730+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:30:03.730569170Z 2024-04-15T01:30:03.732749212Z [2024-04-15T01:30:03.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:30:03.732892850Z [2024-04-15T01:30:03.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:30:03.806389580Z [2024-04-15T01:30:03.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:03.806521801Z [2024-04-15T01:30:03.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:03.806684797Z [2024-04-15T01:30:03.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:28:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:03.821279437Z [2024-04-15T01:30:03.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:28:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:02.161917+00:00, run_end_date=2024-04-15 01:30:02.606055+00:00, run_duration=0.444138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:00.947809+00:00, queued_by_job_id=1, pid=11594 2024-04-15T01:30:03.821567948Z [2024-04-15T01:30:03.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:03.275401+00:00, run_end_date=2024-04-15 01:30:03.583947+00:00, run_duration=0.308546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:00.947809+00:00, queued_by_job_id=1, pid=11625 2024-04-15T01:30:03.821884541Z [2024-04-15T01:30:03.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3fcf80b-68aa-4af5-82f6-e4226224eb21 2024-04-15T01:30:05.305842973Z [2024-04-15T01:30:05.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:30:05.306096177Z [2024-04-15T01:30:05.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:29:00+00:00, run_id=scheduled__2024-04-15T01:29:00+00:00, run_start_date=2024-04-15 01:30:00.831618+00:00, run_end_date=2024-04-15 01:30:05.305707+00:00, run_duration=4.474089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:29:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:30:05.316511077Z [2024-04-15T01:30:05.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:31:00+00:00 2024-04-15T01:30:05.325608770Z [2024-04-15T01:30:05.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:30:05.325818878Z [2024-04-15T01:30:05.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:29:00+00:00, run_id=scheduled__2024-04-15T01:29:00+00:00, run_start_date=2024-04-15 01:30:00.832915+00:00, run_end_date=2024-04-15 01:30:05.325508+00:00, run_duration=4.492593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:29:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:30:05.341922037Z [2024-04-15T01:30:05.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:31:00+00:00 2024-04-15T01:30:05.392675973Z [2024-04-15T01:30:05.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:29:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:05.392898624Z [2024-04-15T01:30:05.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:29:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:05.401361301Z [2024-04-15T01:30:05.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:29:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:03.160735+00:00, run_end_date=2024-04-15 01:30:04.389884+00:00, run_duration=1.229149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:00.947809+00:00, queued_by_job_id=1, pid=11623 2024-04-15T01:30:05.401726977Z [2024-04-15T01:30:05.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:29:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:03.273904+00:00, run_end_date=2024-04-15 01:30:04.867743+00:00, run_duration=1.593839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:00.947809+00:00, queued_by_job_id=1, pid=11624 2024-04-15T01:30:06.479904048Z [2024-04-15T01:30:06.479+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:30:06.479940443Z 2024-04-15T01:30:06.480405439Z [2024-04-15T01:30:06.480+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:30:06.482484693Z [2024-04-15T01:30:06.481+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:30:06.482502738Z 2024-04-15T01:30:06.486734108Z [2024-04-15T01:30:06.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:30:06.487141233Z [2024-04-15T01:30:06.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:30:06.555474432Z [2024-04-15T01:30:06.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:06.555699640Z [2024-04-15T01:30:06.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:06.564460948Z [2024-04-15T01:30:06.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1429e6b-7253-43a5-ba8c-4c6a8dca5b5e 2024-04-15T01:30:06.564875131Z [2024-04-15T01:30:06.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:05.404023+00:00, run_end_date=2024-04-15 01:30:05.786221+00:00, run_duration=0.382198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:03.730865+00:00, queued_by_job_id=1, pid=11648 2024-04-15T01:30:08.912283883Z [2024-04-15T01:30:08.911+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:30:08.912308383Z 2024-04-15T01:30:08.912371110Z [2024-04-15T01:30:08.912+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:30:08.912946546Z [2024-04-15T01:30:08.912+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:30:08.912956207Z 2024-04-15T01:30:08.915111276Z [2024-04-15T01:30:08.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:30:08.915194237Z [2024-04-15T01:30:08.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:30:08.962748243Z [2024-04-15T01:30:08.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status queued for try_number 1 2024-04-15T01:30:08.962780171Z [2024-04-15T01:30:08.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:08.970090436Z [2024-04-15T01:30:08.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e2e6393-874d-4335-a3e1-acece1d2f51e 2024-04-15T01:30:08.970155929Z [2024-04-15T01:30:08.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=0, run_start_date=2024-04-15 01:30:08.131070+00:00, run_end_date=2024-04-15 01:30:08.505520+00:00, run_duration=0.37445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:06.483516+00:00, queued_by_job_id=1, pid=11656 2024-04-15T01:30:11.172937499Z [2024-04-15T01:30:11.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:30:11.172999466Z [2024-04-15T01:30:11.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:25:00+00:00, run_id=scheduled__2024-04-15T01:25:00+00:00, run_start_date=2024-04-15 01:30:00.827490+00:00, run_end_date=2024-04-15 01:30:11.172722+00:00, run_duration=10.345232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:25:00+00:00, data_interval_end=2024-04-15 01:30:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:30:11.177842775Z [2024-04-15T01:30:11.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:30:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:30:11.207016816Z [2024-04-15T01:30:11.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:25:00+00:00 exited with status success for try_number 1 2024-04-15T01:30:11.212444200Z [2024-04-15T01:30:11.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:25:00+00:00, map_index=-1, run_start_date=2024-04-15 01:30:10.508538+00:00, run_end_date=2024-04-15 01:30:10.839632+00:00, run_duration=0.331094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:30:08.913405+00:00, queued_by_job_id=1, pid=11664 2024-04-15T01:31:00.833830608Z [2024-04-15T01:31:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:31:00+00:00, run_after=2024-04-15T01:32:00+00:00 2024-04-15T01:31:00.843984564Z [2024-04-15T01:31:00.843+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:31:00.860117605Z [2024-04-15T01:31:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:31:00+00:00, run_after=2024-04-15T01:32:00+00:00 2024-04-15T01:31:00.948300237Z [2024-04-15T01:31:00.947+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:31:00.948346024Z 2024-04-15T01:31:00.948356737Z 2024-04-15T01:31:00.948365431Z 2024-04-15T01:31:00.948445933Z [2024-04-15T01:31:00.948+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:31:00.948894797Z [2024-04-15T01:31:00.948+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:31:00.949119377Z [2024-04-15T01:31:00.948+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:31:00.950325815Z [2024-04-15T01:31:00.949+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:31:00.950344014Z 2024-04-15T01:31:00.950350383Z 2024-04-15T01:31:00.950355804Z 2024-04-15T01:31:00.955572522Z [2024-04-15T01:31:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:31:00.955853601Z [2024-04-15T01:31:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:31:00.956291466Z [2024-04-15T01:31:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:31:00.956573331Z [2024-04-15T01:31:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:31:00.957098379Z [2024-04-15T01:31:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:31:00.957386818Z [2024-04-15T01:31:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:31:01.281666143Z [2024-04-15T01:31:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:31:01.281701028Z [2024-04-15T01:31:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:31:01.281780243Z [2024-04-15T01:31:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:31:01.290234943Z [2024-04-15T01:31:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5ea101e-8899-472b-aa76-609ac19e648c 2024-04-15T01:31:01.290345295Z [2024-04-15T01:31:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to c96b8d6c-1fb2-4644-8682-0be5f80b982b 2024-04-15T01:31:01.290457869Z [2024-04-15T01:31:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 448b61bf-0a6a-4a08-9a40-c3f7fe8690f0 2024-04-15T01:31:02.421766899Z [2024-04-15T01:31:02.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:31:02.421995107Z [2024-04-15T01:31:02.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:31:00.875413+00:00, run_end_date=2024-04-15 01:31:02.421673+00:00, run_duration=1.54626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:31:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:31:02.432380171Z [2024-04-15T01:31:02.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:31:00+00:00, run_after=2024-04-15T01:32:00+00:00 2024-04-15T01:31:02.476351985Z [2024-04-15T01:31:02.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:31:02.482714756Z [2024-04-15T01:31:02.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:31:01.773632+00:00, run_end_date=2024-04-15 01:31:02.173980+00:00, run_duration=0.400348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:31:00.952113+00:00, queued_by_job_id=1, pid=11686 2024-04-15T01:31:04.241473847Z [2024-04-15T01:31:04.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:31:04.241729409Z [2024-04-15T01:31:04.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:31:00.877272+00:00, run_end_date=2024-04-15 01:31:04.241422+00:00, run_duration=3.36415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:31:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:31:04.256625869Z [2024-04-15T01:31:04.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:31:00+00:00, run_after=2024-04-15T01:32:00+00:00 2024-04-15T01:31:04.267832589Z [2024-04-15T01:31:04.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:31:04.271344926Z [2024-04-15T01:31:04.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:31:00.878501+00:00, run_end_date=2024-04-15 01:31:04.270972+00:00, run_duration=3.392471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:31:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:31:04.280612178Z [2024-04-15T01:31:04.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:31:00+00:00, run_after=2024-04-15T01:32:00+00:00 2024-04-15T01:31:04.355023884Z [2024-04-15T01:31:04.350+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:31:04.580446165Z [2024-04-15T01:31:04.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:31:04.580764061Z [2024-04-15T01:31:04.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:31:04.588745227Z [2024-04-15T01:31:04.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:31:02.793243+00:00, run_end_date=2024-04-15 01:31:04.187357+00:00, run_duration=1.394114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:31:00.952113+00:00, queued_by_job_id=1, pid=11705 2024-04-15T01:31:04.589105846Z [2024-04-15T01:31:04.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:31:02.574078+00:00, run_end_date=2024-04-15 01:31:04.201616+00:00, run_duration=1.627538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:31:00.952113+00:00, queued_by_job_id=1, pid=11699 2024-04-15T01:32:00.077899704Z [2024-04-15T01:32:00.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:32:00.092512983Z [2024-04-15T01:32:00.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:00.105168384Z [2024-04-15T01:32:00.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:00.113184943Z [2024-04-15T01:32:00.112+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:32:00.233837459Z [2024-04-15T01:32:00.233+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:32:00.233868632Z 2024-04-15T01:32:00.233875254Z 2024-04-15T01:32:00.233880461Z 2024-04-15T01:32:00.233885390Z 2024-04-15T01:32:00.234186527Z [2024-04-15T01:32:00.233+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:32:00.234289831Z [2024-04-15T01:32:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:32:00.234454175Z [2024-04-15T01:32:00.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:32:00.234479767Z [2024-04-15T01:32:00.234+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:32:00.235540476Z [2024-04-15T01:32:00.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:32:00.235557540Z 2024-04-15T01:32:00.235563741Z 2024-04-15T01:32:00.235569046Z 2024-04-15T01:32:00.235574662Z 2024-04-15T01:32:00.240885110Z [2024-04-15T01:32:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:00.240918490Z [2024-04-15T01:32:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:32:00.241154110Z [2024-04-15T01:32:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:00.241206478Z [2024-04-15T01:32:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:32:00.241392280Z [2024-04-15T01:32:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:00.241430451Z [2024-04-15T01:32:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:32:00.241624938Z [2024-04-15T01:32:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:32:00.241807503Z [2024-04-15T01:32:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:32:00.817810407Z [2024-04-15T01:32:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:00.817938287Z [2024-04-15T01:32:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:00.818059999Z [2024-04-15T01:32:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:00.818156158Z [2024-04-15T01:32:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status queued for try_number 1 2024-04-15T01:32:00.852081711Z [2024-04-15T01:32:00.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4f8b107-3f80-4a62-bd60-f5eda1355812 2024-04-15T01:32:00.852301370Z [2024-04-15T01:32:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a717220-1ad8-4982-9e7e-5f83a3eb4039 2024-04-15T01:32:00.852463908Z [2024-04-15T01:32:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9f1f399-0ad3-45d6-b245-1548b321d0d7 2024-04-15T01:32:00.852618936Z [2024-04-15T01:32:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to e44ad8f4-aab1-4c06-a07f-0d2442ded4ea 2024-04-15T01:32:02.262549609Z [2024-04-15T01:32:02.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:02.263354208Z [2024-04-15T01:32:02.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:32:00.126337+00:00, run_end_date=2024-04-15 01:32:02.262929+00:00, run_duration=2.136592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:32:02.277933398Z [2024-04-15T01:32:02.277+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:32:02.291494446Z [2024-04-15T01:32:02.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:02.291823555Z [2024-04-15T01:32:02.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:31:00+00:00, run_id=scheduled__2024-04-15T01:31:00+00:00, run_start_date=2024-04-15 01:32:00.128264+00:00, run_end_date=2024-04-15 01:32:02.291471+00:00, run_duration=2.163207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:31:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:32:02.302689342Z [2024-04-15T01:32:02.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:02.374143822Z [2024-04-15T01:32:02.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:02.375951258Z [2024-04-15T01:32:02.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:02.391919889Z [2024-04-15T01:32:02.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:01.279579+00:00, run_end_date=2024-04-15 01:32:01.655042+00:00, run_duration=0.375463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:00.236877+00:00, queued_by_job_id=1, pid=11740 2024-04-15T01:32:02.392178162Z [2024-04-15T01:32:02.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:31:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:01.271158+00:00, run_end_date=2024-04-15 01:32:01.783443+00:00, run_duration=0.512285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:00.236877+00:00, queued_by_job_id=1, pid=11739 2024-04-15T01:32:04.553290035Z [2024-04-15T01:32:04.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:04.553780854Z [2024-04-15T01:32:04.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:31:00+00:00, run_id=scheduled__2024-04-15T01:31:00+00:00, run_start_date=2024-04-15 01:32:00.129946+00:00, run_end_date=2024-04-15 01:32:04.553466+00:00, run_duration=4.42352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:31:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:32:04.563377921Z [2024-04-15T01:32:04.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:04.577979115Z [2024-04-15T01:32:04.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:32:04.578210931Z [2024-04-15T01:32:04.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:31:00+00:00, run_id=scheduled__2024-04-15T01:31:00+00:00, run_start_date=2024-04-15 01:32:00.131145+00:00, run_end_date=2024-04-15 01:32:04.577939+00:00, run_duration=4.446794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:31:00+00:00, data_interval_end=2024-04-15 01:32:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:32:04.586845187Z [2024-04-15T01:32:04.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:32:00+00:00, run_after=2024-04-15T01:33:00+00:00 2024-04-15T01:32:04.625747868Z [2024-04-15T01:32:04.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:04.625993073Z [2024-04-15T01:32:04.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:31:00+00:00 exited with status success for try_number 1 2024-04-15T01:32:04.637358089Z [2024-04-15T01:32:04.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:31:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:02.420848+00:00, run_end_date=2024-04-15 01:32:03.870021+00:00, run_duration=1.449173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:00.236877+00:00, queued_by_job_id=1, pid=11763 2024-04-15T01:32:04.637863459Z [2024-04-15T01:32:04.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:31:00+00:00, map_index=-1, run_start_date=2024-04-15 01:32:02.521451+00:00, run_end_date=2024-04-15 01:32:04.246518+00:00, run_duration=1.725067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:32:00.236877+00:00, queued_by_job_id=1, pid=11764 2024-04-15T01:33:00.961963753Z [2024-04-15T01:33:00.961+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:33:00.973594540Z [2024-04-15T01:33:00.973+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:00.985111823Z [2024-04-15T01:33:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:01.044165635Z [2024-04-15T01:33:01.043+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:33:01.044185274Z 2024-04-15T01:33:01.044188623Z 2024-04-15T01:33:01.044191672Z 2024-04-15T01:33:01.044550048Z [2024-04-15T01:33:01.044+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:33:01.044896712Z [2024-04-15T01:33:01.044+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:33:01.045233915Z [2024-04-15T01:33:01.044+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:33:01.046694449Z [2024-04-15T01:33:01.046+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:33:01.046701381Z 2024-04-15T01:33:01.046704180Z 2024-04-15T01:33:01.046707152Z 2024-04-15T01:33:01.051486145Z [2024-04-15T01:33:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:01.051821432Z [2024-04-15T01:33:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:33:01.052324403Z [2024-04-15T01:33:01.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:01.052629953Z [2024-04-15T01:33:01.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:33:01.053058374Z [2024-04-15T01:33:01.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:33:01.053385275Z [2024-04-15T01:33:01.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:33:01.279708233Z [2024-04-15T01:33:01.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:01.279841618Z [2024-04-15T01:33:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:01.279962608Z [2024-04-15T01:33:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:33:01.287391995Z [2024-04-15T01:33:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9868ccae-df3d-4161-a904-32ea79f6b1cd 2024-04-15T01:33:01.288155292Z [2024-04-15T01:33:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89f21301-9782-4897-9410-673a5e770eeb 2024-04-15T01:33:01.288327284Z [2024-04-15T01:33:01.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95f87f24-6081-4ef7-aec7-8839be07dc8c 2024-04-15T01:33:02.915046631Z [2024-04-15T01:33:02.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:02.915220197Z [2024-04-15T01:33:02.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:33:00.993582+00:00, run_end_date=2024-04-15 01:33:02.914960+00:00, run_duration=1.921378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:33:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:33:02.923997106Z [2024-04-15T01:33:02.923+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:02.961014403Z [2024-04-15T01:33:02.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:02.968183732Z [2024-04-15T01:33:02.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:01.824294+00:00, run_end_date=2024-04-15 01:33:02.190452+00:00, run_duration=0.366158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:01.048297+00:00, queued_by_job_id=1, pid=11796 2024-04-15T01:33:05.153293523Z [2024-04-15T01:33:05.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:05.153768389Z [2024-04-15T01:33:05.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:33:00.995369+00:00, run_end_date=2024-04-15 01:33:05.153190+00:00, run_duration=4.157821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:33:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:33:05.164652631Z [2024-04-15T01:33:05.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:05.206911044Z [2024-04-15T01:33:05.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:05.212974362Z [2024-04-15T01:33:05.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:02.687631+00:00, run_end_date=2024-04-15 01:33:04.120573+00:00, run_duration=1.432942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:01.048297+00:00, queued_by_job_id=1, pid=11815 2024-04-15T01:33:06.531286518Z [2024-04-15T01:33:06.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:33:06.531620155Z [2024-04-15T01:33:06.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:33:00.996238+00:00, run_end_date=2024-04-15 01:33:06.531135+00:00, run_duration=5.534897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:33:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:33:06.539322767Z [2024-04-15T01:33:06.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:33:00+00:00, run_after=2024-04-15T01:34:00+00:00 2024-04-15T01:33:06.583629718Z [2024-04-15T01:33:06.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:33:06.591709561Z [2024-04-15T01:33:06.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:33:02.631634+00:00, run_end_date=2024-04-15 01:33:05.367819+00:00, run_duration=2.736185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:33:01.048297+00:00, queued_by_job_id=1, pid=11814 2024-04-15T01:34:00.904028105Z [2024-04-15T01:34:00.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:00.915198032Z [2024-04-15T01:34:00.914+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:34:00.931322318Z [2024-04-15T01:34:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:00.946158729Z [2024-04-15T01:34:00.945+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:34:01.065179228Z [2024-04-15T01:34:01.064+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:34:01.065203144Z 2024-04-15T01:34:01.065207723Z 2024-04-15T01:34:01.065210876Z 2024-04-15T01:34:01.065213975Z 2024-04-15T01:34:01.065593112Z [2024-04-15T01:34:01.065+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:34:01.065934831Z [2024-04-15T01:34:01.065+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:34:01.066260222Z [2024-04-15T01:34:01.066+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:34:01.066555906Z [2024-04-15T01:34:01.066+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:34:01.067656301Z [2024-04-15T01:34:01.067+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:34:01.067675352Z 2024-04-15T01:34:01.067681710Z 2024-04-15T01:34:01.067687062Z 2024-04-15T01:34:01.067693103Z 2024-04-15T01:34:01.072936572Z [2024-04-15T01:34:01.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:01.073273040Z [2024-04-15T01:34:01.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:34:01.073808426Z [2024-04-15T01:34:01.073+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:01.074229602Z [2024-04-15T01:34:01.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:34:01.074746792Z [2024-04-15T01:34:01.074+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:01.075123163Z [2024-04-15T01:34:01.074+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:34:01.075670270Z [2024-04-15T01:34:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:34:01.076051564Z [2024-04-15T01:34:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:34:01.509693161Z [2024-04-15T01:34:01.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.509846649Z [2024-04-15T01:34:01.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.510056987Z [2024-04-15T01:34:01.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.510206983Z [2024-04-15T01:34:01.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status queued for try_number 1 2024-04-15T01:34:01.541023559Z [2024-04-15T01:34:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to abfbe55b-0795-487a-aee1-8a867f598642 2024-04-15T01:34:01.542197250Z [2024-04-15T01:34:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06ce2971-8062-4b44-ab2e-110277e14d12 2024-04-15T01:34:01.542432243Z [2024-04-15T01:34:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceb12b40-e7f8-48ec-b8d7-c9ea911af296 2024-04-15T01:34:01.542629600Z [2024-04-15T01:34:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e17465-78f5-4238-b6e4-554e38ddee78 2024-04-15T01:34:02.733829061Z [2024-04-15T01:34:02.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:34:02.735702035Z [2024-04-15T01:34:02.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:32:00+00:00, run_id=scheduled__2024-04-15T01:32:00+00:00, run_start_date=2024-04-15 01:34:00.961246+00:00, run_end_date=2024-04-15 01:34:02.734833+00:00, run_duration=1.773587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:32:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:34:02.751381700Z [2024-04-15T01:34:02.750+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:34:02.760060825Z [2024-04-15T01:34:02.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:34:02.760399231Z [2024-04-15T01:34:02.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:33:00+00:00, run_id=scheduled__2024-04-15T01:33:00+00:00, run_start_date=2024-04-15 01:34:00.962661+00:00, run_end_date=2024-04-15 01:34:02.759978+00:00, run_duration=1.797317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:33:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:34:02.770568241Z [2024-04-15T01:34:02.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:02.812727098Z [2024-04-15T01:34:02.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:32:00+00:00 exited with status success for try_number 1 2024-04-15T01:34:02.812970178Z [2024-04-15T01:34:02.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status success for try_number 1 2024-04-15T01:34:02.819580234Z [2024-04-15T01:34:02.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:32:00+00:00, map_index=-1, run_start_date=2024-04-15 01:34:01.906482+00:00, run_end_date=2024-04-15 01:34:02.368569+00:00, run_duration=0.462087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:01.069119+00:00, queued_by_job_id=1, pid=11847 2024-04-15T01:34:02.819849284Z [2024-04-15T01:34:02.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=2024-04-15 01:34:02.013165+00:00, run_end_date=2024-04-15 01:34:02.444047+00:00, run_duration=0.430882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:01.069119+00:00, queued_by_job_id=1, pid=11848 2024-04-15T01:34:05.924884996Z [2024-04-15T01:34:05.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:34:05.925145005Z [2024-04-15T01:34:05.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:33:00+00:00, run_id=scheduled__2024-04-15T01:33:00+00:00, run_start_date=2024-04-15 01:34:00.963699+00:00, run_end_date=2024-04-15 01:34:05.924701+00:00, run_duration=4.961002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:33:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:34:05.939023636Z [2024-04-15T01:34:05.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:05.947633818Z [2024-04-15T01:34:05.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:34:05.947758177Z [2024-04-15T01:34:05.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:33:00+00:00, run_id=scheduled__2024-04-15T01:33:00+00:00, run_start_date=2024-04-15 01:34:00.964663+00:00, run_end_date=2024-04-15 01:34:05.947463+00:00, run_duration=4.9828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:33:00+00:00, data_interval_end=2024-04-15 01:34:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:34:05.960678087Z [2024-04-15T01:34:05.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:34:00+00:00, run_after=2024-04-15T01:35:00+00:00 2024-04-15T01:34:06.009569300Z [2024-04-15T01:34:06.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status success for try_number 1 2024-04-15T01:34:06.009609744Z [2024-04-15T01:34:06.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:33:00+00:00 exited with status success for try_number 1 2024-04-15T01:34:06.019266550Z [2024-04-15T01:34:06.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=2024-04-15 01:34:03.376758+00:00, run_end_date=2024-04-15 01:34:04.919813+00:00, run_duration=1.543055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:01.069119+00:00, queued_by_job_id=1, pid=11872 2024-04-15T01:34:06.019334527Z [2024-04-15T01:34:06.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:33:00+00:00, map_index=-1, run_start_date=2024-04-15 01:34:03.065486+00:00, run_end_date=2024-04-15 01:34:05.582008+00:00, run_duration=2.516522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:34:01.069119+00:00, queued_by_job_id=1, pid=11866 2024-04-15T01:35:00.824360999Z [2024-04-15T01:35:00.823+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:35:00.844515120Z [2024-04-15T01:35:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:35:00.860100352Z [2024-04-15T01:35:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:00.873599824Z [2024-04-15T01:35:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:00.968958585Z [2024-04-15T01:35:00.968+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:35:00.968992508Z 2024-04-15T01:35:00.968998389Z 2024-04-15T01:35:00.969003007Z 2024-04-15T01:35:00.969007430Z 2024-04-15T01:35:00.969338599Z [2024-04-15T01:35:00.969+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:35:00.969672811Z [2024-04-15T01:35:00.969+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:35:00.969995882Z [2024-04-15T01:35:00.969+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:35:00.970310775Z [2024-04-15T01:35:00.970+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:35:00.971333624Z [2024-04-15T01:35:00.971+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:00.971362388Z 2024-04-15T01:35:00.971375938Z 2024-04-15T01:35:00.971387662Z 2024-04-15T01:35:00.971399147Z 2024-04-15T01:35:00.976440095Z [2024-04-15T01:35:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:35:00.976735780Z [2024-04-15T01:35:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:00.977138468Z [2024-04-15T01:35:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:35:00.977421957Z [2024-04-15T01:35:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:35:00.977822391Z [2024-04-15T01:35:00.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:35:00.978078136Z [2024-04-15T01:35:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:35:00.978441047Z [2024-04-15T01:35:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:35:00.978670186Z [2024-04-15T01:35:00.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:35:01.361069080Z [2024-04-15T01:35:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:01.363296610Z [2024-04-15T01:35:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:01.363444247Z [2024-04-15T01:35:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:01.363597374Z [2024-04-15T01:35:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:01.376155476Z [2024-04-15T01:35:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 809fe3df-d0a8-4ca2-be66-1cb746bd98da 2024-04-15T01:35:01.376439680Z [2024-04-15T01:35:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77b5740d-9ff5-4ed2-9bdf-d36a17d1c270 2024-04-15T01:35:01.376702481Z [2024-04-15T01:35:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecc8e366-f8d6-423a-ae45-e2726013bfd0 2024-04-15T01:35:01.376909809Z [2024-04-15T01:35:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d993aea-2c41-4cff-a1f2-eea0112a7952 2024-04-15T01:35:02.663253767Z [2024-04-15T01:35:02.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:35:02.663717403Z [2024-04-15T01:35:02.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:34:00+00:00, run_id=scheduled__2024-04-15T01:34:00+00:00, run_start_date=2024-04-15 01:35:00.887462+00:00, run_end_date=2024-04-15 01:35:02.663335+00:00, run_duration=1.775873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:34:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:35:02.690694843Z [2024-04-15T01:35:02.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:02.788004769Z [2024-04-15T01:35:02.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:02.793677901Z [2024-04-15T01:35:02.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:34:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:01.779887+00:00, run_end_date=2024-04-15 01:35:02.108246+00:00, run_duration=0.328359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:00.972525+00:00, queued_by_job_id=1, pid=11905 2024-04-15T01:35:03.801116150Z [2024-04-15T01:35:03.800+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:35:03.801145434Z 2024-04-15T01:35:03.801542933Z [2024-04-15T01:35:03.801+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:35:03.803017595Z [2024-04-15T01:35:03.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:03.803026721Z 2024-04-15T01:35:03.809839856Z [2024-04-15T01:35:03.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:35:03.810268251Z [2024-04-15T01:35:03.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:03.886474314Z [2024-04-15T01:35:03.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:03.886591057Z [2024-04-15T01:35:03.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:03.893459562Z [2024-04-15T01:35:03.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82d024d2-4fa0-48f7-9835-b340e124c08a 2024-04-15T01:35:03.893679048Z [2024-04-15T01:35:03.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:03.007903+00:00, run_end_date=2024-04-15 01:35:03.416174+00:00, run_duration=0.408271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:00.972525+00:00, queued_by_job_id=1, pid=11931 2024-04-15T01:35:05.072290657Z [2024-04-15T01:35:05.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:35:05.072769139Z [2024-04-15T01:35:05.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:34:00+00:00, run_id=scheduled__2024-04-15T01:34:00+00:00, run_start_date=2024-04-15 01:35:00.888527+00:00, run_end_date=2024-04-15 01:35:05.072176+00:00, run_duration=4.183649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:34:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:35:05.083354171Z [2024-04-15T01:35:05.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:05.090656231Z [2024-04-15T01:35:05.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:35:05.091056648Z [2024-04-15T01:35:05.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:34:00+00:00, run_id=scheduled__2024-04-15T01:34:00+00:00, run_start_date=2024-04-15 01:35:00.889586+00:00, run_end_date=2024-04-15 01:35:05.090586+00:00, run_duration=4.201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:34:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:35:05.099663382Z [2024-04-15T01:35:05.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:36:00+00:00 2024-04-15T01:35:05.158101775Z [2024-04-15T01:35:05.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:05.158600270Z [2024-04-15T01:35:05.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:05.169088447Z [2024-04-15T01:35:05.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:34:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:02.798864+00:00, run_end_date=2024-04-15 01:35:04.143467+00:00, run_duration=1.344603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:00.972525+00:00, queued_by_job_id=1, pid=11929 2024-04-15T01:35:05.169540926Z [2024-04-15T01:35:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:34:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:02.815125+00:00, run_end_date=2024-04-15 01:35:04.516387+00:00, run_duration=1.701262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:00.972525+00:00, queued_by_job_id=1, pid=11930 2024-04-15T01:35:06.248365390Z [2024-04-15T01:35:06.247+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:35:06.248654064Z 2024-04-15T01:35:06.248712461Z [2024-04-15T01:35:06.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:35:06.249471352Z [2024-04-15T01:35:06.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:06.249494240Z 2024-04-15T01:35:06.252198252Z [2024-04-15T01:35:06.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:35:06.252422816Z [2024-04-15T01:35:06.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:35:06.312160680Z [2024-04-15T01:35:06.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:06.312436399Z [2024-04-15T01:35:06.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:06.321155785Z [2024-04-15T01:35:06.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7f41874-ea68-469e-ab54-21a255c57d0f 2024-04-15T01:35:06.321473706Z [2024-04-15T01:35:06.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:05.561715+00:00, run_end_date=2024-04-15 01:35:05.960854+00:00, run_duration=0.399139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:03.803915+00:00, queued_by_job_id=1, pid=11954 2024-04-15T01:35:08.649721378Z [2024-04-15T01:35:08.649+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:35:08.649769201Z 2024-04-15T01:35:08.650046298Z [2024-04-15T01:35:08.649+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:35:08.651396315Z [2024-04-15T01:35:08.650+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:35:08.651416833Z 2024-04-15T01:35:08.655700353Z [2024-04-15T01:35:08.655+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:35:08.656009589Z [2024-04-15T01:35:08.655+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:08.734691004Z [2024-04-15T01:35:08.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status queued for try_number 1 2024-04-15T01:35:08.735146704Z [2024-04-15T01:35:08.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:08.743194487Z [2024-04-15T01:35:08.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to d00b46b5-4f35-4dd8-bd01-931594495da0 2024-04-15T01:35:08.743339492Z [2024-04-15T01:35:08.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=0, run_start_date=2024-04-15 01:35:07.823314+00:00, run_end_date=2024-04-15 01:35:08.193640+00:00, run_duration=0.370326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:06.250054+00:00, queued_by_job_id=1, pid=11962 2024-04-15T01:35:10.648244094Z [2024-04-15T01:35:10.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:35:10.648340951Z [2024-04-15T01:35:10.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:30:00+00:00, run_id=scheduled__2024-04-15T01:30:00+00:00, run_start_date=2024-04-15 01:35:00.886044+00:00, run_end_date=2024-04-15 01:35:10.648115+00:00, run_duration=9.762071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:30:00+00:00, data_interval_end=2024-04-15 01:35:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:35:10.654749854Z [2024-04-15T01:35:10.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:35:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:35:10.682257092Z [2024-04-15T01:35:10.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:30:00+00:00 exited with status success for try_number 1 2024-04-15T01:35:10.687168190Z [2024-04-15T01:35:10.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:30:00+00:00, map_index=-1, run_start_date=2024-04-15 01:35:10.154734+00:00, run_end_date=2024-04-15 01:35:10.524747+00:00, run_duration=0.370013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:35:08.652172+00:00, queued_by_job_id=1, pid=11970 2024-04-15T01:36:00.949417142Z [2024-04-15T01:36:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:00.967329046Z [2024-04-15T01:36:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:00.978072665Z [2024-04-15T01:36:00.977+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:36:00.990324428Z [2024-04-15T01:36:00.989+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:36:01.108306090Z [2024-04-15T01:36:01.107+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:36:01.108331146Z 2024-04-15T01:36:01.108337307Z 2024-04-15T01:36:01.108342457Z 2024-04-15T01:36:01.108347412Z 2024-04-15T01:36:01.108771945Z [2024-04-15T01:36:01.108+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:36:01.108899412Z [2024-04-15T01:36:01.108+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:36:01.109065857Z [2024-04-15T01:36:01.108+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:36:01.109550671Z [2024-04-15T01:36:01.109+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:36:01.110741429Z [2024-04-15T01:36:01.110+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:36:01.110770248Z 2024-04-15T01:36:01.110775410Z 2024-04-15T01:36:01.110779975Z 2024-04-15T01:36:01.110784171Z 2024-04-15T01:36:01.115469400Z [2024-04-15T01:36:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:01.115740566Z [2024-04-15T01:36:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:36:01.116212797Z [2024-04-15T01:36:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:01.116485282Z [2024-04-15T01:36:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:36:01.116824892Z [2024-04-15T01:36:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:01.116992233Z [2024-04-15T01:36:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:36:01.117246452Z [2024-04-15T01:36:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:36:01.117412297Z [2024-04-15T01:36:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:36:01.632555572Z [2024-04-15T01:36:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:01.632585044Z [2024-04-15T01:36:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:01.632657278Z [2024-04-15T01:36:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:01.632707018Z [2024-04-15T01:36:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:36:01.649300010Z [2024-04-15T01:36:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ef756bd-8cdb-4819-b4c6-c20bf81b71ad 2024-04-15T01:36:01.649355357Z [2024-04-15T01:36:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00757c3a-d7f9-425b-bf17-438000b51620 2024-04-15T01:36:01.649474210Z [2024-04-15T01:36:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5846ffdb-27b4-4434-b699-45bca54aaef0 2024-04-15T01:36:01.649553638Z [2024-04-15T01:36:01.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e1078ad-a4f2-406b-8bb3-f32775d789fd 2024-04-15T01:36:02.784076520Z [2024-04-15T01:36:02.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:02.784594910Z [2024-04-15T01:36:02.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:34:00+00:00, run_id=scheduled__2024-04-15T01:34:00+00:00, run_start_date=2024-04-15 01:36:01.009611+00:00, run_end_date=2024-04-15 01:36:02.784098+00:00, run_duration=1.774487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:34:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:36:02.796747270Z [2024-04-15T01:36:02.796+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:36:02.806924811Z [2024-04-15T01:36:02.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:02.807617631Z [2024-04-15T01:36:02.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:36:01.011070+00:00, run_end_date=2024-04-15 01:36:02.807250+00:00, run_duration=1.79618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:36:02.820651043Z [2024-04-15T01:36:02.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:02.924297204Z [2024-04-15T01:36:02.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:34:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:02.924332168Z [2024-04-15T01:36:02.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:02.937915111Z [2024-04-15T01:36:02.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:34:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:01.925749+00:00, run_end_date=2024-04-15 01:36:02.262312+00:00, run_duration=0.336563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:01.112214+00:00, queued_by_job_id=1, pid=11992 2024-04-15T01:36:02.938145435Z [2024-04-15T01:36:02.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:02.061368+00:00, run_end_date=2024-04-15 01:36:02.441216+00:00, run_duration=0.379848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:01.112214+00:00, queued_by_job_id=1, pid=11993 2024-04-15T01:36:04.491098847Z [2024-04-15T01:36:04.490+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:36:04.939320682Z [2024-04-15T01:36:04.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:04.939765213Z [2024-04-15T01:36:04.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:36:01.012180+00:00, run_end_date=2024-04-15 01:36:04.939154+00:00, run_duration=3.926974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:36:04.949205037Z [2024-04-15T01:36:04.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:05.000630185Z [2024-04-15T01:36:05.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:05.008148509Z [2024-04-15T01:36:05.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:02.978358+00:00, run_end_date=2024-04-15 01:36:04.463318+00:00, run_duration=1.48496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:01.112214+00:00, queued_by_job_id=1, pid=12016 2024-04-15T01:36:06.078577003Z [2024-04-15T01:36:06.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:36:06.078853373Z [2024-04-15T01:36:06.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:36:01.013214+00:00, run_end_date=2024-04-15 01:36:06.078404+00:00, run_duration=5.06519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:36:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:36:06.087585604Z [2024-04-15T01:36:06.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:36:00+00:00, run_after=2024-04-15T01:37:00+00:00 2024-04-15T01:36:06.119158787Z [2024-04-15T01:36:06.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:36:06.126519051Z [2024-04-15T01:36:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:36:03.078789+00:00, run_end_date=2024-04-15 01:36:05.164655+00:00, run_duration=2.085866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:36:01.112214+00:00, queued_by_job_id=1, pid=12017 2024-04-15T01:37:00.355536906Z [2024-04-15T01:37:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:00.363159346Z [2024-04-15T01:37:00.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:00.372095797Z [2024-04-15T01:37:00.371+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:37:00.497431669Z [2024-04-15T01:37:00.497+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:37:00.497479253Z 2024-04-15T01:37:00.497483942Z 2024-04-15T01:37:00.497487198Z 2024-04-15T01:37:00.497872065Z [2024-04-15T01:37:00.497+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:37:00.498143286Z [2024-04-15T01:37:00.497+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:37:00.498445605Z [2024-04-15T01:37:00.498+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:37:00.499496099Z [2024-04-15T01:37:00.499+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:37:00.499505095Z 2024-04-15T01:37:00.499521333Z 2024-04-15T01:37:00.499524495Z 2024-04-15T01:37:00.503580322Z [2024-04-15T01:37:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:37:00.504033026Z [2024-04-15T01:37:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:37:00.504530304Z [2024-04-15T01:37:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:37:00.504765721Z [2024-04-15T01:37:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:37:00.505088196Z [2024-04-15T01:37:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:37:00.505299349Z [2024-04-15T01:37:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:37:00.709838044Z [2024-04-15T01:37:00.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:37:00.709863275Z [2024-04-15T01:37:00.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:37:00.709960262Z [2024-04-15T01:37:00.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:37:00.718666453Z [2024-04-15T01:37:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 007b844a-46fe-4cec-9f07-ef38f39532cd 2024-04-15T01:37:00.718766122Z [2024-04-15T01:37:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to f97affe6-04ae-455c-bb1a-668ac1bb800d 2024-04-15T01:37:00.718862797Z [2024-04-15T01:37:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 910b2250-b205-413b-8951-e4659acf6f91 2024-04-15T01:37:01.989745758Z [2024-04-15T01:37:01.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:37:01.989890005Z [2024-04-15T01:37:01.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:37:00.391207+00:00, run_end_date=2024-04-15 01:37:01.989643+00:00, run_duration=1.598436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:37:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:37:01.997554417Z [2024-04-15T01:37:01.997+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:02.043020978Z [2024-04-15T01:37:02.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:37:02.047016720Z [2024-04-15T01:37:02.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:37:01.325138+00:00, run_end_date=2024-04-15 01:37:01.831881+00:00, run_duration=0.506743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:37:00.500520+00:00, queued_by_job_id=1, pid=12049 2024-04-15T01:37:04.203511881Z [2024-04-15T01:37:04.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:37:04.203891863Z [2024-04-15T01:37:04.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:37:00.394602+00:00, run_end_date=2024-04-15 01:37:04.203487+00:00, run_duration=3.808885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:37:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:37:04.212088086Z [2024-04-15T01:37:04.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:04.254036559Z [2024-04-15T01:37:04.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:37:04.260899281Z [2024-04-15T01:37:04.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:37:02.432543+00:00, run_end_date=2024-04-15 01:37:03.748837+00:00, run_duration=1.316294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:37:00.500520+00:00, queued_by_job_id=1, pid=12067 2024-04-15T01:37:05.313499525Z [2024-04-15T01:37:05.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:37:05.313997938Z [2024-04-15T01:37:05.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:37:00.397434+00:00, run_end_date=2024-04-15 01:37:05.313405+00:00, run_duration=4.915971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:37:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:37:05.325158051Z [2024-04-15T01:37:05.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:37:00+00:00, run_after=2024-04-15T01:38:00+00:00 2024-04-15T01:37:05.356157374Z [2024-04-15T01:37:05.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:37:05.361490137Z [2024-04-15T01:37:05.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:37:02.628690+00:00, run_end_date=2024-04-15 01:37:05.157436+00:00, run_duration=2.528746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:37:00.500520+00:00, queued_by_job_id=1, pid=12068 2024-04-15T01:38:00.707907406Z [2024-04-15T01:38:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:00.715218374Z [2024-04-15T01:38:00.714+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:38:00.726157456Z [2024-04-15T01:38:00.725+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:00.733181987Z [2024-04-15T01:38:00.732+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:38:00.847906805Z [2024-04-15T01:38:00.847+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:38:00.847939467Z 2024-04-15T01:38:00.847949952Z 2024-04-15T01:38:00.847956416Z 2024-04-15T01:38:00.847962196Z 2024-04-15T01:38:00.848365331Z [2024-04-15T01:38:00.848+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:38:00.848774657Z [2024-04-15T01:38:00.848+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:38:00.849123802Z [2024-04-15T01:38:00.848+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:38:00.849549192Z [2024-04-15T01:38:00.849+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:38:00.850238709Z [2024-04-15T01:38:00.850+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:38:00.850254510Z 2024-04-15T01:38:00.850259770Z 2024-04-15T01:38:00.850264043Z 2024-04-15T01:38:00.850268071Z 2024-04-15T01:38:00.855441183Z [2024-04-15T01:38:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.855767732Z [2024-04-15T01:38:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:38:00.856165693Z [2024-04-15T01:38:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.856425187Z [2024-04-15T01:38:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:38:00.856845578Z [2024-04-15T01:38:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.857043679Z [2024-04-15T01:38:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:38:00.857413649Z [2024-04-15T01:38:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:38:00.857677580Z [2024-04-15T01:38:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:38:01.360908015Z [2024-04-15T01:38:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:01.361010285Z [2024-04-15T01:38:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:01.361131906Z [2024-04-15T01:38:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:01.361183084Z [2024-04-15T01:38:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status queued for try_number 1 2024-04-15T01:38:01.375220133Z [2024-04-15T01:38:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to d95caf0c-7bc8-4e15-9a8b-5bd44d2ba903 2024-04-15T01:38:01.375245126Z [2024-04-15T01:38:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6206508-4163-4473-ab49-5ac875481023 2024-04-15T01:38:01.375373849Z [2024-04-15T01:38:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 198c0cae-9493-44c2-b582-27dda8cc06c7 2024-04-15T01:38:01.375466990Z [2024-04-15T01:38:01.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8195e61-f468-4ef1-a623-96bf07c99a46 2024-04-15T01:38:02.977027918Z [2024-04-15T01:38:02.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:02.977485600Z [2024-04-15T01:38:02.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:36:00+00:00, run_id=scheduled__2024-04-15T01:36:00+00:00, run_start_date=2024-04-15 01:38:00.744062+00:00, run_end_date=2024-04-15 01:38:02.976989+00:00, run_duration=2.232927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:36:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:38:02.987133727Z [2024-04-15T01:38:02.986+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:38:02.993795920Z [2024-04-15T01:38:02.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:02.994684717Z [2024-04-15T01:38:02.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:37:00+00:00, run_id=scheduled__2024-04-15T01:37:00+00:00, run_start_date=2024-04-15 01:38:00.745193+00:00, run_end_date=2024-04-15 01:38:02.994375+00:00, run_duration=2.249182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:37:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:38:03.004518721Z [2024-04-15T01:38:03.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:03.081215667Z [2024-04-15T01:38:03.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:36:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:03.081327669Z [2024-04-15T01:38:03.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:03.091022697Z [2024-04-15T01:38:03.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:37:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:01.650809+00:00, run_end_date=2024-04-15 01:38:02.001386+00:00, run_duration=0.350577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.851496+00:00, queued_by_job_id=1, pid=12102 2024-04-15T01:38:03.091147559Z [2024-04-15T01:38:03.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:36:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:01.635928+00:00, run_end_date=2024-04-15 01:38:01.918084+00:00, run_duration=0.282156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.851496+00:00, queued_by_job_id=1, pid=12101 2024-04-15T01:38:05.223213976Z [2024-04-15T01:38:05.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:05.223412350Z [2024-04-15T01:38:05.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:37:00+00:00, run_id=scheduled__2024-04-15T01:37:00+00:00, run_start_date=2024-04-15 01:38:00.746257+00:00, run_end_date=2024-04-15 01:38:05.223127+00:00, run_duration=4.47687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:37:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:38:05.230721024Z [2024-04-15T01:38:05.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:05.236619359Z [2024-04-15T01:38:05.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:38:05.236844235Z [2024-04-15T01:38:05.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:37:00+00:00, run_id=scheduled__2024-04-15T01:37:00+00:00, run_start_date=2024-04-15 01:38:00.747604+00:00, run_end_date=2024-04-15 01:38:05.236533+00:00, run_duration=4.488929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:37:00+00:00, data_interval_end=2024-04-15 01:38:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:38:05.244622570Z [2024-04-15T01:38:05.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:38:00+00:00, run_after=2024-04-15T01:39:00+00:00 2024-04-15T01:38:05.280514006Z [2024-04-15T01:38:05.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:05.280586519Z [2024-04-15T01:38:05.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:37:00+00:00 exited with status success for try_number 1 2024-04-15T01:38:05.286387872Z [2024-04-15T01:38:05.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:37:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:02.549830+00:00, run_end_date=2024-04-15 01:38:05.027883+00:00, run_duration=2.478053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.851496+00:00, queued_by_job_id=1, pid=12125 2024-04-15T01:38:05.286617641Z [2024-04-15T01:38:05.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:37:00+00:00, map_index=-1, run_start_date=2024-04-15 01:38:02.644773+00:00, run_end_date=2024-04-15 01:38:04.244052+00:00, run_duration=1.599279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:38:00.851496+00:00, queued_by_job_id=1, pid=12126 2024-04-15T01:39:00.082324187Z [2024-04-15T01:39:00.081+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:00.089317394Z [2024-04-15T01:39:00.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:39:00.098607343Z [2024-04-15T01:39:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:00.155969210Z [2024-04-15T01:39:00.155+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:39:00.156005296Z 2024-04-15T01:39:00.156013399Z 2024-04-15T01:39:00.156020771Z 2024-04-15T01:39:00.156452714Z [2024-04-15T01:39:00.155+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:39:00.156818261Z [2024-04-15T01:39:00.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:39:00.157174537Z [2024-04-15T01:39:00.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:39:00.158757458Z [2024-04-15T01:39:00.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:39:00.158778276Z 2024-04-15T01:39:00.158787932Z 2024-04-15T01:39:00.158796525Z 2024-04-15T01:39:00.163794576Z [2024-04-15T01:39:00.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:00.164067164Z [2024-04-15T01:39:00.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:39:00.164506176Z [2024-04-15T01:39:00.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:00.164720555Z [2024-04-15T01:39:00.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:39:00.165081228Z [2024-04-15T01:39:00.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:39:00.165265200Z [2024-04-15T01:39:00.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:39:00.355029658Z [2024-04-15T01:39:00.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:39:00.355068815Z [2024-04-15T01:39:00.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:39:00.355073141Z [2024-04-15T01:39:00.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:39:00.376602318Z [2024-04-15T01:39:00.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9da93882-c10b-4b71-a98c-cb596544601a 2024-04-15T01:39:00.376637803Z [2024-04-15T01:39:00.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d8ff223-2403-4ec3-a15f-3ee49ce469e1 2024-04-15T01:39:00.376641818Z [2024-04-15T01:39:00.375+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7c1047b-46dc-4fdf-9c70-de1c9ade3578 2024-04-15T01:39:01.598902457Z [2024-04-15T01:39:01.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:39:01.599562207Z [2024-04-15T01:39:01.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:39:00.106076+00:00, run_end_date=2024-04-15 01:39:01.599058+00:00, run_duration=1.492982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:39:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:39:01.613087832Z [2024-04-15T01:39:01.612+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:01.684974316Z [2024-04-15T01:39:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status success for try_number 1 2024-04-15T01:39:01.698612272Z [2024-04-15T01:39:01.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=2024-04-15 01:39:00.916676+00:00, run_end_date=2024-04-15 01:39:01.331401+00:00, run_duration=0.414725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:00.159795+00:00, queued_by_job_id=1, pid=12158 2024-04-15T01:39:03.903427156Z [2024-04-15T01:39:03.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:39:03.903783245Z [2024-04-15T01:39:03.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:39:00.107113+00:00, run_end_date=2024-04-15 01:39:03.903309+00:00, run_duration=3.796196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:39:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:39:03.912105440Z [2024-04-15T01:39:03.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:03.919059865Z [2024-04-15T01:39:03.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:39:03.919298580Z [2024-04-15T01:39:03.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:39:00.108001+00:00, run_end_date=2024-04-15 01:39:03.918909+00:00, run_duration=3.810908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:39:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:39:03.927688432Z [2024-04-15T01:39:03.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:39:00+00:00, run_after=2024-04-15T01:40:00+00:00 2024-04-15T01:39:03.974960194Z [2024-04-15T01:39:03.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status success for try_number 1 2024-04-15T01:39:03.975634049Z [2024-04-15T01:39:03.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status success for try_number 1 2024-04-15T01:39:03.989657877Z [2024-04-15T01:39:03.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=2024-04-15 01:39:01.745092+00:00, run_end_date=2024-04-15 01:39:02.981749+00:00, run_duration=1.236657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:00.159795+00:00, queued_by_job_id=1, pid=12176 2024-04-15T01:39:03.990196693Z [2024-04-15T01:39:03.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=2024-04-15 01:39:01.805560+00:00, run_end_date=2024-04-15 01:39:03.539342+00:00, run_duration=1.733782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:39:00.159795+00:00, queued_by_job_id=1, pid=12177 2024-04-15T01:40:00.747880117Z [2024-04-15T01:40:00.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:40:00.759089481Z [2024-04-15T01:40:00.758+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:40:00.779645358Z [2024-04-15T01:40:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:00.794644126Z [2024-04-15T01:40:00.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:00.804843063Z [2024-04-15T01:40:00.804+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:40:00.904478475Z [2024-04-15T01:40:00.903+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:40:00.904509637Z 2024-04-15T01:40:00.904513504Z 2024-04-15T01:40:00.904517510Z 2024-04-15T01:40:00.904521185Z 2024-04-15T01:40:00.904524588Z 2024-04-15T01:40:00.904977636Z [2024-04-15T01:40:00.904+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:40:00.905394887Z [2024-04-15T01:40:00.904+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:40:00.905649826Z [2024-04-15T01:40:00.905+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:40:00.906084387Z [2024-04-15T01:40:00.905+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:40:00.906346758Z [2024-04-15T01:40:00.906+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:40:00.907890634Z [2024-04-15T01:40:00.907+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:00.907901418Z 2024-04-15T01:40:00.907904636Z 2024-04-15T01:40:00.907908081Z 2024-04-15T01:40:00.907910969Z 2024-04-15T01:40:00.907914104Z 2024-04-15T01:40:00.913943180Z [2024-04-15T01:40:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:40:00.914273003Z [2024-04-15T01:40:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:00.914702008Z [2024-04-15T01:40:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:00.914996493Z [2024-04-15T01:40:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:40:00.915382475Z [2024-04-15T01:40:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:00.915832433Z [2024-04-15T01:40:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:40:00.916615670Z [2024-04-15T01:40:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:00.917093664Z [2024-04-15T01:40:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:40:00.917894984Z [2024-04-15T01:40:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:00.918265489Z [2024-04-15T01:40:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:40:01.514733365Z [2024-04-15T01:40:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:01.514803846Z [2024-04-15T01:40:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:01.514819423Z [2024-04-15T01:40:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:01.514822841Z [2024-04-15T01:40:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:01.514846318Z [2024-04-15T01:40:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:01.537589583Z [2024-04-15T01:40:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to e47d316e-1f43-4bb3-b9fc-7ef398604184 2024-04-15T01:40:01.537666902Z [2024-04-15T01:40:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07161179-1e5e-4052-a12c-d20b41681e38 2024-04-15T01:40:01.537733247Z [2024-04-15T01:40:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to d10e0c52-9177-4025-9a2a-e04a5af4ac4d 2024-04-15T01:40:01.537827011Z [2024-04-15T01:40:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 242732cd-6bf0-472c-a487-f8d77004c055 2024-04-15T01:40:01.537897513Z [2024-04-15T01:40:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 494af98a-7b6d-4a1f-ab4e-69ede9022083 2024-04-15T01:40:02.847699714Z [2024-04-15T01:40:02.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:02.854980385Z [2024-04-15T01:40:02.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:38:00+00:00, run_id=scheduled__2024-04-15T01:38:00+00:00, run_start_date=2024-04-15 01:40:00.816345+00:00, run_end_date=2024-04-15 01:40:02.846116+00:00, run_duration=2.029771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:38:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:40:02.870940035Z [2024-04-15T01:40:02.864+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:40:02.879009364Z [2024-04-15T01:40:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:02.883012839Z [2024-04-15T01:40:02.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:39:00+00:00, run_id=scheduled__2024-04-15T01:39:00+00:00, run_start_date=2024-04-15 01:40:00.817386+00:00, run_end_date=2024-04-15 01:40:02.878651+00:00, run_duration=2.061265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:39:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:40:02.915990019Z [2024-04-15T01:40:02.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:02.969014844Z [2024-04-15T01:40:02.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:38:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:02.969160778Z [2024-04-15T01:40:02.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:02.981780286Z [2024-04-15T01:40:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:39:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:01.853046+00:00, run_end_date=2024-04-15 01:40:02.292690+00:00, run_duration=0.439644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.909771+00:00, queued_by_job_id=1, pid=12212 2024-04-15T01:40:02.982026868Z [2024-04-15T01:40:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:38:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:01.790452+00:00, run_end_date=2024-04-15 01:40:02.312853+00:00, run_duration=0.522401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.909771+00:00, queued_by_job_id=1, pid=12211 2024-04-15T01:40:03.712858909Z [2024-04-15T01:40:03.712+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:40:03.712907724Z 2024-04-15T01:40:03.712933438Z [2024-04-15T01:40:03.712+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:40:03.713641261Z [2024-04-15T01:40:03.713+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:03.713655406Z 2024-04-15T01:40:03.716049700Z [2024-04-15T01:40:03.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:40:03.716239361Z [2024-04-15T01:40:03.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:03.786592668Z [2024-04-15T01:40:03.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:03.787220677Z [2024-04-15T01:40:03.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:03.796229754Z [2024-04-15T01:40:03.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9102352-5669-4c04-ae9d-e818c9940ce0 2024-04-15T01:40:03.796676981Z [2024-04-15T01:40:03.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:03.181097+00:00, run_end_date=2024-04-15 01:40:03.540008+00:00, run_duration=0.358911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.909771+00:00, queued_by_job_id=1, pid=12242 2024-04-15T01:40:04.995679396Z [2024-04-15T01:40:04.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:04.995840143Z [2024-04-15T01:40:04.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:39:00+00:00, run_id=scheduled__2024-04-15T01:39:00+00:00, run_start_date=2024-04-15 01:40:00.818334+00:00, run_end_date=2024-04-15 01:40:04.995509+00:00, run_duration=4.177175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:39:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:40:05.010547513Z [2024-04-15T01:40:05.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:05.068322943Z [2024-04-15T01:40:05.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:05.078600490Z [2024-04-15T01:40:05.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:39:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:02.951098+00:00, run_end_date=2024-04-15 01:40:04.248019+00:00, run_duration=1.296921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.909771+00:00, queued_by_job_id=1, pid=12231 2024-04-15T01:40:06.123456833Z [2024-04-15T01:40:06.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:06.123507698Z [2024-04-15T01:40:06.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:39:00+00:00, run_id=scheduled__2024-04-15T01:39:00+00:00, run_start_date=2024-04-15 01:40:00.819295+00:00, run_end_date=2024-04-15 01:40:06.123137+00:00, run_duration=5.303842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:39:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:40:06.131781054Z [2024-04-15T01:40:06.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:41:00+00:00 2024-04-15T01:40:06.170436629Z [2024-04-15T01:40:06.169+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:40:06.170480498Z 2024-04-15T01:40:06.170490589Z [2024-04-15T01:40:06.170+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:40:06.171137198Z [2024-04-15T01:40:06.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:06.171159280Z 2024-04-15T01:40:06.173531809Z [2024-04-15T01:40:06.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:40:06.173611005Z [2024-04-15T01:40:06.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:40:06.234390414Z [2024-04-15T01:40:06.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:06.234773612Z [2024-04-15T01:40:06.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:39:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:06.235218116Z [2024-04-15T01:40:06.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:06.247204887Z [2024-04-15T01:40:06.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 916e1e7d-87f3-4e77-9954-3731c74e08eb 2024-04-15T01:40:06.247544334Z [2024-04-15T01:40:06.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:39:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:03.207710+00:00, run_end_date=2024-04-15 01:40:05.689384+00:00, run_duration=2.481674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:00.909771+00:00, queued_by_job_id=1, pid=12243 2024-04-15T01:40:06.247850104Z [2024-04-15T01:40:06.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:05.445883+00:00, run_end_date=2024-04-15 01:40:05.899380+00:00, run_duration=0.453497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:03.713978+00:00, queued_by_job_id=1, pid=12266 2024-04-15T01:40:08.434780684Z [2024-04-15T01:40:08.434+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:40:08.434815554Z 2024-04-15T01:40:08.435311717Z [2024-04-15T01:40:08.434+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:40:08.436249205Z [2024-04-15T01:40:08.435+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:40:08.436256147Z 2024-04-15T01:40:08.439226413Z [2024-04-15T01:40:08.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:40:08.439605321Z [2024-04-15T01:40:08.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:08.522428484Z [2024-04-15T01:40:08.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status queued for try_number 1 2024-04-15T01:40:08.525290245Z [2024-04-15T01:40:08.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:08.531350659Z [2024-04-15T01:40:08.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea7dd822-e47c-40a3-b8e4-a806966810b2 2024-04-15T01:40:08.531609367Z [2024-04-15T01:40:08.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=0, run_start_date=2024-04-15 01:40:07.735918+00:00, run_end_date=2024-04-15 01:40:08.108390+00:00, run_duration=0.372472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:06.171344+00:00, queued_by_job_id=1, pid=12274 2024-04-15T01:40:10.901587260Z [2024-04-15T01:40:10.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:40:10.901863223Z [2024-04-15T01:40:10.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:35:00+00:00, run_id=scheduled__2024-04-15T01:35:00+00:00, run_start_date=2024-04-15 01:40:00.815094+00:00, run_end_date=2024-04-15 01:40:10.901467+00:00, run_duration=10.086373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:35:00+00:00, data_interval_end=2024-04-15 01:40:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:40:10.907907412Z [2024-04-15T01:40:10.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:40:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:40:10.947849757Z [2024-04-15T01:40:10.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:35:00+00:00 exited with status success for try_number 1 2024-04-15T01:40:10.950355523Z [2024-04-15T01:40:10.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:35:00+00:00, map_index=-1, run_start_date=2024-04-15 01:40:09.954946+00:00, run_end_date=2024-04-15 01:40:10.357421+00:00, run_duration=0.402475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:40:08.437093+00:00, queued_by_job_id=1, pid=12282 2024-04-15T01:41:00.794856427Z [2024-04-15T01:41:00.794+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:41:00.814468300Z [2024-04-15T01:41:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:00.829363608Z [2024-04-15T01:41:00.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:00.906933212Z [2024-04-15T01:41:00.906+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:41:00.906977654Z 2024-04-15T01:41:00.906987859Z 2024-04-15T01:41:00.906996608Z 2024-04-15T01:41:00.907558341Z [2024-04-15T01:41:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:41:00.908005113Z [2024-04-15T01:41:00.907+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:41:00.908378367Z [2024-04-15T01:41:00.908+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:41:00.910098422Z [2024-04-15T01:41:00.909+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:41:00.910161235Z 2024-04-15T01:41:00.910171771Z 2024-04-15T01:41:00.910180475Z 2024-04-15T01:41:00.915901479Z [2024-04-15T01:41:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:41:00.916203033Z [2024-04-15T01:41:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:41:00.916790599Z [2024-04-15T01:41:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:41:00.917096403Z [2024-04-15T01:41:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:41:00.917641830Z [2024-04-15T01:41:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:41:00.917964997Z [2024-04-15T01:41:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:41:01.117565526Z [2024-04-15T01:41:01.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:41:01.117815207Z [2024-04-15T01:41:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:41:01.117947422Z [2024-04-15T01:41:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:41:01.128314717Z [2024-04-15T01:41:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8d9599d-5b2c-4edb-9df4-31be8d978c34 2024-04-15T01:41:01.128610699Z [2024-04-15T01:41:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ed317ec-3219-4f9f-894a-b0abadc2b2aa 2024-04-15T01:41:01.128823924Z [2024-04-15T01:41:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 102ed569-f806-4ad1-8dc4-08468cc30aba 2024-04-15T01:41:02.321306002Z [2024-04-15T01:41:02.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:41:02.321642200Z [2024-04-15T01:41:02.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:41:00.841776+00:00, run_end_date=2024-04-15 01:41:02.321016+00:00, run_duration=1.47924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:41:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:41:02.333470830Z [2024-04-15T01:41:02.333+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:02.385274761Z [2024-04-15T01:41:02.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:41:02.392167545Z [2024-04-15T01:41:02.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:41:01.644725+00:00, run_end_date=2024-04-15 01:41:01.982374+00:00, run_duration=0.337649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:41:00.911406+00:00, queued_by_job_id=1, pid=12304 2024-04-15T01:41:04.606678147Z [2024-04-15T01:41:04.606+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:41:05.940059188Z [2024-04-15T01:41:05.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:41:05.940148961Z [2024-04-15T01:41:05.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:41:00.842928+00:00, run_end_date=2024-04-15 01:41:05.939798+00:00, run_duration=5.09687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:41:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:41:05.951213878Z [2024-04-15T01:41:05.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:05.959194829Z [2024-04-15T01:41:05.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:41:05.959354005Z [2024-04-15T01:41:05.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:41:00.843959+00:00, run_end_date=2024-04-15 01:41:05.959004+00:00, run_duration=5.115045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:41:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:41:05.968626214Z [2024-04-15T01:41:05.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:41:00+00:00, run_after=2024-04-15T01:42:00+00:00 2024-04-15T01:41:06.035185013Z [2024-04-15T01:41:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:41:06.035238247Z [2024-04-15T01:41:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:41:06.045809437Z [2024-04-15T01:41:06.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:41:02.949933+00:00, run_end_date=2024-04-15 01:41:05.573295+00:00, run_duration=2.623362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:41:00.911406+00:00, queued_by_job_id=1, pid=12322 2024-04-15T01:41:06.045987732Z [2024-04-15T01:41:06.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:41:02.962414+00:00, run_end_date=2024-04-15 01:41:04.971401+00:00, run_duration=2.008987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:41:00.911406+00:00, queued_by_job_id=1, pid=12323 2024-04-15T01:42:00.415399302Z [2024-04-15T01:42:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:00.422759486Z [2024-04-15T01:42:00.422+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:42:00.468425754Z [2024-04-15T01:42:00.468+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:00.485435274Z [2024-04-15T01:42:00.485+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:42:00.577860738Z [2024-04-15T01:42:00.577+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:42:00.577879010Z 2024-04-15T01:42:00.577894799Z 2024-04-15T01:42:00.577898680Z 2024-04-15T01:42:00.577901969Z 2024-04-15T01:42:00.578011236Z [2024-04-15T01:42:00.577+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:42:00.578158752Z [2024-04-15T01:42:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:42:00.578296536Z [2024-04-15T01:42:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:42:00.578424293Z [2024-04-15T01:42:00.578+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:42:00.579068220Z [2024-04-15T01:42:00.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:42:00.579078974Z 2024-04-15T01:42:00.579082512Z 2024-04-15T01:42:00.579085707Z 2024-04-15T01:42:00.579089163Z 2024-04-15T01:42:00.582961641Z [2024-04-15T01:42:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:42:00.583136036Z [2024-04-15T01:42:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:42:00.583396989Z [2024-04-15T01:42:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:42:00.583536587Z [2024-04-15T01:42:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:42:00.583775179Z [2024-04-15T01:42:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:42:00.583911468Z [2024-04-15T01:42:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:42:00.584140237Z [2024-04-15T01:42:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:42:00.584305717Z [2024-04-15T01:42:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:42:01.080079452Z [2024-04-15T01:42:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:42:01.080256121Z [2024-04-15T01:42:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status queued for try_number 1 2024-04-15T01:42:01.080427032Z [2024-04-15T01:42:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status queued for try_number 1 2024-04-15T01:42:01.080575541Z [2024-04-15T01:42:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status queued for try_number 1 2024-04-15T01:42:01.104266139Z [2024-04-15T01:42:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d1da11c-8d79-45b5-a068-a52e62610a9f 2024-04-15T01:42:01.104511529Z [2024-04-15T01:42:01.104+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9e7acb8-4401-4d1a-89de-6fa77553d755 2024-04-15T01:42:01.104734763Z [2024-04-15T01:42:01.104+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c2348f9-3794-4137-be03-7593eb59f170 2024-04-15T01:42:01.104899976Z [2024-04-15T01:42:01.104+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d8331f8-ca70-455f-a7fa-b8ad709a097b 2024-04-15T01:42:02.483400606Z [2024-04-15T01:42:02.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:42:02.483588179Z [2024-04-15T01:42:02.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:42:00.503669+00:00, run_end_date=2024-04-15 01:42:02.483354+00:00, run_duration=1.979685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:42:02.514154545Z [2024-04-15T01:42:02.513+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:42:02.522949767Z [2024-04-15T01:42:02.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:42:02.523251573Z [2024-04-15T01:42:02.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:41:00+00:00, run_id=scheduled__2024-04-15T01:41:00+00:00, run_start_date=2024-04-15 01:42:00.506377+00:00, run_end_date=2024-04-15 01:42:02.522845+00:00, run_duration=2.016468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:41:00+00:00, data_interval_end=2024-04-15 01:42:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:42:02.531978776Z [2024-04-15T01:42:02.531+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:02.595279246Z [2024-04-15T01:42:02.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:42:02.608378385Z [2024-04-15T01:42:02.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:42:01.294774+00:00, run_end_date=2024-04-15 01:42:01.648230+00:00, run_duration=0.353456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:42:00.580023+00:00, queued_by_job_id=1, pid=12351 2024-04-15T01:42:03.705433070Z [2024-04-15T01:42:03.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status success for try_number 1 2024-04-15T01:42:03.710120013Z [2024-04-15T01:42:03.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:41:00+00:00, map_index=-1, run_start_date=2024-04-15 01:42:01.911705+00:00, run_end_date=2024-04-15 01:42:02.477539+00:00, run_duration=0.565834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:42:00.580023+00:00, queued_by_job_id=1, pid=12362 2024-04-15T01:42:05.851276744Z [2024-04-15T01:42:05.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:42:05.851444792Z [2024-04-15T01:42:05.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:41:00+00:00, run_id=scheduled__2024-04-15T01:41:00+00:00, run_start_date=2024-04-15 01:42:00.507905+00:00, run_end_date=2024-04-15 01:42:05.851196+00:00, run_duration=5.343291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:41:00+00:00, data_interval_end=2024-04-15 01:42:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:42:05.860301200Z [2024-04-15T01:42:05.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:05.866079995Z [2024-04-15T01:42:05.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:42:05.866235097Z [2024-04-15T01:42:05.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:41:00+00:00, run_id=scheduled__2024-04-15T01:41:00+00:00, run_start_date=2024-04-15 01:42:00.509334+00:00, run_end_date=2024-04-15 01:42:05.866010+00:00, run_duration=5.356676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:41:00+00:00, data_interval_end=2024-04-15 01:42:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:42:05.874557917Z [2024-04-15T01:42:05.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:42:00+00:00, run_after=2024-04-15T01:43:00+00:00 2024-04-15T01:42:05.903070564Z [2024-04-15T01:42:05.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status success for try_number 1 2024-04-15T01:42:05.903145385Z [2024-04-15T01:42:05.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:41:00+00:00 exited with status success for try_number 1 2024-04-15T01:42:05.912994004Z [2024-04-15T01:42:05.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:41:00+00:00, map_index=-1, run_start_date=2024-04-15 01:42:03.269060+00:00, run_end_date=2024-04-15 01:42:05.026609+00:00, run_duration=1.757549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:42:00.580023+00:00, queued_by_job_id=1, pid=12386 2024-04-15T01:42:05.913210495Z [2024-04-15T01:42:05.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:41:00+00:00, map_index=-1, run_start_date=2024-04-15 01:42:02.855197+00:00, run_end_date=2024-04-15 01:42:04.640439+00:00, run_duration=1.785242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:42:00.580023+00:00, queued_by_job_id=1, pid=12375 2024-04-15T01:43:00.804692988Z [2024-04-15T01:43:00.804+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:43:00.822035186Z [2024-04-15T01:43:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:00.845855930Z [2024-04-15T01:43:00.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:00.935440917Z [2024-04-15T01:43:00.934+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:43:00.935473882Z 2024-04-15T01:43:00.935480369Z 2024-04-15T01:43:00.935486222Z 2024-04-15T01:43:00.935927043Z [2024-04-15T01:43:00.935+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:43:00.936573473Z [2024-04-15T01:43:00.936+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:43:00.937048076Z [2024-04-15T01:43:00.936+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:43:00.938512248Z [2024-04-15T01:43:00.938+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:43:00.938527706Z 2024-04-15T01:43:00.938533990Z 2024-04-15T01:43:00.938540417Z 2024-04-15T01:43:00.944325755Z [2024-04-15T01:43:00.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:43:00.944757755Z [2024-04-15T01:43:00.944+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:43:00.945256073Z [2024-04-15T01:43:00.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:43:00.945618843Z [2024-04-15T01:43:00.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:43:00.946099448Z [2024-04-15T01:43:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:43:00.946950685Z [2024-04-15T01:43:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:43:01.149948542Z [2024-04-15T01:43:01.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status queued for try_number 1 2024-04-15T01:43:01.150255260Z [2024-04-15T01:43:01.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status queued for try_number 1 2024-04-15T01:43:01.150440085Z [2024-04-15T01:43:01.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status queued for try_number 1 2024-04-15T01:43:01.158803607Z [2024-04-15T01:43:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 763dac5d-b797-4244-b580-3752b28ed7b6 2024-04-15T01:43:01.159102950Z [2024-04-15T01:43:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to b648ce79-763f-49db-afd6-c3720bc9bdb6 2024-04-15T01:43:01.159327047Z [2024-04-15T01:43:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4acf5f81-c0dd-426f-872b-0dcc7bfe35f4 2024-04-15T01:43:03.154245104Z [2024-04-15T01:43:03.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:43:03.154484739Z [2024-04-15T01:43:03.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:42:00+00:00, run_id=scheduled__2024-04-15T01:42:00+00:00, run_start_date=2024-04-15 01:43:00.861257+00:00, run_end_date=2024-04-15 01:43:03.153954+00:00, run_duration=2.292697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:42:00+00:00, data_interval_end=2024-04-15 01:43:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:43:03.176048045Z [2024-04-15T01:43:03.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:03.249994482Z [2024-04-15T01:43:03.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status success for try_number 1 2024-04-15T01:43:03.258858573Z [2024-04-15T01:43:03.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:42:00+00:00, map_index=-1, run_start_date=2024-04-15 01:43:01.741076+00:00, run_end_date=2024-04-15 01:43:02.191200+00:00, run_duration=0.450124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:43:00.940417+00:00, queued_by_job_id=1, pid=12413 2024-04-15T01:43:04.329319684Z [2024-04-15T01:43:04.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:43:04.329357080Z [2024-04-15T01:43:04.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:42:00+00:00, run_id=scheduled__2024-04-15T01:42:00+00:00, run_start_date=2024-04-15 01:43:00.862802+00:00, run_end_date=2024-04-15 01:43:04.328054+00:00, run_duration=3.465252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:42:00+00:00, data_interval_end=2024-04-15 01:43:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:43:04.343001383Z [2024-04-15T01:43:04.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:05.455957923Z [2024-04-15T01:43:05.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:43:05.456164139Z [2024-04-15T01:43:05.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:42:00+00:00, run_id=scheduled__2024-04-15T01:42:00+00:00, run_start_date=2024-04-15 01:43:00.864214+00:00, run_end_date=2024-04-15 01:43:05.455749+00:00, run_duration=4.591535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:42:00+00:00, data_interval_end=2024-04-15 01:43:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:43:05.464244840Z [2024-04-15T01:43:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:43:00+00:00, run_after=2024-04-15T01:44:00+00:00 2024-04-15T01:43:05.504453618Z [2024-04-15T01:43:05.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status success for try_number 1 2024-04-15T01:43:05.504947792Z [2024-04-15T01:43:05.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status success for try_number 1 2024-04-15T01:43:05.515806925Z [2024-04-15T01:43:05.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:42:00+00:00, map_index=-1, run_start_date=2024-04-15 01:43:02.591010+00:00, run_end_date=2024-04-15 01:43:04.238452+00:00, run_duration=1.647442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:43:00.940417+00:00, queued_by_job_id=1, pid=12431 2024-04-15T01:43:05.516698500Z [2024-04-15T01:43:05.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:42:00+00:00, map_index=-1, run_start_date=2024-04-15 01:43:02.635470+00:00, run_end_date=2024-04-15 01:43:04.798522+00:00, run_duration=2.163052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:43:00.940417+00:00, queued_by_job_id=1, pid=12432 2024-04-15T01:44:00.205302792Z [2024-04-15T01:44:00.204+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:00.220698137Z [2024-04-15T01:44:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:00.228382970Z [2024-04-15T01:44:00.228+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:44:00.235716739Z [2024-04-15T01:44:00.235+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:44:00.351020590Z [2024-04-15T01:44:00.345+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:44:00.351055807Z 2024-04-15T01:44:00.351082879Z 2024-04-15T01:44:00.351091949Z 2024-04-15T01:44:00.351099803Z 2024-04-15T01:44:00.351108733Z [2024-04-15T01:44:00.345+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:44:00.351116592Z [2024-04-15T01:44:00.346+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:44:00.351124484Z [2024-04-15T01:44:00.346+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:44:00.351132096Z [2024-04-15T01:44:00.346+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:44:00.351139708Z [2024-04-15T01:44:00.347+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:44:00.351147297Z 2024-04-15T01:44:00.351155213Z 2024-04-15T01:44:00.351183201Z 2024-04-15T01:44:00.351191187Z 2024-04-15T01:44:00.354826318Z [2024-04-15T01:44:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:44:00.355012953Z [2024-04-15T01:44:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:44:00.365350002Z [2024-04-15T01:44:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:44:00.365374131Z [2024-04-15T01:44:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:44:00.365380237Z [2024-04-15T01:44:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:44:00.365385717Z [2024-04-15T01:44:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:44:00.365391143Z [2024-04-15T01:44:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:44:00.365396810Z [2024-04-15T01:44:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:44:00.937038485Z [2024-04-15T01:44:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status queued for try_number 1 2024-04-15T01:44:00.941739913Z [2024-04-15T01:44:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status queued for try_number 1 2024-04-15T01:44:00.942811489Z [2024-04-15T01:44:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status queued for try_number 1 2024-04-15T01:44:00.942996637Z [2024-04-15T01:44:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status queued for try_number 1 2024-04-15T01:44:00.968471520Z [2024-04-15T01:44:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 102c2858-c1b3-4c50-bf81-fa9b95ca2b1a 2024-04-15T01:44:00.968661152Z [2024-04-15T01:44:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48ebcc46-7cf9-4370-9aa7-8f57ceddebf5 2024-04-15T01:44:00.968825286Z [2024-04-15T01:44:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6a581f7-9fa2-4091-8927-e75a7a13c4bb 2024-04-15T01:44:00.968982288Z [2024-04-15T01:44:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5581f69a-3b82-4b17-9179-8003cfd54f87 2024-04-15T01:44:02.162640617Z [2024-04-15T01:44:02.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:44:02.163280815Z [2024-04-15T01:44:02.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:42:00+00:00, run_id=scheduled__2024-04-15T01:42:00+00:00, run_start_date=2024-04-15 01:44:00.248846+00:00, run_end_date=2024-04-15 01:44:02.162582+00:00, run_duration=1.913736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:42:00+00:00, data_interval_end=2024-04-15 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:44:02.172773251Z [2024-04-15T01:44:02.172+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:44:02.179380151Z [2024-04-15T01:44:02.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:44:02.179629288Z [2024-04-15T01:44:02.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:43:00+00:00, run_id=scheduled__2024-04-15T01:43:00+00:00, run_start_date=2024-04-15 01:44:00.250083+00:00, run_end_date=2024-04-15 01:44:02.179327+00:00, run_duration=1.929244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:43:00+00:00, data_interval_end=2024-04-15 01:44:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:44:02.193768724Z [2024-04-15T01:44:02.193+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:02.231088228Z [2024-04-15T01:44:02.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:42:00+00:00 exited with status success for try_number 1 2024-04-15T01:44:02.231132673Z [2024-04-15T01:44:02.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status success for try_number 1 2024-04-15T01:44:02.240122565Z [2024-04-15T01:44:02.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:43:00+00:00, map_index=-1, run_start_date=2024-04-15 01:44:01.239091+00:00, run_end_date=2024-04-15 01:44:01.590338+00:00, run_duration=0.351247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:44:00.349740+00:00, queued_by_job_id=1, pid=12466 2024-04-15T01:44:02.240616983Z [2024-04-15T01:44:02.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:42:00+00:00, map_index=-1, run_start_date=2024-04-15 01:44:01.131941+00:00, run_end_date=2024-04-15 01:44:01.449079+00:00, run_duration=0.317138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:44:00.349740+00:00, queued_by_job_id=1, pid=12465 2024-04-15T01:44:04.085040312Z [2024-04-15T01:44:04.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:44:04.085379970Z [2024-04-15T01:44:04.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:43:00+00:00, run_id=scheduled__2024-04-15T01:43:00+00:00, run_start_date=2024-04-15 01:44:00.251208+00:00, run_end_date=2024-04-15 01:44:04.084931+00:00, run_duration=3.833723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:43:00+00:00, data_interval_end=2024-04-15 01:44:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:44:04.094249550Z [2024-04-15T01:44:04.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:04.101031869Z [2024-04-15T01:44:04.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:44:04.101471651Z [2024-04-15T01:44:04.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:43:00+00:00, run_id=scheduled__2024-04-15T01:43:00+00:00, run_start_date=2024-04-15 01:44:00.252265+00:00, run_end_date=2024-04-15 01:44:04.100941+00:00, run_duration=3.848676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:43:00+00:00, data_interval_end=2024-04-15 01:44:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:44:04.112717276Z [2024-04-15T01:44:04.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:44:00+00:00, run_after=2024-04-15T01:45:00+00:00 2024-04-15T01:44:04.163431582Z [2024-04-15T01:44:04.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status success for try_number 1 2024-04-15T01:44:04.163555298Z [2024-04-15T01:44:04.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:43:00+00:00 exited with status success for try_number 1 2024-04-15T01:44:04.169948091Z [2024-04-15T01:44:04.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:43:00+00:00, map_index=-1, run_start_date=2024-04-15 01:44:02.135207+00:00, run_end_date=2024-04-15 01:44:03.278676+00:00, run_duration=1.143469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:44:00.349740+00:00, queued_by_job_id=1, pid=12490 2024-04-15T01:44:04.170054126Z [2024-04-15T01:44:04.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:43:00+00:00, map_index=-1, run_start_date=2024-04-15 01:44:02.131715+00:00, run_end_date=2024-04-15 01:44:03.730199+00:00, run_duration=1.598484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:44:00.349740+00:00, queued_by_job_id=1, pid=12489 2024-04-15T01:45:01.009125583Z [2024-04-15T01:45:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:45:01.024079396Z [2024-04-15T01:45:01.023+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:45:01.046550124Z [2024-04-15T01:45:01.046+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:01.062383345Z [2024-04-15T01:45:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:01.183711702Z [2024-04-15T01:45:01.183+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:45:01.183761212Z 2024-04-15T01:45:01.183775403Z 2024-04-15T01:45:01.183786318Z 2024-04-15T01:45:01.183807815Z 2024-04-15T01:45:01.183868174Z [2024-04-15T01:45:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:45:01.184049005Z [2024-04-15T01:45:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:45:01.184216116Z [2024-04-15T01:45:01.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:45:01.184446968Z [2024-04-15T01:45:01.184+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:45:01.185361695Z [2024-04-15T01:45:01.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:01.185411244Z 2024-04-15T01:45:01.185419374Z 2024-04-15T01:45:01.185426928Z 2024-04-15T01:45:01.185434067Z 2024-04-15T01:45:01.190316154Z [2024-04-15T01:45:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:45:01.190508858Z [2024-04-15T01:45:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:01.190836117Z [2024-04-15T01:45:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:45:01.191036962Z [2024-04-15T01:45:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:45:01.191317953Z [2024-04-15T01:45:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:45:01.191477980Z [2024-04-15T01:45:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:45:01.191751059Z [2024-04-15T01:45:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:45:01.191915566Z [2024-04-15T01:45:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:45:01.602057761Z [2024-04-15T01:45:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:01.602208522Z [2024-04-15T01:45:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:01.602488173Z [2024-04-15T01:45:01.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:01.602691216Z [2024-04-15T01:45:01.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:01.615733328Z [2024-04-15T01:45:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca276bc4-2928-4387-bd2c-3be2e31e7872 2024-04-15T01:45:01.615992443Z [2024-04-15T01:45:01.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to 737c243c-455f-4424-ad4f-abf37461f102 2024-04-15T01:45:01.616237615Z [2024-04-15T01:45:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to c12b7bcf-3e71-4158-8034-e71320513a07 2024-04-15T01:45:01.616495164Z [2024-04-15T01:45:01.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to 344a163c-1b23-4706-8401-f9ba629f5295 2024-04-15T01:45:02.899770019Z [2024-04-15T01:45:02.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:45:02.899802473Z [2024-04-15T01:45:02.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:44:00+00:00, run_id=scheduled__2024-04-15T01:44:00+00:00, run_start_date=2024-04-15 01:45:01.076105+00:00, run_end_date=2024-04-15 01:45:02.898956+00:00, run_duration=1.822851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:44:00+00:00, data_interval_end=2024-04-15 01:45:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:45:02.913430070Z [2024-04-15T01:45:02.913+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:02.970956233Z [2024-04-15T01:45:02.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:02.976239243Z [2024-04-15T01:45:02.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:44:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:02.141474+00:00, run_end_date=2024-04-15 01:45:02.584433+00:00, run_duration=0.442959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:01.186667+00:00, queued_by_job_id=1, pid=12523 2024-04-15T01:45:03.959539738Z [2024-04-15T01:45:03.958+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:45:03.959649737Z 2024-04-15T01:45:03.959729656Z [2024-04-15T01:45:03.959+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:45:03.961199852Z [2024-04-15T01:45:03.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:03.961294218Z 2024-04-15T01:45:03.965899726Z [2024-04-15T01:45:03.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:45:03.965952748Z [2024-04-15T01:45:03.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:04.052481981Z [2024-04-15T01:45:04.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:04.052713071Z [2024-04-15T01:45:04.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:04.058303811Z [2024-04-15T01:45:04.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to c656c51a-d70a-407a-9ef0-df1a0d6455ca 2024-04-15T01:45:04.058508533Z [2024-04-15T01:45:04.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:03.004128+00:00, run_end_date=2024-04-15 01:45:03.369405+00:00, run_duration=0.365277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:01.186667+00:00, queued_by_job_id=1, pid=12548 2024-04-15T01:45:05.248363955Z [2024-04-15T01:45:05.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:45:05.248929065Z [2024-04-15T01:45:05.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:44:00+00:00, run_id=scheduled__2024-04-15T01:44:00+00:00, run_start_date=2024-04-15 01:45:01.077296+00:00, run_end_date=2024-04-15 01:45:05.248431+00:00, run_duration=4.171135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:44:00+00:00, data_interval_end=2024-04-15 01:45:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:45:05.263676954Z [2024-04-15T01:45:05.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:05.276792628Z [2024-04-15T01:45:05.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:45:05.277180563Z [2024-04-15T01:45:05.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:44:00+00:00, run_id=scheduled__2024-04-15T01:44:00+00:00, run_start_date=2024-04-15 01:45:01.078454+00:00, run_end_date=2024-04-15 01:45:05.276672+00:00, run_duration=4.198218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:44:00+00:00, data_interval_end=2024-04-15 01:45:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:45:05.286997649Z [2024-04-15T01:45:05.286+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:46:00+00:00 2024-04-15T01:45:05.350868927Z [2024-04-15T01:45:05.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:05.351304757Z [2024-04-15T01:45:05.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:05.361579309Z [2024-04-15T01:45:05.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:44:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:02.997729+00:00, run_end_date=2024-04-15 01:45:04.642040+00:00, run_duration=1.644311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:01.186667+00:00, queued_by_job_id=1, pid=12547 2024-04-15T01:45:05.362069217Z [2024-04-15T01:45:05.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:44:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:03.119134+00:00, run_end_date=2024-04-15 01:45:05.068216+00:00, run_duration=1.949082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:01.186667+00:00, queued_by_job_id=1, pid=12549 2024-04-15T01:45:06.450325178Z [2024-04-15T01:45:06.449+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:45:06.450366667Z 2024-04-15T01:45:06.450553041Z [2024-04-15T01:45:06.450+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:45:06.452167399Z [2024-04-15T01:45:06.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:06.452236205Z 2024-04-15T01:45:06.456565073Z [2024-04-15T01:45:06.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:45:06.456767187Z [2024-04-15T01:45:06.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:45:06.515492558Z [2024-04-15T01:45:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:06.515594506Z [2024-04-15T01:45:06.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:06.524275794Z [2024-04-15T01:45:06.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf3200be-fd94-4cbb-b2eb-7013835e63dc 2024-04-15T01:45:06.524546524Z [2024-04-15T01:45:06.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:05.642882+00:00, run_end_date=2024-04-15 01:45:06.021641+00:00, run_duration=0.378759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:03.961898+00:00, queued_by_job_id=1, pid=12572 2024-04-15T01:45:08.799183341Z [2024-04-15T01:45:08.798+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:45:08.799227517Z 2024-04-15T01:45:08.799576248Z [2024-04-15T01:45:08.799+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:45:08.801033683Z [2024-04-15T01:45:08.800+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:45:08.801057011Z 2024-04-15T01:45:08.805995109Z [2024-04-15T01:45:08.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:45:08.806525133Z [2024-04-15T01:45:08.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:08.868867987Z [2024-04-15T01:45:08.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status queued for try_number 1 2024-04-15T01:45:08.874223468Z [2024-04-15T01:45:08.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:08.884919146Z [2024-04-15T01:45:08.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf16746d-6310-48e4-8184-1e20bb1521e3 2024-04-15T01:45:08.885343018Z [2024-04-15T01:45:08.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=0, run_start_date=2024-04-15 01:45:08.142618+00:00, run_end_date=2024-04-15 01:45:08.494697+00:00, run_duration=0.352079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:06.452966+00:00, queued_by_job_id=1, pid=12580 2024-04-15T01:45:11.352860039Z [2024-04-15T01:45:11.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:45:11.353401495Z [2024-04-15T01:45:11.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:40:00+00:00, run_id=scheduled__2024-04-15T01:40:00+00:00, run_start_date=2024-04-15 01:45:01.074698+00:00, run_end_date=2024-04-15 01:45:11.352682+00:00, run_duration=10.277984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:40:00+00:00, data_interval_end=2024-04-15 01:45:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:45:11.362287919Z [2024-04-15T01:45:11.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:45:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:45:11.408819480Z [2024-04-15T01:45:11.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:40:00+00:00 exited with status success for try_number 1 2024-04-15T01:45:11.417342080Z [2024-04-15T01:45:11.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:40:00+00:00, map_index=-1, run_start_date=2024-04-15 01:45:10.237934+00:00, run_end_date=2024-04-15 01:45:10.640281+00:00, run_duration=0.402347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:45:08.802264+00:00, queued_by_job_id=1, pid=12588 2024-04-15T01:46:01.092370155Z [2024-04-15T01:46:01.091+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:46:01.108817306Z [2024-04-15T01:46:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:01.120660175Z [2024-04-15T01:46:01.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:01.127465389Z [2024-04-15T01:46:01.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:46:01.193689771Z [2024-04-15T01:46:01.193+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:46:01.193713386Z 2024-04-15T01:46:01.193717425Z 2024-04-15T01:46:01.193735548Z 2024-04-15T01:46:01.193738621Z 2024-04-15T01:46:01.193807562Z [2024-04-15T01:46:01.193+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:46:01.193886644Z [2024-04-15T01:46:01.193+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:46:01.194054283Z [2024-04-15T01:46:01.193+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:46:01.194155555Z [2024-04-15T01:46:01.194+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:46:01.194727817Z [2024-04-15T01:46:01.194+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:46:01.194737208Z 2024-04-15T01:46:01.194740638Z 2024-04-15T01:46:01.194743588Z 2024-04-15T01:46:01.194746589Z 2024-04-15T01:46:01.198062637Z [2024-04-15T01:46:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:46:01.198162400Z [2024-04-15T01:46:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:46:01.198430321Z [2024-04-15T01:46:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:46:01.198522927Z [2024-04-15T01:46:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:46:01.198772562Z [2024-04-15T01:46:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:46:01.198856923Z [2024-04-15T01:46:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:46:01.199130769Z [2024-04-15T01:46:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:46:01.199228616Z [2024-04-15T01:46:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:46:01.519858407Z [2024-04-15T01:46:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status queued for try_number 1 2024-04-15T01:46:01.520011737Z [2024-04-15T01:46:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:46:01.520180558Z [2024-04-15T01:46:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:46:01.520333997Z [2024-04-15T01:46:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:46:01.533747631Z [2024-04-15T01:46:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to a43a9846-1faa-42e6-b4d1-edeb9cee94f8 2024-04-15T01:46:01.539197417Z [2024-04-15T01:46:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b606d84-988e-49c4-a548-85e03d7dcce1 2024-04-15T01:46:01.539366425Z [2024-04-15T01:46:01.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32efc257-0876-4a15-a123-3f306d1c46ea 2024-04-15T01:46:01.539485546Z [2024-04-15T01:46:01.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53607a64-6f51-46e1-b21c-25f2e7844a3a 2024-04-15T01:46:03.317813464Z [2024-04-15T01:46:03.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:46:03.318079557Z [2024-04-15T01:46:03.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:44:00+00:00, run_id=scheduled__2024-04-15T01:44:00+00:00, run_start_date=2024-04-15 01:46:01.137183+00:00, run_end_date=2024-04-15 01:46:03.317733+00:00, run_duration=2.18055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:44:00+00:00, data_interval_end=2024-04-15 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:46:03.324504926Z [2024-04-15T01:46:03.324+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:46:03.330134074Z [2024-04-15T01:46:03.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:46:03.330402520Z [2024-04-15T01:46:03.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:45:00+00:00, run_id=scheduled__2024-04-15T01:45:00+00:00, run_start_date=2024-04-15 01:46:01.138464+00:00, run_end_date=2024-04-15 01:46:03.330146+00:00, run_duration=2.191682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:45:00+00:00, data_interval_end=2024-04-15 01:46:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:46:03.342382873Z [2024-04-15T01:46:03.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:03.388950265Z [2024-04-15T01:46:03.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:44:00+00:00 exited with status success for try_number 1 2024-04-15T01:46:03.389127841Z [2024-04-15T01:46:03.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:46:03.394956982Z [2024-04-15T01:46:03.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:46:02.340104+00:00, run_end_date=2024-04-15 01:46:02.981314+00:00, run_duration=0.64121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:46:01.195616+00:00, queued_by_job_id=1, pid=12612 2024-04-15T01:46:03.395287671Z [2024-04-15T01:46:03.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:44:00+00:00, map_index=-1, run_start_date=2024-04-15 01:46:02.320842+00:00, run_end_date=2024-04-15 01:46:02.855969+00:00, run_duration=0.535127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:46:01.195616+00:00, queued_by_job_id=1, pid=12611 2024-04-15T01:46:04.728762964Z [2024-04-15T01:46:04.728+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:46:06.230270436Z [2024-04-15T01:46:06.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:46:06.230445803Z [2024-04-15T01:46:06.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:45:00+00:00, run_id=scheduled__2024-04-15T01:45:00+00:00, run_start_date=2024-04-15 01:46:01.139512+00:00, run_end_date=2024-04-15 01:46:06.229999+00:00, run_duration=5.090487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:45:00+00:00, data_interval_end=2024-04-15 01:46:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:46:06.242149267Z [2024-04-15T01:46:06.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:06.252861521Z [2024-04-15T01:46:06.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:46:06.253111137Z [2024-04-15T01:46:06.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:45:00+00:00, run_id=scheduled__2024-04-15T01:45:00+00:00, run_start_date=2024-04-15 01:46:01.140437+00:00, run_end_date=2024-04-15 01:46:06.252616+00:00, run_duration=5.112179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:45:00+00:00, data_interval_end=2024-04-15 01:46:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:46:06.265996789Z [2024-04-15T01:46:06.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:46:00+00:00, run_after=2024-04-15T01:47:00+00:00 2024-04-15T01:46:06.320176577Z [2024-04-15T01:46:06.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:46:06.320221315Z [2024-04-15T01:46:06.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:46:06.331365372Z [2024-04-15T01:46:06.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:46:03.830559+00:00, run_end_date=2024-04-15 01:46:05.474646+00:00, run_duration=1.644087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:46:01.195616+00:00, queued_by_job_id=1, pid=12635 2024-04-15T01:46:06.331774789Z [2024-04-15T01:46:06.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:46:03.831227+00:00, run_end_date=2024-04-15 01:46:05.169918+00:00, run_duration=1.338691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:46:01.195616+00:00, queued_by_job_id=1, pid=12636 2024-04-15T01:47:00.835222718Z [2024-04-15T01:47:00.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:00.846966111Z [2024-04-15T01:47:00.846+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:47:00.860637617Z [2024-04-15T01:47:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:00.931857035Z [2024-04-15T01:47:00.931+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:47:00.931898367Z 2024-04-15T01:47:00.931908127Z 2024-04-15T01:47:00.931942845Z 2024-04-15T01:47:00.932230797Z [2024-04-15T01:47:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:47:00.932604963Z [2024-04-15T01:47:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:47:00.932958788Z [2024-04-15T01:47:00.932+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:47:00.934383000Z [2024-04-15T01:47:00.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:47:00.934406637Z 2024-04-15T01:47:00.934416480Z 2024-04-15T01:47:00.934425505Z 2024-04-15T01:47:00.940485716Z [2024-04-15T01:47:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:47:00.940798696Z [2024-04-15T01:47:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:47:00.941537622Z [2024-04-15T01:47:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:47:00.941908440Z [2024-04-15T01:47:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:47:00.942371705Z [2024-04-15T01:47:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:47:00.942618187Z [2024-04-15T01:47:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:47:01.143144758Z [2024-04-15T01:47:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status queued for try_number 1 2024-04-15T01:47:01.144087915Z [2024-04-15T01:47:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status queued for try_number 1 2024-04-15T01:47:01.144497082Z [2024-04-15T01:47:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status queued for try_number 1 2024-04-15T01:47:01.154386404Z [2024-04-15T01:47:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7bf3230-38a7-4e00-8965-7846b3e0e660 2024-04-15T01:47:01.154734551Z [2024-04-15T01:47:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1971a4f9-efe2-4d4b-9536-ddc4929881d3 2024-04-15T01:47:01.155039473Z [2024-04-15T01:47:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 983e8483-d9ea-4bd0-9ecf-72a36be62bff 2024-04-15T01:47:02.290848193Z [2024-04-15T01:47:02.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:47:02.291336629Z [2024-04-15T01:47:02.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:46:00+00:00, run_id=scheduled__2024-04-15T01:46:00+00:00, run_start_date=2024-04-15 01:47:00.872065+00:00, run_end_date=2024-04-15 01:47:02.290981+00:00, run_duration=1.418916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:46:00+00:00, data_interval_end=2024-04-15 01:47:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:47:02.313480173Z [2024-04-15T01:47:02.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:02.372706533Z [2024-04-15T01:47:02.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status success for try_number 1 2024-04-15T01:47:02.386166844Z [2024-04-15T01:47:02.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:46:00+00:00, map_index=-1, run_start_date=2024-04-15 01:47:01.601758+00:00, run_end_date=2024-04-15 01:47:01.962853+00:00, run_duration=0.361095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:47:00.936010+00:00, queued_by_job_id=1, pid=12668 2024-04-15T01:47:04.928991905Z [2024-04-15T01:47:04.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:47:04.929368616Z [2024-04-15T01:47:04.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:46:00+00:00, run_id=scheduled__2024-04-15T01:46:00+00:00, run_start_date=2024-04-15 01:47:00.873393+00:00, run_end_date=2024-04-15 01:47:04.929008+00:00, run_duration=4.055615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:46:00+00:00, data_interval_end=2024-04-15 01:47:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:47:04.943018039Z [2024-04-15T01:47:04.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:04.956610345Z [2024-04-15T01:47:04.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:47:04.956890610Z [2024-04-15T01:47:04.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:46:00+00:00, run_id=scheduled__2024-04-15T01:46:00+00:00, run_start_date=2024-04-15 01:47:00.874424+00:00, run_end_date=2024-04-15 01:47:04.956582+00:00, run_duration=4.082158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:46:00+00:00, data_interval_end=2024-04-15 01:47:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:47:04.965917450Z [2024-04-15T01:47:04.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:47:00+00:00, run_after=2024-04-15T01:48:00+00:00 2024-04-15T01:47:04.995264766Z [2024-04-15T01:47:04.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status success for try_number 1 2024-04-15T01:47:04.995429665Z [2024-04-15T01:47:04.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status success for try_number 1 2024-04-15T01:47:05.016919824Z [2024-04-15T01:47:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:46:00+00:00, map_index=-1, run_start_date=2024-04-15 01:47:02.528326+00:00, run_end_date=2024-04-15 01:47:03.905967+00:00, run_duration=1.377641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:47:00.936010+00:00, queued_by_job_id=1, pid=12686 2024-04-15T01:47:05.017098282Z [2024-04-15T01:47:05.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:46:00+00:00, map_index=-1, run_start_date=2024-04-15 01:47:02.527992+00:00, run_end_date=2024-04-15 01:47:04.179603+00:00, run_duration=1.651611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:47:00.936010+00:00, queued_by_job_id=1, pid=12687 2024-04-15T01:48:01.037758481Z [2024-04-15T01:48:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:01.045624285Z [2024-04-15T01:48:01.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:48:01.053300320Z [2024-04-15T01:48:01.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:48:01.066085350Z [2024-04-15T01:48:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:01.151481061Z [2024-04-15T01:48:01.150+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:48:01.151501514Z 2024-04-15T01:48:01.151510979Z 2024-04-15T01:48:01.151515349Z 2024-04-15T01:48:01.151519486Z 2024-04-15T01:48:01.162864818Z [2024-04-15T01:48:01.151+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:48:01.162894732Z [2024-04-15T01:48:01.159+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:48:01.162898255Z [2024-04-15T01:48:01.159+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:48:01.162901272Z [2024-04-15T01:48:01.159+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:48:01.162904478Z [2024-04-15T01:48:01.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:48:01.162907949Z 2024-04-15T01:48:01.162910883Z 2024-04-15T01:48:01.162922577Z 2024-04-15T01:48:01.162925562Z 2024-04-15T01:48:01.164324941Z [2024-04-15T01:48:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:48:01.165853441Z [2024-04-15T01:48:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:48:01.166349797Z [2024-04-15T01:48:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:48:01.166622997Z [2024-04-15T01:48:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:48:01.167114606Z [2024-04-15T01:48:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:48:01.167408133Z [2024-04-15T01:48:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:48:01.167762018Z [2024-04-15T01:48:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:48:01.167936560Z [2024-04-15T01:48:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:48:01.647690690Z [2024-04-15T01:48:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status queued for try_number 1 2024-04-15T01:48:01.647731093Z [2024-04-15T01:48:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status queued for try_number 1 2024-04-15T01:48:01.647884716Z [2024-04-15T01:48:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status queued for try_number 1 2024-04-15T01:48:01.648007554Z [2024-04-15T01:48:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status queued for try_number 1 2024-04-15T01:48:01.664029401Z [2024-04-15T01:48:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d918fc6-11a6-4b1a-a5c0-839a5fffb99d 2024-04-15T01:48:01.664166218Z [2024-04-15T01:48:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to c692cab2-da3e-4343-acd0-e56e59885ba3 2024-04-15T01:48:01.664373058Z [2024-04-15T01:48:01.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9773cf45-0635-43d9-83ff-ad17994104ef 2024-04-15T01:48:01.664526150Z [2024-04-15T01:48:01.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f2495b2-6b52-49b1-9c33-bec03a618fc4 2024-04-15T01:48:03.195845140Z [2024-04-15T01:48:03.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:48:03.196279002Z [2024-04-15T01:48:03.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:46:00+00:00, run_id=scheduled__2024-04-15T01:46:00+00:00, run_start_date=2024-04-15 01:48:01.075376+00:00, run_end_date=2024-04-15 01:48:03.195922+00:00, run_duration=2.120546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:46:00+00:00, data_interval_end=2024-04-15 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:48:03.217669392Z [2024-04-15T01:48:03.217+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:48:03.233178340Z [2024-04-15T01:48:03.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:48:03.235347119Z [2024-04-15T01:48:03.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:47:00+00:00, run_id=scheduled__2024-04-15T01:47:00+00:00, run_start_date=2024-04-15 01:48:01.076525+00:00, run_end_date=2024-04-15 01:48:03.234856+00:00, run_duration=2.158331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:47:00+00:00, data_interval_end=2024-04-15 01:48:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:48:03.269602383Z [2024-04-15T01:48:03.258+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:03.337473278Z [2024-04-15T01:48:03.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:46:00+00:00 exited with status success for try_number 1 2024-04-15T01:48:03.339390451Z [2024-04-15T01:48:03.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status success for try_number 1 2024-04-15T01:48:03.345644267Z [2024-04-15T01:48:03.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:47:00+00:00, map_index=-1, run_start_date=2024-04-15 01:48:02.093406+00:00, run_end_date=2024-04-15 01:48:02.548741+00:00, run_duration=0.455335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:48:01.161712+00:00, queued_by_job_id=1, pid=12722 2024-04-15T01:48:03.346007663Z [2024-04-15T01:48:03.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:46:00+00:00, map_index=-1, run_start_date=2024-04-15 01:48:01.942123+00:00, run_end_date=2024-04-15 01:48:02.301979+00:00, run_duration=0.359856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:48:01.161712+00:00, queued_by_job_id=1, pid=12721 2024-04-15T01:48:05.525128422Z [2024-04-15T01:48:05.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:48:05.525594673Z [2024-04-15T01:48:05.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:47:00+00:00, run_id=scheduled__2024-04-15T01:47:00+00:00, run_start_date=2024-04-15 01:48:01.077772+00:00, run_end_date=2024-04-15 01:48:05.525271+00:00, run_duration=4.447499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:47:00+00:00, data_interval_end=2024-04-15 01:48:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:48:05.534787248Z [2024-04-15T01:48:05.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:05.540730670Z [2024-04-15T01:48:05.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:48:05.541031048Z [2024-04-15T01:48:05.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:47:00+00:00, run_id=scheduled__2024-04-15T01:47:00+00:00, run_start_date=2024-04-15 01:48:01.078848+00:00, run_end_date=2024-04-15 01:48:05.540657+00:00, run_duration=4.461809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:47:00+00:00, data_interval_end=2024-04-15 01:48:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:48:05.549253980Z [2024-04-15T01:48:05.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:48:00+00:00, run_after=2024-04-15T01:49:00+00:00 2024-04-15T01:48:05.585893473Z [2024-04-15T01:48:05.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status success for try_number 1 2024-04-15T01:48:05.586097224Z [2024-04-15T01:48:05.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:47:00+00:00 exited with status success for try_number 1 2024-04-15T01:48:05.602251725Z [2024-04-15T01:48:05.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:47:00+00:00, map_index=-1, run_start_date=2024-04-15 01:48:03.228892+00:00, run_end_date=2024-04-15 01:48:04.741862+00:00, run_duration=1.51297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:48:01.161712+00:00, queued_by_job_id=1, pid=12746 2024-04-15T01:48:05.603009190Z [2024-04-15T01:48:05.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:47:00+00:00, map_index=-1, run_start_date=2024-04-15 01:48:03.170637+00:00, run_end_date=2024-04-15 01:48:04.838005+00:00, run_duration=1.667368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:48:01.161712+00:00, queued_by_job_id=1, pid=12745 2024-04-15T01:49:00.305823049Z [2024-04-15T01:49:00.305+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:00.319493088Z [2024-04-15T01:49:00.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:00.326177962Z [2024-04-15T01:49:00.324+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:49:00.420830718Z [2024-04-15T01:49:00.420+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:49:00.420869300Z 2024-04-15T01:49:00.420876065Z 2024-04-15T01:49:00.420882545Z 2024-04-15T01:49:00.420956367Z [2024-04-15T01:49:00.420+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:49:00.420974091Z [2024-04-15T01:49:00.420+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:49:00.421079922Z [2024-04-15T01:49:00.420+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:49:00.421749839Z [2024-04-15T01:49:00.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:49:00.421760623Z 2024-04-15T01:49:00.421763995Z 2024-04-15T01:49:00.421777239Z 2024-04-15T01:49:00.425325761Z [2024-04-15T01:49:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:49:00.425549867Z [2024-04-15T01:49:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:49:00.425875685Z [2024-04-15T01:49:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:49:00.426069364Z [2024-04-15T01:49:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:49:00.426349476Z [2024-04-15T01:49:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:49:00.426530609Z [2024-04-15T01:49:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:49:00.668770640Z [2024-04-15T01:49:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status queued for try_number 1 2024-04-15T01:49:00.669093851Z [2024-04-15T01:49:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status queued for try_number 1 2024-04-15T01:49:00.669390954Z [2024-04-15T01:49:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status queued for try_number 1 2024-04-15T01:49:00.678381631Z [2024-04-15T01:49:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 432c914d-6d32-4a74-af07-04eedb528962 2024-04-15T01:49:00.678682316Z [2024-04-15T01:49:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to d95e3ee1-3264-4d52-ba89-75b0493e147e 2024-04-15T01:49:00.678957490Z [2024-04-15T01:49:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42f5682b-034d-42e2-a954-5121410e9b65 2024-04-15T01:49:01.817069643Z [2024-04-15T01:49:01.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:49:01.817812816Z [2024-04-15T01:49:01.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:48:00+00:00, run_id=scheduled__2024-04-15T01:48:00+00:00, run_start_date=2024-04-15 01:49:00.335542+00:00, run_end_date=2024-04-15 01:49:01.817392+00:00, run_duration=1.48185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:48:00+00:00, data_interval_end=2024-04-15 01:49:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:49:01.826498024Z [2024-04-15T01:49:01.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:01.877604573Z [2024-04-15T01:49:01.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status success for try_number 1 2024-04-15T01:49:01.882286036Z [2024-04-15T01:49:01.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:48:00+00:00, map_index=-1, run_start_date=2024-04-15 01:49:01.147348+00:00, run_end_date=2024-04-15 01:49:01.496729+00:00, run_duration=0.349381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:49:00.422435+00:00, queued_by_job_id=1, pid=12778 2024-04-15T01:49:03.761074817Z [2024-04-15T01:49:03.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:49:03.761946450Z [2024-04-15T01:49:03.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:48:00+00:00, run_id=scheduled__2024-04-15T01:48:00+00:00, run_start_date=2024-04-15 01:49:00.338833+00:00, run_end_date=2024-04-15 01:49:03.761228+00:00, run_duration=3.422395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:48:00+00:00, data_interval_end=2024-04-15 01:49:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:49:03.785551396Z [2024-04-15T01:49:03.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:03.863131935Z [2024-04-15T01:49:03.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status success for try_number 1 2024-04-15T01:49:03.868734021Z [2024-04-15T01:49:03.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:48:00+00:00, map_index=-1, run_start_date=2024-04-15 01:49:02.176548+00:00, run_end_date=2024-04-15 01:49:03.443077+00:00, run_duration=1.266529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:49:00.422435+00:00, queued_by_job_id=1, pid=12797 2024-04-15T01:49:04.927925601Z [2024-04-15T01:49:04.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:49:04.928447708Z [2024-04-15T01:49:04.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:48:00+00:00, run_id=scheduled__2024-04-15T01:48:00+00:00, run_start_date=2024-04-15 01:49:00.341688+00:00, run_end_date=2024-04-15 01:49:04.927743+00:00, run_duration=4.586055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:48:00+00:00, data_interval_end=2024-04-15 01:49:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:49:04.940630268Z [2024-04-15T01:49:04.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:49:00+00:00, run_after=2024-04-15T01:50:00+00:00 2024-04-15T01:49:04.989177470Z [2024-04-15T01:49:04.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status success for try_number 1 2024-04-15T01:49:04.997368466Z [2024-04-15T01:49:04.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:48:00+00:00, map_index=-1, run_start_date=2024-04-15 01:49:02.077461+00:00, run_end_date=2024-04-15 01:49:03.808412+00:00, run_duration=1.730951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:49:00.422435+00:00, queued_by_job_id=1, pid=12796 2024-04-15T01:50:01.071049820Z [2024-04-15T01:50:01.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:50:01.101895677Z [2024-04-15T01:50:01.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:01.125153853Z [2024-04-15T01:50:01.124+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:01.139558546Z [2024-04-15T01:50:01.139+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:50:01.160865542Z [2024-04-15T01:50:01.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:50:01.261955624Z [2024-04-15T01:50:01.261+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T01:50:01.262001703Z 2024-04-15T01:50:01.262011408Z 2024-04-15T01:50:01.262020046Z 2024-04-15T01:50:01.262028507Z 2024-04-15T01:50:01.262036431Z 2024-04-15T01:50:01.262044201Z [2024-04-15T01:50:01.261+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:50:01.262052800Z [2024-04-15T01:50:01.261+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:50:01.262134542Z [2024-04-15T01:50:01.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:50:01.262289107Z [2024-04-15T01:50:01.261+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:50:01.262452105Z [2024-04-15T01:50:01.262+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:50:01.263083033Z [2024-04-15T01:50:01.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:01.263095615Z 2024-04-15T01:50:01.263099342Z 2024-04-15T01:50:01.263102521Z 2024-04-15T01:50:01.263105875Z 2024-04-15T01:50:01.263131327Z 2024-04-15T01:50:01.267366319Z [2024-04-15T01:50:01.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:50:01.267583956Z [2024-04-15T01:50:01.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:01.267868250Z [2024-04-15T01:50:01.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:01.268064005Z [2024-04-15T01:50:01.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:50:01.268419229Z [2024-04-15T01:50:01.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:01.268585788Z [2024-04-15T01:50:01.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:50:01.268797565Z [2024-04-15T01:50:01.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:01.268967188Z [2024-04-15T01:50:01.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:50:01.269299397Z [2024-04-15T01:50:01.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:01.269426866Z [2024-04-15T01:50:01.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:50:01.871272733Z [2024-04-15T01:50:01.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:01.871302365Z [2024-04-15T01:50:01.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:01.871340736Z [2024-04-15T01:50:01.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:01.871424565Z [2024-04-15T01:50:01.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:01.871444971Z [2024-04-15T01:50:01.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:01.891649778Z [2024-04-15T01:50:01.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf47fe8e-4f2c-45bd-ae7c-eab4e439b261 2024-04-15T01:50:01.891692947Z [2024-04-15T01:50:01.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to b07bd920-0233-4c8e-93b9-c685ad9b30a2 2024-04-15T01:50:01.891806224Z [2024-04-15T01:50:01.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97215fd6-bbc9-4aa1-afc1-00d04f46313a 2024-04-15T01:50:01.891895264Z [2024-04-15T01:50:01.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcfd20b5-b0ba-463e-a6e2-66a021ea2183 2024-04-15T01:50:01.891968145Z [2024-04-15T01:50:01.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to fafa2cce-ecb3-4b39-b410-e84c72fc634b 2024-04-15T01:50:03.253738921Z [2024-04-15T01:50:03.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:03.254209132Z [2024-04-15T01:50:03.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:48:00+00:00, run_id=scheduled__2024-04-15T01:48:00+00:00, run_start_date=2024-04-15 01:50:01.172606+00:00, run_end_date=2024-04-15 01:50:03.253648+00:00, run_duration=2.081042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:48:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:50:03.265423037Z [2024-04-15T01:50:03.265+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:50:03.293133812Z [2024-04-15T01:50:03.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:03.293339353Z [2024-04-15T01:50:03.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:49:00+00:00, run_id=scheduled__2024-04-15T01:49:00+00:00, run_start_date=2024-04-15 01:50:01.173569+00:00, run_end_date=2024-04-15 01:50:03.293039+00:00, run_duration=2.11947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:49:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:50:03.306042423Z [2024-04-15T01:50:03.305+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:03.357096773Z [2024-04-15T01:50:03.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:48:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:03.357277265Z [2024-04-15T01:50:03.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:03.364932644Z [2024-04-15T01:50:03.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:49:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:02.522215+00:00, run_end_date=2024-04-15 01:50:03.016550+00:00, run_duration=0.494335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:01.264316+00:00, queued_by_job_id=1, pid=12839 2024-04-15T01:50:03.365150341Z [2024-04-15T01:50:03.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:48:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:02.182567+00:00, run_end_date=2024-04-15 01:50:02.563320+00:00, run_duration=0.380753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:01.264316+00:00, queued_by_job_id=1, pid=12826 2024-04-15T01:50:04.016062513Z [2024-04-15T01:50:04.015+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:50:04.016092158Z 2024-04-15T01:50:04.016096936Z [2024-04-15T01:50:04.015+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:50:04.016681788Z [2024-04-15T01:50:04.016+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:04.016694198Z 2024-04-15T01:50:04.018771976Z [2024-04-15T01:50:04.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:50:04.018974818Z [2024-04-15T01:50:04.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:04.068958466Z [2024-04-15T01:50:04.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:04.072464054Z [2024-04-15T01:50:04.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:04.086797842Z [2024-04-15T01:50:04.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8293be7-f5c5-493d-b433-be8b082269a6 2024-04-15T01:50:04.087280151Z [2024-04-15T01:50:04.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:03.139537+00:00, run_end_date=2024-04-15 01:50:03.484090+00:00, run_duration=0.344553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:01.264316+00:00, queued_by_job_id=1, pid=12851 2024-04-15T01:50:05.470698827Z [2024-04-15T01:50:05.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:05.471120386Z [2024-04-15T01:50:05.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:49:00+00:00, run_id=scheduled__2024-04-15T01:49:00+00:00, run_start_date=2024-04-15 01:50:01.177042+00:00, run_end_date=2024-04-15 01:50:05.470619+00:00, run_duration=4.293577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:49:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:50:05.480649622Z [2024-04-15T01:50:05.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:05.488093892Z [2024-04-15T01:50:05.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:05.488445482Z [2024-04-15T01:50:05.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:49:00+00:00, run_id=scheduled__2024-04-15T01:49:00+00:00, run_start_date=2024-04-15 01:50:01.175458+00:00, run_end_date=2024-04-15 01:50:05.488043+00:00, run_duration=4.312585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:49:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:50:05.498488868Z [2024-04-15T01:50:05.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:51:00+00:00 2024-04-15T01:50:05.544563972Z [2024-04-15T01:50:05.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:05.546471177Z [2024-04-15T01:50:05.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:49:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:05.563289082Z [2024-04-15T01:50:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:49:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:03.680285+00:00, run_end_date=2024-04-15 01:50:05.050099+00:00, run_duration=1.369814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:01.264316+00:00, queued_by_job_id=1, pid=12873 2024-04-15T01:50:05.564209433Z [2024-04-15T01:50:05.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:49:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:03.394835+00:00, run_end_date=2024-04-15 01:50:05.158970+00:00, run_duration=1.764135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:01.264316+00:00, queued_by_job_id=1, pid=12858 2024-04-15T01:50:06.653259463Z [2024-04-15T01:50:06.652+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:50:06.653275260Z 2024-04-15T01:50:06.653421921Z [2024-04-15T01:50:06.653+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:50:06.654006122Z [2024-04-15T01:50:06.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:06.654021928Z 2024-04-15T01:50:06.656201067Z [2024-04-15T01:50:06.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:50:06.656395279Z [2024-04-15T01:50:06.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:50:06.709016598Z [2024-04-15T01:50:06.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:06.709162350Z [2024-04-15T01:50:06.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:06.714210558Z [2024-04-15T01:50:06.713+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95286a78-cce4-4d76-b85e-e4f678e51d77 2024-04-15T01:50:06.714413766Z [2024-04-15T01:50:06.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:05.621537+00:00, run_end_date=2024-04-15 01:50:05.977428+00:00, run_duration=0.355891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:04.016951+00:00, queued_by_job_id=1, pid=12886 2024-04-15T01:50:09.035635269Z [2024-04-15T01:50:09.035+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:50:09.035669561Z 2024-04-15T01:50:09.035987966Z [2024-04-15T01:50:09.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:50:09.037117077Z [2024-04-15T01:50:09.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:50:09.037148941Z 2024-04-15T01:50:09.040459152Z [2024-04-15T01:50:09.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:50:09.040821235Z [2024-04-15T01:50:09.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:09.117384576Z [2024-04-15T01:50:09.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status queued for try_number 1 2024-04-15T01:50:09.117661291Z [2024-04-15T01:50:09.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:09.130783866Z [2024-04-15T01:50:09.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe773c70-8657-4126-a231-2564517da7ba 2024-04-15T01:50:09.131776460Z [2024-04-15T01:50:09.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=0, run_start_date=2024-04-15 01:50:08.156106+00:00, run_end_date=2024-04-15 01:50:08.520535+00:00, run_duration=0.364429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:06.654410+00:00, queued_by_job_id=1, pid=12894 2024-04-15T01:50:11.386756702Z [2024-04-15T01:50:11.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:50:11.387207885Z [2024-04-15T01:50:11.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:45:00+00:00, run_id=scheduled__2024-04-15T01:45:00+00:00, run_start_date=2024-04-15 01:50:01.171504+00:00, run_end_date=2024-04-15 01:50:11.386819+00:00, run_duration=10.215315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:45:00+00:00, data_interval_end=2024-04-15 01:50:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:50:11.393628512Z [2024-04-15T01:50:11.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:50:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:50:11.425120776Z [2024-04-15T01:50:11.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:45:00+00:00 exited with status success for try_number 1 2024-04-15T01:50:11.439799231Z [2024-04-15T01:50:11.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:45:00+00:00, map_index=-1, run_start_date=2024-04-15 01:50:10.454927+00:00, run_end_date=2024-04-15 01:50:10.852747+00:00, run_duration=0.39782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:50:09.037725+00:00, queued_by_job_id=1, pid=12902 2024-04-15T01:51:01.020830912Z [2024-04-15T01:51:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:01.036417092Z [2024-04-15T01:51:01.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:01.045783906Z [2024-04-15T01:51:01.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:51:01.118771643Z [2024-04-15T01:51:01.118+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:51:01.118807720Z 2024-04-15T01:51:01.118815657Z 2024-04-15T01:51:01.118823604Z 2024-04-15T01:51:01.118831028Z [2024-04-15T01:51:01.118+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:51:01.118977436Z [2024-04-15T01:51:01.118+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:51:01.119238096Z [2024-04-15T01:51:01.118+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:51:01.119926735Z [2024-04-15T01:51:01.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:51:01.119971810Z 2024-04-15T01:51:01.119981634Z 2024-04-15T01:51:01.119989727Z 2024-04-15T01:51:01.123658997Z [2024-04-15T01:51:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:51:01.123790972Z [2024-04-15T01:51:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:51:01.124007068Z [2024-04-15T01:51:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:51:01.124127475Z [2024-04-15T01:51:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:51:01.124405467Z [2024-04-15T01:51:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:51:01.124502888Z [2024-04-15T01:51:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:51:01.364434226Z [2024-04-15T01:51:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:51:01.364470826Z [2024-04-15T01:51:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:51:01.364560353Z [2024-04-15T01:51:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:51:01.378980015Z [2024-04-15T01:51:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 583be38a-2132-4208-a55d-079e8dcf52b2 2024-04-15T01:51:01.379257544Z [2024-04-15T01:51:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to a95cde75-4606-4477-b2c5-43a93775ea17 2024-04-15T01:51:01.379752841Z [2024-04-15T01:51:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebfaa3c9-b7b8-4e85-b0ae-b5105eb9d569 2024-04-15T01:51:03.583989858Z [2024-04-15T01:51:03.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:51:03.584242008Z [2024-04-15T01:51:03.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:51:01.059335+00:00, run_end_date=2024-04-15 01:51:03.583791+00:00, run_duration=2.524456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:51:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:51:03.592531288Z [2024-04-15T01:51:03.592+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:03.641693739Z [2024-04-15T01:51:03.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:51:03.654341558Z [2024-04-15T01:51:03.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:51:02.068123+00:00, run_end_date=2024-04-15 01:51:02.505221+00:00, run_duration=0.437098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:51:01.120822+00:00, queued_by_job_id=1, pid=12924 2024-04-15T01:51:04.714281499Z [2024-04-15T01:51:04.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:51:04.714567390Z [2024-04-15T01:51:04.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:51:01.060633+00:00, run_end_date=2024-04-15 01:51:04.714127+00:00, run_duration=3.653494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:51:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:51:04.725833978Z [2024-04-15T01:51:04.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:04.788724245Z [2024-04-15T01:51:04.788+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:51:05.014583529Z [2024-04-15T01:51:05.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:51:05.014960655Z [2024-04-15T01:51:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:51:01.061977+00:00, run_end_date=2024-04-15 01:51:05.014618+00:00, run_duration=3.952641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:51:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:51:05.024347395Z [2024-04-15T01:51:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:51:00+00:00, run_after=2024-04-15T01:52:00+00:00 2024-04-15T01:51:05.055406086Z [2024-04-15T01:51:05.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:51:05.060957686Z [2024-04-15T01:51:05.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:51:03.022541+00:00, run_end_date=2024-04-15 01:51:04.684526+00:00, run_duration=1.661985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:51:01.120822+00:00, queued_by_job_id=1, pid=12943 2024-04-15T01:51:06.166148761Z [2024-04-15T01:51:06.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:51:06.170765639Z [2024-04-15T01:51:06.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:51:02.971466+00:00, run_end_date=2024-04-15 01:51:04.960014+00:00, run_duration=1.988548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:51:01.120822+00:00, queued_by_job_id=1, pid=12942 2024-04-15T01:52:00.029282356Z [2024-04-15T01:52:00.028+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:52:00.040193136Z [2024-04-15T01:52:00.039+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:52:00.060179434Z [2024-04-15T01:52:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:00.075686711Z [2024-04-15T01:52:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:00.188650670Z [2024-04-15T01:52:00.188+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:52:00.188674618Z 2024-04-15T01:52:00.188680053Z 2024-04-15T01:52:00.188684126Z 2024-04-15T01:52:00.188688458Z 2024-04-15T01:52:00.188700244Z [2024-04-15T01:52:00.188+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:52:00.188774479Z [2024-04-15T01:52:00.188+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:52:00.188860595Z [2024-04-15T01:52:00.188+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:52:00.188954374Z [2024-04-15T01:52:00.188+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:52:00.189552801Z [2024-04-15T01:52:00.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:52:00.189558835Z 2024-04-15T01:52:00.189561950Z 2024-04-15T01:52:00.189564757Z 2024-04-15T01:52:00.189567471Z 2024-04-15T01:52:00.193524458Z [2024-04-15T01:52:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:52:00.193660885Z [2024-04-15T01:52:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:52:00.193916001Z [2024-04-15T01:52:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:52:00.194019384Z [2024-04-15T01:52:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:52:00.194241456Z [2024-04-15T01:52:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:52:00.194372686Z [2024-04-15T01:52:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:52:00.194574261Z [2024-04-15T01:52:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:52:00.194677855Z [2024-04-15T01:52:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:52:00.617145458Z [2024-04-15T01:52:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:52:00.617326583Z [2024-04-15T01:52:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status queued for try_number 1 2024-04-15T01:52:00.617510423Z [2024-04-15T01:52:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status queued for try_number 1 2024-04-15T01:52:00.617660127Z [2024-04-15T01:52:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status queued for try_number 1 2024-04-15T01:52:00.638185015Z [2024-04-15T01:52:00.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83fc1eac-c26e-496f-b848-2167f6bd1071 2024-04-15T01:52:00.638405119Z [2024-04-15T01:52:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1419f7f-9ace-4ff7-9dcc-41e5f1a7a77f 2024-04-15T01:52:00.638589298Z [2024-04-15T01:52:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96f100c3-f413-402f-affb-2a09875af6d0 2024-04-15T01:52:00.638770763Z [2024-04-15T01:52:00.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57c01e3f-95c9-44b5-a6ad-f8338d01ac2f 2024-04-15T01:52:02.311516403Z [2024-04-15T01:52:02.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:52:02.311876189Z [2024-04-15T01:52:02.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:52:00.089513+00:00, run_end_date=2024-04-15 01:52:02.311412+00:00, run_duration=2.221899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:52:02.321965309Z [2024-04-15T01:52:02.321+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:52:02.329085007Z [2024-04-15T01:52:02.328+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:52:02.329509364Z [2024-04-15T01:52:02.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:51:00+00:00, run_id=scheduled__2024-04-15T01:51:00+00:00, run_start_date=2024-04-15 01:52:00.091552+00:00, run_end_date=2024-04-15 01:52:02.329005+00:00, run_duration=2.237453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:51:00+00:00, data_interval_end=2024-04-15 01:52:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:52:02.344613524Z [2024-04-15T01:52:02.344+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:02.414434393Z [2024-04-15T01:52:02.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:52:02.414528311Z [2024-04-15T01:52:02.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status success for try_number 1 2024-04-15T01:52:02.420699405Z [2024-04-15T01:52:02.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:52:00.991083+00:00, run_end_date=2024-04-15 01:52:01.381221+00:00, run_duration=0.390138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:52:00.190606+00:00, queued_by_job_id=1, pid=12976 2024-04-15T01:52:02.420893520Z [2024-04-15T01:52:02.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:51:00+00:00, map_index=-1, run_start_date=2024-04-15 01:52:01.283284+00:00, run_end_date=2024-04-15 01:52:01.660717+00:00, run_duration=0.377433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:52:00.190606+00:00, queued_by_job_id=1, pid=12980 2024-04-15T01:52:04.598242153Z [2024-04-15T01:52:04.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:52:04.598837791Z [2024-04-15T01:52:04.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:51:00+00:00, run_id=scheduled__2024-04-15T01:51:00+00:00, run_start_date=2024-04-15 01:52:00.092976+00:00, run_end_date=2024-04-15 01:52:04.598444+00:00, run_duration=4.505468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:51:00+00:00, data_interval_end=2024-04-15 01:52:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:52:04.610943520Z [2024-04-15T01:52:04.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:04.616964597Z [2024-04-15T01:52:04.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:52:04.617375121Z [2024-04-15T01:52:04.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:51:00+00:00, run_id=scheduled__2024-04-15T01:51:00+00:00, run_start_date=2024-04-15 01:52:00.094342+00:00, run_end_date=2024-04-15 01:52:04.617081+00:00, run_duration=4.522739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:51:00+00:00, data_interval_end=2024-04-15 01:52:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:52:04.626136440Z [2024-04-15T01:52:04.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:52:00+00:00, run_after=2024-04-15T01:53:00+00:00 2024-04-15T01:52:04.665247897Z [2024-04-15T01:52:04.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status success for try_number 1 2024-04-15T01:52:04.665567928Z [2024-04-15T01:52:04.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:51:00+00:00 exited with status success for try_number 1 2024-04-15T01:52:04.675575716Z [2024-04-15T01:52:04.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:51:00+00:00, map_index=-1, run_start_date=2024-04-15 01:52:02.387905+00:00, run_end_date=2024-04-15 01:52:03.637486+00:00, run_duration=1.249581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:52:00.190606+00:00, queued_by_job_id=1, pid=13000 2024-04-15T01:52:04.676056293Z [2024-04-15T01:52:04.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:51:00+00:00, map_index=-1, run_start_date=2024-04-15 01:52:02.392755+00:00, run_end_date=2024-04-15 01:52:04.013373+00:00, run_duration=1.620618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:52:00.190606+00:00, queued_by_job_id=1, pid=13001 2024-04-15T01:53:00.296857528Z [2024-04-15T01:53:00.296+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:53:00.328658579Z [2024-04-15T01:53:00.328+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:00.353302460Z [2024-04-15T01:53:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:00.394983071Z [2024-04-15T01:53:00.392+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:53:00.395018775Z 2024-04-15T01:53:00.395026529Z 2024-04-15T01:53:00.395032459Z 2024-04-15T01:53:00.395038206Z [2024-04-15T01:53:00.392+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:53:00.395043823Z [2024-04-15T01:53:00.392+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:53:00.395049383Z [2024-04-15T01:53:00.392+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:53:00.395055865Z [2024-04-15T01:53:00.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:53:00.395061555Z 2024-04-15T01:53:00.395082904Z 2024-04-15T01:53:00.395089036Z 2024-04-15T01:53:00.399688006Z [2024-04-15T01:53:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:53:00.399711409Z [2024-04-15T01:53:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:53:00.399717580Z [2024-04-15T01:53:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:53:00.399723392Z [2024-04-15T01:53:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:53:00.399729171Z [2024-04-15T01:53:00.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:53:00.399734850Z [2024-04-15T01:53:00.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:53:00.644828527Z [2024-04-15T01:53:00.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status queued for try_number 1 2024-04-15T01:53:00.645004927Z [2024-04-15T01:53:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status queued for try_number 1 2024-04-15T01:53:00.645063984Z [2024-04-15T01:53:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status queued for try_number 1 2024-04-15T01:53:00.652901018Z [2024-04-15T01:53:00.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e60c666-8f5c-4003-aa5f-7bb9f811b8d4 2024-04-15T01:53:00.653106535Z [2024-04-15T01:53:00.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bed8ac2-a7ae-4beb-9970-20df3a7413ff 2024-04-15T01:53:00.653294733Z [2024-04-15T01:53:00.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to e89dfd6d-200e-452f-a2a1-4b6d48b3a362 2024-04-15T01:53:01.788350575Z [2024-04-15T01:53:01.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:53:01.788838574Z [2024-04-15T01:53:01.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:52:00+00:00, run_id=scheduled__2024-04-15T01:52:00+00:00, run_start_date=2024-04-15 01:53:00.352353+00:00, run_end_date=2024-04-15 01:53:01.788256+00:00, run_duration=1.435903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:52:00+00:00, data_interval_end=2024-04-15 01:53:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:53:01.797635571Z [2024-04-15T01:53:01.797+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:01.850659802Z [2024-04-15T01:53:01.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status success for try_number 1 2024-04-15T01:53:01.855448190Z [2024-04-15T01:53:01.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:52:00+00:00, map_index=-1, run_start_date=2024-04-15 01:53:01.205323+00:00, run_end_date=2024-04-15 01:53:01.568770+00:00, run_duration=0.363447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:53:00.393946+00:00, queued_by_job_id=1, pid=13033 2024-04-15T01:53:04.421196652Z [2024-04-15T01:53:04.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:53:04.421315630Z [2024-04-15T01:53:04.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:52:00+00:00, run_id=scheduled__2024-04-15T01:52:00+00:00, run_start_date=2024-04-15 01:53:00.353542+00:00, run_end_date=2024-04-15 01:53:04.418479+00:00, run_duration=4.064937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:52:00+00:00, data_interval_end=2024-04-15 01:53:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:53:04.433551364Z [2024-04-15T01:53:04.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:04.441215431Z [2024-04-15T01:53:04.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:53:04.441446587Z [2024-04-15T01:53:04.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:52:00+00:00, run_id=scheduled__2024-04-15T01:52:00+00:00, run_start_date=2024-04-15 01:53:00.354433+00:00, run_end_date=2024-04-15 01:53:04.441168+00:00, run_duration=4.086735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:52:00+00:00, data_interval_end=2024-04-15 01:53:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:53:04.450260151Z [2024-04-15T01:53:04.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:53:00+00:00, run_after=2024-04-15T01:54:00+00:00 2024-04-15T01:53:04.489976891Z [2024-04-15T01:53:04.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status success for try_number 1 2024-04-15T01:53:04.490405606Z [2024-04-15T01:53:04.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status success for try_number 1 2024-04-15T01:53:04.499710182Z [2024-04-15T01:53:04.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:52:00+00:00, map_index=-1, run_start_date=2024-04-15 01:53:02.207502+00:00, run_end_date=2024-04-15 01:53:03.445863+00:00, run_duration=1.238361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:53:00.393946+00:00, queued_by_job_id=1, pid=13052 2024-04-15T01:53:04.500296226Z [2024-04-15T01:53:04.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:52:00+00:00, map_index=-1, run_start_date=2024-04-15 01:53:02.176817+00:00, run_end_date=2024-04-15 01:53:03.812447+00:00, run_duration=1.63563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:53:00.393946+00:00, queued_by_job_id=1, pid=13051 2024-04-15T01:54:00.564156610Z [2024-04-15T01:54:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:00.577913738Z [2024-04-15T01:54:00.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:00.585744578Z [2024-04-15T01:54:00.585+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:54:00.593495488Z [2024-04-15T01:54:00.593+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:54:00.713225302Z [2024-04-15T01:54:00.712+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:54:00.713268161Z 2024-04-15T01:54:00.713278951Z 2024-04-15T01:54:00.713287823Z 2024-04-15T01:54:00.713296741Z 2024-04-15T01:54:00.713678584Z [2024-04-15T01:54:00.713+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:54:00.714167694Z [2024-04-15T01:54:00.713+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:54:00.714533872Z [2024-04-15T01:54:00.714+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:54:00.714927783Z [2024-04-15T01:54:00.714+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:54:00.716205106Z [2024-04-15T01:54:00.715+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:54:00.716228664Z 2024-04-15T01:54:00.716238499Z 2024-04-15T01:54:00.716246929Z 2024-04-15T01:54:00.716255570Z 2024-04-15T01:54:00.724062562Z [2024-04-15T01:54:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:54:00.724406149Z [2024-04-15T01:54:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:54:00.724845497Z [2024-04-15T01:54:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:54:00.725217127Z [2024-04-15T01:54:00.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:54:00.725698951Z [2024-04-15T01:54:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:54:00.726080132Z [2024-04-15T01:54:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:54:00.726540943Z [2024-04-15T01:54:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:54:00.726955829Z [2024-04-15T01:54:00.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:54:01.119940213Z [2024-04-15T01:54:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status queued for try_number 1 2024-04-15T01:54:01.119977765Z [2024-04-15T01:54:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status queued for try_number 1 2024-04-15T01:54:01.120055594Z [2024-04-15T01:54:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status queued for try_number 1 2024-04-15T01:54:01.120082907Z [2024-04-15T01:54:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status queued for try_number 1 2024-04-15T01:54:01.127952276Z [2024-04-15T01:54:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaf60ae5-112f-41ab-bd3f-b8b572595d4d 2024-04-15T01:54:01.128039417Z [2024-04-15T01:54:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to d20b4289-8a22-45b2-ba15-3d22ba3d7de6 2024-04-15T01:54:01.128078316Z [2024-04-15T01:54:01.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72c77877-50ee-4548-8cec-4611e8a76518 2024-04-15T01:54:01.128215205Z [2024-04-15T01:54:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to c399a01d-e00b-481c-b5e1-392d60659f0c 2024-04-15T01:54:02.267817744Z [2024-04-15T01:54:02.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:54:02.267969430Z [2024-04-15T01:54:02.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:52:00+00:00, run_id=scheduled__2024-04-15T01:52:00+00:00, run_start_date=2024-04-15 01:54:00.606005+00:00, run_end_date=2024-04-15 01:54:02.267675+00:00, run_duration=1.66167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:52:00+00:00, data_interval_end=2024-04-15 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:54:02.274803653Z [2024-04-15T01:54:02.274+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:54:02.283056638Z [2024-04-15T01:54:02.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:54:02.283091995Z [2024-04-15T01:54:02.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:53:00+00:00, run_id=scheduled__2024-04-15T01:53:00+00:00, run_start_date=2024-04-15 01:54:00.607389+00:00, run_end_date=2024-04-15 01:54:02.279662+00:00, run_duration=1.672273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:53:00+00:00, data_interval_end=2024-04-15 01:54:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:54:02.288800908Z [2024-04-15T01:54:02.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:02.329807881Z [2024-04-15T01:54:02.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:52:00+00:00 exited with status success for try_number 1 2024-04-15T01:54:02.329830762Z [2024-04-15T01:54:02.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status success for try_number 1 2024-04-15T01:54:02.335482251Z [2024-04-15T01:54:02.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:53:00+00:00, map_index=-1, run_start_date=2024-04-15 01:54:01.541267+00:00, run_end_date=2024-04-15 01:54:01.866009+00:00, run_duration=0.324742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:54:00.719331+00:00, queued_by_job_id=1, pid=13087 2024-04-15T01:54:02.335667211Z [2024-04-15T01:54:02.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:52:00+00:00, map_index=-1, run_start_date=2024-04-15 01:54:01.441435+00:00, run_end_date=2024-04-15 01:54:01.779195+00:00, run_duration=0.33776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:54:00.719331+00:00, queued_by_job_id=1, pid=13086 2024-04-15T01:54:04.289012019Z [2024-04-15T01:54:04.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:54:04.289417310Z [2024-04-15T01:54:04.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:53:00+00:00, run_id=scheduled__2024-04-15T01:53:00+00:00, run_start_date=2024-04-15 01:54:00.608608+00:00, run_end_date=2024-04-15 01:54:04.289011+00:00, run_duration=3.680403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:53:00+00:00, data_interval_end=2024-04-15 01:54:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:54:04.297868328Z [2024-04-15T01:54:04.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:04.349475990Z [2024-04-15T01:54:04.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status success for try_number 1 2024-04-15T01:54:04.357958917Z [2024-04-15T01:54:04.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:53:00+00:00, map_index=-1, run_start_date=2024-04-15 01:54:02.541516+00:00, run_end_date=2024-04-15 01:54:03.812465+00:00, run_duration=1.270949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:54:00.719331+00:00, queued_by_job_id=1, pid=13111 2024-04-15T01:54:05.416497383Z [2024-04-15T01:54:05.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:54:05.416591387Z [2024-04-15T01:54:05.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:53:00+00:00, run_id=scheduled__2024-04-15T01:53:00+00:00, run_start_date=2024-04-15 01:54:00.611488+00:00, run_end_date=2024-04-15 01:54:05.416341+00:00, run_duration=4.804853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:53:00+00:00, data_interval_end=2024-04-15 01:54:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:54:05.424011091Z [2024-04-15T01:54:05.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:54:00+00:00, run_after=2024-04-15T01:55:00+00:00 2024-04-15T01:54:05.461031568Z [2024-04-15T01:54:05.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:53:00+00:00 exited with status success for try_number 1 2024-04-15T01:54:05.467613756Z [2024-04-15T01:54:05.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:53:00+00:00, map_index=-1, run_start_date=2024-04-15 01:54:02.515452+00:00, run_end_date=2024-04-15 01:54:04.188659+00:00, run_duration=1.673207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:54:00.719331+00:00, queued_by_job_id=1, pid=13110 2024-04-15T01:55:00.834496091Z [2024-04-15T01:55:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:55:00.853749965Z [2024-04-15T01:55:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:55:00.875012803Z [2024-04-15T01:55:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:00.904644616Z [2024-04-15T01:55:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:01.026236659Z [2024-04-15T01:55:01.025+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:55:01.026271007Z 2024-04-15T01:55:01.026278704Z 2024-04-15T01:55:01.026284784Z 2024-04-15T01:55:01.026310807Z 2024-04-15T01:55:01.026469209Z [2024-04-15T01:55:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:55:01.026772934Z [2024-04-15T01:55:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:55:01.027101217Z [2024-04-15T01:55:01.026+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:55:01.027523756Z [2024-04-15T01:55:01.027+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:55:01.028682110Z [2024-04-15T01:55:01.028+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:01.028701604Z 2024-04-15T01:55:01.028708643Z 2024-04-15T01:55:01.028714908Z 2024-04-15T01:55:01.028720739Z 2024-04-15T01:55:01.035585511Z [2024-04-15T01:55:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T01:55:01.035691022Z [2024-04-15T01:55:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:01.036202816Z [2024-04-15T01:55:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:55:01.036454064Z [2024-04-15T01:55:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:55:01.036885418Z [2024-04-15T01:55:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:55:01.037152059Z [2024-04-15T01:55:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:55:01.037582045Z [2024-04-15T01:55:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:55:01.037838077Z [2024-04-15T01:55:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:55:01.358094133Z [2024-04-15T01:55:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:01.358135609Z [2024-04-15T01:55:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:01.358187268Z [2024-04-15T01:55:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:01.358248267Z [2024-04-15T01:55:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:01.366035571Z [2024-04-15T01:55:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78044e77-e881-48d6-8f08-78181013ed39 2024-04-15T01:55:01.366056673Z [2024-04-15T01:55:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0f66351-897d-428e-ad02-833313af2f66 2024-04-15T01:55:01.366177031Z [2024-04-15T01:55:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 490dd5de-bd85-41ce-b686-1c744d0019a3 2024-04-15T01:55:01.366250502Z [2024-04-15T01:55:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1233a1ed-1275-4dd7-8121-7861ce6fa1d1 2024-04-15T01:55:03.708134805Z [2024-04-15T01:55:03.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:55:03.708615598Z [2024-04-15T01:55:03.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:54:00+00:00, run_id=scheduled__2024-04-15T01:54:00+00:00, run_start_date=2024-04-15 01:55:00.923230+00:00, run_end_date=2024-04-15 01:55:03.708262+00:00, run_duration=2.785032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:54:00+00:00, data_interval_end=2024-04-15 01:55:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:55:03.718030621Z [2024-04-15T01:55:03.717+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:03.845504050Z [2024-04-15T01:55:03.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:03.854104079Z [2024-04-15T01:55:03.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:54:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:02.196130+00:00, run_end_date=2024-04-15 01:55:02.575879+00:00, run_duration=0.379749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:01.030327+00:00, queued_by_job_id=1, pid=13144 2024-04-15T01:55:05.292346341Z [2024-04-15T01:55:05.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:55:05.292684164Z [2024-04-15T01:55:05.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:54:00+00:00, run_id=scheduled__2024-04-15T01:54:00+00:00, run_start_date=2024-04-15 01:55:00.925339+00:00, run_end_date=2024-04-15 01:55:05.292247+00:00, run_duration=4.366908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:54:00+00:00, data_interval_end=2024-04-15 01:55:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:55:05.308910443Z [2024-04-15T01:55:05.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:05.330723063Z [2024-04-15T01:55:05.330+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:55:05.330744312Z 2024-04-15T01:55:05.330755435Z [2024-04-15T01:55:05.330+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:55:05.331393569Z [2024-04-15T01:55:05.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:05.331405809Z 2024-04-15T01:55:05.333617362Z [2024-04-15T01:55:05.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T01:55:05.333691633Z [2024-04-15T01:55:05.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:05.391715868Z [2024-04-15T01:55:05.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:05.392081920Z [2024-04-15T01:55:05.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:05.392567746Z [2024-04-15T01:55:05.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:05.408488623Z [2024-04-15T01:55:05.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:54:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:03.365606+00:00, run_end_date=2024-04-15 01:55:04.968653+00:00, run_duration=1.603047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:01.030327+00:00, queued_by_job_id=1, pid=13158 2024-04-15T01:55:05.408787519Z [2024-04-15T01:55:05.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 464d587e-1757-4b38-9196-4bff7485f7c6 2024-04-15T01:55:05.409170351Z [2024-04-15T01:55:05.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:03.758824+00:00, run_end_date=2024-04-15 01:55:04.213728+00:00, run_duration=0.454904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:01.030327+00:00, queued_by_job_id=1, pid=13165 2024-04-15T01:55:06.456178449Z [2024-04-15T01:55:06.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:55:06.456549630Z [2024-04-15T01:55:06.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:54:00+00:00, run_id=scheduled__2024-04-15T01:54:00+00:00, run_start_date=2024-04-15 01:55:00.927312+00:00, run_end_date=2024-04-15 01:55:06.456158+00:00, run_duration=5.528846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:54:00+00:00, data_interval_end=2024-04-15 01:55:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:55:06.470749551Z [2024-04-15T01:55:06.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T01:56:00+00:00 2024-04-15T01:55:06.512906259Z [2024-04-15T01:55:06.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:06.518026119Z [2024-04-15T01:55:06.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:54:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:04.097404+00:00, run_end_date=2024-04-15 01:55:05.754120+00:00, run_duration=1.656716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:01.030327+00:00, queued_by_job_id=1, pid=13175 2024-04-15T01:55:07.597087370Z [2024-04-15T01:55:07.596+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:55:07.597117540Z 2024-04-15T01:55:07.597563953Z [2024-04-15T01:55:07.597+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:55:07.599344359Z [2024-04-15T01:55:07.598+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:07.599358724Z 2024-04-15T01:55:07.603969000Z [2024-04-15T01:55:07.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T01:55:07.604290577Z [2024-04-15T01:55:07.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:55:07.668983121Z [2024-04-15T01:55:07.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:07.671305900Z [2024-04-15T01:55:07.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:07.676837234Z [2024-04-15T01:55:07.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to c925f8f6-1b6e-497a-86d8-759977ca1539 2024-04-15T01:55:07.677156367Z [2024-04-15T01:55:07.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:06.884152+00:00, run_end_date=2024-04-15 01:55:07.307216+00:00, run_duration=0.423064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:05.331650+00:00, queued_by_job_id=1, pid=13193 2024-04-15T01:55:11.526957501Z [2024-04-15T01:55:11.526+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T01:55:11.526994605Z 2024-04-15T01:55:11.527020683Z [2024-04-15T01:55:11.526+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:55:11.527810829Z [2024-04-15T01:55:11.527+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:55:11.527830471Z 2024-04-15T01:55:11.530131653Z [2024-04-15T01:55:11.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:55:11.530370792Z [2024-04-15T01:55:11.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:11.589370489Z [2024-04-15T01:55:11.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status queued for try_number 1 2024-04-15T01:55:11.589710384Z [2024-04-15T01:55:11.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:11.596167614Z [2024-04-15T01:55:11.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81f75136-e0db-47e2-8f84-af69a59eb3d3 2024-04-15T01:55:11.596460893Z [2024-04-15T01:55:11.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=0, run_start_date=2024-04-15 01:55:09.219944+00:00, run_end_date=2024-04-15 01:55:10.483335+00:00, run_duration=1.263391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:07.600298+00:00, queued_by_job_id=1, pid=13201 2024-04-15T01:55:13.857953190Z [2024-04-15T01:55:13.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:55:13.858387802Z [2024-04-15T01:55:13.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:50:00+00:00, run_id=scheduled__2024-04-15T01:50:00+00:00, run_start_date=2024-04-15 01:55:00.920772+00:00, run_end_date=2024-04-15 01:55:13.857940+00:00, run_duration=12.937168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:50:00+00:00, data_interval_end=2024-04-15 01:55:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T01:55:13.866476396Z [2024-04-15T01:55:13.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:55:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:55:13.907445838Z [2024-04-15T01:55:13.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:50:00+00:00 exited with status success for try_number 1 2024-04-15T01:55:13.914623939Z [2024-04-15T01:55:13.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:50:00+00:00, map_index=-1, run_start_date=2024-04-15 01:55:13.088296+00:00, run_end_date=2024-04-15 01:55:13.469244+00:00, run_duration=0.380948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:55:11.528248+00:00, queued_by_job_id=1, pid=13214 2024-04-15T01:56:00.120063942Z [2024-04-15T01:56:00.119+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:56:00.134767367Z [2024-04-15T01:56:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:00.151005761Z [2024-04-15T01:56:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:56:00.163617926Z [2024-04-15T01:56:00.163+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:00.272757357Z [2024-04-15T01:56:00.272+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:56:00.272796891Z 2024-04-15T01:56:00.272810590Z 2024-04-15T01:56:00.272820011Z 2024-04-15T01:56:00.272829302Z 2024-04-15T01:56:00.272888389Z [2024-04-15T01:56:00.272+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:56:00.273162045Z [2024-04-15T01:56:00.272+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:56:00.273370498Z [2024-04-15T01:56:00.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:56:00.273578255Z [2024-04-15T01:56:00.273+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:56:00.274791006Z [2024-04-15T01:56:00.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:56:00.274804121Z 2024-04-15T01:56:00.274813484Z 2024-04-15T01:56:00.274822238Z 2024-04-15T01:56:00.274830884Z 2024-04-15T01:56:00.280820861Z [2024-04-15T01:56:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:56:00.280913439Z [2024-04-15T01:56:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:56:00.281312320Z [2024-04-15T01:56:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:56:00.281519151Z [2024-04-15T01:56:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:56:00.281807550Z [2024-04-15T01:56:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:56:00.281984750Z [2024-04-15T01:56:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:56:00.282299265Z [2024-04-15T01:56:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:56:00.282503148Z [2024-04-15T01:56:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:56:00.763337100Z [2024-04-15T01:56:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status queued for try_number 1 2024-04-15T01:56:00.763389990Z [2024-04-15T01:56:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:56:00.763601857Z [2024-04-15T01:56:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:56:00.763725406Z [2024-04-15T01:56:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T01:56:00.784083629Z [2024-04-15T01:56:00.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 223af4e1-c43c-4195-95d8-a461e75ad650 2024-04-15T01:56:00.784375956Z [2024-04-15T01:56:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 207255a1-00ae-45d4-94e0-4b36ce8b99e5 2024-04-15T01:56:00.784578039Z [2024-04-15T01:56:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to eed4ae44-4c82-417e-b21c-d2c517394298 2024-04-15T01:56:00.784752393Z [2024-04-15T01:56:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ae9495e-42b9-4e3e-a04b-a6d0c32681fd 2024-04-15T01:56:02.054253411Z [2024-04-15T01:56:02.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:56:02.054483717Z [2024-04-15T01:56:02.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:54:00+00:00, run_id=scheduled__2024-04-15T01:54:00+00:00, run_start_date=2024-04-15 01:56:00.179040+00:00, run_end_date=2024-04-15 01:56:02.054191+00:00, run_duration=1.875151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:54:00+00:00, data_interval_end=2024-04-15 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:56:02.062137364Z [2024-04-15T01:56:02.061+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:56:02.067337722Z [2024-04-15T01:56:02.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:56:02.067539922Z [2024-04-15T01:56:02.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:55:00+00:00, run_id=scheduled__2024-04-15T01:55:00+00:00, run_start_date=2024-04-15 01:56:00.180407+00:00, run_end_date=2024-04-15 01:56:02.067243+00:00, run_duration=1.886836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:55:00+00:00, data_interval_end=2024-04-15 01:56:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:56:02.075478523Z [2024-04-15T01:56:02.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:02.123111345Z [2024-04-15T01:56:02.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:54:00+00:00 exited with status success for try_number 1 2024-04-15T01:56:02.123168559Z [2024-04-15T01:56:02.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:56:02.128880888Z [2024-04-15T01:56:02.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:54:00+00:00, map_index=-1, run_start_date=2024-04-15 01:56:01.020901+00:00, run_end_date=2024-04-15 01:56:01.433142+00:00, run_duration=0.412241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:56:00.276480+00:00, queued_by_job_id=1, pid=13237 2024-04-15T01:56:02.129206224Z [2024-04-15T01:56:02.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:56:01.196990+00:00, run_end_date=2024-04-15 01:56:01.592346+00:00, run_duration=0.395356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:56:00.276480+00:00, queued_by_job_id=1, pid=13238 2024-04-15T01:56:04.847626605Z [2024-04-15T01:56:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:56:04.847755990Z [2024-04-15T01:56:04.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:55:00+00:00, run_id=scheduled__2024-04-15T01:55:00+00:00, run_start_date=2024-04-15 01:56:00.181542+00:00, run_end_date=2024-04-15 01:56:04.847326+00:00, run_duration=4.665784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:55:00+00:00, data_interval_end=2024-04-15 01:56:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:56:04.859817762Z [2024-04-15T01:56:04.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:04.869240531Z [2024-04-15T01:56:04.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:56:04.869918271Z [2024-04-15T01:56:04.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:55:00+00:00, run_id=scheduled__2024-04-15T01:55:00+00:00, run_start_date=2024-04-15 01:56:00.182599+00:00, run_end_date=2024-04-15 01:56:04.869299+00:00, run_duration=4.6867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:55:00+00:00, data_interval_end=2024-04-15 01:56:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:56:04.890035474Z [2024-04-15T01:56:04.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:56:00+00:00, run_after=2024-04-15T01:57:00+00:00 2024-04-15T01:56:04.947194056Z [2024-04-15T01:56:04.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:56:04.947705191Z [2024-04-15T01:56:04.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T01:56:04.960151921Z [2024-04-15T01:56:04.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:56:02.191795+00:00, run_end_date=2024-04-15 01:56:04.289551+00:00, run_duration=2.097756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:56:00.276480+00:00, queued_by_job_id=1, pid=13261 2024-04-15T01:56:04.960762726Z [2024-04-15T01:56:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 01:56:02.193554+00:00, run_end_date=2024-04-15 01:56:04.617414+00:00, run_duration=2.42386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:56:00.276480+00:00, queued_by_job_id=1, pid=13262 2024-04-15T01:56:04.973660149Z [2024-04-15T01:56:04.973+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T01:57:00.295134094Z [2024-04-15T01:57:00.294+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:57:00.322021833Z [2024-04-15T01:57:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:00.351134611Z [2024-04-15T01:57:00.339+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:00.433091709Z [2024-04-15T01:57:00.432+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:57:00.433121689Z 2024-04-15T01:57:00.433125492Z 2024-04-15T01:57:00.433128565Z 2024-04-15T01:57:00.433277766Z [2024-04-15T01:57:00.433+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:57:00.433534785Z [2024-04-15T01:57:00.433+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:57:00.433773704Z [2024-04-15T01:57:00.433+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:57:00.434316575Z [2024-04-15T01:57:00.434+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:57:00.434326826Z 2024-04-15T01:57:00.434330477Z 2024-04-15T01:57:00.434333845Z 2024-04-15T01:57:00.436986109Z [2024-04-15T01:57:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:57:00.437133456Z [2024-04-15T01:57:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:57:00.437345328Z [2024-04-15T01:57:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:57:00.437490874Z [2024-04-15T01:57:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:57:00.437709541Z [2024-04-15T01:57:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:57:00.437840499Z [2024-04-15T01:57:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:57:00.662629055Z [2024-04-15T01:57:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status queued for try_number 1 2024-04-15T01:57:00.662849662Z [2024-04-15T01:57:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status queued for try_number 1 2024-04-15T01:57:00.663108619Z [2024-04-15T01:57:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status queued for try_number 1 2024-04-15T01:57:00.673529275Z [2024-04-15T01:57:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b90739e-fd63-4b19-96e8-2c77431c210c 2024-04-15T01:57:00.673738360Z [2024-04-15T01:57:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4470482-cec0-4743-9cb5-3375fb470e66 2024-04-15T01:57:00.673946340Z [2024-04-15T01:57:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfdefc5d-090c-426d-8b63-3260564ead87 2024-04-15T01:57:01.805756592Z [2024-04-15T01:57:01.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:57:01.805887672Z [2024-04-15T01:57:01.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:56:00+00:00, run_id=scheduled__2024-04-15T01:56:00+00:00, run_start_date=2024-04-15 01:57:00.361529+00:00, run_end_date=2024-04-15 01:57:01.805603+00:00, run_duration=1.444074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:56:00+00:00, data_interval_end=2024-04-15 01:57:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:57:01.814471560Z [2024-04-15T01:57:01.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:01.851751877Z [2024-04-15T01:57:01.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status success for try_number 1 2024-04-15T01:57:01.859957068Z [2024-04-15T01:57:01.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:56:00+00:00, map_index=-1, run_start_date=2024-04-15 01:57:01.198202+00:00, run_end_date=2024-04-15 01:57:01.565056+00:00, run_duration=0.366854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:57:00.434923+00:00, queued_by_job_id=1, pid=13294 2024-04-15T01:57:04.005372585Z [2024-04-15T01:57:04.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:57:04.005814506Z [2024-04-15T01:57:04.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:56:00+00:00, run_id=scheduled__2024-04-15T01:56:00+00:00, run_start_date=2024-04-15 01:57:00.362797+00:00, run_end_date=2024-04-15 01:57:04.005248+00:00, run_duration=3.642451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:56:00+00:00, data_interval_end=2024-04-15 01:57:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:57:04.015348162Z [2024-04-15T01:57:04.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:04.021999804Z [2024-04-15T01:57:04.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:57:04.022346396Z [2024-04-15T01:57:04.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:56:00+00:00, run_id=scheduled__2024-04-15T01:56:00+00:00, run_start_date=2024-04-15 01:57:00.364077+00:00, run_end_date=2024-04-15 01:57:04.021826+00:00, run_duration=3.657749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:56:00+00:00, data_interval_end=2024-04-15 01:57:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:57:04.039748837Z [2024-04-15T01:57:04.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:57:00+00:00, run_after=2024-04-15T01:58:00+00:00 2024-04-15T01:57:04.087675519Z [2024-04-15T01:57:04.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status success for try_number 1 2024-04-15T01:57:04.088184484Z [2024-04-15T01:57:04.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status success for try_number 1 2024-04-15T01:57:04.102035216Z [2024-04-15T01:57:04.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:56:00+00:00, map_index=-1, run_start_date=2024-04-15 01:57:02.301325+00:00, run_end_date=2024-04-15 01:57:03.527910+00:00, run_duration=1.226585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:57:00.434923+00:00, queued_by_job_id=1, pid=13313 2024-04-15T01:57:04.102696899Z [2024-04-15T01:57:04.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:56:00+00:00, map_index=-1, run_start_date=2024-04-15 01:57:02.111602+00:00, run_end_date=2024-04-15 01:57:03.707817+00:00, run_duration=1.596215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:57:00.434923+00:00, queued_by_job_id=1, pid=13310 2024-04-15T01:58:00.874532585Z [2024-04-15T01:58:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:00.883294850Z [2024-04-15T01:58:00.882+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:58:00.897649572Z [2024-04-15T01:58:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:00.905774457Z [2024-04-15T01:58:00.905+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:58:00.998124840Z [2024-04-15T01:58:00.997+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T01:58:00.998156469Z 2024-04-15T01:58:00.998164427Z 2024-04-15T01:58:00.998171337Z 2024-04-15T01:58:00.998177905Z 2024-04-15T01:58:00.998459151Z [2024-04-15T01:58:00.998+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T01:58:00.998852853Z [2024-04-15T01:58:00.998+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:58:00.999285651Z [2024-04-15T01:58:00.998+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:58:00.999701826Z [2024-04-15T01:58:00.999+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:58:01.001028240Z [2024-04-15T01:58:01.000+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:58:01.001048215Z 2024-04-15T01:58:01.001055469Z 2024-04-15T01:58:01.001061764Z 2024-04-15T01:58:01.001067943Z 2024-04-15T01:58:01.007955811Z [2024-04-15T01:58:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:58:01.008229465Z [2024-04-15T01:58:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:58:01.008658884Z [2024-04-15T01:58:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:58:01.008885876Z [2024-04-15T01:58:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:58:01.009266028Z [2024-04-15T01:58:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:58:01.009548786Z [2024-04-15T01:58:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:58:01.009936387Z [2024-04-15T01:58:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:58:01.010143668Z [2024-04-15T01:58:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:58:01.537564560Z [2024-04-15T01:58:01.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status queued for try_number 1 2024-04-15T01:58:01.537729468Z [2024-04-15T01:58:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status queued for try_number 1 2024-04-15T01:58:01.537939349Z [2024-04-15T01:58:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status queued for try_number 1 2024-04-15T01:58:01.538150201Z [2024-04-15T01:58:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status queued for try_number 1 2024-04-15T01:58:01.564288595Z [2024-04-15T01:58:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cb95f4f-b4dd-4f76-bd66-eb2b9dc4917c 2024-04-15T01:58:01.564560841Z [2024-04-15T01:58:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88a86871-572e-4b32-a138-e12cadd9ad16 2024-04-15T01:58:01.564939854Z [2024-04-15T01:58:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26bf5098-c7fa-4558-98b5-a2dabbd9a902 2024-04-15T01:58:01.565141188Z [2024-04-15T01:58:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to e849dbd8-8aa2-4295-959b-78e480deafde 2024-04-15T01:58:02.749449430Z [2024-04-15T01:58:02.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:58:02.749959921Z [2024-04-15T01:58:02.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:56:00+00:00, run_id=scheduled__2024-04-15T01:56:00+00:00, run_start_date=2024-04-15 01:58:00.918290+00:00, run_end_date=2024-04-15 01:58:02.749529+00:00, run_duration=1.831239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:56:00+00:00, data_interval_end=2024-04-15 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T01:58:02.761317149Z [2024-04-15T01:58:02.761+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:58:02.768092172Z [2024-04-15T01:58:02.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:58:02.768421171Z [2024-04-15T01:58:02.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:57:00+00:00, run_id=scheduled__2024-04-15T01:57:00+00:00, run_start_date=2024-04-15 01:58:00.919545+00:00, run_end_date=2024-04-15 01:58:02.768009+00:00, run_duration=1.848464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:57:00+00:00, data_interval_end=2024-04-15 01:58:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:58:02.779548103Z [2024-04-15T01:58:02.779+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:02.846956142Z [2024-04-15T01:58:02.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:56:00+00:00 exited with status success for try_number 1 2024-04-15T01:58:02.846995135Z [2024-04-15T01:58:02.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status success for try_number 1 2024-04-15T01:58:02.870778399Z [2024-04-15T01:58:02.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:56:00+00:00, map_index=-1, run_start_date=2024-04-15 01:58:01.766431+00:00, run_end_date=2024-04-15 01:58:02.128703+00:00, run_duration=0.362272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:58:01.002632+00:00, queued_by_job_id=1, pid=13347 2024-04-15T01:58:02.870811752Z [2024-04-15T01:58:02.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:57:00+00:00, map_index=-1, run_start_date=2024-04-15 01:58:01.859167+00:00, run_end_date=2024-04-15 01:58:02.229962+00:00, run_duration=0.370795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:58:01.002632+00:00, queued_by_job_id=1, pid=13348 2024-04-15T01:58:05.048581399Z [2024-04-15T01:58:05.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:58:05.048772186Z [2024-04-15T01:58:05.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:57:00+00:00, run_id=scheduled__2024-04-15T01:57:00+00:00, run_start_date=2024-04-15 01:58:00.920682+00:00, run_end_date=2024-04-15 01:58:05.048420+00:00, run_duration=4.127738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:57:00+00:00, data_interval_end=2024-04-15 01:58:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:58:05.062174765Z [2024-04-15T01:58:05.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:05.074431837Z [2024-04-15T01:58:05.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:58:05.075330866Z [2024-04-15T01:58:05.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:57:00+00:00, run_id=scheduled__2024-04-15T01:57:00+00:00, run_start_date=2024-04-15 01:58:00.921731+00:00, run_end_date=2024-04-15 01:58:05.074317+00:00, run_duration=4.152586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:57:00+00:00, data_interval_end=2024-04-15 01:58:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:58:05.091209469Z [2024-04-15T01:58:05.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:58:00+00:00, run_after=2024-04-15T01:59:00+00:00 2024-04-15T01:58:05.138946010Z [2024-04-15T01:58:05.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status success for try_number 1 2024-04-15T01:58:05.139332754Z [2024-04-15T01:58:05.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:57:00+00:00 exited with status success for try_number 1 2024-04-15T01:58:05.149997078Z [2024-04-15T01:58:05.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:57:00+00:00, map_index=-1, run_start_date=2024-04-15 01:58:02.795734+00:00, run_end_date=2024-04-15 01:58:04.234004+00:00, run_duration=1.43827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:58:01.002632+00:00, queued_by_job_id=1, pid=13371 2024-04-15T01:58:05.150340890Z [2024-04-15T01:58:05.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:57:00+00:00, map_index=-1, run_start_date=2024-04-15 01:58:02.960668+00:00, run_end_date=2024-04-15 01:58:04.499020+00:00, run_duration=1.538352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:58:01.002632+00:00, queued_by_job_id=1, pid=13372 2024-04-15T01:59:00.925819385Z [2024-04-15T01:59:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:00.945412963Z [2024-04-15T01:59:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:00.953823362Z [2024-04-15T01:59:00.953+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T01:59:01.064315682Z [2024-04-15T01:59:01.063+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T01:59:01.064362253Z 2024-04-15T01:59:01.064372359Z 2024-04-15T01:59:01.064382187Z 2024-04-15T01:59:01.064588732Z [2024-04-15T01:59:01.064+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:59:01.065033295Z [2024-04-15T01:59:01.064+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T01:59:01.065376413Z [2024-04-15T01:59:01.065+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T01:59:01.066651821Z [2024-04-15T01:59:01.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T01:59:01.066671763Z 2024-04-15T01:59:01.066678913Z 2024-04-15T01:59:01.066685302Z 2024-04-15T01:59:01.072160765Z [2024-04-15T01:59:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:59:01.072525972Z [2024-04-15T01:59:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:59:01.073101967Z [2024-04-15T01:59:01.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:59:01.073312988Z [2024-04-15T01:59:01.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:59:01.073739748Z [2024-04-15T01:59:01.073+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T01:59:01.073968090Z [2024-04-15T01:59:01.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T01:59:01.261477436Z [2024-04-15T01:59:01.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status queued for try_number 1 2024-04-15T01:59:01.261505587Z [2024-04-15T01:59:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status queued for try_number 1 2024-04-15T01:59:01.261571016Z [2024-04-15T01:59:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status queued for try_number 1 2024-04-15T01:59:01.269722374Z [2024-04-15T01:59:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to abfb65e4-f79d-4d75-80fa-b15bb86d03fe 2024-04-15T01:59:01.269772011Z [2024-04-15T01:59:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9433eaf4-f782-4e80-bc2a-0604efe4fa33 2024-04-15T01:59:01.269868490Z [2024-04-15T01:59:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10471a50-bd62-4e0b-a444-5cf94a642061 2024-04-15T01:59:02.937222946Z [2024-04-15T01:59:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:59:02.937403247Z [2024-04-15T01:59:02.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:58:00+00:00, run_id=scheduled__2024-04-15T01:58:00+00:00, run_start_date=2024-04-15 01:59:00.969531+00:00, run_end_date=2024-04-15 01:59:02.937139+00:00, run_duration=1.967608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:58:00+00:00, data_interval_end=2024-04-15 01:59:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T01:59:02.948440804Z [2024-04-15T01:59:02.948+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:02.998889606Z [2024-04-15T01:59:02.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status success for try_number 1 2024-04-15T01:59:03.004587763Z [2024-04-15T01:59:03.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:58:00+00:00, map_index=-1, run_start_date=2024-04-15 01:59:01.834702+00:00, run_end_date=2024-04-15 01:59:02.189992+00:00, run_duration=0.35529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:59:01.067978+00:00, queued_by_job_id=1, pid=13404 2024-04-15T01:59:04.977475926Z [2024-04-15T01:59:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:59:04.977645792Z [2024-04-15T01:59:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:58:00+00:00, run_id=scheduled__2024-04-15T01:58:00+00:00, run_start_date=2024-04-15 01:59:00.973226+00:00, run_end_date=2024-04-15 01:59:04.977295+00:00, run_duration=4.004069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:58:00+00:00, data_interval_end=2024-04-15 01:59:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T01:59:04.989059071Z [2024-04-15T01:59:04.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:04.997850874Z [2024-04-15T01:59:04.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T01:59:04.997904857Z [2024-04-15T01:59:04.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:58:00+00:00, run_id=scheduled__2024-04-15T01:58:00+00:00, run_start_date=2024-04-15 01:59:00.976348+00:00, run_end_date=2024-04-15 01:59:04.997666+00:00, run_duration=4.021318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:58:00+00:00, data_interval_end=2024-04-15 01:59:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T01:59:05.008368636Z [2024-04-15T01:59:05.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T01:59:00+00:00, run_after=2024-04-15T02:00:00+00:00 2024-04-15T01:59:05.054117558Z [2024-04-15T01:59:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status success for try_number 1 2024-04-15T01:59:05.054172812Z [2024-04-15T01:59:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status success for try_number 1 2024-04-15T01:59:05.066980730Z [2024-04-15T01:59:05.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:58:00+00:00, map_index=-1, run_start_date=2024-04-15 01:59:02.808985+00:00, run_end_date=2024-04-15 01:59:04.369695+00:00, run_duration=1.56071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:59:01.067978+00:00, queued_by_job_id=1, pid=13423 2024-04-15T01:59:05.067250792Z [2024-04-15T01:59:05.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:58:00+00:00, map_index=-1, run_start_date=2024-04-15 01:59:02.745485+00:00, run_end_date=2024-04-15 01:59:04.060823+00:00, run_duration=1.315338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 01:59:01.067978+00:00, queued_by_job_id=1, pid=13422 2024-04-15T02:00:00.855660795Z [2024-04-15T02:00:00.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:00.871626935Z [2024-04-15T02:00:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:00:00.886171950Z [2024-04-15T02:00:00.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:00.897383559Z [2024-04-15T02:00:00.897+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:00:00.905162952Z [2024-04-15T02:00:00.904+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:00:01.040802970Z [2024-04-15T02:00:01.038+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T02:00:01.040844409Z 2024-04-15T02:00:01.040854159Z 2024-04-15T02:00:01.040863698Z 2024-04-15T02:00:01.040872272Z 2024-04-15T02:00:01.040880634Z 2024-04-15T02:00:01.040888969Z [2024-04-15T02:00:01.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:00:01.040898364Z [2024-04-15T02:00:01.038+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:00:01.040907559Z [2024-04-15T02:00:01.039+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:00:01.040940514Z [2024-04-15T02:00:01.039+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:00:01.040949527Z [2024-04-15T02:00:01.039+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:00:01.040957929Z [2024-04-15T02:00:01.040+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:01.040966408Z 2024-04-15T02:00:01.040974751Z 2024-04-15T02:00:01.040983170Z 2024-04-15T02:00:01.040991683Z 2024-04-15T02:00:01.041000171Z 2024-04-15T02:00:01.049792354Z [2024-04-15T02:00:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:00:01.049918251Z [2024-04-15T02:00:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:01.050338842Z [2024-04-15T02:00:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:01.050512114Z [2024-04-15T02:00:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:00:01.050935606Z [2024-04-15T02:00:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:01.051077569Z [2024-04-15T02:00:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:00:01.051471682Z [2024-04-15T02:00:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:01.051624856Z [2024-04-15T02:00:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:00:01.052039015Z [2024-04-15T02:00:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:01.052172949Z [2024-04-15T02:00:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:00:01.584137761Z [2024-04-15T02:00:01.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:01.584189519Z [2024-04-15T02:00:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:01.584199486Z [2024-04-15T02:00:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:01.584250619Z [2024-04-15T02:00:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:01.584321886Z [2024-04-15T02:00:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:01.608136605Z [2024-04-15T02:00:01.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97b7aab8-9747-4334-989b-2c3648b561a5 2024-04-15T02:00:01.608213609Z [2024-04-15T02:00:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to f47d7ec8-732d-4be7-b87d-3d2c15416df7 2024-04-15T02:00:01.608302875Z [2024-04-15T02:00:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdbe0013-45a2-4319-9f7a-1c75a9063048 2024-04-15T02:00:01.608410027Z [2024-04-15T02:00:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01b54687-b93b-4509-91a2-5058d34e09c2 2024-04-15T02:00:01.608501334Z [2024-04-15T02:00:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to b129a5a2-869d-495e-b1cc-a1d43167b6dc 2024-04-15T02:00:02.252510625Z [2024-04-15T02:00:02.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:02.252825392Z [2024-04-15T02:00:02.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 01:58:00+00:00, run_id=scheduled__2024-04-15T01:58:00+00:00, run_start_date=2024-04-15 02:00:00.920220+00:00, run_end_date=2024-04-15 02:00:02.252461+00:00, run_duration=1.332241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:58:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:00:02.261108743Z [2024-04-15T02:00:02.260+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:00:03.443031059Z [2024-04-15T02:00:03.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:03.443335478Z [2024-04-15T02:00:03.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 01:59:00+00:00, run_id=scheduled__2024-04-15T01:59:00+00:00, run_start_date=2024-04-15 02:00:00.921430+00:00, run_end_date=2024-04-15 02:00:03.442965+00:00, run_duration=2.521535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:59:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:00:03.452865279Z [2024-04-15T02:00:03.452+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:03.506801727Z [2024-04-15T02:00:03.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T01:58:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:03.506823158Z [2024-04-15T02:00:03.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:03.516367111Z [2024-04-15T02:00:03.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T01:58:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:01.845820+00:00, run_end_date=2024-04-15 02:00:02.221623+00:00, run_duration=0.375803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:01.042706+00:00, queued_by_job_id=1, pid=13451 2024-04-15T02:00:03.516590166Z [2024-04-15T02:00:03.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:59:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:02.507393+00:00, run_end_date=2024-04-15 02:00:02.850493+00:00, run_duration=0.3431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:01.042706+00:00, queued_by_job_id=1, pid=13465 2024-04-15T02:00:04.609460268Z [2024-04-15T02:00:04.609+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:00:04.609486548Z 2024-04-15T02:00:04.610818229Z [2024-04-15T02:00:04.610+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:00:04.611713405Z [2024-04-15T02:00:04.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:04.611744483Z 2024-04-15T02:00:04.615567544Z [2024-04-15T02:00:04.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:00:04.615638627Z [2024-04-15T02:00:04.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:04.661228276Z [2024-04-15T02:00:04.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:04.661256154Z [2024-04-15T02:00:04.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:04.682335662Z [2024-04-15T02:00:04.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32009138-434e-4398-990f-fbd9e6b6ae50 2024-04-15T02:00:04.682432529Z [2024-04-15T02:00:04.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:03.107088+00:00, run_end_date=2024-04-15 02:00:03.453723+00:00, run_duration=0.346635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:01.042706+00:00, queued_by_job_id=1, pid=13486 2024-04-15T02:00:04.722389879Z [2024-04-15T02:00:04.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:04.722522701Z [2024-04-15T02:00:04.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:59:00+00:00, run_id=scheduled__2024-04-15T01:59:00+00:00, run_start_date=2024-04-15 02:00:00.922766+00:00, run_end_date=2024-04-15 02:00:04.722309+00:00, run_duration=3.799543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:59:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:00:04.736629649Z [2024-04-15T02:00:04.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:04.853557783Z [2024-04-15T02:00:04.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:04.862734503Z [2024-04-15T02:00:04.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:59:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:03.187484+00:00, run_end_date=2024-04-15 02:00:04.551076+00:00, run_duration=1.363592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:01.042706+00:00, queued_by_job_id=1, pid=13487 2024-04-15T02:00:05.929760288Z [2024-04-15T02:00:05.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:05.930793141Z [2024-04-15T02:00:05.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:59:00+00:00, run_id=scheduled__2024-04-15T01:59:00+00:00, run_start_date=2024-04-15 02:00:00.924215+00:00, run_end_date=2024-04-15 02:00:05.930368+00:00, run_duration=5.006153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:59:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:00:05.947434611Z [2024-04-15T02:00:05.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:01:00+00:00 2024-04-15T02:00:06.017642276Z [2024-04-15T02:00:06.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T01:59:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:06.024666960Z [2024-04-15T02:00:06.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T01:59:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:03.288251+00:00, run_end_date=2024-04-15 02:00:04.909443+00:00, run_duration=1.621192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:01.042706+00:00, queued_by_job_id=1, pid=13488 2024-04-15T02:00:07.102075588Z [2024-04-15T02:00:07.101+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:00:07.102127997Z 2024-04-15T02:00:07.102342903Z [2024-04-15T02:00:07.101+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:00:07.102990351Z [2024-04-15T02:00:07.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:07.103016154Z 2024-04-15T02:00:07.104966381Z [2024-04-15T02:00:07.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:00:07.105204540Z [2024-04-15T02:00:07.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:00:07.210960810Z [2024-04-15T02:00:07.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:07.211014508Z [2024-04-15T02:00:07.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:07.214094643Z [2024-04-15T02:00:07.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e415c1a-4f37-408c-8466-50b17afcca35 2024-04-15T02:00:07.214295349Z [2024-04-15T02:00:07.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:06.311986+00:00, run_end_date=2024-04-15 02:00:06.655815+00:00, run_duration=0.343829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:04.612318+00:00, queued_by_job_id=1, pid=13511 2024-04-15T02:00:11.056193620Z [2024-04-15T02:00:11.055+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:00:11.056222731Z 2024-04-15T02:00:11.056403826Z [2024-04-15T02:00:11.056+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:00:11.057557744Z [2024-04-15T02:00:11.057+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:00:11.057565097Z 2024-04-15T02:00:11.062423832Z [2024-04-15T02:00:11.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:00:11.062593064Z [2024-04-15T02:00:11.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:11.114164951Z [2024-04-15T02:00:11.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status queued for try_number 1 2024-04-15T02:00:11.114514113Z [2024-04-15T02:00:11.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:11.126127868Z [2024-04-15T02:00:11.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cc02aae-54d2-4f27-a02d-50263d580876 2024-04-15T02:00:11.126560080Z [2024-04-15T02:00:11.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=0, run_start_date=2024-04-15 02:00:08.612868+00:00, run_end_date=2024-04-15 02:00:09.944564+00:00, run_duration=1.331696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:07.103335+00:00, queued_by_job_id=1, pid=13519 2024-04-15T02:00:13.347207230Z [2024-04-15T02:00:13.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:00:13.347761545Z [2024-04-15T02:00:13.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 01:55:00+00:00, run_id=scheduled__2024-04-15T01:55:00+00:00, run_start_date=2024-04-15 02:00:00.918781+00:00, run_end_date=2024-04-15 02:00:13.347301+00:00, run_duration=12.42852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 01:55:00+00:00, data_interval_end=2024-04-15 02:00:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:00:13.357360835Z [2024-04-15T02:00:13.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:00:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:00:13.411393147Z [2024-04-15T02:00:13.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T01:55:00+00:00 exited with status success for try_number 1 2024-04-15T02:00:13.421052249Z [2024-04-15T02:00:13.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T01:55:00+00:00, map_index=-1, run_start_date=2024-04-15 02:00:12.611493+00:00, run_end_date=2024-04-15 02:00:13.038961+00:00, run_duration=0.427468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:00:11.058431+00:00, queued_by_job_id=1, pid=13532 2024-04-15T02:01:00.856490291Z [2024-04-15T02:01:00.855+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:00.871094496Z [2024-04-15T02:01:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:00.879102591Z [2024-04-15T02:01:00.878+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:01:00.976073970Z [2024-04-15T02:01:00.975+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:01:00.976125578Z 2024-04-15T02:01:00.976137055Z 2024-04-15T02:01:00.976146011Z 2024-04-15T02:01:00.976192170Z [2024-04-15T02:01:00.975+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:01:00.976599377Z [2024-04-15T02:01:00.976+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:01:00.976974263Z [2024-04-15T02:01:00.976+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:01:00.977894459Z [2024-04-15T02:01:00.977+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:01:00.977913222Z 2024-04-15T02:01:00.977919288Z 2024-04-15T02:01:00.977924661Z 2024-04-15T02:01:00.982296058Z [2024-04-15T02:01:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:01:00.982925342Z [2024-04-15T02:01:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:01:00.983538515Z [2024-04-15T02:01:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:01:00.984070446Z [2024-04-15T02:01:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:01:00.984720955Z [2024-04-15T02:01:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:01:00.985184323Z [2024-04-15T02:01:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:01:01.197946117Z [2024-04-15T02:01:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:01:01.198178265Z [2024-04-15T02:01:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:01:01.198443297Z [2024-04-15T02:01:01.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:01:01.208984946Z [2024-04-15T02:01:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to be9e0655-2eab-49a1-b09c-483f43f1d92c 2024-04-15T02:01:01.209222547Z [2024-04-15T02:01:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4f6fdf0-4c95-4409-b47b-2a86f99ebcfe 2024-04-15T02:01:01.209484705Z [2024-04-15T02:01:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5171ef00-46ed-488a-911f-c57a87cd91f2 2024-04-15T02:01:02.339549356Z [2024-04-15T02:01:02.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:01:02.339718247Z [2024-04-15T02:01:02.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:01:00.891770+00:00, run_end_date=2024-04-15 02:01:02.339412+00:00, run_duration=1.447642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:01:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:01:02.348991031Z [2024-04-15T02:01:02.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:02.417193593Z [2024-04-15T02:01:02.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:01:02.430737749Z [2024-04-15T02:01:02.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:01:01.756145+00:00, run_end_date=2024-04-15 02:01:02.172294+00:00, run_duration=0.416149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:01:00.979061+00:00, queued_by_job_id=1, pid=13554 2024-04-15T02:01:04.795271028Z [2024-04-15T02:01:04.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:01:04.795634978Z [2024-04-15T02:01:04.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:01:00.893081+00:00, run_end_date=2024-04-15 02:01:04.795087+00:00, run_duration=3.902006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:01:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:01:04.810227845Z [2024-04-15T02:01:04.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:04.866576484Z [2024-04-15T02:01:04.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:01:04.873021041Z [2024-04-15T02:01:04.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:01:02.748766+00:00, run_end_date=2024-04-15 02:01:04.425244+00:00, run_duration=1.676478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:01:00.979061+00:00, queued_by_job_id=1, pid=13573 2024-04-15T02:01:05.099920515Z [2024-04-15T02:01:05.099+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:01:06.168686566Z [2024-04-15T02:01:06.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:01:06.169064838Z [2024-04-15T02:01:06.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:01:00.894284+00:00, run_end_date=2024-04-15 02:01:06.168597+00:00, run_duration=5.274313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:01:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:01:06.177531412Z [2024-04-15T02:01:06.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:01:00+00:00, run_after=2024-04-15T02:02:00+00:00 2024-04-15T02:01:06.207721812Z [2024-04-15T02:01:06.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:01:06.214272139Z [2024-04-15T02:01:06.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:01:02.658015+00:00, run_end_date=2024-04-15 02:01:05.762815+00:00, run_duration=3.1048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:01:00.979061+00:00, queued_by_job_id=1, pid=13572 2024-04-15T02:02:00.408510524Z [2024-04-15T02:02:00.408+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:02:00.427281375Z [2024-04-15T02:02:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:00.440403340Z [2024-04-15T02:02:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:00.447942641Z [2024-04-15T02:02:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:02:00.543295146Z [2024-04-15T02:02:00.540+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:02:00.543334021Z 2024-04-15T02:02:00.543367693Z 2024-04-15T02:02:00.543377178Z 2024-04-15T02:02:00.543392415Z 2024-04-15T02:02:00.543401889Z [2024-04-15T02:02:00.541+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:02:00.543410572Z [2024-04-15T02:02:00.541+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:02:00.543419097Z [2024-04-15T02:02:00.542+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:02:00.543428079Z [2024-04-15T02:02:00.542+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:02:00.543517062Z [2024-04-15T02:02:00.542+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:02:00.543542645Z 2024-04-15T02:02:00.543561488Z 2024-04-15T02:02:00.543568143Z 2024-04-15T02:02:00.543573614Z 2024-04-15T02:02:00.548428362Z [2024-04-15T02:02:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:02:00.548620706Z [2024-04-15T02:02:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:02:00.548924830Z [2024-04-15T02:02:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:02:00.549146840Z [2024-04-15T02:02:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:02:00.549482568Z [2024-04-15T02:02:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:02:00.549658468Z [2024-04-15T02:02:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:02:00.550028231Z [2024-04-15T02:02:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:02:00.550215314Z [2024-04-15T02:02:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:02:01.102183821Z [2024-04-15T02:02:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:02:01.102253326Z [2024-04-15T02:02:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status queued for try_number 1 2024-04-15T02:02:01.102346537Z [2024-04-15T02:02:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status queued for try_number 1 2024-04-15T02:02:01.102431975Z [2024-04-15T02:02:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status queued for try_number 1 2024-04-15T02:02:01.128347644Z [2024-04-15T02:02:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c505c4a-1d86-4687-87ec-20a94d85adc3 2024-04-15T02:02:01.128477119Z [2024-04-15T02:02:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40229bd1-7178-4562-b55c-7950e348cd25 2024-04-15T02:02:01.128597714Z [2024-04-15T02:02:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25813045-cc7f-497e-a346-27a840f98691 2024-04-15T02:02:01.128706926Z [2024-04-15T02:02:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b6b14be-9e35-42dc-bb70-fe6fb95f3d29 2024-04-15T02:02:02.161960368Z [2024-04-15T02:02:02.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:02:02.162254707Z [2024-04-15T02:02:02.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:02:00.460548+00:00, run_end_date=2024-04-15 02:02:02.161834+00:00, run_duration=1.701286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:02:02.172904983Z [2024-04-15T02:02:02.169+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:02:02.178764241Z [2024-04-15T02:02:02.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:02:02.178805743Z [2024-04-15T02:02:02.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:01:00+00:00, run_id=scheduled__2024-04-15T02:01:00+00:00, run_start_date=2024-04-15 02:02:00.462095+00:00, run_end_date=2024-04-15 02:02:02.175908+00:00, run_duration=1.713813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:01:00+00:00, data_interval_end=2024-04-15 02:02:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:02:02.186977003Z [2024-04-15T02:02:02.186+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:02.243490758Z [2024-04-15T02:02:02.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:02:02.243916123Z [2024-04-15T02:02:02.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status success for try_number 1 2024-04-15T02:02:02.257495144Z [2024-04-15T02:02:02.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:02:01.268798+00:00, run_end_date=2024-04-15 02:02:01.721686+00:00, run_duration=0.452888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:02:00.544737+00:00, queued_by_job_id=1, pid=13607 2024-04-15T02:02:02.257857154Z [2024-04-15T02:02:02.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:01:00+00:00, map_index=-1, run_start_date=2024-04-15 02:02:01.274526+00:00, run_end_date=2024-04-15 02:02:01.620853+00:00, run_duration=0.346327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:02:00.544737+00:00, queued_by_job_id=1, pid=13606 2024-04-15T02:02:05.129910111Z [2024-04-15T02:02:05.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:02:05.130114068Z [2024-04-15T02:02:05.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:01:00+00:00, run_id=scheduled__2024-04-15T02:01:00+00:00, run_start_date=2024-04-15 02:02:00.467241+00:00, run_end_date=2024-04-15 02:02:05.129632+00:00, run_duration=4.662391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:01:00+00:00, data_interval_end=2024-04-15 02:02:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:02:05.141370475Z [2024-04-15T02:02:05.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:05.150320010Z [2024-04-15T02:02:05.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:02:05.150628745Z [2024-04-15T02:02:05.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:01:00+00:00, run_id=scheduled__2024-04-15T02:01:00+00:00, run_start_date=2024-04-15 02:02:00.469134+00:00, run_end_date=2024-04-15 02:02:05.150161+00:00, run_duration=4.681027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:01:00+00:00, data_interval_end=2024-04-15 02:02:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:02:05.161168842Z [2024-04-15T02:02:05.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:02:00+00:00, run_after=2024-04-15T02:03:00+00:00 2024-04-15T02:02:05.214547924Z [2024-04-15T02:02:05.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status success for try_number 1 2024-04-15T02:02:05.217127148Z [2024-04-15T02:02:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:01:00+00:00 exited with status success for try_number 1 2024-04-15T02:02:05.228586169Z [2024-04-15T02:02:05.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:01:00+00:00, map_index=-1, run_start_date=2024-04-15 02:02:02.465392+00:00, run_end_date=2024-04-15 02:02:04.614357+00:00, run_duration=2.148965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:02:00.544737+00:00, queued_by_job_id=1, pid=13631 2024-04-15T02:02:05.228876711Z [2024-04-15T02:02:05.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:01:00+00:00, map_index=-1, run_start_date=2024-04-15 02:02:02.322427+00:00, run_end_date=2024-04-15 02:02:04.074754+00:00, run_duration=1.752327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:02:00.544737+00:00, queued_by_job_id=1, pid=13630 2024-04-15T02:03:00.853281409Z [2024-04-15T02:03:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:00.861288975Z [2024-04-15T02:03:00.860+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:03:00.875663642Z [2024-04-15T02:03:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:00.936704348Z [2024-04-15T02:03:00.936+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:03:00.936749485Z 2024-04-15T02:03:00.936783615Z 2024-04-15T02:03:00.936793696Z 2024-04-15T02:03:00.936880998Z [2024-04-15T02:03:00.936+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:03:00.936937592Z [2024-04-15T02:03:00.936+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:03:00.937166974Z [2024-04-15T02:03:00.936+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:03:00.937857959Z [2024-04-15T02:03:00.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:03:00.937867580Z 2024-04-15T02:03:00.937874528Z 2024-04-15T02:03:00.937881075Z 2024-04-15T02:03:00.941864781Z [2024-04-15T02:03:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:03:00.942022103Z [2024-04-15T02:03:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:03:00.942339625Z [2024-04-15T02:03:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:03:00.942526651Z [2024-04-15T02:03:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:03:00.942938127Z [2024-04-15T02:03:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:03:00.943078646Z [2024-04-15T02:03:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:03:01.123168848Z [2024-04-15T02:03:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status queued for try_number 1 2024-04-15T02:03:01.123206646Z [2024-04-15T02:03:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status queued for try_number 1 2024-04-15T02:03:01.123233544Z [2024-04-15T02:03:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status queued for try_number 1 2024-04-15T02:03:01.130461096Z [2024-04-15T02:03:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4d1038b-21ee-4b62-8916-52389fe5b649 2024-04-15T02:03:01.130547170Z [2024-04-15T02:03:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91d07c4c-c37f-43fd-9cb5-19f6007f8649 2024-04-15T02:03:01.131135130Z [2024-04-15T02:03:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c88822b-aea4-499e-807d-ee80487dfd7f 2024-04-15T02:03:02.259636593Z [2024-04-15T02:03:02.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:03:02.259877143Z [2024-04-15T02:03:02.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:02:00+00:00, run_id=scheduled__2024-04-15T02:02:00+00:00, run_start_date=2024-04-15 02:03:00.886357+00:00, run_end_date=2024-04-15 02:03:02.259553+00:00, run_duration=1.373196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:02:00+00:00, data_interval_end=2024-04-15 02:03:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:03:02.268073610Z [2024-04-15T02:03:02.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:02.308063961Z [2024-04-15T02:03:02.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status success for try_number 1 2024-04-15T02:03:02.320019711Z [2024-04-15T02:03:02.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:02:00+00:00, map_index=-1, run_start_date=2024-04-15 02:03:01.703789+00:00, run_end_date=2024-04-15 02:03:02.066043+00:00, run_duration=0.362254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:03:00.938667+00:00, queued_by_job_id=1, pid=13662 2024-04-15T02:03:04.273620163Z [2024-04-15T02:03:04.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:03:04.273986429Z [2024-04-15T02:03:04.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:02:00+00:00, run_id=scheduled__2024-04-15T02:02:00+00:00, run_start_date=2024-04-15 02:03:00.887702+00:00, run_end_date=2024-04-15 02:03:04.273715+00:00, run_duration=3.386013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:02:00+00:00, data_interval_end=2024-04-15 02:03:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:03:04.281633459Z [2024-04-15T02:03:04.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:05.392021183Z [2024-04-15T02:03:05.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:03:05.392268879Z [2024-04-15T02:03:05.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:02:00+00:00, run_id=scheduled__2024-04-15T02:02:00+00:00, run_start_date=2024-04-15 02:03:00.888765+00:00, run_end_date=2024-04-15 02:03:05.391859+00:00, run_duration=4.503094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:02:00+00:00, data_interval_end=2024-04-15 02:03:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:03:05.401732675Z [2024-04-15T02:03:05.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:03:00+00:00, run_after=2024-04-15T02:04:00+00:00 2024-04-15T02:03:05.438142051Z [2024-04-15T02:03:05.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status success for try_number 1 2024-04-15T02:03:05.438327466Z [2024-04-15T02:03:05.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status success for try_number 1 2024-04-15T02:03:05.446270484Z [2024-04-15T02:03:05.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:02:00+00:00, map_index=-1, run_start_date=2024-04-15 02:03:02.562681+00:00, run_end_date=2024-04-15 02:03:04.189363+00:00, run_duration=1.626682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:03:00.938667+00:00, queued_by_job_id=1, pid=13680 2024-04-15T02:03:05.446591971Z [2024-04-15T02:03:05.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:02:00+00:00, map_index=-1, run_start_date=2024-04-15 02:03:02.575414+00:00, run_end_date=2024-04-15 02:03:05.205758+00:00, run_duration=2.630344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:03:00.938667+00:00, queued_by_job_id=1, pid=13681 2024-04-15T02:04:00.153366960Z [2024-04-15T02:04:00.152+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:04:00.162284758Z [2024-04-15T02:04:00.162+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:04:00.175242453Z [2024-04-15T02:04:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:00.191859291Z [2024-04-15T02:04:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:00.257820228Z [2024-04-15T02:04:00.257+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:04:00.257904196Z 2024-04-15T02:04:00.257958817Z 2024-04-15T02:04:00.257969997Z 2024-04-15T02:04:00.258017092Z 2024-04-15T02:04:00.258043365Z [2024-04-15T02:04:00.257+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:04:00.258086603Z [2024-04-15T02:04:00.257+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:04:00.258096008Z [2024-04-15T02:04:00.257+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:04:00.258114359Z [2024-04-15T02:04:00.257+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:04:00.259166804Z [2024-04-15T02:04:00.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:04:00.259186185Z 2024-04-15T02:04:00.259190121Z 2024-04-15T02:04:00.259193313Z 2024-04-15T02:04:00.259196724Z 2024-04-15T02:04:00.262455905Z [2024-04-15T02:04:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:04:00.262512089Z [2024-04-15T02:04:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:04:00.262706168Z [2024-04-15T02:04:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:04:00.262777194Z [2024-04-15T02:04:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:04:00.262964554Z [2024-04-15T02:04:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:04:00.263028888Z [2024-04-15T02:04:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:04:00.263205962Z [2024-04-15T02:04:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:04:00.263264351Z [2024-04-15T02:04:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:04:00.834907046Z [2024-04-15T02:04:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status queued for try_number 1 2024-04-15T02:04:00.835107262Z [2024-04-15T02:04:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status queued for try_number 1 2024-04-15T02:04:00.835314383Z [2024-04-15T02:04:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status queued for try_number 1 2024-04-15T02:04:00.835456898Z [2024-04-15T02:04:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status queued for try_number 1 2024-04-15T02:04:00.855590129Z [2024-04-15T02:04:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34a98f58-24be-4dc5-a4da-106d13f8e543 2024-04-15T02:04:00.858858213Z [2024-04-15T02:04:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72bfe581-7262-444a-9a63-d731bd69f138 2024-04-15T02:04:00.859118434Z [2024-04-15T02:04:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to f036d721-acdb-4c0e-814f-72c476fb9c86 2024-04-15T02:04:00.859407190Z [2024-04-15T02:04:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6121621-118d-4bc2-80e1-b693e69d1144 2024-04-15T02:04:02.190831891Z [2024-04-15T02:04:02.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:04:02.191847967Z [2024-04-15T02:04:02.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:02:00+00:00, run_id=scheduled__2024-04-15T02:02:00+00:00, run_start_date=2024-04-15 02:04:00.202378+00:00, run_end_date=2024-04-15 02:04:02.190610+00:00, run_duration=1.988232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:02:00+00:00, data_interval_end=2024-04-15 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:04:02.210455775Z [2024-04-15T02:04:02.210+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:04:02.350415252Z [2024-04-15T02:04:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:02:00+00:00 exited with status success for try_number 1 2024-04-15T02:04:02.361412693Z [2024-04-15T02:04:02.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:02:00+00:00, map_index=-1, run_start_date=2024-04-15 02:04:01.365135+00:00, run_end_date=2024-04-15 02:04:01.910611+00:00, run_duration=0.545476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:04:00.259948+00:00, queued_by_job_id=1, pid=13709 2024-04-15T02:04:03.417695132Z [2024-04-15T02:04:03.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:04:03.418175889Z [2024-04-15T02:04:03.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:03:00+00:00, run_id=scheduled__2024-04-15T02:03:00+00:00, run_start_date=2024-04-15 02:04:00.203662+00:00, run_end_date=2024-04-15 02:04:03.417649+00:00, run_duration=3.213987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:03:00+00:00, data_interval_end=2024-04-15 02:04:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:04:03.440152423Z [2024-04-15T02:04:03.438+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:03.502023486Z [2024-04-15T02:04:03.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status success for try_number 1 2024-04-15T02:04:03.506145792Z [2024-04-15T02:04:03.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:03:00+00:00, map_index=-1, run_start_date=2024-04-15 02:04:02.028656+00:00, run_end_date=2024-04-15 02:04:02.496662+00:00, run_duration=0.468006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:04:00.259948+00:00, queued_by_job_id=1, pid=13722 2024-04-15T02:04:04.154966558Z [2024-04-15T02:04:04.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:04:04.155093602Z [2024-04-15T02:04:04.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:03:00+00:00, run_id=scheduled__2024-04-15T02:03:00+00:00, run_start_date=2024-04-15 02:04:00.206066+00:00, run_end_date=2024-04-15 02:04:04.154868+00:00, run_duration=3.948802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:03:00+00:00, data_interval_end=2024-04-15 02:04:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:04:04.168487824Z [2024-04-15T02:04:04.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:04.224303178Z [2024-04-15T02:04:04.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status success for try_number 1 2024-04-15T02:04:04.230625282Z [2024-04-15T02:04:04.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:03:00+00:00, map_index=-1, run_start_date=2024-04-15 02:04:02.357491+00:00, run_end_date=2024-04-15 02:04:04.022019+00:00, run_duration=1.664528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:04:00.259948+00:00, queued_by_job_id=1, pid=13732 2024-04-15T02:04:05.290573233Z [2024-04-15T02:04:05.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:04:05.291008790Z [2024-04-15T02:04:05.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:03:00+00:00, run_id=scheduled__2024-04-15T02:03:00+00:00, run_start_date=2024-04-15 02:04:00.204818+00:00, run_end_date=2024-04-15 02:04:05.290624+00:00, run_duration=5.085806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:03:00+00:00, data_interval_end=2024-04-15 02:04:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:04:05.299137407Z [2024-04-15T02:04:05.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:04:00+00:00, run_after=2024-04-15T02:05:00+00:00 2024-04-15T02:04:05.333059235Z [2024-04-15T02:04:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:03:00+00:00 exited with status success for try_number 1 2024-04-15T02:04:05.338317318Z [2024-04-15T02:04:05.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:03:00+00:00, map_index=-1, run_start_date=2024-04-15 02:04:02.940389+00:00, run_end_date=2024-04-15 02:04:04.639772+00:00, run_duration=1.699383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:04:00.259948+00:00, queued_by_job_id=1, pid=13744 2024-04-15T02:05:00.113792389Z [2024-04-15T02:05:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:00.120100795Z [2024-04-15T02:05:00.119+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:05:00.129700597Z [2024-04-15T02:05:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:00.140493305Z [2024-04-15T02:05:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:05:00.202692028Z [2024-04-15T02:05:00.202+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:05:00.202725090Z 2024-04-15T02:05:00.202733810Z 2024-04-15T02:05:00.202740914Z 2024-04-15T02:05:00.202747356Z 2024-04-15T02:05:00.202753633Z [2024-04-15T02:05:00.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:05:00.202814837Z [2024-04-15T02:05:00.202+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:05:00.202857516Z [2024-04-15T02:05:00.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:05:00.202908519Z [2024-04-15T02:05:00.202+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:05:00.203452901Z [2024-04-15T02:05:00.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:00.203479596Z 2024-04-15T02:05:00.203490843Z 2024-04-15T02:05:00.203501125Z 2024-04-15T02:05:00.203510866Z 2024-04-15T02:05:00.206411526Z [2024-04-15T02:05:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:05:00.206446099Z [2024-04-15T02:05:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:00.206558509Z [2024-04-15T02:05:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:05:00.206634302Z [2024-04-15T02:05:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:05:00.206649923Z [2024-04-15T02:05:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:05:00.206717211Z [2024-04-15T02:05:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:05:00.206932058Z [2024-04-15T02:05:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:05:00.206989903Z [2024-04-15T02:05:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:05:00.718113954Z [2024-04-15T02:05:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:00.718585136Z [2024-04-15T02:05:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:00.718776788Z [2024-04-15T02:05:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:00.720047316Z [2024-04-15T02:05:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:00.735081787Z [2024-04-15T02:05:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f2ccef5-cbaf-4dc9-9b93-2e1486335770 2024-04-15T02:05:00.735364189Z [2024-04-15T02:05:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ec822b2-e550-4639-8901-fbd90c78706b 2024-04-15T02:05:00.735617903Z [2024-04-15T02:05:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80357e39-b164-42a8-b22a-c35c485e8a22 2024-04-15T02:05:00.735909719Z [2024-04-15T02:05:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0bde2d3-15cf-46eb-b0f7-f8f86fdf06ee 2024-04-15T02:05:02.588234748Z [2024-04-15T02:05:02.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:05:02.591435276Z [2024-04-15T02:05:02.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:04:00+00:00, run_id=scheduled__2024-04-15T02:04:00+00:00, run_start_date=2024-04-15 02:05:00.149502+00:00, run_end_date=2024-04-15 02:05:02.590964+00:00, run_duration=2.441462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:04:00+00:00, data_interval_end=2024-04-15 02:05:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:05:02.601147527Z [2024-04-15T02:05:02.600+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:02.715177552Z [2024-04-15T02:05:02.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:02.738238318Z [2024-04-15T02:05:02.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:04:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:01.368595+00:00, run_end_date=2024-04-15 02:05:01.797233+00:00, run_duration=0.428638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:00.204027+00:00, queued_by_job_id=1, pid=13773 2024-04-15T02:05:03.814393938Z [2024-04-15T02:05:03.814+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:05:03.814408277Z 2024-04-15T02:05:03.814415536Z [2024-04-15T02:05:03.814+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:05:03.814927514Z [2024-04-15T02:05:03.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:03.814935888Z 2024-04-15T02:05:03.817136978Z [2024-04-15T02:05:03.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:05:03.817198363Z [2024-04-15T02:05:03.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:03.902040085Z [2024-04-15T02:05:03.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:03.903956883Z [2024-04-15T02:05:03.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:03.909086547Z [2024-04-15T02:05:03.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to aac8e770-bffd-4000-9fe4-3d5eb7593709 2024-04-15T02:05:03.909399852Z [2024-04-15T02:05:03.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:02.192900+00:00, run_end_date=2024-04-15 02:05:02.575109+00:00, run_duration=0.382209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:00.204027+00:00, queued_by_job_id=1, pid=13797 2024-04-15T02:05:03.951420153Z [2024-04-15T02:05:03.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:05:03.951858680Z [2024-04-15T02:05:03.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:04:00+00:00, run_id=scheduled__2024-04-15T02:04:00+00:00, run_start_date=2024-04-15 02:05:00.150359+00:00, run_end_date=2024-04-15 02:05:03.951341+00:00, run_duration=3.800982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:04:00+00:00, data_interval_end=2024-04-15 02:05:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:05:03.961284335Z [2024-04-15T02:05:03.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:04.035167681Z [2024-04-15T02:05:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:04.045103893Z [2024-04-15T02:05:04.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:04:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:02.432536+00:00, run_end_date=2024-04-15 02:05:03.774096+00:00, run_duration=1.34156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:00.204027+00:00, queued_by_job_id=1, pid=13799 2024-04-15T02:05:05.086819971Z [2024-04-15T02:05:05.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:05:05.087208501Z [2024-04-15T02:05:05.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:04:00+00:00, run_id=scheduled__2024-04-15T02:04:00+00:00, run_start_date=2024-04-15 02:05:00.151269+00:00, run_end_date=2024-04-15 02:05:05.086704+00:00, run_duration=4.935435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:04:00+00:00, data_interval_end=2024-04-15 02:05:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:05:05.095264251Z [2024-04-15T02:05:05.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:06:00+00:00 2024-04-15T02:05:05.134719293Z [2024-04-15T02:05:05.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:05.139457791Z [2024-04-15T02:05:05.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:04:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:02.352261+00:00, run_end_date=2024-04-15 02:05:04.102044+00:00, run_duration=1.749783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:00.204027+00:00, queued_by_job_id=1, pid=13798 2024-04-15T02:05:06.945620934Z [2024-04-15T02:05:06.945+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:05:06.945674331Z 2024-04-15T02:05:06.945684807Z [2024-04-15T02:05:06.945+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:05:06.946441648Z [2024-04-15T02:05:06.946+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:06.946468267Z 2024-04-15T02:05:06.949540701Z [2024-04-15T02:05:06.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:05:06.949555692Z [2024-04-15T02:05:06.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:05:07.033439483Z [2024-04-15T02:05:07.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:07.033478675Z [2024-04-15T02:05:07.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:07.043056657Z [2024-04-15T02:05:07.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to f241f31a-d5c6-4983-a0a0-a2a2d004803c 2024-04-15T02:05:07.043314218Z [2024-04-15T02:05:07.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:05.502615+00:00, run_end_date=2024-04-15 02:05:05.826514+00:00, run_duration=0.323899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:03.815227+00:00, queued_by_job_id=1, pid=13822 2024-04-15T02:05:10.477099293Z [2024-04-15T02:05:10.476+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:05:10.477121976Z 2024-04-15T02:05:10.477434823Z [2024-04-15T02:05:10.477+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:05:10.478536930Z [2024-04-15T02:05:10.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:05:10.478548440Z 2024-04-15T02:05:10.482141737Z [2024-04-15T02:05:10.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:05:10.482508516Z [2024-04-15T02:05:10.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:10.534788115Z [2024-04-15T02:05:10.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status queued for try_number 1 2024-04-15T02:05:10.534923449Z [2024-04-15T02:05:10.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:10.544521275Z [2024-04-15T02:05:10.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30448b08-ba07-41ec-9422-c5a69b78f137 2024-04-15T02:05:10.544745715Z [2024-04-15T02:05:10.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=0, run_start_date=2024-04-15 02:05:08.541114+00:00, run_end_date=2024-04-15 02:05:09.850206+00:00, run_duration=1.309092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:06.946980+00:00, queued_by_job_id=1, pid=13830 2024-04-15T02:05:12.651921924Z [2024-04-15T02:05:12.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:05:12.652550202Z [2024-04-15T02:05:12.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:00:00+00:00, run_id=scheduled__2024-04-15T02:00:00+00:00, run_start_date=2024-04-15 02:05:00.148517+00:00, run_end_date=2024-04-15 02:05:12.651755+00:00, run_duration=12.503238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:00:00+00:00, data_interval_end=2024-04-15 02:05:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:05:12.662608985Z [2024-04-15T02:05:12.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:05:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:05:12.693836537Z [2024-04-15T02:05:12.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:00:00+00:00 exited with status success for try_number 1 2024-04-15T02:05:12.699464032Z [2024-04-15T02:05:12.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:00:00+00:00, map_index=-1, run_start_date=2024-04-15 02:05:11.973021+00:00, run_end_date=2024-04-15 02:05:12.356591+00:00, run_duration=0.38357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:05:10.479236+00:00, queued_by_job_id=1, pid=13843 2024-04-15T02:06:00.917536186Z [2024-04-15T02:06:00.915+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:06:00.941489847Z [2024-04-15T02:06:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:00.958020398Z [2024-04-15T02:06:00.957+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:00.966974105Z [2024-04-15T02:06:00.966+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:06:01.068197287Z [2024-04-15T02:06:01.067+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:06:01.068247104Z 2024-04-15T02:06:01.068264481Z 2024-04-15T02:06:01.068278663Z 2024-04-15T02:06:01.068290371Z 2024-04-15T02:06:01.068513280Z [2024-04-15T02:06:01.068+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:06:01.069035552Z [2024-04-15T02:06:01.068+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:06:01.069374116Z [2024-04-15T02:06:01.069+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:06:01.069709719Z [2024-04-15T02:06:01.069+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:06:01.071246805Z [2024-04-15T02:06:01.070+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:06:01.071282783Z 2024-04-15T02:06:01.071296527Z 2024-04-15T02:06:01.071308953Z 2024-04-15T02:06:01.071354893Z 2024-04-15T02:06:01.080513886Z [2024-04-15T02:06:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:06:01.081469212Z [2024-04-15T02:06:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:06:01.081908160Z [2024-04-15T02:06:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:06:01.082143026Z [2024-04-15T02:06:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:06:01.082500391Z [2024-04-15T02:06:01.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:06:01.082741924Z [2024-04-15T02:06:01.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:06:01.083340653Z [2024-04-15T02:06:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:06:01.083559282Z [2024-04-15T02:06:01.083+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:06:01.653448278Z [2024-04-15T02:06:01.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status queued for try_number 1 2024-04-15T02:06:01.653582722Z [2024-04-15T02:06:01.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:06:01.653739730Z [2024-04-15T02:06:01.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:06:01.654212030Z [2024-04-15T02:06:01.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:06:01.671038777Z [2024-04-15T02:06:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a8f9ea5-5a01-4278-86d1-13d70b7652f2 2024-04-15T02:06:01.671284637Z [2024-04-15T02:06:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81f83638-b7cc-4e9f-a5f8-be773bbf646e 2024-04-15T02:06:01.671479907Z [2024-04-15T02:06:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to c674b87b-68cb-40ce-a85e-20b225eeadd6 2024-04-15T02:06:01.671675765Z [2024-04-15T02:06:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d10fe8d-30f3-446c-ab29-dfa550c2cef7 2024-04-15T02:06:03.094537043Z [2024-04-15T02:06:03.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:06:03.095025020Z [2024-04-15T02:06:03.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:05:00+00:00, run_id=scheduled__2024-04-15T02:05:00+00:00, run_start_date=2024-04-15 02:06:00.992762+00:00, run_end_date=2024-04-15 02:06:03.094681+00:00, run_duration=2.101919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:05:00+00:00, data_interval_end=2024-04-15 02:06:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:06:03.104239397Z [2024-04-15T02:06:03.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:03.110296325Z [2024-04-15T02:06:03.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:06:03.110701874Z [2024-04-15T02:06:03.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:04:00+00:00, run_id=scheduled__2024-04-15T02:04:00+00:00, run_start_date=2024-04-15 02:06:00.990519+00:00, run_end_date=2024-04-15 02:06:03.110382+00:00, run_duration=2.119863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:04:00+00:00, data_interval_end=2024-04-15 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:06:03.117468396Z [2024-04-15T02:06:03.117+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:06:03.174807036Z [2024-04-15T02:06:03.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:04:00+00:00 exited with status success for try_number 1 2024-04-15T02:06:03.175100270Z [2024-04-15T02:06:03.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:06:03.180941373Z [2024-04-15T02:06:03.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:04:00+00:00, map_index=-1, run_start_date=2024-04-15 02:06:01.870216+00:00, run_end_date=2024-04-15 02:06:02.188852+00:00, run_duration=0.318636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:06:01.073624+00:00, queued_by_job_id=1, pid=13867 2024-04-15T02:06:03.181343729Z [2024-04-15T02:06:03.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:06:01.840878+00:00, run_end_date=2024-04-15 02:06:02.271130+00:00, run_duration=0.430252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:06:01.073624+00:00, queued_by_job_id=1, pid=13866 2024-04-15T02:06:05.159223577Z [2024-04-15T02:06:05.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:06:05.159721681Z [2024-04-15T02:06:05.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:05:00+00:00, run_id=scheduled__2024-04-15T02:05:00+00:00, run_start_date=2024-04-15 02:06:00.999136+00:00, run_end_date=2024-04-15 02:06:05.159272+00:00, run_duration=4.160136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:05:00+00:00, data_interval_end=2024-04-15 02:06:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:06:05.168995372Z [2024-04-15T02:06:05.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:05.215037725Z [2024-04-15T02:06:05.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:06:05.222755041Z [2024-04-15T02:06:05.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:06:03.049871+00:00, run_end_date=2024-04-15 02:06:04.568942+00:00, run_duration=1.519071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:06:01.073624+00:00, queued_by_job_id=1, pid=13891 2024-04-15T02:06:05.235552487Z [2024-04-15T02:06:05.234+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:06:06.294726573Z [2024-04-15T02:06:06.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:06:06.295370086Z [2024-04-15T02:06:06.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:05:00+00:00, run_id=scheduled__2024-04-15T02:05:00+00:00, run_start_date=2024-04-15 02:06:01.004471+00:00, run_end_date=2024-04-15 02:06:06.295069+00:00, run_duration=5.290598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:05:00+00:00, data_interval_end=2024-04-15 02:06:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:06:06.306003855Z [2024-04-15T02:06:06.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:06:00+00:00, run_after=2024-04-15T02:07:00+00:00 2024-04-15T02:06:06.337679615Z [2024-04-15T02:06:06.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:06:06.358600027Z [2024-04-15T02:06:06.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:06:03.039535+00:00, run_end_date=2024-04-15 02:06:06.177083+00:00, run_duration=3.137548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:06:01.073624+00:00, queued_by_job_id=1, pid=13890 2024-04-15T02:07:00.609763983Z [2024-04-15T02:07:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:00.621568364Z [2024-04-15T02:07:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:00.633789488Z [2024-04-15T02:07:00.633+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:07:00.717804183Z [2024-04-15T02:07:00.717+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:07:00.717844226Z 2024-04-15T02:07:00.717852692Z 2024-04-15T02:07:00.717860528Z 2024-04-15T02:07:00.717910062Z [2024-04-15T02:07:00.717+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:07:00.718148531Z [2024-04-15T02:07:00.717+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:07:00.718448798Z [2024-04-15T02:07:00.718+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:07:00.724623496Z [2024-04-15T02:07:00.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:07:00.724639633Z 2024-04-15T02:07:00.724643157Z 2024-04-15T02:07:00.724646603Z 2024-04-15T02:07:00.730032603Z [2024-04-15T02:07:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:07:00.730453874Z [2024-04-15T02:07:00.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:07:00.731084541Z [2024-04-15T02:07:00.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:07:00.731423548Z [2024-04-15T02:07:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:07:00.732058543Z [2024-04-15T02:07:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:07:00.732709775Z [2024-04-15T02:07:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:07:00.964846737Z [2024-04-15T02:07:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status queued for try_number 1 2024-04-15T02:07:00.964959124Z [2024-04-15T02:07:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status queued for try_number 1 2024-04-15T02:07:00.965081949Z [2024-04-15T02:07:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status queued for try_number 1 2024-04-15T02:07:00.981559096Z [2024-04-15T02:07:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66a24690-51b0-4aba-bde0-e0d7ef13c364 2024-04-15T02:07:00.981702271Z [2024-04-15T02:07:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4150fdf-154b-4e03-858f-5ab905767808 2024-04-15T02:07:00.981849162Z [2024-04-15T02:07:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac65d474-981b-49c0-8aec-9b9424cd0b04 2024-04-15T02:07:02.126242612Z [2024-04-15T02:07:02.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:07:02.126542664Z [2024-04-15T02:07:02.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:06:00+00:00, run_id=scheduled__2024-04-15T02:06:00+00:00, run_start_date=2024-04-15 02:07:00.648024+00:00, run_end_date=2024-04-15 02:07:02.126245+00:00, run_duration=1.478221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:06:00+00:00, data_interval_end=2024-04-15 02:07:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:07:02.139704956Z [2024-04-15T02:07:02.139+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:02.189758731Z [2024-04-15T02:07:02.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status success for try_number 1 2024-04-15T02:07:02.194161925Z [2024-04-15T02:07:02.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:06:00+00:00, map_index=-1, run_start_date=2024-04-15 02:07:01.484950+00:00, run_end_date=2024-04-15 02:07:01.842081+00:00, run_duration=0.357131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:07:00.725085+00:00, queued_by_job_id=1, pid=13923 2024-04-15T02:07:04.471227800Z [2024-04-15T02:07:04.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:07:04.471534307Z [2024-04-15T02:07:04.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:06:00+00:00, run_id=scheduled__2024-04-15T02:06:00+00:00, run_start_date=2024-04-15 02:07:00.649635+00:00, run_end_date=2024-04-15 02:07:04.471111+00:00, run_duration=3.821476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:06:00+00:00, data_interval_end=2024-04-15 02:07:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:07:04.484960224Z [2024-04-15T02:07:04.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:04.495702148Z [2024-04-15T02:07:04.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:07:04.495960976Z [2024-04-15T02:07:04.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:06:00+00:00, run_id=scheduled__2024-04-15T02:06:00+00:00, run_start_date=2024-04-15 02:07:00.650864+00:00, run_end_date=2024-04-15 02:07:04.495471+00:00, run_duration=3.844607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:06:00+00:00, data_interval_end=2024-04-15 02:07:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:07:04.509274949Z [2024-04-15T02:07:04.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:07:00+00:00, run_after=2024-04-15T02:08:00+00:00 2024-04-15T02:07:04.573227558Z [2024-04-15T02:07:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status success for try_number 1 2024-04-15T02:07:04.573981037Z [2024-04-15T02:07:04.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status success for try_number 1 2024-04-15T02:07:04.586053570Z [2024-04-15T02:07:04.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:06:00+00:00, map_index=-1, run_start_date=2024-04-15 02:07:02.362794+00:00, run_end_date=2024-04-15 02:07:03.977428+00:00, run_duration=1.614634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:07:00.725085+00:00, queued_by_job_id=1, pid=13942 2024-04-15T02:07:04.586493436Z [2024-04-15T02:07:04.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:06:00+00:00, map_index=-1, run_start_date=2024-04-15 02:07:02.261156+00:00, run_end_date=2024-04-15 02:07:03.572153+00:00, run_duration=1.310997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:07:00.725085+00:00, queued_by_job_id=1, pid=13941 2024-04-15T02:08:00.308947364Z [2024-04-15T02:08:00.308+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:08:00.319377330Z [2024-04-15T02:08:00.318+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:08:00.342421646Z [2024-04-15T02:08:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:00.357743879Z [2024-04-15T02:08:00.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:00.502770955Z [2024-04-15T02:08:00.502+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:08:00.502810856Z 2024-04-15T02:08:00.502817254Z 2024-04-15T02:08:00.502822297Z 2024-04-15T02:08:00.502827266Z 2024-04-15T02:08:00.503185859Z [2024-04-15T02:08:00.502+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:08:00.503562006Z [2024-04-15T02:08:00.503+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:08:00.503822844Z [2024-04-15T02:08:00.503+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:08:00.504088231Z [2024-04-15T02:08:00.503+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:08:00.505103185Z [2024-04-15T02:08:00.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:08:00.505115215Z 2024-04-15T02:08:00.505120950Z 2024-04-15T02:08:00.505125956Z 2024-04-15T02:08:00.505130840Z 2024-04-15T02:08:00.510208454Z [2024-04-15T02:08:00.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:08:00.510473267Z [2024-04-15T02:08:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:08:00.510850886Z [2024-04-15T02:08:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:08:00.511158159Z [2024-04-15T02:08:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:08:00.511523146Z [2024-04-15T02:08:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:08:00.511791877Z [2024-04-15T02:08:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:08:00.512128378Z [2024-04-15T02:08:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:08:00.512368118Z [2024-04-15T02:08:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:08:01.006111010Z [2024-04-15T02:08:01.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status queued for try_number 1 2024-04-15T02:08:01.006349377Z [2024-04-15T02:08:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status queued for try_number 1 2024-04-15T02:08:01.007036075Z [2024-04-15T02:08:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status queued for try_number 1 2024-04-15T02:08:01.007225827Z [2024-04-15T02:08:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status queued for try_number 1 2024-04-15T02:08:01.024199798Z [2024-04-15T02:08:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea9c42e9-f6ab-4c4c-9091-99b84d7b6f9e 2024-04-15T02:08:01.024432449Z [2024-04-15T02:08:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7188ff56-815f-470a-96a3-5b69ad011c99 2024-04-15T02:08:01.024700411Z [2024-04-15T02:08:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c96cd02-9fae-49b5-bb48-a8bec73c4d15 2024-04-15T02:08:01.024895914Z [2024-04-15T02:08:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to c091abc3-95a8-4a24-b9af-e856854fdf77 2024-04-15T02:08:02.226067520Z [2024-04-15T02:08:02.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:08:02.226391496Z [2024-04-15T02:08:02.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:06:00+00:00, run_id=scheduled__2024-04-15T02:06:00+00:00, run_start_date=2024-04-15 02:08:00.384445+00:00, run_end_date=2024-04-15 02:08:02.225971+00:00, run_duration=1.841526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:06:00+00:00, data_interval_end=2024-04-15 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:08:02.232990219Z [2024-04-15T02:08:02.232+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:08:02.238404283Z [2024-04-15T02:08:02.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:08:02.238684760Z [2024-04-15T02:08:02.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:07:00+00:00, run_id=scheduled__2024-04-15T02:07:00+00:00, run_start_date=2024-04-15 02:08:00.385756+00:00, run_end_date=2024-04-15 02:08:02.238346+00:00, run_duration=1.85259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:07:00+00:00, data_interval_end=2024-04-15 02:08:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:08:02.247295766Z [2024-04-15T02:08:02.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:02.288015391Z [2024-04-15T02:08:02.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:06:00+00:00 exited with status success for try_number 1 2024-04-15T02:08:02.288233432Z [2024-04-15T02:08:02.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status success for try_number 1 2024-04-15T02:08:02.295789692Z [2024-04-15T02:08:02.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:06:00+00:00, map_index=-1, run_start_date=2024-04-15 02:08:01.202220+00:00, run_end_date=2024-04-15 02:08:01.507283+00:00, run_duration=0.305063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:08:00.506645+00:00, queued_by_job_id=1, pid=13975 2024-04-15T02:08:02.296219625Z [2024-04-15T02:08:02.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:07:00+00:00, map_index=-1, run_start_date=2024-04-15 02:08:01.409121+00:00, run_end_date=2024-04-15 02:08:01.752040+00:00, run_duration=0.342919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:08:00.506645+00:00, queued_by_job_id=1, pid=13976 2024-04-15T02:08:04.362970984Z [2024-04-15T02:08:04.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:08:04.363007431Z [2024-04-15T02:08:04.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:07:00+00:00, run_id=scheduled__2024-04-15T02:07:00+00:00, run_start_date=2024-04-15 02:08:00.391489+00:00, run_end_date=2024-04-15 02:08:04.358252+00:00, run_duration=3.966763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:07:00+00:00, data_interval_end=2024-04-15 02:08:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:08:04.375020275Z [2024-04-15T02:08:04.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:04.375045578Z [2024-04-15T02:08:04.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:08:04.375055715Z [2024-04-15T02:08:04.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:07:00+00:00, run_id=scheduled__2024-04-15T02:07:00+00:00, run_start_date=2024-04-15 02:08:00.387448+00:00, run_end_date=2024-04-15 02:08:04.374249+00:00, run_duration=3.986801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:07:00+00:00, data_interval_end=2024-04-15 02:08:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:08:04.391050309Z [2024-04-15T02:08:04.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:08:00+00:00, run_after=2024-04-15T02:09:00+00:00 2024-04-15T02:08:04.420712437Z [2024-04-15T02:08:04.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status success for try_number 1 2024-04-15T02:08:04.420879163Z [2024-04-15T02:08:04.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:07:00+00:00 exited with status success for try_number 1 2024-04-15T02:08:04.434429343Z [2024-04-15T02:08:04.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:07:00+00:00, map_index=-1, run_start_date=2024-04-15 02:08:02.496239+00:00, run_end_date=2024-04-15 02:08:03.857750+00:00, run_duration=1.361511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:08:00.506645+00:00, queued_by_job_id=1, pid=14000 2024-04-15T02:08:04.434673027Z [2024-04-15T02:08:04.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:07:00+00:00, map_index=-1, run_start_date=2024-04-15 02:08:02.308823+00:00, run_end_date=2024-04-15 02:08:04.120890+00:00, run_duration=1.812067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:08:00.506645+00:00, queued_by_job_id=1, pid=13996 2024-04-15T02:09:00.293435441Z [2024-04-15T02:09:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:00.316917122Z [2024-04-15T02:09:00.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:00.332843535Z [2024-04-15T02:09:00.332+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:09:00.410554141Z [2024-04-15T02:09:00.410+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:09:00.410575458Z 2024-04-15T02:09:00.410578966Z 2024-04-15T02:09:00.410582071Z 2024-04-15T02:09:00.410788051Z [2024-04-15T02:09:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:09:00.411025115Z [2024-04-15T02:09:00.410+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:09:00.411073302Z [2024-04-15T02:09:00.410+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:09:00.411642315Z [2024-04-15T02:09:00.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:09:00.411685497Z 2024-04-15T02:09:00.411695261Z 2024-04-15T02:09:00.411703678Z 2024-04-15T02:09:00.416326784Z [2024-04-15T02:09:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:09:00.417609165Z [2024-04-15T02:09:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:09:00.418105570Z [2024-04-15T02:09:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:09:00.418622725Z [2024-04-15T02:09:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:09:00.419100759Z [2024-04-15T02:09:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:09:00.419335985Z [2024-04-15T02:09:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:09:00.687002712Z [2024-04-15T02:09:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status queued for try_number 1 2024-04-15T02:09:00.687021366Z [2024-04-15T02:09:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status queued for try_number 1 2024-04-15T02:09:00.687024698Z [2024-04-15T02:09:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status queued for try_number 1 2024-04-15T02:09:00.691500463Z [2024-04-15T02:09:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a96d811-59a1-4267-94f4-6d548fce8320 2024-04-15T02:09:00.691609574Z [2024-04-15T02:09:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72338798-b3c4-45d9-948a-42ce3ab90af4 2024-04-15T02:09:00.691710371Z [2024-04-15T02:09:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdc45153-c482-4a1a-8543-80da45891619 2024-04-15T02:09:01.835725505Z [2024-04-15T02:09:01.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:09:01.836178500Z [2024-04-15T02:09:01.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:08:00+00:00, run_id=scheduled__2024-04-15T02:08:00+00:00, run_start_date=2024-04-15 02:09:00.345535+00:00, run_end_date=2024-04-15 02:09:01.835618+00:00, run_duration=1.490083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:08:00+00:00, data_interval_end=2024-04-15 02:09:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:09:01.846790453Z [2024-04-15T02:09:01.846+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:01.907676294Z [2024-04-15T02:09:01.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status success for try_number 1 2024-04-15T02:09:01.924099164Z [2024-04-15T02:09:01.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:08:00+00:00, map_index=-1, run_start_date=2024-04-15 02:09:01.227706+00:00, run_end_date=2024-04-15 02:09:01.621662+00:00, run_duration=0.393956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:09:00.412347+00:00, queued_by_job_id=1, pid=14031 2024-04-15T02:09:04.317191227Z [2024-04-15T02:09:04.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:09:04.317252847Z [2024-04-15T02:09:04.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:08:00+00:00, run_id=scheduled__2024-04-15T02:08:00+00:00, run_start_date=2024-04-15 02:09:00.353618+00:00, run_end_date=2024-04-15 02:09:04.315899+00:00, run_duration=3.962281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:08:00+00:00, data_interval_end=2024-04-15 02:09:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:09:04.331034684Z [2024-04-15T02:09:04.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:04.341357756Z [2024-04-15T02:09:04.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:09:04.341405068Z [2024-04-15T02:09:04.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:08:00+00:00, run_id=scheduled__2024-04-15T02:08:00+00:00, run_start_date=2024-04-15 02:09:00.355189+00:00, run_end_date=2024-04-15 02:09:04.339182+00:00, run_duration=3.983993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:08:00+00:00, data_interval_end=2024-04-15 02:09:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:09:04.348146981Z [2024-04-15T02:09:04.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:09:00+00:00, run_after=2024-04-15T02:10:00+00:00 2024-04-15T02:09:04.399071930Z [2024-04-15T02:09:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status success for try_number 1 2024-04-15T02:09:04.399380831Z [2024-04-15T02:09:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status success for try_number 1 2024-04-15T02:09:04.405555934Z [2024-04-15T02:09:04.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:08:00+00:00, map_index=-1, run_start_date=2024-04-15 02:09:02.180413+00:00, run_end_date=2024-04-15 02:09:03.351616+00:00, run_duration=1.171203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:09:00.412347+00:00, queued_by_job_id=1, pid=14050 2024-04-15T02:09:04.405879322Z [2024-04-15T02:09:04.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:08:00+00:00, map_index=-1, run_start_date=2024-04-15 02:09:02.100053+00:00, run_end_date=2024-04-15 02:09:04.044543+00:00, run_duration=1.94449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:09:00.412347+00:00, queued_by_job_id=1, pid=14049 2024-04-15T02:10:00.225955333Z [2024-04-15T02:10:00.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:00.235875153Z [2024-04-15T02:10:00.235+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:10:00.254067294Z [2024-04-15T02:10:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:10:00.265107420Z [2024-04-15T02:10:00.264+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:10:00.280372715Z [2024-04-15T02:10:00.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:00.383210840Z [2024-04-15T02:10:00.381+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T02:10:00.383275531Z 2024-04-15T02:10:00.383285532Z 2024-04-15T02:10:00.383314704Z 2024-04-15T02:10:00.383321969Z 2024-04-15T02:10:00.383328945Z 2024-04-15T02:10:00.383335200Z [2024-04-15T02:10:00.381+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:10:00.383342274Z [2024-04-15T02:10:00.381+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:10:00.383348939Z [2024-04-15T02:10:00.381+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:10:00.383355160Z [2024-04-15T02:10:00.381+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:10:00.383361361Z [2024-04-15T02:10:00.381+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:10:00.383367522Z [2024-04-15T02:10:00.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:00.383373868Z 2024-04-15T02:10:00.383380040Z 2024-04-15T02:10:00.383386219Z 2024-04-15T02:10:00.383392431Z 2024-04-15T02:10:00.383398660Z 2024-04-15T02:10:00.386856162Z [2024-04-15T02:10:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:10:00.386866836Z [2024-04-15T02:10:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:00.386890134Z [2024-04-15T02:10:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:00.386895309Z [2024-04-15T02:10:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:10:00.386898580Z [2024-04-15T02:10:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:00.386909105Z [2024-04-15T02:10:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:10:00.386912086Z [2024-04-15T02:10:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:00.386914910Z [2024-04-15T02:10:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:10:00.386917706Z [2024-04-15T02:10:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:00.386920535Z [2024-04-15T02:10:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:10:00.973473851Z [2024-04-15T02:10:00.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.973739287Z [2024-04-15T02:10:00.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.973975058Z [2024-04-15T02:10:00.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.974148832Z [2024-04-15T02:10:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.974320573Z [2024-04-15T02:10:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:00.984145074Z [2024-04-15T02:10:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29a92313-8691-4a4a-9118-f1b0e72821f2 2024-04-15T02:10:00.984410407Z [2024-04-15T02:10:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7d2bf72-8cff-4eab-87ce-8187a9e15c81 2024-04-15T02:10:00.984628736Z [2024-04-15T02:10:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to b47dc0c3-f02a-41d1-88ab-5e96d1373651 2024-04-15T02:10:00.984847950Z [2024-04-15T02:10:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e6c9051-541a-4706-924a-d0312f118b9f 2024-04-15T02:10:00.985086768Z [2024-04-15T02:10:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c4cec02-64e3-4359-a7f7-c1d59fb94f6b 2024-04-15T02:10:02.289835660Z [2024-04-15T02:10:02.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:02.290264580Z [2024-04-15T02:10:02.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:08:00+00:00, run_id=scheduled__2024-04-15T02:08:00+00:00, run_start_date=2024-04-15 02:10:00.290602+00:00, run_end_date=2024-04-15 02:10:02.289761+00:00, run_duration=1.999159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:08:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:10:02.304124689Z [2024-04-15T02:10:02.303+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:10:02.318221857Z [2024-04-15T02:10:02.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:02.318461724Z [2024-04-15T02:10:02.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:09:00+00:00, run_id=scheduled__2024-04-15T02:09:00+00:00, run_start_date=2024-04-15 02:10:00.291649+00:00, run_end_date=2024-04-15 02:10:02.318097+00:00, run_duration=2.026448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:09:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:10:02.329442722Z [2024-04-15T02:10:02.329+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:02.419590338Z [2024-04-15T02:10:02.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:08:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:02.419700032Z [2024-04-15T02:10:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:02.431228732Z [2024-04-15T02:10:02.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:09:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:01.364198+00:00, run_end_date=2024-04-15 02:10:01.767338+00:00, run_duration=0.40314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.383073+00:00, queued_by_job_id=1, pid=14084 2024-04-15T02:10:02.431584150Z [2024-04-15T02:10:02.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:08:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:01.445540+00:00, run_end_date=2024-04-15 02:10:01.841806+00:00, run_duration=0.396266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.383073+00:00, queued_by_job_id=1, pid=14085 2024-04-15T02:10:03.552358138Z [2024-04-15T02:10:03.551+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:10:03.552407719Z 2024-04-15T02:10:03.552549677Z [2024-04-15T02:10:03.552+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:10:03.553429034Z [2024-04-15T02:10:03.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:03.553452663Z 2024-04-15T02:10:03.557240873Z [2024-04-15T02:10:03.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:10:03.557419449Z [2024-04-15T02:10:03.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:03.656949094Z [2024-04-15T02:10:03.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:03.657398629Z [2024-04-15T02:10:03.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:03.667065937Z [2024-04-15T02:10:03.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5345078a-015c-47ec-abd7-3e42d3db5d0e 2024-04-15T02:10:03.667486192Z [2024-04-15T02:10:03.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:02.739346+00:00, run_end_date=2024-04-15 02:10:03.123559+00:00, run_duration=0.384213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.383073+00:00, queued_by_job_id=1, pid=14116 2024-04-15T02:10:04.831909383Z [2024-04-15T02:10:04.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:04.832388694Z [2024-04-15T02:10:04.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:09:00+00:00, run_id=scheduled__2024-04-15T02:09:00+00:00, run_start_date=2024-04-15 02:10:00.292585+00:00, run_end_date=2024-04-15 02:10:04.831772+00:00, run_duration=4.539187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:09:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:10:04.844755280Z [2024-04-15T02:10:04.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:04.852945375Z [2024-04-15T02:10:04.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:04.853179174Z [2024-04-15T02:10:04.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:09:00+00:00, run_id=scheduled__2024-04-15T02:09:00+00:00, run_start_date=2024-04-15 02:10:00.293758+00:00, run_end_date=2024-04-15 02:10:04.852829+00:00, run_duration=4.559071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:09:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:10:04.861806503Z [2024-04-15T02:10:04.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:11:00+00:00 2024-04-15T02:10:04.923376823Z [2024-04-15T02:10:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:04.923937725Z [2024-04-15T02:10:04.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:09:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:04.935274387Z [2024-04-15T02:10:04.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:09:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:02.443342+00:00, run_end_date=2024-04-15 02:10:03.816972+00:00, run_duration=1.37363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.383073+00:00, queued_by_job_id=1, pid=14109 2024-04-15T02:10:04.935908492Z [2024-04-15T02:10:04.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:09:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:02.625013+00:00, run_end_date=2024-04-15 02:10:04.261664+00:00, run_duration=1.636651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:00.383073+00:00, queued_by_job_id=1, pid=14115 2024-04-15T02:10:06.113427241Z [2024-04-15T02:10:06.112+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:10:06.113466046Z 2024-04-15T02:10:06.114301278Z [2024-04-15T02:10:06.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:10:06.115123574Z [2024-04-15T02:10:06.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:06.115144556Z 2024-04-15T02:10:06.120097066Z [2024-04-15T02:10:06.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:10:06.120410577Z [2024-04-15T02:10:06.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:10:06.202340754Z [2024-04-15T02:10:06.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:06.202448393Z [2024-04-15T02:10:06.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:06.216504330Z [2024-04-15T02:10:06.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25547ba0-3379-440e-9030-e9c1b3191833 2024-04-15T02:10:06.217025309Z [2024-04-15T02:10:06.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:05.336141+00:00, run_end_date=2024-04-15 02:10:05.692396+00:00, run_duration=0.356255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:03.553832+00:00, queued_by_job_id=1, pid=14139 2024-04-15T02:10:09.636529807Z [2024-04-15T02:10:09.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:10:09.636587885Z 2024-04-15T02:10:09.636884137Z [2024-04-15T02:10:09.636+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:10:09.637811360Z [2024-04-15T02:10:09.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:10:09.637892783Z 2024-04-15T02:10:09.640852364Z [2024-04-15T02:10:09.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:10:09.640991922Z [2024-04-15T02:10:09.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:09.707631471Z [2024-04-15T02:10:09.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status queued for try_number 1 2024-04-15T02:10:09.707760195Z [2024-04-15T02:10:09.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:09.718052444Z [2024-04-15T02:10:09.717+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15ad6773-f138-4582-a529-aa063b30b183 2024-04-15T02:10:09.718227003Z [2024-04-15T02:10:09.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=0, run_start_date=2024-04-15 02:10:07.796942+00:00, run_end_date=2024-04-15 02:10:09.103738+00:00, run_duration=1.306796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:06.115946+00:00, queued_by_job_id=1, pid=14147 2024-04-15T02:10:12.398945294Z [2024-04-15T02:10:12.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:10:12.399628776Z [2024-04-15T02:10:12.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:05:00+00:00, run_id=scheduled__2024-04-15T02:05:00+00:00, run_start_date=2024-04-15 02:10:00.289529+00:00, run_end_date=2024-04-15 02:10:12.399222+00:00, run_duration=12.109693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:05:00+00:00, data_interval_end=2024-04-15 02:10:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:10:12.408046655Z [2024-04-15T02:10:12.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:10:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:10:12.447836008Z [2024-04-15T02:10:12.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:05:00+00:00 exited with status success for try_number 1 2024-04-15T02:10:12.456004900Z [2024-04-15T02:10:12.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:05:00+00:00, map_index=-1, run_start_date=2024-04-15 02:10:11.260508+00:00, run_end_date=2024-04-15 02:10:11.645621+00:00, run_duration=0.385113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:10:09.638205+00:00, queued_by_job_id=1, pid=14160 2024-04-15T02:11:00.272306917Z [2024-04-15T02:11:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:00.282836957Z [2024-04-15T02:11:00.282+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:11:00.296474009Z [2024-04-15T02:11:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:00.411892537Z [2024-04-15T02:11:00.411+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:11:00.411912421Z 2024-04-15T02:11:00.411916276Z 2024-04-15T02:11:00.411927626Z 2024-04-15T02:11:00.412041488Z [2024-04-15T02:11:00.411+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:11:00.412195025Z [2024-04-15T02:11:00.412+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:11:00.412307593Z [2024-04-15T02:11:00.412+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:11:00.412877003Z [2024-04-15T02:11:00.412+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:11:00.412883783Z 2024-04-15T02:11:00.412886780Z 2024-04-15T02:11:00.412889464Z 2024-04-15T02:11:00.415806695Z [2024-04-15T02:11:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:11:00.415896339Z [2024-04-15T02:11:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:11:00.416090618Z [2024-04-15T02:11:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:11:00.416180862Z [2024-04-15T02:11:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:11:00.416443674Z [2024-04-15T02:11:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:11:00.416532729Z [2024-04-15T02:11:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:11:00.635340810Z [2024-04-15T02:11:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:11:00.635778357Z [2024-04-15T02:11:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:11:00.635983036Z [2024-04-15T02:11:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:11:00.642205641Z [2024-04-15T02:11:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfd0c7b5-afe8-451b-8480-1ebbac172377 2024-04-15T02:11:00.642450273Z [2024-04-15T02:11:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb1466c5-5456-4e64-b94e-ab0575ffb0fc 2024-04-15T02:11:00.643263385Z [2024-04-15T02:11:00.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7e168bb-6c37-4baa-ba58-aa40359e2e4f 2024-04-15T02:11:01.769931844Z [2024-04-15T02:11:01.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:11:01.770117522Z [2024-04-15T02:11:01.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:11:00.308956+00:00, run_end_date=2024-04-15 02:11:01.769844+00:00, run_duration=1.460888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:11:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:11:01.780479202Z [2024-04-15T02:11:01.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:01.832389831Z [2024-04-15T02:11:01.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:11:01.842501924Z [2024-04-15T02:11:01.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:11:01.186566+00:00, run_end_date=2024-04-15 02:11:01.532416+00:00, run_duration=0.34585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:11:00.413467+00:00, queued_by_job_id=1, pid=14182 2024-04-15T02:11:04.198818271Z [2024-04-15T02:11:04.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:11:04.198979326Z [2024-04-15T02:11:04.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:11:00.310294+00:00, run_end_date=2024-04-15 02:11:04.198380+00:00, run_duration=3.888086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:11:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:11:04.207327660Z [2024-04-15T02:11:04.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:04.215322515Z [2024-04-15T02:11:04.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:11:04.215671233Z [2024-04-15T02:11:04.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:11:00.311483+00:00, run_end_date=2024-04-15 02:11:04.215191+00:00, run_duration=3.903708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:11:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:11:04.229765450Z [2024-04-15T02:11:04.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:11:00+00:00, run_after=2024-04-15T02:12:00+00:00 2024-04-15T02:11:04.277670268Z [2024-04-15T02:11:04.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:11:04.277710214Z [2024-04-15T02:11:04.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:11:04.287394509Z [2024-04-15T02:11:04.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:11:02.070138+00:00, run_end_date=2024-04-15 02:11:03.377765+00:00, run_duration=1.307627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:11:00.413467+00:00, queued_by_job_id=1, pid=14200 2024-04-15T02:11:04.287954651Z [2024-04-15T02:11:04.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:11:02.112794+00:00, run_end_date=2024-04-15 02:11:03.787094+00:00, run_duration=1.6743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:11:00.413467+00:00, queued_by_job_id=1, pid=14201 2024-04-15T02:11:05.328575580Z [2024-04-15T02:11:05.327+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:11:25.502007086Z [2024-04-15T02:11:25.501+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:11:25.502068939Z 2024-04-15T02:11:25.502090597Z [2024-04-15T02:11:25.501+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-15T02:11:25.502961887Z [2024-04-15T02:11:25.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:11:25.502981413Z 2024-04-15T02:11:25.506562970Z [2024-04-15T02:11:25.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240415021125_477811', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:11:25.506677661Z [2024-04-15T02:11:25.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240415021125_477811', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-15T02:11:25.565830322Z [2024-04-15T02:11:25.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415021125_477811 exited with status queued for try_number 1 2024-04-15T02:11:25.576821524Z [2024-04-15T02:11:25.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86b79508-a1c4-4c58-a80f-dc6baf3476a1 2024-04-15T02:11:26.703622034Z [2024-04-15T02:11:26.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:11:26.703668087Z [2024-04-15T02:11:26.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-15 02:11:25.293394+00:00, run_id=scaleout_vdu_20240415021125_477811, run_start_date=2024-04-15 02:11:25.458568+00:00, run_end_date=2024-04-15 02:11:26.703323+00:00, run_duration=1.244755, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 02:11:25.293394+00:00, data_interval_end=2024-04-15 02:11:25.293394+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-15T02:11:26.706845430Z [2024-04-15T02:11:26.706+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-15T02:11:27.630101953Z [2024-04-15T02:11:27.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415021125_477811 exited with status success for try_number 1 2024-04-15T02:11:27.640222754Z [2024-04-15T02:11:27.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240415021125_477811, map_index=-1, run_start_date=2024-04-15 02:11:26.236225+00:00, run_end_date=2024-04-15 02:11:26.659685+00:00, run_duration=0.42346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:11:25.503589+00:00, queued_by_job_id=1, pid=14213 2024-04-15T02:12:00.295058140Z [2024-04-15T02:12:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:00.330340557Z [2024-04-15T02:12:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:00.345653386Z [2024-04-15T02:12:00.340+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:12:00.350224116Z [2024-04-15T02:12:00.348+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:12:00.426951037Z [2024-04-15T02:12:00.426+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:12:00.426979727Z 2024-04-15T02:12:00.426985730Z 2024-04-15T02:12:00.426988934Z 2024-04-15T02:12:00.426991907Z 2024-04-15T02:12:00.427366871Z [2024-04-15T02:12:00.427+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:12:00.427679513Z [2024-04-15T02:12:00.427+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:12:00.427928384Z [2024-04-15T02:12:00.427+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:12:00.428163492Z [2024-04-15T02:12:00.427+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:12:00.429080046Z [2024-04-15T02:12:00.428+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:12:00.429095466Z 2024-04-15T02:12:00.429100772Z 2024-04-15T02:12:00.429113469Z 2024-04-15T02:12:00.429117755Z 2024-04-15T02:12:00.433738839Z [2024-04-15T02:12:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:12:00.434140910Z [2024-04-15T02:12:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:12:00.434610652Z [2024-04-15T02:12:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:12:00.434986741Z [2024-04-15T02:12:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:12:00.435414229Z [2024-04-15T02:12:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:12:00.435715769Z [2024-04-15T02:12:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:12:00.436114610Z [2024-04-15T02:12:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:12:00.436428277Z [2024-04-15T02:12:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:12:00.759946366Z [2024-04-15T02:12:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:12:00.759986227Z [2024-04-15T02:12:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status queued for try_number 1 2024-04-15T02:12:00.759995854Z [2024-04-15T02:12:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status queued for try_number 1 2024-04-15T02:12:00.760061990Z [2024-04-15T02:12:00.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status queued for try_number 1 2024-04-15T02:12:00.768112557Z [2024-04-15T02:12:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4759db72-8b7a-4070-bcf9-4e342d0d627c 2024-04-15T02:12:00.768141349Z [2024-04-15T02:12:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a22c251-8c1f-41da-a82a-66b0e1b64413 2024-04-15T02:12:00.768275085Z [2024-04-15T02:12:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to a98e878d-9899-40f5-ae97-696e4ee60f8a 2024-04-15T02:12:00.768361724Z [2024-04-15T02:12:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 389fc278-03cb-4be4-83a6-d4ff025a539c 2024-04-15T02:12:01.882554699Z [2024-04-15T02:12:01.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:12:01.883218371Z [2024-04-15T02:12:01.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:12:00.359034+00:00, run_end_date=2024-04-15 02:12:01.882479+00:00, run_duration=1.523445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:12:01.890556766Z [2024-04-15T02:12:01.890+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:12:01.895862656Z [2024-04-15T02:12:01.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:12:01.896134960Z [2024-04-15T02:12:01.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:11:00+00:00, run_id=scheduled__2024-04-15T02:11:00+00:00, run_start_date=2024-04-15 02:12:00.360363+00:00, run_end_date=2024-04-15 02:12:01.895773+00:00, run_duration=1.53541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:11:00+00:00, data_interval_end=2024-04-15 02:12:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:12:01.904951956Z [2024-04-15T02:12:01.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:01.952855652Z [2024-04-15T02:12:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:12:01.953131582Z [2024-04-15T02:12:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status success for try_number 1 2024-04-15T02:12:01.962160820Z [2024-04-15T02:12:01.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:11:00+00:00, map_index=-1, run_start_date=2024-04-15 02:12:01.298714+00:00, run_end_date=2024-04-15 02:12:01.682760+00:00, run_duration=0.384046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:12:00.430322+00:00, queued_by_job_id=1, pid=14242 2024-04-15T02:12:01.962542174Z [2024-04-15T02:12:01.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:12:01.319012+00:00, run_end_date=2024-04-15 02:12:01.728030+00:00, run_duration=0.409018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:12:00.430322+00:00, queued_by_job_id=1, pid=14243 2024-04-15T02:12:04.355204856Z [2024-04-15T02:12:04.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:12:04.355250710Z [2024-04-15T02:12:04.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:11:00+00:00, run_id=scheduled__2024-04-15T02:11:00+00:00, run_start_date=2024-04-15 02:12:00.361491+00:00, run_end_date=2024-04-15 02:12:04.354561+00:00, run_duration=3.99307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:11:00+00:00, data_interval_end=2024-04-15 02:12:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:12:04.363540616Z [2024-04-15T02:12:04.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:04.416803817Z [2024-04-15T02:12:04.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status success for try_number 1 2024-04-15T02:12:04.424765097Z [2024-04-15T02:12:04.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:11:00+00:00, map_index=-1, run_start_date=2024-04-15 02:12:02.221643+00:00, run_end_date=2024-04-15 02:12:03.595135+00:00, run_duration=1.373492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:12:00.430322+00:00, queued_by_job_id=1, pid=14266 2024-04-15T02:12:05.831000798Z [2024-04-15T02:12:05.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:12:05.831269383Z [2024-04-15T02:12:05.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:11:00+00:00, run_id=scheduled__2024-04-15T02:11:00+00:00, run_start_date=2024-04-15 02:12:00.362624+00:00, run_end_date=2024-04-15 02:12:05.830674+00:00, run_duration=5.46805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:11:00+00:00, data_interval_end=2024-04-15 02:12:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:12:05.844833492Z [2024-04-15T02:12:05.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:12:00+00:00, run_after=2024-04-15T02:13:00+00:00 2024-04-15T02:12:05.905081429Z [2024-04-15T02:12:05.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:11:00+00:00 exited with status success for try_number 1 2024-04-15T02:12:05.915725976Z [2024-04-15T02:12:05.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:11:00+00:00, map_index=-1, run_start_date=2024-04-15 02:12:02.372236+00:00, run_end_date=2024-04-15 02:12:05.042695+00:00, run_duration=2.670459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:12:00.430322+00:00, queued_by_job_id=1, pid=14267 2024-04-15T02:13:00.244090908Z [2024-04-15T02:13:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:00.250341145Z [2024-04-15T02:13:00.249+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:13:00.260250408Z [2024-04-15T02:13:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:00.317325311Z [2024-04-15T02:13:00.316+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:13:00.317383586Z 2024-04-15T02:13:00.317395090Z 2024-04-15T02:13:00.317405052Z 2024-04-15T02:13:00.317431948Z [2024-04-15T02:13:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:13:00.317443206Z [2024-04-15T02:13:00.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:13:00.317551155Z [2024-04-15T02:13:00.317+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:13:00.318018238Z [2024-04-15T02:13:00.317+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:13:00.318034815Z 2024-04-15T02:13:00.318046249Z 2024-04-15T02:13:00.318056251Z 2024-04-15T02:13:00.320417904Z [2024-04-15T02:13:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:13:00.320523568Z [2024-04-15T02:13:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:13:00.320758653Z [2024-04-15T02:13:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:13:00.320871140Z [2024-04-15T02:13:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:13:00.321061993Z [2024-04-15T02:13:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:13:00.321166499Z [2024-04-15T02:13:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:13:00.643805135Z [2024-04-15T02:13:00.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status queued for try_number 1 2024-04-15T02:13:00.647235927Z [2024-04-15T02:13:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status queued for try_number 1 2024-04-15T02:13:00.647451068Z [2024-04-15T02:13:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status queued for try_number 1 2024-04-15T02:13:00.667111408Z [2024-04-15T02:13:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c294426-d1aa-4763-a5f7-0c765ccc9415 2024-04-15T02:13:00.667609887Z [2024-04-15T02:13:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c9ccdb7-7a30-47fa-8392-dc757951daca 2024-04-15T02:13:00.668011252Z [2024-04-15T02:13:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1aa65e3-b6aa-43b9-aa35-870d7c5e203b 2024-04-15T02:13:01.791901981Z [2024-04-15T02:13:01.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:13:01.792311677Z [2024-04-15T02:13:01.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:12:00+00:00, run_id=scheduled__2024-04-15T02:12:00+00:00, run_start_date=2024-04-15 02:13:00.269816+00:00, run_end_date=2024-04-15 02:13:01.791966+00:00, run_duration=1.52215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:12:00+00:00, data_interval_end=2024-04-15 02:13:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:13:01.801847511Z [2024-04-15T02:13:01.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:01.853299079Z [2024-04-15T02:13:01.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status success for try_number 1 2024-04-15T02:13:01.857844189Z [2024-04-15T02:13:01.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:12:00+00:00, map_index=-1, run_start_date=2024-04-15 02:13:01.118392+00:00, run_end_date=2024-04-15 02:13:01.460243+00:00, run_duration=0.341851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:13:00.318537+00:00, queued_by_job_id=1, pid=14300 2024-04-15T02:13:04.009965651Z [2024-04-15T02:13:04.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:13:04.010458331Z [2024-04-15T02:13:04.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:12:00+00:00, run_id=scheduled__2024-04-15T02:12:00+00:00, run_start_date=2024-04-15 02:13:00.272692+00:00, run_end_date=2024-04-15 02:13:04.009895+00:00, run_duration=3.737203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:12:00+00:00, data_interval_end=2024-04-15 02:13:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:13:04.023498518Z [2024-04-15T02:13:04.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:04.056196822Z [2024-04-15T02:13:04.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status success for try_number 1 2024-04-15T02:13:04.060096921Z [2024-04-15T02:13:04.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:12:00+00:00, map_index=-1, run_start_date=2024-04-15 02:13:02.327487+00:00, run_end_date=2024-04-15 02:13:03.600306+00:00, run_duration=1.272819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:13:00.318537+00:00, queued_by_job_id=1, pid=14319 2024-04-15T02:13:04.251682541Z [2024-04-15T02:13:04.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:13:04.251990870Z [2024-04-15T02:13:04.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:12:00+00:00, run_id=scheduled__2024-04-15T02:12:00+00:00, run_start_date=2024-04-15 02:13:00.275662+00:00, run_end_date=2024-04-15 02:13:04.251571+00:00, run_duration=3.975909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:12:00+00:00, data_interval_end=2024-04-15 02:13:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:13:04.259540573Z [2024-04-15T02:13:04.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:13:00+00:00, run_after=2024-04-15T02:14:00+00:00 2024-04-15T02:13:04.291724176Z [2024-04-15T02:13:04.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status success for try_number 1 2024-04-15T02:13:04.296156970Z [2024-04-15T02:13:04.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:12:00+00:00, map_index=-1, run_start_date=2024-04-15 02:13:02.265130+00:00, run_end_date=2024-04-15 02:13:03.902383+00:00, run_duration=1.637253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:13:00.318537+00:00, queued_by_job_id=1, pid=14318 2024-04-15T02:14:00.138252142Z [2024-04-15T02:14:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:00.164826085Z [2024-04-15T02:14:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:00.175509782Z [2024-04-15T02:14:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:14:00.184309080Z [2024-04-15T02:14:00.183+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:14:00.302318856Z [2024-04-15T02:14:00.301+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:14:00.302366096Z 2024-04-15T02:14:00.302380354Z 2024-04-15T02:14:00.302391866Z 2024-04-15T02:14:00.302402673Z 2024-04-15T02:14:00.302414183Z [2024-04-15T02:14:00.302+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:14:00.302474970Z [2024-04-15T02:14:00.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:14:00.302630936Z [2024-04-15T02:14:00.302+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:14:00.302750050Z [2024-04-15T02:14:00.302+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:14:00.303772558Z [2024-04-15T02:14:00.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:14:00.303799340Z 2024-04-15T02:14:00.303809108Z 2024-04-15T02:14:00.303817846Z 2024-04-15T02:14:00.303826574Z 2024-04-15T02:14:00.309833804Z [2024-04-15T02:14:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:14:00.309867423Z [2024-04-15T02:14:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:14:00.310135350Z [2024-04-15T02:14:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:14:00.310262803Z [2024-04-15T02:14:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:14:00.310544140Z [2024-04-15T02:14:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:14:00.310719955Z [2024-04-15T02:14:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:14:00.311042482Z [2024-04-15T02:14:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:14:00.311225283Z [2024-04-15T02:14:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:14:00.654843254Z [2024-04-15T02:14:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status queued for try_number 1 2024-04-15T02:14:00.656628991Z [2024-04-15T02:14:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status queued for try_number 1 2024-04-15T02:14:00.656815175Z [2024-04-15T02:14:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status queued for try_number 1 2024-04-15T02:14:00.656908628Z [2024-04-15T02:14:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status queued for try_number 1 2024-04-15T02:14:00.665344238Z [2024-04-15T02:14:00.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23bb7038-eb9a-40d9-a70b-37e9a1f66172 2024-04-15T02:14:00.665438445Z [2024-04-15T02:14:00.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76c8be58-c8af-43c1-b29c-de119a141c3f 2024-04-15T02:14:00.665604296Z [2024-04-15T02:14:00.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2b52938-e83f-4540-8882-10daa739d60e 2024-04-15T02:14:00.665740427Z [2024-04-15T02:14:00.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d478019-6faf-4b75-a8aa-7b9196efac31 2024-04-15T02:14:01.904832625Z [2024-04-15T02:14:01.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:14:01.905312172Z [2024-04-15T02:14:01.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:12:00+00:00, run_id=scheduled__2024-04-15T02:12:00+00:00, run_start_date=2024-04-15 02:14:00.197630+00:00, run_end_date=2024-04-15 02:14:01.904746+00:00, run_duration=1.707116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:12:00+00:00, data_interval_end=2024-04-15 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:14:01.913569145Z [2024-04-15T02:14:01.913+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:14:01.919852940Z [2024-04-15T02:14:01.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:14:01.920164256Z [2024-04-15T02:14:01.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:13:00+00:00, run_id=scheduled__2024-04-15T02:13:00+00:00, run_start_date=2024-04-15 02:14:00.199012+00:00, run_end_date=2024-04-15 02:14:01.919785+00:00, run_duration=1.720773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:13:00+00:00, data_interval_end=2024-04-15 02:14:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:14:01.929074777Z [2024-04-15T02:14:01.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:02.063089352Z [2024-04-15T02:14:02.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:12:00+00:00 exited with status success for try_number 1 2024-04-15T02:14:02.074263837Z [2024-04-15T02:14:02.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:12:00+00:00, map_index=-1, run_start_date=2024-04-15 02:14:01.294072+00:00, run_end_date=2024-04-15 02:14:01.728077+00:00, run_duration=0.434005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:14:00.305487+00:00, queued_by_job_id=1, pid=14352 2024-04-15T02:14:03.162024433Z [2024-04-15T02:14:03.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status success for try_number 1 2024-04-15T02:14:03.167123763Z [2024-04-15T02:14:03.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:13:00+00:00, map_index=-1, run_start_date=2024-04-15 02:14:01.482319+00:00, run_end_date=2024-04-15 02:14:01.840117+00:00, run_duration=0.357798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:14:00.305487+00:00, queued_by_job_id=1, pid=14354 2024-04-15T02:14:04.206081894Z [2024-04-15T02:14:04.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:14:04.206272030Z [2024-04-15T02:14:04.205+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:13:00+00:00, run_id=scheduled__2024-04-15T02:13:00+00:00, run_start_date=2024-04-15 02:14:00.200293+00:00, run_end_date=2024-04-15 02:14:04.205891+00:00, run_duration=4.005598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:13:00+00:00, data_interval_end=2024-04-15 02:14:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:14:04.215146459Z [2024-04-15T02:14:04.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:04.269474151Z [2024-04-15T02:14:04.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status success for try_number 1 2024-04-15T02:14:04.278540059Z [2024-04-15T02:14:04.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:13:00+00:00, map_index=-1, run_start_date=2024-04-15 02:14:02.492029+00:00, run_end_date=2024-04-15 02:14:03.859645+00:00, run_duration=1.367616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:14:00.305487+00:00, queued_by_job_id=1, pid=14376 2024-04-15T02:14:05.359899522Z [2024-04-15T02:14:05.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:14:05.360384651Z [2024-04-15T02:14:05.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:13:00+00:00, run_id=scheduled__2024-04-15T02:13:00+00:00, run_start_date=2024-04-15 02:14:00.201947+00:00, run_end_date=2024-04-15 02:14:05.359818+00:00, run_duration=5.157871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:13:00+00:00, data_interval_end=2024-04-15 02:14:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:14:05.372430802Z [2024-04-15T02:14:05.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:14:00+00:00, run_after=2024-04-15T02:15:00+00:00 2024-04-15T02:14:05.406476309Z [2024-04-15T02:14:05.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:13:00+00:00 exited with status success for try_number 1 2024-04-15T02:14:05.414064519Z [2024-04-15T02:14:05.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:13:00+00:00, map_index=-1, run_start_date=2024-04-15 02:14:02.489958+00:00, run_end_date=2024-04-15 02:14:04.609216+00:00, run_duration=2.119258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:14:00.305487+00:00, queued_by_job_id=1, pid=14377 2024-04-15T02:15:00.767990825Z [2024-04-15T02:15:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:15:00.786711131Z [2024-04-15T02:15:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:15:00.803527117Z [2024-04-15T02:15:00.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:00.817511552Z [2024-04-15T02:15:00.817+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:00.904794493Z [2024-04-15T02:15:00.902+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:15:00.904818054Z 2024-04-15T02:15:00.904822974Z 2024-04-15T02:15:00.904826020Z 2024-04-15T02:15:00.904829085Z 2024-04-15T02:15:00.907097273Z [2024-04-15T02:15:00.904+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:15:00.907678165Z [2024-04-15T02:15:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:15:00.908172955Z [2024-04-15T02:15:00.907+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:15:00.908724196Z [2024-04-15T02:15:00.908+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:15:00.910179858Z [2024-04-15T02:15:00.909+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:00.910185571Z 2024-04-15T02:15:00.910188785Z 2024-04-15T02:15:00.910191939Z 2024-04-15T02:15:00.910194958Z 2024-04-15T02:15:00.917782556Z [2024-04-15T02:15:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:15:00.918084933Z [2024-04-15T02:15:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:00.918494298Z [2024-04-15T02:15:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:00.918742802Z [2024-04-15T02:15:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:15:00.919323313Z [2024-04-15T02:15:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:00.919567990Z [2024-04-15T02:15:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:15:00.919922930Z [2024-04-15T02:15:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:00.920166137Z [2024-04-15T02:15:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:15:01.246379466Z [2024-04-15T02:15:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:01.246540709Z [2024-04-15T02:15:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:01.246703435Z [2024-04-15T02:15:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:01.246828131Z [2024-04-15T02:15:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:01.254508750Z [2024-04-15T02:15:01.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28819461-4446-41da-aa6e-14c9885fd0fc 2024-04-15T02:15:01.254663041Z [2024-04-15T02:15:01.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a8212ed-a57e-4ccb-be76-b94a1ed2c8a5 2024-04-15T02:15:01.254840590Z [2024-04-15T02:15:01.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b3014e6-0834-42cb-b5a3-a79996c5cb16 2024-04-15T02:15:01.255323554Z [2024-04-15T02:15:01.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 369e0de0-712f-45f9-9cd9-bda5d2131eaf 2024-04-15T02:15:02.797977416Z [2024-04-15T02:15:02.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:02.798433396Z [2024-04-15T02:15:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:15:00.832178+00:00, run_end_date=2024-04-15 02:15:02.797893+00:00, run_duration=1.965715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:15:02.807650953Z [2024-04-15T02:15:02.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:02.896204867Z [2024-04-15T02:15:02.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:02.913191289Z [2024-04-15T02:15:02.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:01.934175+00:00, run_end_date=2024-04-15 02:15:02.369920+00:00, run_duration=0.435745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:00.912715+00:00, queued_by_job_id=1, pid=14410 2024-04-15T02:15:04.018450183Z [2024-04-15T02:15:04.018+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:15:04.018494468Z 2024-04-15T02:15:04.018718450Z [2024-04-15T02:15:04.018+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:15:04.019865594Z [2024-04-15T02:15:04.019+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:04.019880839Z 2024-04-15T02:15:04.023667299Z [2024-04-15T02:15:04.023+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:15:04.023957729Z [2024-04-15T02:15:04.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:04.076521559Z [2024-04-15T02:15:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:04.077098427Z [2024-04-15T02:15:04.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:04.085211462Z [2024-04-15T02:15:04.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66815f25-72d8-453f-a648-b6c1a489ff4a 2024-04-15T02:15:04.085690123Z [2024-04-15T02:15:04.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:02.944301+00:00, run_end_date=2024-04-15 02:15:03.313427+00:00, run_duration=0.369126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:00.912715+00:00, queued_by_job_id=1, pid=14436 2024-04-15T02:15:04.152031173Z [2024-04-15T02:15:04.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:04.152372159Z [2024-04-15T02:15:04.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:15:00.835076+00:00, run_end_date=2024-04-15 02:15:04.151970+00:00, run_duration=3.316894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:15:04.160752584Z [2024-04-15T02:15:04.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:05.282423616Z [2024-04-15T02:15:05.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:05.283628435Z [2024-04-15T02:15:05.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:15:00.837436+00:00, run_end_date=2024-04-15 02:15:05.282289+00:00, run_duration=4.444853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:15:05.296648620Z [2024-04-15T02:15:05.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:16:00+00:00 2024-04-15T02:15:05.352998688Z [2024-04-15T02:15:05.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:05.353488099Z [2024-04-15T02:15:05.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:05.362717812Z [2024-04-15T02:15:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:02.742411+00:00, run_end_date=2024-04-15 02:15:04.387430+00:00, run_duration=1.645019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:00.912715+00:00, queued_by_job_id=1, pid=14434 2024-04-15T02:15:05.363074043Z [2024-04-15T02:15:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:02.806351+00:00, run_end_date=2024-04-15 02:15:04.106388+00:00, run_duration=1.300037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:00.912715+00:00, queued_by_job_id=1, pid=14435 2024-04-15T02:15:06.753307781Z [2024-04-15T02:15:06.752+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:15:06.753355584Z 2024-04-15T02:15:06.753366565Z [2024-04-15T02:15:06.753+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:15:06.753780231Z [2024-04-15T02:15:06.753+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:06.753794279Z 2024-04-15T02:15:06.755724620Z [2024-04-15T02:15:06.755+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:15:06.755764756Z [2024-04-15T02:15:06.755+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:15:06.836260878Z [2024-04-15T02:15:06.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:06.836281765Z [2024-04-15T02:15:06.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:06.844117689Z [2024-04-15T02:15:06.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f46d2d3-10b5-4ae4-abff-f3a29b611cf4 2024-04-15T02:15:06.844222161Z [2024-04-15T02:15:06.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:05.801890+00:00, run_end_date=2024-04-15 02:15:06.202923+00:00, run_duration=0.401033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:04.021043+00:00, queued_by_job_id=1, pid=14459 2024-04-15T02:15:09.049870454Z [2024-04-15T02:15:09.049+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:15:09.049975180Z 2024-04-15T02:15:09.049988437Z [2024-04-15T02:15:09.049+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:15:09.050083320Z [2024-04-15T02:15:09.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:15:09.050095015Z 2024-04-15T02:15:09.051658024Z [2024-04-15T02:15:09.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:15:09.051720077Z [2024-04-15T02:15:09.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:09.111845825Z [2024-04-15T02:15:09.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status queued for try_number 1 2024-04-15T02:15:09.112807197Z [2024-04-15T02:15:09.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:09.123866443Z [2024-04-15T02:15:09.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18d2356f-f2ef-4620-8b88-d7c7241485c2 2024-04-15T02:15:09.124428823Z [2024-04-15T02:15:09.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=0, run_start_date=2024-04-15 02:15:08.380169+00:00, run_end_date=2024-04-15 02:15:08.771411+00:00, run_duration=0.391242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:06.754026+00:00, queued_by_job_id=1, pid=14467 2024-04-15T02:15:11.398437511Z [2024-04-15T02:15:11.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:15:11.399057012Z [2024-04-15T02:15:11.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:10:00+00:00, run_id=scheduled__2024-04-15T02:10:00+00:00, run_start_date=2024-04-15 02:15:00.829998+00:00, run_end_date=2024-04-15 02:15:11.398324+00:00, run_duration=10.568326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:10:00+00:00, data_interval_end=2024-04-15 02:15:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:15:11.406221064Z [2024-04-15T02:15:11.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:15:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:15:11.437125756Z [2024-04-15T02:15:11.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:10:00+00:00 exited with status success for try_number 1 2024-04-15T02:15:11.441592746Z [2024-04-15T02:15:11.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:10:00+00:00, map_index=-1, run_start_date=2024-04-15 02:15:10.491103+00:00, run_end_date=2024-04-15 02:15:10.848842+00:00, run_duration=0.357739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:15:09.050147+00:00, queued_by_job_id=1, pid=14475 2024-04-15T02:16:00.921095918Z [2024-04-15T02:16:00.920+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:16:00.941515631Z [2024-04-15T02:16:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:00.950559838Z [2024-04-15T02:16:00.950+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:16:00.965285167Z [2024-04-15T02:16:00.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:01.066771229Z [2024-04-15T02:16:01.066+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:16:01.066812493Z 2024-04-15T02:16:01.066822995Z 2024-04-15T02:16:01.066832260Z 2024-04-15T02:16:01.066840797Z 2024-04-15T02:16:01.066851776Z [2024-04-15T02:16:01.066+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:16:01.067032905Z [2024-04-15T02:16:01.066+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:16:01.067416434Z [2024-04-15T02:16:01.066+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:16:01.067647780Z [2024-04-15T02:16:01.067+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:16:01.068800124Z [2024-04-15T02:16:01.068+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:16:01.068829024Z 2024-04-15T02:16:01.068907501Z 2024-04-15T02:16:01.068920383Z 2024-04-15T02:16:01.069005662Z 2024-04-15T02:16:01.076355804Z [2024-04-15T02:16:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:01.076521841Z [2024-04-15T02:16:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:16:01.077029606Z [2024-04-15T02:16:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:01.077216613Z [2024-04-15T02:16:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:16:01.077610598Z [2024-04-15T02:16:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:01.077791236Z [2024-04-15T02:16:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:16:01.078121102Z [2024-04-15T02:16:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:16:01.078200163Z [2024-04-15T02:16:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:16:01.327865368Z [2024-04-15T02:16:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:01.327928787Z [2024-04-15T02:16:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:01.327978020Z [2024-04-15T02:16:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:01.328000434Z [2024-04-15T02:16:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:16:01.336819708Z [2024-04-15T02:16:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49c8f0c9-6d1d-4046-a835-76a96ad0d313 2024-04-15T02:16:01.336967202Z [2024-04-15T02:16:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6644c1b2-b024-4967-82ff-aeeb81e51665 2024-04-15T02:16:01.337178988Z [2024-04-15T02:16:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88b508e8-f3e5-4bc8-a082-97771f3f3c67 2024-04-15T02:16:01.337431180Z [2024-04-15T02:16:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dbbe63d-8f90-445e-8e48-85ff0d95d776 2024-04-15T02:16:02.504813074Z [2024-04-15T02:16:02.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:02.505179904Z [2024-04-15T02:16:02.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:14:00+00:00, run_id=scheduled__2024-04-15T02:14:00+00:00, run_start_date=2024-04-15 02:16:00.978385+00:00, run_end_date=2024-04-15 02:16:02.504727+00:00, run_duration=1.526342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:14:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:16:02.512277661Z [2024-04-15T02:16:02.511+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:16:02.518291181Z [2024-04-15T02:16:02.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:02.518564767Z [2024-04-15T02:16:02.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:16:00.979719+00:00, run_end_date=2024-04-15 02:16:02.518217+00:00, run_duration=1.538498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:16:02.529985157Z [2024-04-15T02:16:02.529+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:02.586859174Z [2024-04-15T02:16:02.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:14:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:02.587082399Z [2024-04-15T02:16:02.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:02.593497658Z [2024-04-15T02:16:02.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:14:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:01.764306+00:00, run_end_date=2024-04-15 02:16:02.104535+00:00, run_duration=0.340229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:01.070473+00:00, queued_by_job_id=1, pid=14497 2024-04-15T02:16:02.596980536Z [2024-04-15T02:16:02.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:01.950316+00:00, run_end_date=2024-04-15 02:16:02.300344+00:00, run_duration=0.350028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:01.070473+00:00, queued_by_job_id=1, pid=14498 2024-04-15T02:16:05.066079713Z [2024-04-15T02:16:05.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:05.067082715Z [2024-04-15T02:16:05.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:16:00.980885+00:00, run_end_date=2024-04-15 02:16:05.066315+00:00, run_duration=4.08543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:16:05.093206051Z [2024-04-15T02:16:05.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:05.148624058Z [2024-04-15T02:16:05.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:05.156742105Z [2024-04-15T02:16:05.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:02.896744+00:00, run_end_date=2024-04-15 02:16:04.284435+00:00, run_duration=1.387691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:01.070473+00:00, queued_by_job_id=1, pid=14521 2024-04-15T02:16:05.463759757Z [2024-04-15T02:16:05.463+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:16:06.464087789Z [2024-04-15T02:16:06.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:16:06.464317111Z [2024-04-15T02:16:06.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:16:00.982074+00:00, run_end_date=2024-04-15 02:16:06.463826+00:00, run_duration=5.481752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:16:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:16:06.477346369Z [2024-04-15T02:16:06.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:16:00+00:00, run_after=2024-04-15T02:17:00+00:00 2024-04-15T02:16:06.514329113Z [2024-04-15T02:16:06.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:16:06.520607495Z [2024-04-15T02:16:06.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:16:02.898651+00:00, run_end_date=2024-04-15 02:16:05.836845+00:00, run_duration=2.938194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:16:01.070473+00:00, queued_by_job_id=1, pid=14522 2024-04-15T02:17:00.724278438Z [2024-04-15T02:17:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:00.730139654Z [2024-04-15T02:17:00.729+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:17:00.740628279Z [2024-04-15T02:17:00.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:00.784715934Z [2024-04-15T02:17:00.784+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:17:00.784759545Z 2024-04-15T02:17:00.784769906Z 2024-04-15T02:17:00.784791639Z 2024-04-15T02:17:00.784814979Z [2024-04-15T02:17:00.784+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:17:00.784967135Z [2024-04-15T02:17:00.784+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:17:00.785069222Z [2024-04-15T02:17:00.784+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:17:00.785702992Z [2024-04-15T02:17:00.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:17:00.785719058Z 2024-04-15T02:17:00.785754175Z 2024-04-15T02:17:00.785763024Z 2024-04-15T02:17:00.788170379Z [2024-04-15T02:17:00.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:00.788361672Z [2024-04-15T02:17:00.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:17:00.788607623Z [2024-04-15T02:17:00.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:00.788685031Z [2024-04-15T02:17:00.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:17:00.788977697Z [2024-04-15T02:17:00.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:00.789056072Z [2024-04-15T02:17:00.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:17:00.968348518Z [2024-04-15T02:17:00.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:17:00.969950181Z [2024-04-15T02:17:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:17:00.970170384Z [2024-04-15T02:17:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:17:00.979124225Z [2024-04-15T02:17:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48b0dd3c-dffb-4f9e-a6e0-8896a8e6206d 2024-04-15T02:17:00.979239878Z [2024-04-15T02:17:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89ede718-f78b-430d-81f1-a58dc9dbbb6d 2024-04-15T02:17:00.979390839Z [2024-04-15T02:17:00.979+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e3cf678-bb7a-4bec-9eab-ab62dfc89a57 2024-04-15T02:17:02.125347601Z [2024-04-15T02:17:02.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:17:02.125722011Z [2024-04-15T02:17:02.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:17:00.748382+00:00, run_end_date=2024-04-15 02:17:02.125265+00:00, run_duration=1.376883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:17:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:17:02.134457224Z [2024-04-15T02:17:02.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:02.195353887Z [2024-04-15T02:17:02.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status success for try_number 1 2024-04-15T02:17:02.201108082Z [2024-04-15T02:17:02.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=2024-04-15 02:17:01.439383+00:00, run_end_date=2024-04-15 02:17:01.811713+00:00, run_duration=0.37233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:00.786286+00:00, queued_by_job_id=1, pid=14555 2024-04-15T02:17:04.832480819Z [2024-04-15T02:17:04.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:17:04.832941995Z [2024-04-15T02:17:04.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:17:00.749400+00:00, run_end_date=2024-04-15 02:17:04.832376+00:00, run_duration=4.082976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:17:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:17:04.845816188Z [2024-04-15T02:17:04.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:04.895739852Z [2024-04-15T02:17:04.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status success for try_number 1 2024-04-15T02:17:04.901721895Z [2024-04-15T02:17:04.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=2024-04-15 02:17:02.541094+00:00, run_end_date=2024-04-15 02:17:03.740235+00:00, run_duration=1.199141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:00.786286+00:00, queued_by_job_id=1, pid=14574 2024-04-15T02:17:05.960015422Z [2024-04-15T02:17:05.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:17:05.960097037Z [2024-04-15T02:17:05.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:17:00.750272+00:00, run_end_date=2024-04-15 02:17:05.959816+00:00, run_duration=5.209544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:17:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:17:05.970606709Z [2024-04-15T02:17:05.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:17:00+00:00, run_after=2024-04-15T02:18:00+00:00 2024-04-15T02:17:06.016309638Z [2024-04-15T02:17:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status success for try_number 1 2024-04-15T02:17:06.027733614Z [2024-04-15T02:17:06.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=2024-04-15 02:17:02.459829+00:00, run_end_date=2024-04-15 02:17:05.218915+00:00, run_duration=2.759086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:00.786286+00:00, queued_by_job_id=1, pid=14573 2024-04-15T02:17:26.204186130Z [2024-04-15T02:17:26.203+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:17:26.204234422Z 2024-04-15T02:17:26.204604304Z [2024-04-15T02:17:26.203+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-15T02:17:26.206354278Z [2024-04-15T02:17:26.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:17:26.206367047Z 2024-04-15T02:17:26.210279727Z [2024-04-15T02:17:26.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240415021725_420505', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:17:26.210687650Z [2024-04-15T02:17:26.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240415021725_420505', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-15T02:17:26.294208830Z [2024-04-15T02:17:26.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415021725_420505 exited with status queued for try_number 1 2024-04-15T02:17:26.303283229Z [2024-04-15T02:17:26.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3394cf5a-b7d0-4a73-9058-e2069ca348c8 2024-04-15T02:17:28.216549402Z [2024-04-15T02:17:28.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:17:28.216730460Z [2024-04-15T02:17:28.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-15 02:17:25.245047+00:00, run_id=scaleout_vdu_20240415021725_420505, run_start_date=2024-04-15 02:17:26.175922+00:00, run_end_date=2024-04-15 02:17:28.216269+00:00, run_duration=2.040347, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 02:17:25.245047+00:00, data_interval_end=2024-04-15 02:17:25.245047+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-15T02:17:28.220277627Z [2024-04-15T02:17:28.219+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-15T02:17:28.257977320Z [2024-04-15T02:17:28.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415021725_420505 exited with status success for try_number 1 2024-04-15T02:17:28.266747597Z [2024-04-15T02:17:28.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240415021725_420505, map_index=-1, run_start_date=2024-04-15 02:17:26.896022+00:00, run_end_date=2024-04-15 02:17:27.299972+00:00, run_duration=0.40395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:17:26.207392+00:00, queued_by_job_id=1, pid=14586 2024-04-15T02:18:00.690138503Z [2024-04-15T02:18:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:00.698294059Z [2024-04-15T02:18:00.697+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:18:00.710771402Z [2024-04-15T02:18:00.710+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:00.716228132Z [2024-04-15T02:18:00.715+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:18:00.814748557Z [2024-04-15T02:18:00.814+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:18:00.814790343Z 2024-04-15T02:18:00.814801722Z 2024-04-15T02:18:00.814810648Z 2024-04-15T02:18:00.814819144Z 2024-04-15T02:18:00.815066305Z [2024-04-15T02:18:00.814+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:18:00.815369282Z [2024-04-15T02:18:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:18:00.815685517Z [2024-04-15T02:18:00.815+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:18:00.815975233Z [2024-04-15T02:18:00.815+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:18:00.816963815Z [2024-04-15T02:18:00.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:18:00.816985876Z 2024-04-15T02:18:00.816995543Z 2024-04-15T02:18:00.817004390Z 2024-04-15T02:18:00.817013206Z 2024-04-15T02:18:00.822205174Z [2024-04-15T02:18:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:18:00.822377126Z [2024-04-15T02:18:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:18:00.822704578Z [2024-04-15T02:18:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:18:00.822891547Z [2024-04-15T02:18:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:18:00.823185741Z [2024-04-15T02:18:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:18:00.823364415Z [2024-04-15T02:18:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:18:00.823689684Z [2024-04-15T02:18:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:18:00.823864865Z [2024-04-15T02:18:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:18:01.091596313Z [2024-04-15T02:18:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status queued for try_number 1 2024-04-15T02:18:01.091778883Z [2024-04-15T02:18:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status queued for try_number 1 2024-04-15T02:18:01.091881957Z [2024-04-15T02:18:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status queued for try_number 1 2024-04-15T02:18:01.092018988Z [2024-04-15T02:18:01.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status queued for try_number 1 2024-04-15T02:18:01.101900451Z [2024-04-15T02:18:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to a202e57b-1eae-4799-8d3b-b576888757f7 2024-04-15T02:18:01.102155172Z [2024-04-15T02:18:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee8d3e3c-1640-49d6-993b-e30105efa60a 2024-04-15T02:18:01.102362258Z [2024-04-15T02:18:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to a473e521-2ee8-45d3-8996-b62280f7b335 2024-04-15T02:18:01.102564759Z [2024-04-15T02:18:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to a449bfed-aafe-48a1-b18d-7ce26c4f045f 2024-04-15T02:18:02.230802283Z [2024-04-15T02:18:02.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:18:02.231155355Z [2024-04-15T02:18:02.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:16:00+00:00, run_id=scheduled__2024-04-15T02:16:00+00:00, run_start_date=2024-04-15 02:18:00.725672+00:00, run_end_date=2024-04-15 02:18:02.230688+00:00, run_duration=1.505016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:16:00+00:00, data_interval_end=2024-04-15 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:18:02.238197282Z [2024-04-15T02:18:02.237+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:18:02.244595137Z [2024-04-15T02:18:02.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:18:02.244910370Z [2024-04-15T02:18:02.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:17:00+00:00, run_id=scheduled__2024-04-15T02:17:00+00:00, run_start_date=2024-04-15 02:18:00.726842+00:00, run_end_date=2024-04-15 02:18:02.244525+00:00, run_duration=1.517683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:17:00+00:00, data_interval_end=2024-04-15 02:18:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:18:02.253535017Z [2024-04-15T02:18:02.253+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:02.299823207Z [2024-04-15T02:18:02.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:16:00+00:00 exited with status success for try_number 1 2024-04-15T02:18:02.300051236Z [2024-04-15T02:18:02.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status success for try_number 1 2024-04-15T02:18:02.306847588Z [2024-04-15T02:18:02.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:16:00+00:00, map_index=-1, run_start_date=2024-04-15 02:18:01.629183+00:00, run_end_date=2024-04-15 02:18:01.979363+00:00, run_duration=0.35018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:18:00.818369+00:00, queued_by_job_id=1, pid=14614 2024-04-15T02:18:02.307209850Z [2024-04-15T02:18:02.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:17:00+00:00, map_index=-1, run_start_date=2024-04-15 02:18:01.715253+00:00, run_end_date=2024-04-15 02:18:02.076573+00:00, run_duration=0.36132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:18:00.818369+00:00, queued_by_job_id=1, pid=14615 2024-04-15T02:18:04.475296936Z [2024-04-15T02:18:04.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:18:04.475548315Z [2024-04-15T02:18:04.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:17:00+00:00, run_id=scheduled__2024-04-15T02:17:00+00:00, run_start_date=2024-04-15 02:18:00.727896+00:00, run_end_date=2024-04-15 02:18:04.475267+00:00, run_duration=3.747371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:17:00+00:00, data_interval_end=2024-04-15 02:18:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:18:04.484645749Z [2024-04-15T02:18:04.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:04.491337448Z [2024-04-15T02:18:04.490+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:18:04.491635258Z [2024-04-15T02:18:04.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:17:00+00:00, run_id=scheduled__2024-04-15T02:17:00+00:00, run_start_date=2024-04-15 02:18:00.728843+00:00, run_end_date=2024-04-15 02:18:04.491303+00:00, run_duration=3.76246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:17:00+00:00, data_interval_end=2024-04-15 02:18:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:18:04.502803049Z [2024-04-15T02:18:04.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:18:00+00:00, run_after=2024-04-15T02:19:00+00:00 2024-04-15T02:18:04.543545921Z [2024-04-15T02:18:04.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status success for try_number 1 2024-04-15T02:18:04.543714069Z [2024-04-15T02:18:04.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:17:00+00:00 exited with status success for try_number 1 2024-04-15T02:18:04.557863975Z [2024-04-15T02:18:04.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:17:00+00:00, map_index=-1, run_start_date=2024-04-15 02:18:02.711245+00:00, run_end_date=2024-04-15 02:18:03.995886+00:00, run_duration=1.284641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:18:00.818369+00:00, queued_by_job_id=1, pid=14639 2024-04-15T02:18:04.558155973Z [2024-04-15T02:18:04.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:17:00+00:00, map_index=-1, run_start_date=2024-04-15 02:18:02.508711+00:00, run_end_date=2024-04-15 02:18:04.128085+00:00, run_duration=1.619374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:18:00.818369+00:00, queued_by_job_id=1, pid=14638 2024-04-15T02:19:00.504368022Z [2024-04-15T02:19:00.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:00.518220900Z [2024-04-15T02:19:00.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:00.524526282Z [2024-04-15T02:19:00.524+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:19:00.609718054Z [2024-04-15T02:19:00.609+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:19:00.609861130Z 2024-04-15T02:19:00.609871438Z 2024-04-15T02:19:00.609879535Z 2024-04-15T02:19:00.609917725Z [2024-04-15T02:19:00.609+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:19:00.610194365Z [2024-04-15T02:19:00.609+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:19:00.610489725Z [2024-04-15T02:19:00.610+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:19:00.612016641Z [2024-04-15T02:19:00.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:19:00.612059701Z 2024-04-15T02:19:00.612068688Z 2024-04-15T02:19:00.612077200Z 2024-04-15T02:19:00.620064585Z [2024-04-15T02:19:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:19:00.620606110Z [2024-04-15T02:19:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:19:00.621276688Z [2024-04-15T02:19:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:19:00.621588308Z [2024-04-15T02:19:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:19:00.622039407Z [2024-04-15T02:19:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:19:00.622317123Z [2024-04-15T02:19:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:19:00.936098468Z [2024-04-15T02:19:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status queued for try_number 1 2024-04-15T02:19:00.936256963Z [2024-04-15T02:19:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status queued for try_number 1 2024-04-15T02:19:00.936411123Z [2024-04-15T02:19:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status queued for try_number 1 2024-04-15T02:19:00.945823525Z [2024-04-15T02:19:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 857d5393-f809-4957-92a4-e5142c031631 2024-04-15T02:19:00.948769233Z [2024-04-15T02:19:00.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40aaec7b-9422-4071-aa36-48ca8b4ef732 2024-04-15T02:19:00.948966303Z [2024-04-15T02:19:00.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97232f4d-3ced-4ab2-865d-64d23f36e4de 2024-04-15T02:19:02.111445541Z [2024-04-15T02:19:02.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:19:02.112320082Z [2024-04-15T02:19:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:18:00+00:00, run_id=scheduled__2024-04-15T02:18:00+00:00, run_start_date=2024-04-15 02:19:00.534362+00:00, run_end_date=2024-04-15 02:19:02.111770+00:00, run_duration=1.577408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:18:00+00:00, data_interval_end=2024-04-15 02:19:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:19:02.123969801Z [2024-04-15T02:19:02.123+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:02.191811061Z [2024-04-15T02:19:02.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status success for try_number 1 2024-04-15T02:19:02.196513363Z [2024-04-15T02:19:02.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:18:00+00:00, map_index=-1, run_start_date=2024-04-15 02:19:01.349838+00:00, run_end_date=2024-04-15 02:19:01.765774+00:00, run_duration=0.415936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:19:00.613700+00:00, queued_by_job_id=1, pid=14670 2024-04-15T02:19:04.378110123Z [2024-04-15T02:19:04.377+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:19:04.378438705Z [2024-04-15T02:19:04.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:18:00+00:00, run_id=scheduled__2024-04-15T02:18:00+00:00, run_start_date=2024-04-15 02:19:00.538156+00:00, run_end_date=2024-04-15 02:19:04.378114+00:00, run_duration=3.839958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:18:00+00:00, data_interval_end=2024-04-15 02:19:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:19:04.390383249Z [2024-04-15T02:19:04.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:04.427402545Z [2024-04-15T02:19:04.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status success for try_number 1 2024-04-15T02:19:04.432975474Z [2024-04-15T02:19:04.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:18:00+00:00, map_index=-1, run_start_date=2024-04-15 02:19:02.441806+00:00, run_end_date=2024-04-15 02:19:04.264906+00:00, run_duration=1.8231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:19:00.613700+00:00, queued_by_job_id=1, pid=14689 2024-04-15T02:19:05.502043468Z [2024-04-15T02:19:05.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:19:05.502488338Z [2024-04-15T02:19:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:18:00+00:00, run_id=scheduled__2024-04-15T02:18:00+00:00, run_start_date=2024-04-15 02:19:00.536535+00:00, run_end_date=2024-04-15 02:19:05.501992+00:00, run_duration=4.965457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:18:00+00:00, data_interval_end=2024-04-15 02:19:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:19:05.513549083Z [2024-04-15T02:19:05.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:19:00+00:00, run_after=2024-04-15T02:20:00+00:00 2024-04-15T02:19:05.560257480Z [2024-04-15T02:19:05.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status success for try_number 1 2024-04-15T02:19:05.571634139Z [2024-04-15T02:19:05.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:18:00+00:00, map_index=-1, run_start_date=2024-04-15 02:19:02.245865+00:00, run_end_date=2024-04-15 02:19:04.377557+00:00, run_duration=2.131692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:19:00.613700+00:00, queued_by_job_id=1, pid=14688 2024-04-15T02:19:26.219075245Z [2024-04-15T02:19:26.218+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:19:26.219123680Z 2024-04-15T02:19:26.219424760Z [2024-04-15T02:19:26.219+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-15T02:19:26.220477684Z [2024-04-15T02:19:26.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:19:26.220514625Z 2024-04-15T02:19:26.223791689Z [2024-04-15T02:19:26.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240415021925_343723', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:19:26.224112229Z [2024-04-15T02:19:26.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240415021925_343723', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-15T02:19:26.295935516Z [2024-04-15T02:19:26.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415021925_343723 exited with status queued for try_number 1 2024-04-15T02:19:26.308666631Z [2024-04-15T02:19:26.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cae3ee4-1da1-4b45-af25-90f81ea143af 2024-04-15T02:19:27.443211732Z [2024-04-15T02:19:27.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:19:27.443779670Z [2024-04-15T02:19:27.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-15 02:19:25.280246+00:00, run_id=scaleout_vdu_20240415021925_343723, run_start_date=2024-04-15 02:19:26.175689+00:00, run_end_date=2024-04-15 02:19:27.443449+00:00, run_duration=1.26776, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 02:19:25.280246+00:00, data_interval_end=2024-04-15 02:19:25.280246+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-15T02:19:27.446446123Z [2024-04-15T02:19:27.446+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-15T02:19:27.470032336Z [2024-04-15T02:19:27.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240415021925_343723 exited with status success for try_number 1 2024-04-15T02:19:27.477076771Z [2024-04-15T02:19:27.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240415021925_343723, map_index=-1, run_start_date=2024-04-15 02:19:26.894058+00:00, run_end_date=2024-04-15 02:19:27.306366+00:00, run_duration=0.412308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:19:26.221042+00:00, queued_by_job_id=1, pid=14701 2024-04-15T02:20:00.258523126Z [2024-04-15T02:20:00.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:20:00.265012857Z [2024-04-15T02:20:00.264+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:20:00.274722734Z [2024-04-15T02:20:00.274+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:00.287552664Z [2024-04-15T02:20:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:00.299836184Z [2024-04-15T02:20:00.299+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:20:00.430744496Z [2024-04-15T02:20:00.430+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T02:20:00.430772522Z 2024-04-15T02:20:00.430776082Z 2024-04-15T02:20:00.430783698Z 2024-04-15T02:20:00.430786772Z 2024-04-15T02:20:00.430790015Z 2024-04-15T02:20:00.430860040Z [2024-04-15T02:20:00.430+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:20:00.430864745Z [2024-04-15T02:20:00.430+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:20:00.430978272Z [2024-04-15T02:20:00.430+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:20:00.431050227Z [2024-04-15T02:20:00.430+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:20:00.431114450Z [2024-04-15T02:20:00.431+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:20:00.431653480Z [2024-04-15T02:20:00.431+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:00.431662125Z 2024-04-15T02:20:00.431665839Z 2024-04-15T02:20:00.431669424Z 2024-04-15T02:20:00.431672482Z 2024-04-15T02:20:00.431675791Z 2024-04-15T02:20:00.434748374Z [2024-04-15T02:20:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:20:00.434815124Z [2024-04-15T02:20:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:00.435119034Z [2024-04-15T02:20:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:00.435213263Z [2024-04-15T02:20:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:20:00.435370501Z [2024-04-15T02:20:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:00.435431213Z [2024-04-15T02:20:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:20:00.435599068Z [2024-04-15T02:20:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:00.435671263Z [2024-04-15T02:20:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:20:00.435815755Z [2024-04-15T02:20:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:00.435885692Z [2024-04-15T02:20:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:20:00.894632278Z [2024-04-15T02:20:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.894664661Z [2024-04-15T02:20:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.894677573Z [2024-04-15T02:20:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.894735792Z [2024-04-15T02:20:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.894800341Z [2024-04-15T02:20:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:00.903021124Z [2024-04-15T02:20:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5338308-03f4-44e6-a1ef-357b3579779b 2024-04-15T02:20:00.903146687Z [2024-04-15T02:20:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to a85b1ddd-ff9b-4615-a630-63f39e72dbf3 2024-04-15T02:20:00.903212235Z [2024-04-15T02:20:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to aecd9cbc-89fc-4618-bd9f-0f0f6c88be0c 2024-04-15T02:20:00.903292253Z [2024-04-15T02:20:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 308c330c-9d7c-4f7c-be85-4000f405eeab 2024-04-15T02:20:00.903384745Z [2024-04-15T02:20:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ab07965-44bf-4502-9082-d83684f00a6d 2024-04-15T02:20:01.827579887Z [2024-04-15T02:20:01.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:01.827684072Z [2024-04-15T02:20:01.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:18:00+00:00, run_id=scheduled__2024-04-15T02:18:00+00:00, run_start_date=2024-04-15 02:20:00.321946+00:00, run_end_date=2024-04-15 02:20:01.826653+00:00, run_duration=1.504707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:18:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:20:01.843281766Z [2024-04-15T02:20:01.842+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:20:01.898093798Z [2024-04-15T02:20:01.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:18:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:01.902034658Z [2024-04-15T02:20:01.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:18:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:01.213939+00:00, run_end_date=2024-04-15 02:20:01.570968+00:00, run_duration=0.357029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.432492+00:00, queued_by_job_id=1, pid=14724 2024-04-15T02:20:02.976233587Z [2024-04-15T02:20:02.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:02.977294468Z [2024-04-15T02:20:02.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:19:00+00:00, run_id=scheduled__2024-04-15T02:19:00+00:00, run_start_date=2024-04-15 02:20:00.325886+00:00, run_end_date=2024-04-15 02:20:02.976898+00:00, run_duration=2.651012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:19:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:20:02.987637536Z [2024-04-15T02:20:02.987+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:03.084055765Z [2024-04-15T02:20:03.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:03.092295441Z [2024-04-15T02:20:03.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:19:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:01.711515+00:00, run_end_date=2024-04-15 02:20:02.097951+00:00, run_duration=0.386436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.432492+00:00, queued_by_job_id=1, pid=14735 2024-04-15T02:20:04.206016854Z [2024-04-15T02:20:04.205+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:20:04.206061161Z 2024-04-15T02:20:04.206442097Z [2024-04-15T02:20:04.206+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:20:04.207439872Z [2024-04-15T02:20:04.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:04.207455754Z 2024-04-15T02:20:04.211563847Z [2024-04-15T02:20:04.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:20:04.211906261Z [2024-04-15T02:20:04.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:04.302753498Z [2024-04-15T02:20:04.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:04.302827252Z [2024-04-15T02:20:04.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:04.309224536Z [2024-04-15T02:20:04.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6fe26a9-e453-451a-b06c-05c4da04a475 2024-04-15T02:20:04.310035256Z [2024-04-15T02:20:04.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:02.695602+00:00, run_end_date=2024-04-15 02:20:03.071158+00:00, run_duration=0.375556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.432492+00:00, queued_by_job_id=1, pid=14755 2024-04-15T02:20:05.478688663Z [2024-04-15T02:20:05.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:05.479423533Z [2024-04-15T02:20:05.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:19:00+00:00, run_id=scheduled__2024-04-15T02:19:00+00:00, run_start_date=2024-04-15 02:20:00.329083+00:00, run_end_date=2024-04-15 02:20:05.478527+00:00, run_duration=5.149444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:19:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:20:05.491711505Z [2024-04-15T02:20:05.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:05.498932224Z [2024-04-15T02:20:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:05.499407360Z [2024-04-15T02:20:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:19:00+00:00, run_id=scheduled__2024-04-15T02:19:00+00:00, run_start_date=2024-04-15 02:20:00.330769+00:00, run_end_date=2024-04-15 02:20:05.498820+00:00, run_duration=5.168051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:19:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:20:05.507759919Z [2024-04-15T02:20:05.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:21:00+00:00 2024-04-15T02:20:05.549755136Z [2024-04-15T02:20:05.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:05.549946756Z [2024-04-15T02:20:05.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:19:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:05.556077169Z [2024-04-15T02:20:05.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:19:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:03.020506+00:00, run_end_date=2024-04-15 02:20:04.443673+00:00, run_duration=1.423167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.432492+00:00, queued_by_job_id=1, pid=14771 2024-04-15T02:20:05.556424535Z [2024-04-15T02:20:05.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:19:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:02.597481+00:00, run_end_date=2024-04-15 02:20:04.533459+00:00, run_duration=1.935978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:00.432492+00:00, queued_by_job_id=1, pid=14754 2024-04-15T02:20:06.640677815Z [2024-04-15T02:20:06.640+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:20:06.640704786Z 2024-04-15T02:20:06.641004996Z [2024-04-15T02:20:06.640+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:20:06.641994515Z [2024-04-15T02:20:06.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:06.642005000Z 2024-04-15T02:20:06.648582364Z [2024-04-15T02:20:06.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:20:06.648886228Z [2024-04-15T02:20:06.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:20:06.721074015Z [2024-04-15T02:20:06.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:06.721321613Z [2024-04-15T02:20:06.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:06.734477234Z [2024-04-15T02:20:06.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfccc08e-4247-47ca-b1c7-290b6ea3c294 2024-04-15T02:20:06.734939787Z [2024-04-15T02:20:06.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:06.007557+00:00, run_end_date=2024-04-15 02:20:06.379342+00:00, run_duration=0.371785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:04.208081+00:00, queued_by_job_id=1, pid=14784 2024-04-15T02:20:10.417309084Z [2024-04-15T02:20:10.416+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:20:10.417341796Z 2024-04-15T02:20:10.417905697Z [2024-04-15T02:20:10.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:20:10.418521629Z [2024-04-15T02:20:10.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:20:10.418532860Z 2024-04-15T02:20:10.421647832Z [2024-04-15T02:20:10.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:20:10.421847281Z [2024-04-15T02:20:10.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:10.537505739Z [2024-04-15T02:20:10.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status queued for try_number 1 2024-04-15T02:20:10.537698184Z [2024-04-15T02:20:10.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:10.548467941Z [2024-04-15T02:20:10.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e7b99e8-6bd2-4334-8a3b-b8874c5a75eb 2024-04-15T02:20:10.548764448Z [2024-04-15T02:20:10.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=0, run_start_date=2024-04-15 02:20:08.435059+00:00, run_end_date=2024-04-15 02:20:09.631359+00:00, run_duration=1.1963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:06.642471+00:00, queued_by_job_id=1, pid=14792 2024-04-15T02:20:13.204735496Z [2024-04-15T02:20:13.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:20:13.205124976Z [2024-04-15T02:20:13.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:15:00+00:00, run_id=scheduled__2024-04-15T02:15:00+00:00, run_start_date=2024-04-15 02:20:00.319696+00:00, run_end_date=2024-04-15 02:20:13.204601+00:00, run_duration=12.884905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:15:00+00:00, data_interval_end=2024-04-15 02:20:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:20:13.219451464Z [2024-04-15T02:20:13.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:20:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:20:13.264093065Z [2024-04-15T02:20:13.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:15:00+00:00 exited with status success for try_number 1 2024-04-15T02:20:13.273976956Z [2024-04-15T02:20:13.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:15:00+00:00, map_index=-1, run_start_date=2024-04-15 02:20:11.887861+00:00, run_end_date=2024-04-15 02:20:12.254300+00:00, run_duration=0.366439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:20:10.419507+00:00, queued_by_job_id=1, pid=14805 2024-04-15T02:21:00.687838028Z [2024-04-15T02:21:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:00.703666529Z [2024-04-15T02:21:00.703+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:00.713287165Z [2024-04-15T02:21:00.712+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:21:00.814180144Z [2024-04-15T02:21:00.813+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:21:00.814221557Z 2024-04-15T02:21:00.814231184Z 2024-04-15T02:21:00.814266611Z 2024-04-15T02:21:00.814394985Z [2024-04-15T02:21:00.814+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:21:00.814654681Z [2024-04-15T02:21:00.814+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:21:00.814860902Z [2024-04-15T02:21:00.814+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:21:00.815584580Z [2024-04-15T02:21:00.815+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:21:00.815597774Z 2024-04-15T02:21:00.815601475Z 2024-04-15T02:21:00.815604739Z 2024-04-15T02:21:00.820097465Z [2024-04-15T02:21:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:21:00.820448611Z [2024-04-15T02:21:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:21:00.820836419Z [2024-04-15T02:21:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:21:00.821106942Z [2024-04-15T02:21:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:21:00.821494092Z [2024-04-15T02:21:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:21:00.821751499Z [2024-04-15T02:21:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:21:01.045906726Z [2024-04-15T02:21:01.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:21:01.046095760Z [2024-04-15T02:21:01.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:21:01.046289060Z [2024-04-15T02:21:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:21:01.055803884Z [2024-04-15T02:21:01.055+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8025f62b-7091-4896-8424-c04ddabf5138 2024-04-15T02:21:01.056059087Z [2024-04-15T02:21:01.055+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5952a7cf-66d1-4df1-b305-5b8c5ecb59e4 2024-04-15T02:21:01.056252347Z [2024-04-15T02:21:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to c95ba803-983e-4436-9366-ff513f05403b 2024-04-15T02:21:02.182708678Z [2024-04-15T02:21:02.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:21:02.183086891Z [2024-04-15T02:21:02.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:21:00.734251+00:00, run_end_date=2024-04-15 02:21:02.182647+00:00, run_duration=1.448396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:21:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:21:02.191553222Z [2024-04-15T02:21:02.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:02.239182928Z [2024-04-15T02:21:02.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:21:02.249629015Z [2024-04-15T02:21:02.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:21:01.506726+00:00, run_end_date=2024-04-15 02:21:01.886429+00:00, run_duration=0.379703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:21:00.816460+00:00, queued_by_job_id=1, pid=14827 2024-04-15T02:21:03.939522457Z [2024-04-15T02:21:03.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:21:03.939744418Z [2024-04-15T02:21:03.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:21:00.736601+00:00, run_end_date=2024-04-15 02:21:03.939426+00:00, run_duration=3.202825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:21:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:21:03.946993851Z [2024-04-15T02:21:03.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:04.013308082Z [2024-04-15T02:21:04.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:21:04.021636888Z [2024-04-15T02:21:04.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:21:02.375323+00:00, run_end_date=2024-04-15 02:21:03.673077+00:00, run_duration=1.297754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:21:00.816460+00:00, queued_by_job_id=1, pid=14845 2024-04-15T02:21:05.086519343Z [2024-04-15T02:21:05.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:21:05.087483918Z [2024-04-15T02:21:05.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:21:00.738778+00:00, run_end_date=2024-04-15 02:21:05.086628+00:00, run_duration=4.34785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:21:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:21:05.105110238Z [2024-04-15T02:21:05.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:21:00+00:00, run_after=2024-04-15T02:22:00+00:00 2024-04-15T02:21:05.159440205Z [2024-04-15T02:21:05.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:21:05.170557159Z [2024-04-15T02:21:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:21:02.521287+00:00, run_end_date=2024-04-15 02:21:04.472051+00:00, run_duration=1.950764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:21:00.816460+00:00, queued_by_job_id=1, pid=14846 2024-04-15T02:21:05.528599041Z [2024-04-15T02:21:05.528+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:22:01.038717820Z [2024-04-15T02:22:01.036+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:22:01.052906452Z [2024-04-15T02:22:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:01.080345294Z [2024-04-15T02:22:01.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:01.090227649Z [2024-04-15T02:22:01.089+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:22:01.170964889Z [2024-04-15T02:22:01.170+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:22:01.170988377Z 2024-04-15T02:22:01.170996445Z 2024-04-15T02:22:01.171000245Z 2024-04-15T02:22:01.171003775Z 2024-04-15T02:22:01.171058022Z [2024-04-15T02:22:01.170+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:22:01.171204942Z [2024-04-15T02:22:01.171+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:22:01.171341290Z [2024-04-15T02:22:01.171+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:22:01.171484861Z [2024-04-15T02:22:01.171+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:22:01.172079003Z [2024-04-15T02:22:01.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:22:01.172088031Z 2024-04-15T02:22:01.172091898Z 2024-04-15T02:22:01.172095262Z 2024-04-15T02:22:01.172098684Z 2024-04-15T02:22:01.177419135Z [2024-04-15T02:22:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:22:01.177685000Z [2024-04-15T02:22:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:22:01.177991591Z [2024-04-15T02:22:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:22:01.178144964Z [2024-04-15T02:22:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:22:01.178380772Z [2024-04-15T02:22:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:22:01.178524144Z [2024-04-15T02:22:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:22:01.178803800Z [2024-04-15T02:22:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:22:01.178988587Z [2024-04-15T02:22:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:22:01.571305714Z [2024-04-15T02:22:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:22:01.573432763Z [2024-04-15T02:22:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status queued for try_number 1 2024-04-15T02:22:01.573966365Z [2024-04-15T02:22:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status queued for try_number 1 2024-04-15T02:22:01.574188258Z [2024-04-15T02:22:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status queued for try_number 1 2024-04-15T02:22:01.583621850Z [2024-04-15T02:22:01.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to c509df1a-8857-44ed-a827-c063fe2499d4 2024-04-15T02:22:01.583848244Z [2024-04-15T02:22:01.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e314945-6fd0-4fa7-845b-4c9cf320b9c7 2024-04-15T02:22:01.583999034Z [2024-04-15T02:22:01.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0eb5a17-f67f-4503-921a-814503fad3b2 2024-04-15T02:22:01.584169343Z [2024-04-15T02:22:01.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1daaf69f-0c9a-4005-b059-bee61de0a0a5 2024-04-15T02:22:02.767210780Z [2024-04-15T02:22:02.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:22:02.767488137Z [2024-04-15T02:22:02.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:22:01.102449+00:00, run_end_date=2024-04-15 02:22:02.767171+00:00, run_duration=1.664722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:22:02.773812386Z [2024-04-15T02:22:02.773+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:22:02.778983937Z [2024-04-15T02:22:02.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:22:02.779195604Z [2024-04-15T02:22:02.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:21:00+00:00, run_id=scheduled__2024-04-15T02:21:00+00:00, run_start_date=2024-04-15 02:22:01.103717+00:00, run_end_date=2024-04-15 02:22:02.778907+00:00, run_duration=1.67519, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:21:00+00:00, data_interval_end=2024-04-15 02:22:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:22:02.787187982Z [2024-04-15T02:22:02.786+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:02.836991964Z [2024-04-15T02:22:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:22:02.842394784Z [2024-04-15T02:22:02.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status success for try_number 1 2024-04-15T02:22:02.849606784Z [2024-04-15T02:22:02.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:21:00+00:00, map_index=-1, run_start_date=2024-04-15 02:22:02.108833+00:00, run_end_date=2024-04-15 02:22:02.462181+00:00, run_duration=0.353348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:22:01.173717+00:00, queued_by_job_id=1, pid=14880 2024-04-15T02:22:02.849634798Z [2024-04-15T02:22:02.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:22:02.154998+00:00, run_end_date=2024-04-15 02:22:02.507378+00:00, run_duration=0.35238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:22:01.173717+00:00, queued_by_job_id=1, pid=14881 2024-04-15T02:22:04.914296129Z [2024-04-15T02:22:04.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:22:04.914743255Z [2024-04-15T02:22:04.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:21:00+00:00, run_id=scheduled__2024-04-15T02:21:00+00:00, run_start_date=2024-04-15 02:22:01.104776+00:00, run_end_date=2024-04-15 02:22:04.914069+00:00, run_duration=3.809293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:21:00+00:00, data_interval_end=2024-04-15 02:22:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:22:04.928316169Z [2024-04-15T02:22:04.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:04.983711942Z [2024-04-15T02:22:04.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status success for try_number 1 2024-04-15T02:22:04.990657778Z [2024-04-15T02:22:04.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:21:00+00:00, map_index=-1, run_start_date=2024-04-15 02:22:02.985723+00:00, run_end_date=2024-04-15 02:22:04.280492+00:00, run_duration=1.294769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:22:01.173717+00:00, queued_by_job_id=1, pid=14899 2024-04-15T02:22:06.051482768Z [2024-04-15T02:22:06.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:22:06.051899102Z [2024-04-15T02:22:06.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:21:00+00:00, run_id=scheduled__2024-04-15T02:21:00+00:00, run_start_date=2024-04-15 02:22:01.105704+00:00, run_end_date=2024-04-15 02:22:06.051355+00:00, run_duration=4.945651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:21:00+00:00, data_interval_end=2024-04-15 02:22:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:22:06.063050103Z [2024-04-15T02:22:06.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:22:00+00:00, run_after=2024-04-15T02:23:00+00:00 2024-04-15T02:22:06.105248907Z [2024-04-15T02:22:06.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:21:00+00:00 exited with status success for try_number 1 2024-04-15T02:22:06.113253155Z [2024-04-15T02:22:06.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:21:00+00:00, map_index=-1, run_start_date=2024-04-15 02:22:03.344828+00:00, run_end_date=2024-04-15 02:22:05.131339+00:00, run_duration=1.786511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:22:01.173717+00:00, queued_by_job_id=1, pid=14910 2024-04-15T02:23:00.831333557Z [2024-04-15T02:23:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:00.842923889Z [2024-04-15T02:23:00.842+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:23:00.861189481Z [2024-04-15T02:23:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:00.930553898Z [2024-04-15T02:23:00.929+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:23:00.930597652Z 2024-04-15T02:23:00.930608669Z 2024-04-15T02:23:00.930617540Z 2024-04-15T02:23:00.931289779Z [2024-04-15T02:23:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:23:00.931749040Z [2024-04-15T02:23:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:23:00.932180289Z [2024-04-15T02:23:00.931+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:23:00.934369348Z [2024-04-15T02:23:00.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:23:00.934382340Z 2024-04-15T02:23:00.934386749Z 2024-04-15T02:23:00.934390599Z 2024-04-15T02:23:00.941444091Z [2024-04-15T02:23:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:23:00.941836196Z [2024-04-15T02:23:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:23:00.942546305Z [2024-04-15T02:23:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:23:00.942790840Z [2024-04-15T02:23:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:23:00.943353850Z [2024-04-15T02:23:00.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:23:00.943821264Z [2024-04-15T02:23:00.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:23:01.161514324Z [2024-04-15T02:23:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status queued for try_number 1 2024-04-15T02:23:01.161553203Z [2024-04-15T02:23:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status queued for try_number 1 2024-04-15T02:23:01.161701087Z [2024-04-15T02:23:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status queued for try_number 1 2024-04-15T02:23:01.169033438Z [2024-04-15T02:23:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2cdc4c2-5cc3-47bd-b0a2-ea1293669e16 2024-04-15T02:23:01.169294350Z [2024-04-15T02:23:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05c9bd53-45ea-470b-ba67-bfc8321ba3cb 2024-04-15T02:23:01.169534078Z [2024-04-15T02:23:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfa02faf-a3da-4fd1-8ea2-2f2f78018475 2024-04-15T02:23:03.508623670Z [2024-04-15T02:23:03.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:23:03.510386726Z [2024-04-15T02:23:03.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:22:00+00:00, run_id=scheduled__2024-04-15T02:22:00+00:00, run_start_date=2024-04-15 02:23:00.874692+00:00, run_end_date=2024-04-15 02:23:03.509944+00:00, run_duration=2.635252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:22:00+00:00, data_interval_end=2024-04-15 02:23:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:23:03.520632804Z [2024-04-15T02:23:03.520+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:03.569623437Z [2024-04-15T02:23:03.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status success for try_number 1 2024-04-15T02:23:03.575190834Z [2024-04-15T02:23:03.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:22:00+00:00, map_index=-1, run_start_date=2024-04-15 02:23:01.865770+00:00, run_end_date=2024-04-15 02:23:02.357815+00:00, run_duration=0.492045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:23:00.936646+00:00, queued_by_job_id=1, pid=14936 2024-04-15T02:23:05.936211067Z [2024-04-15T02:23:05.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:23:05.936575327Z [2024-04-15T02:23:05.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:22:00+00:00, run_id=scheduled__2024-04-15T02:22:00+00:00, run_start_date=2024-04-15 02:23:00.876145+00:00, run_end_date=2024-04-15 02:23:05.935981+00:00, run_duration=5.059836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:22:00+00:00, data_interval_end=2024-04-15 02:23:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:23:05.953483623Z [2024-04-15T02:23:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:05.963034790Z [2024-04-15T02:23:05.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:23:05.963492493Z [2024-04-15T02:23:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:22:00+00:00, run_id=scheduled__2024-04-15T02:22:00+00:00, run_start_date=2024-04-15 02:23:00.877405+00:00, run_end_date=2024-04-15 02:23:05.962838+00:00, run_duration=5.085433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:22:00+00:00, data_interval_end=2024-04-15 02:23:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:23:05.981487236Z [2024-04-15T02:23:05.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:23:00+00:00, run_after=2024-04-15T02:24:00+00:00 2024-04-15T02:23:06.026246126Z [2024-04-15T02:23:06.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status success for try_number 1 2024-04-15T02:23:06.026295264Z [2024-04-15T02:23:06.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status success for try_number 1 2024-04-15T02:23:06.033863875Z [2024-04-15T02:23:06.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:22:00+00:00, map_index=-1, run_start_date=2024-04-15 02:23:03.237857+00:00, run_end_date=2024-04-15 02:23:04.799600+00:00, run_duration=1.561743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:23:00.936646+00:00, queued_by_job_id=1, pid=14955 2024-04-15T02:23:06.034365863Z [2024-04-15T02:23:06.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:22:00+00:00, map_index=-1, run_start_date=2024-04-15 02:23:03.089667+00:00, run_end_date=2024-04-15 02:23:05.446834+00:00, run_duration=2.357167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:23:00.936646+00:00, queued_by_job_id=1, pid=14954 2024-04-15T02:24:00.714040832Z [2024-04-15T02:24:00.713+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:24:00.736882899Z [2024-04-15T02:24:00.736+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:00.746026349Z [2024-04-15T02:24:00.745+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:24:00.757044800Z [2024-04-15T02:24:00.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:00.867058384Z [2024-04-15T02:24:00.866+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:24:00.867100389Z 2024-04-15T02:24:00.867111066Z 2024-04-15T02:24:00.867120001Z 2024-04-15T02:24:00.867128589Z 2024-04-15T02:24:00.867169238Z [2024-04-15T02:24:00.867+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:24:00.867430847Z [2024-04-15T02:24:00.867+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:24:00.867666474Z [2024-04-15T02:24:00.867+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:24:00.867869638Z [2024-04-15T02:24:00.867+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:24:00.868719679Z [2024-04-15T02:24:00.868+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:24:00.868733870Z 2024-04-15T02:24:00.868743226Z 2024-04-15T02:24:00.868752837Z 2024-04-15T02:24:00.868761469Z 2024-04-15T02:24:00.874272533Z [2024-04-15T02:24:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:24:00.874553564Z [2024-04-15T02:24:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:24:00.874978203Z [2024-04-15T02:24:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:24:00.875214176Z [2024-04-15T02:24:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:24:00.875660076Z [2024-04-15T02:24:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:24:00.876061556Z [2024-04-15T02:24:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:24:00.876466825Z [2024-04-15T02:24:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:24:00.876690971Z [2024-04-15T02:24:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:24:01.312971933Z [2024-04-15T02:24:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status queued for try_number 1 2024-04-15T02:24:01.313119269Z [2024-04-15T02:24:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status queued for try_number 1 2024-04-15T02:24:01.313257101Z [2024-04-15T02:24:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status queued for try_number 1 2024-04-15T02:24:01.313377383Z [2024-04-15T02:24:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status queued for try_number 1 2024-04-15T02:24:01.328367336Z [2024-04-15T02:24:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82da5187-6e4c-4a5f-ada4-1b99203b8d23 2024-04-15T02:24:01.328606706Z [2024-04-15T02:24:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 702e588d-f97e-444c-a1fb-cc7e67b98290 2024-04-15T02:24:01.328849465Z [2024-04-15T02:24:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 147eddd5-30e2-46e0-8ffb-bf671167eaed 2024-04-15T02:24:01.329059459Z [2024-04-15T02:24:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a4b8236-3c57-415f-9eac-2bc973daf4ed 2024-04-15T02:24:02.530183341Z [2024-04-15T02:24:02.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:24:02.530594863Z [2024-04-15T02:24:02.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:22:00+00:00, run_id=scheduled__2024-04-15T02:22:00+00:00, run_start_date=2024-04-15 02:24:00.768006+00:00, run_end_date=2024-04-15 02:24:02.530094+00:00, run_duration=1.762088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:22:00+00:00, data_interval_end=2024-04-15 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:24:02.542215014Z [2024-04-15T02:24:02.541+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:24:02.549992291Z [2024-04-15T02:24:02.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:24:02.551234330Z [2024-04-15T02:24:02.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:23:00+00:00, run_id=scheduled__2024-04-15T02:23:00+00:00, run_start_date=2024-04-15 02:24:00.769154+00:00, run_end_date=2024-04-15 02:24:02.549889+00:00, run_duration=1.780735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:23:00+00:00, data_interval_end=2024-04-15 02:24:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:24:02.562437759Z [2024-04-15T02:24:02.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:02.605805411Z [2024-04-15T02:24:02.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:22:00+00:00 exited with status success for try_number 1 2024-04-15T02:24:02.607597565Z [2024-04-15T02:24:02.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status success for try_number 1 2024-04-15T02:24:02.613392482Z [2024-04-15T02:24:02.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:22:00+00:00, map_index=-1, run_start_date=2024-04-15 02:24:01.759901+00:00, run_end_date=2024-04-15 02:24:02.075518+00:00, run_duration=0.315617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:24:00.870029+00:00, queued_by_job_id=1, pid=14988 2024-04-15T02:24:02.613748554Z [2024-04-15T02:24:02.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:23:00+00:00, map_index=-1, run_start_date=2024-04-15 02:24:01.766867+00:00, run_end_date=2024-04-15 02:24:02.165260+00:00, run_duration=0.398393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:24:00.870029+00:00, queued_by_job_id=1, pid=14987 2024-04-15T02:24:04.777694195Z [2024-04-15T02:24:04.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:24:04.777891390Z [2024-04-15T02:24:04.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:23:00+00:00, run_id=scheduled__2024-04-15T02:23:00+00:00, run_start_date=2024-04-15 02:24:00.771014+00:00, run_end_date=2024-04-15 02:24:04.777502+00:00, run_duration=4.006488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:23:00+00:00, data_interval_end=2024-04-15 02:24:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:24:04.789162211Z [2024-04-15T02:24:04.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:04.797241109Z [2024-04-15T02:24:04.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:24:04.797419909Z [2024-04-15T02:24:04.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:23:00+00:00, run_id=scheduled__2024-04-15T02:23:00+00:00, run_start_date=2024-04-15 02:24:00.770056+00:00, run_end_date=2024-04-15 02:24:04.797081+00:00, run_duration=4.027025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:23:00+00:00, data_interval_end=2024-04-15 02:24:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:24:04.807272850Z [2024-04-15T02:24:04.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:24:00+00:00, run_after=2024-04-15T02:25:00+00:00 2024-04-15T02:24:04.846391583Z [2024-04-15T02:24:04.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status success for try_number 1 2024-04-15T02:24:04.846425553Z [2024-04-15T02:24:04.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:23:00+00:00 exited with status success for try_number 1 2024-04-15T02:24:04.854196568Z [2024-04-15T02:24:04.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:23:00+00:00, map_index=-1, run_start_date=2024-04-15 02:24:02.748401+00:00, run_end_date=2024-04-15 02:24:03.995120+00:00, run_duration=1.246719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:24:00.870029+00:00, queued_by_job_id=1, pid=15012 2024-04-15T02:24:04.854337120Z [2024-04-15T02:24:04.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:23:00+00:00, map_index=-1, run_start_date=2024-04-15 02:24:02.689064+00:00, run_end_date=2024-04-15 02:24:04.329276+00:00, run_duration=1.640212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:24:00.870029+00:00, queued_by_job_id=1, pid=15011 2024-04-15T02:25:00.257488508Z [2024-04-15T02:25:00.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:00.274144704Z [2024-04-15T02:25:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:00.283741552Z [2024-04-15T02:25:00.283+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:25:00.305027584Z [2024-04-15T02:25:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:25:00.429003584Z [2024-04-15T02:25:00.428+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:25:00.429029804Z 2024-04-15T02:25:00.429034562Z 2024-04-15T02:25:00.429038118Z 2024-04-15T02:25:00.429041542Z 2024-04-15T02:25:00.429133607Z [2024-04-15T02:25:00.428+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:25:00.429235434Z [2024-04-15T02:25:00.429+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:25:00.429279307Z [2024-04-15T02:25:00.429+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:25:00.429402696Z [2024-04-15T02:25:00.429+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:25:00.429864188Z [2024-04-15T02:25:00.429+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:00.429872992Z 2024-04-15T02:25:00.429877067Z 2024-04-15T02:25:00.429880945Z 2024-04-15T02:25:00.429887818Z 2024-04-15T02:25:00.433337209Z [2024-04-15T02:25:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:25:00.433412719Z [2024-04-15T02:25:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:00.433602786Z [2024-04-15T02:25:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:25:00.433675581Z [2024-04-15T02:25:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:25:00.433821607Z [2024-04-15T02:25:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:25:00.433893591Z [2024-04-15T02:25:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:25:00.434036325Z [2024-04-15T02:25:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:25:00.434146603Z [2024-04-15T02:25:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:25:00.756836816Z [2024-04-15T02:25:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:00.756861820Z [2024-04-15T02:25:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:00.756925005Z [2024-04-15T02:25:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:00.757027284Z [2024-04-15T02:25:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:00.764388384Z [2024-04-15T02:25:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4db8a71e-6a40-46d7-837d-7df9532e4cce 2024-04-15T02:25:00.764473760Z [2024-04-15T02:25:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f46d7eb-fe63-4c9f-a13b-fe22a6c0e2b1 2024-04-15T02:25:00.764649169Z [2024-04-15T02:25:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72f4209b-c79c-4465-8c0f-9e7e0aaad2f6 2024-04-15T02:25:00.764812690Z [2024-04-15T02:25:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4bd261b-0d2e-4493-8a59-559fa90f6be5 2024-04-15T02:25:01.933397013Z [2024-04-15T02:25:01.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:25:01.933584515Z [2024-04-15T02:25:01.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:24:00+00:00, run_id=scheduled__2024-04-15T02:24:00+00:00, run_start_date=2024-04-15 02:25:00.338846+00:00, run_end_date=2024-04-15 02:25:01.933270+00:00, run_duration=1.594424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:24:00+00:00, data_interval_end=2024-04-15 02:25:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:25:01.942841424Z [2024-04-15T02:25:01.942+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:01.983166199Z [2024-04-15T02:25:01.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:01.988633297Z [2024-04-15T02:25:01.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:24:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:01.264936+00:00, run_end_date=2024-04-15 02:25:01.654102+00:00, run_duration=0.389166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:00.430578+00:00, queued_by_job_id=1, pid=15046 2024-04-15T02:25:03.515927381Z [2024-04-15T02:25:03.515+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:25:03.515975796Z 2024-04-15T02:25:03.516331339Z [2024-04-15T02:25:03.516+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:25:03.517395508Z [2024-04-15T02:25:03.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:03.517429833Z 2024-04-15T02:25:03.521484103Z [2024-04-15T02:25:03.521+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:25:03.522362677Z [2024-04-15T02:25:03.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:03.597712745Z [2024-04-15T02:25:03.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:03.597761152Z [2024-04-15T02:25:03.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:03.602351038Z [2024-04-15T02:25:03.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b905b16-6975-4aef-aa89-6b829290f767 2024-04-15T02:25:03.602489897Z [2024-04-15T02:25:03.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:02.277881+00:00, run_end_date=2024-04-15 02:25:02.581952+00:00, run_duration=0.304071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:00.430578+00:00, queued_by_job_id=1, pid=15070 2024-04-15T02:25:03.648737330Z [2024-04-15T02:25:03.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:25:03.648937204Z [2024-04-15T02:25:03.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:24:00+00:00, run_id=scheduled__2024-04-15T02:24:00+00:00, run_start_date=2024-04-15 02:25:00.340223+00:00, run_end_date=2024-04-15 02:25:03.648620+00:00, run_duration=3.308397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:24:00+00:00, data_interval_end=2024-04-15 02:25:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:25:03.657067129Z [2024-04-15T02:25:03.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:04.745485473Z [2024-04-15T02:25:04.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:25:04.745548461Z [2024-04-15T02:25:04.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:24:00+00:00, run_id=scheduled__2024-04-15T02:24:00+00:00, run_start_date=2024-04-15 02:25:00.341369+00:00, run_end_date=2024-04-15 02:25:04.745336+00:00, run_duration=4.403967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:24:00+00:00, data_interval_end=2024-04-15 02:25:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:25:04.753487795Z [2024-04-15T02:25:04.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:26:00+00:00 2024-04-15T02:25:04.804955679Z [2024-04-15T02:25:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:04.805367562Z [2024-04-15T02:25:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:04.816266005Z [2024-04-15T02:25:04.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:24:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:02.317266+00:00, run_end_date=2024-04-15 02:25:03.930805+00:00, run_duration=1.613539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:00.430578+00:00, queued_by_job_id=1, pid=15072 2024-04-15T02:25:04.816705784Z [2024-04-15T02:25:04.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:24:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:02.281666+00:00, run_end_date=2024-04-15 02:25:03.585728+00:00, run_duration=1.304062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:00.430578+00:00, queued_by_job_id=1, pid=15071 2024-04-15T02:25:05.901596585Z [2024-04-15T02:25:05.901+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:25:05.901674080Z 2024-04-15T02:25:05.901691645Z [2024-04-15T02:25:05.901+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:25:05.902287714Z [2024-04-15T02:25:05.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:05.902318219Z 2024-04-15T02:25:05.904972183Z [2024-04-15T02:25:05.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:25:05.905213946Z [2024-04-15T02:25:05.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:25:05.981459800Z [2024-04-15T02:25:05.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:05.982033880Z [2024-04-15T02:25:05.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:05.993827024Z [2024-04-15T02:25:05.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6b57448-7314-41a3-8c55-df5545136f9f 2024-04-15T02:25:05.994276089Z [2024-04-15T02:25:05.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:05.111345+00:00, run_end_date=2024-04-15 02:25:05.498663+00:00, run_duration=0.387318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:03.518050+00:00, queued_by_job_id=1, pid=15095 2024-04-15T02:25:09.421161505Z [2024-04-15T02:25:09.420+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:25:09.421196336Z 2024-04-15T02:25:09.421209032Z [2024-04-15T02:25:09.421+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:25:09.421526600Z [2024-04-15T02:25:09.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:25:09.421537223Z 2024-04-15T02:25:09.423301528Z [2024-04-15T02:25:09.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:25:09.423371214Z [2024-04-15T02:25:09.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:09.475028852Z [2024-04-15T02:25:09.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status queued for try_number 1 2024-04-15T02:25:09.475080814Z [2024-04-15T02:25:09.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:09.479775468Z [2024-04-15T02:25:09.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bf9f9ad-230c-4330-9f04-666b8b7b2bf5 2024-04-15T02:25:09.479874535Z [2024-04-15T02:25:09.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=0, run_start_date=2024-04-15 02:25:07.480765+00:00, run_end_date=2024-04-15 02:25:08.654390+00:00, run_duration=1.173625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:05.902474+00:00, queued_by_job_id=1, pid=15103 2024-04-15T02:25:11.934414672Z [2024-04-15T02:25:11.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:25:11.935546690Z [2024-04-15T02:25:11.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:20:00+00:00, run_id=scheduled__2024-04-15T02:20:00+00:00, run_start_date=2024-04-15 02:25:00.333098+00:00, run_end_date=2024-04-15 02:25:11.934247+00:00, run_duration=11.601149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:20:00+00:00, data_interval_end=2024-04-15 02:25:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:25:11.953535254Z [2024-04-15T02:25:11.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:25:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:25:12.023605103Z [2024-04-15T02:25:12.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:20:00+00:00 exited with status success for try_number 1 2024-04-15T02:25:12.032977057Z [2024-04-15T02:25:12.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:20:00+00:00, map_index=-1, run_start_date=2024-04-15 02:25:10.914660+00:00, run_end_date=2024-04-15 02:25:11.252421+00:00, run_duration=0.337761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:25:09.421722+00:00, queued_by_job_id=1, pid=15116 2024-04-15T02:26:00.458251982Z [2024-04-15T02:26:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:00.473157006Z [2024-04-15T02:26:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:00.483082935Z [2024-04-15T02:26:00.482+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:26:00.491508956Z [2024-04-15T02:26:00.491+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:26:00.597034828Z [2024-04-15T02:26:00.596+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:26:00.597068019Z 2024-04-15T02:26:00.597076165Z 2024-04-15T02:26:00.597082931Z 2024-04-15T02:26:00.597089380Z 2024-04-15T02:26:00.597097186Z [2024-04-15T02:26:00.596+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:26:00.597139289Z [2024-04-15T02:26:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:26:00.597359609Z [2024-04-15T02:26:00.597+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:26:00.597398548Z [2024-04-15T02:26:00.597+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:26:00.597938170Z [2024-04-15T02:26:00.597+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:26:00.597953562Z 2024-04-15T02:26:00.597961164Z 2024-04-15T02:26:00.597968208Z 2024-04-15T02:26:00.597974740Z 2024-04-15T02:26:00.600744631Z [2024-04-15T02:26:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:00.600788087Z [2024-04-15T02:26:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:26:00.600986728Z [2024-04-15T02:26:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:00.601051207Z [2024-04-15T02:26:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:26:00.601191662Z [2024-04-15T02:26:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:00.601250416Z [2024-04-15T02:26:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:26:00.601400442Z [2024-04-15T02:26:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:00.601475463Z [2024-04-15T02:26:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:26:00.901384729Z [2024-04-15T02:26:00.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status queued for try_number 1 2024-04-15T02:26:00.901442379Z [2024-04-15T02:26:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:26:00.901524662Z [2024-04-15T02:26:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:26:00.901636176Z [2024-04-15T02:26:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:26:00.908944672Z [2024-04-15T02:26:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06764e5f-0636-49b6-91da-e2685e33886c 2024-04-15T02:26:00.909032274Z [2024-04-15T02:26:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b942658-3f36-4fe0-babd-5d57cb20166f 2024-04-15T02:26:00.909205092Z [2024-04-15T02:26:00.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e0abcbd-c414-4434-ab2a-e7f57ce59150 2024-04-15T02:26:00.909338713Z [2024-04-15T02:26:00.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85b5fa77-845c-4088-8e3d-d295e8ac06de 2024-04-15T02:26:02.441687171Z [2024-04-15T02:26:02.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:02.442035989Z [2024-04-15T02:26:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:24:00+00:00, run_id=scheduled__2024-04-15T02:24:00+00:00, run_start_date=2024-04-15 02:26:00.519539+00:00, run_end_date=2024-04-15 02:26:02.441731+00:00, run_duration=1.922192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:24:00+00:00, data_interval_end=2024-04-15 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:26:02.449952798Z [2024-04-15T02:26:02.449+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:26:02.456692126Z [2024-04-15T02:26:02.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:02.457015103Z [2024-04-15T02:26:02.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:25:00+00:00, run_id=scheduled__2024-04-15T02:25:00+00:00, run_start_date=2024-04-15 02:26:00.521100+00:00, run_end_date=2024-04-15 02:26:02.456701+00:00, run_duration=1.935601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:25:00+00:00, data_interval_end=2024-04-15 02:26:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:26:02.466414507Z [2024-04-15T02:26:02.466+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:02.536226742Z [2024-04-15T02:26:02.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:24:00+00:00 exited with status success for try_number 1 2024-04-15T02:26:02.536570151Z [2024-04-15T02:26:02.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:26:02.546835464Z [2024-04-15T02:26:02.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:24:00+00:00, map_index=-1, run_start_date=2024-04-15 02:26:01.323851+00:00, run_end_date=2024-04-15 02:26:01.726042+00:00, run_duration=0.402191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:00.598604+00:00, queued_by_job_id=1, pid=15137 2024-04-15T02:26:02.547319078Z [2024-04-15T02:26:02.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:26:01.569107+00:00, run_end_date=2024-04-15 02:26:01.948293+00:00, run_duration=0.379186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:00.598604+00:00, queued_by_job_id=1, pid=15141 2024-04-15T02:26:04.542738744Z [2024-04-15T02:26:04.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:04.544311570Z [2024-04-15T02:26:04.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:25:00+00:00, run_id=scheduled__2024-04-15T02:25:00+00:00, run_start_date=2024-04-15 02:26:00.522291+00:00, run_end_date=2024-04-15 02:26:04.543703+00:00, run_duration=4.021412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:25:00+00:00, data_interval_end=2024-04-15 02:26:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:26:04.559749584Z [2024-04-15T02:26:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:04.566394530Z [2024-04-15T02:26:04.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:04.567429165Z [2024-04-15T02:26:04.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:25:00+00:00, run_id=scheduled__2024-04-15T02:25:00+00:00, run_start_date=2024-04-15 02:26:00.526550+00:00, run_end_date=2024-04-15 02:26:04.566314+00:00, run_duration=4.039764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:25:00+00:00, data_interval_end=2024-04-15 02:26:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:26:04.583151738Z [2024-04-15T02:26:04.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:26:00+00:00, run_after=2024-04-15T02:27:00+00:00 2024-04-15T02:26:04.623582172Z [2024-04-15T02:26:04.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:26:04.629485951Z [2024-04-15T02:26:04.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:26:02.352873+00:00, run_end_date=2024-04-15 02:26:03.654482+00:00, run_duration=1.301609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:00.598604+00:00, queued_by_job_id=1, pid=15158 2024-04-15T02:26:05.596731138Z [2024-04-15T02:26:05.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:26:05.602575745Z [2024-04-15T02:26:05.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:26:02.606023+00:00, run_end_date=2024-04-15 02:26:04.467184+00:00, run_duration=1.861161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:00.598604+00:00, queued_by_job_id=1, pid=15164 2024-04-15T02:26:05.614990589Z [2024-04-15T02:26:05.613+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:26:35.030575386Z [2024-04-15T02:26:35.029+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:26:35.030637217Z 2024-04-15T02:26:35.031175987Z [2024-04-15T02:26:35.030+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-15T02:26:35.032765362Z [2024-04-15T02:26:35.032+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:26:35.032795021Z 2024-04-15T02:26:35.038571891Z [2024-04-15T02:26:35.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240415022634_472887', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:26:35.039154278Z [2024-04-15T02:26:35.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240415022634_472887', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-15T02:26:35.105097807Z [2024-04-15T02:26:35.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415022634_472887 exited with status queued for try_number 1 2024-04-15T02:26:35.114717269Z [2024-04-15T02:26:35.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f91c22a-a5fc-4dcc-89b7-c3052dcba61b 2024-04-15T02:26:36.258196250Z [2024-04-15T02:26:36.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:26:36.258900410Z [2024-04-15T02:26:36.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-15 02:26:34.819479+00:00, run_id=vdu_alarm_20240415022634_472887, run_start_date=2024-04-15 02:26:34.979394+00:00, run_end_date=2024-04-15 02:26:36.257995+00:00, run_duration=1.278601, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 02:26:34.819479+00:00, data_interval_end=2024-04-15 02:26:34.819479+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-15T02:26:36.263528245Z [2024-04-15T02:26:36.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-15T02:26:36.303060387Z [2024-04-15T02:26:36.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415022634_472887 exited with status success for try_number 1 2024-04-15T02:26:36.312408718Z [2024-04-15T02:26:36.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240415022634_472887, map_index=-1, run_start_date=2024-04-15 02:26:35.707129+00:00, run_end_date=2024-04-15 02:26:36.142147+00:00, run_duration=0.435018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:26:35.033777+00:00, queued_by_job_id=1, pid=15176 2024-04-15T02:27:00.295712906Z [2024-04-15T02:27:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:00.303901936Z [2024-04-15T02:27:00.303+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:27:00.315128121Z [2024-04-15T02:27:00.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:00.408756330Z [2024-04-15T02:27:00.408+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:27:00.408780890Z 2024-04-15T02:27:00.408784480Z 2024-04-15T02:27:00.408787591Z 2024-04-15T02:27:00.409387479Z [2024-04-15T02:27:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:27:00.409687397Z [2024-04-15T02:27:00.409+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:27:00.413774439Z [2024-04-15T02:27:00.409+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:27:00.413794530Z [2024-04-15T02:27:00.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:27:00.413800169Z 2024-04-15T02:27:00.413805215Z 2024-04-15T02:27:00.413810421Z 2024-04-15T02:27:00.417358168Z [2024-04-15T02:27:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:27:00.417371362Z [2024-04-15T02:27:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:27:00.417374798Z [2024-04-15T02:27:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:27:00.417378207Z [2024-04-15T02:27:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:27:00.417381579Z [2024-04-15T02:27:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:27:00.417384973Z [2024-04-15T02:27:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:27:00.690901940Z [2024-04-15T02:27:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status queued for try_number 1 2024-04-15T02:27:00.691071148Z [2024-04-15T02:27:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status queued for try_number 1 2024-04-15T02:27:00.691256345Z [2024-04-15T02:27:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status queued for try_number 1 2024-04-15T02:27:00.701579731Z [2024-04-15T02:27:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97f3f01a-1623-4758-83a0-b28256932aff 2024-04-15T02:27:00.701716707Z [2024-04-15T02:27:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to f72ea3e2-f5a3-47d0-ba93-3f9f4fac9b39 2024-04-15T02:27:00.701863831Z [2024-04-15T02:27:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0b33fef-57bd-453b-8e3e-d5db6eb50d12 2024-04-15T02:27:01.829525145Z [2024-04-15T02:27:01.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:27:01.830032507Z [2024-04-15T02:27:01.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:26:00+00:00, run_id=scheduled__2024-04-15T02:26:00+00:00, run_start_date=2024-04-15 02:27:00.328824+00:00, run_end_date=2024-04-15 02:27:01.829558+00:00, run_duration=1.500734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:26:00+00:00, data_interval_end=2024-04-15 02:27:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:27:01.842159028Z [2024-04-15T02:27:01.841+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:01.906208977Z [2024-04-15T02:27:01.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status success for try_number 1 2024-04-15T02:27:01.912482389Z [2024-04-15T02:27:01.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:26:00+00:00, map_index=-1, run_start_date=2024-04-15 02:27:01.162211+00:00, run_end_date=2024-04-15 02:27:01.491491+00:00, run_duration=0.32928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:27:00.412005+00:00, queued_by_job_id=1, pid=15204 2024-04-15T02:27:04.065503497Z [2024-04-15T02:27:04.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:27:04.066040791Z [2024-04-15T02:27:04.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:26:00+00:00, run_id=scheduled__2024-04-15T02:26:00+00:00, run_start_date=2024-04-15 02:27:00.329860+00:00, run_end_date=2024-04-15 02:27:04.065659+00:00, run_duration=3.735799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:26:00+00:00, data_interval_end=2024-04-15 02:27:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:27:04.075706275Z [2024-04-15T02:27:04.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:04.360239529Z [2024-04-15T02:27:04.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status success for try_number 1 2024-04-15T02:27:04.360258880Z [2024-04-15T02:27:04.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:26:00+00:00, map_index=-1, run_start_date=2024-04-15 02:27:02.562946+00:00, run_end_date=2024-04-15 02:27:04.001263+00:00, run_duration=1.438317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:27:00.412005+00:00, queued_by_job_id=1, pid=15222 2024-04-15T02:27:05.443046098Z [2024-04-15T02:27:05.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:27:05.443570100Z [2024-04-15T02:27:05.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:26:00+00:00, run_id=scheduled__2024-04-15T02:26:00+00:00, run_start_date=2024-04-15 02:27:00.330753+00:00, run_end_date=2024-04-15 02:27:05.443066+00:00, run_duration=5.112313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:26:00+00:00, data_interval_end=2024-04-15 02:27:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:27:05.453486691Z [2024-04-15T02:27:05.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:27:00+00:00, run_after=2024-04-15T02:28:00+00:00 2024-04-15T02:27:05.483936505Z [2024-04-15T02:27:05.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status success for try_number 1 2024-04-15T02:27:05.490568807Z [2024-04-15T02:27:05.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:26:00+00:00, map_index=-1, run_start_date=2024-04-15 02:27:02.606482+00:00, run_end_date=2024-04-15 02:27:04.805957+00:00, run_duration=2.199475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:27:00.412005+00:00, queued_by_job_id=1, pid=15223 2024-04-15T02:28:00.241332758Z [2024-04-15T02:28:00.240+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:28:00.257245197Z [2024-04-15T02:28:00.256+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:00.271099922Z [2024-04-15T02:28:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:00.277003033Z [2024-04-15T02:28:00.276+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:28:00.373858704Z [2024-04-15T02:28:00.373+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:28:00.373885740Z 2024-04-15T02:28:00.373900136Z 2024-04-15T02:28:00.373905689Z 2024-04-15T02:28:00.373911455Z 2024-04-15T02:28:00.380100382Z [2024-04-15T02:28:00.373+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:28:00.380166751Z [2024-04-15T02:28:00.373+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:28:00.380180297Z [2024-04-15T02:28:00.373+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:28:00.380183573Z [2024-04-15T02:28:00.374+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:28:00.380186706Z [2024-04-15T02:28:00.374+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:28:00.380196957Z 2024-04-15T02:28:00.380200339Z 2024-04-15T02:28:00.380203477Z 2024-04-15T02:28:00.380206578Z 2024-04-15T02:28:00.380210445Z [2024-04-15T02:28:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:28:00.380214267Z [2024-04-15T02:28:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:28:00.380217906Z [2024-04-15T02:28:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:28:00.380220986Z [2024-04-15T02:28:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:28:00.380224010Z [2024-04-15T02:28:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:28:00.380227176Z [2024-04-15T02:28:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:28:00.381963135Z [2024-04-15T02:28:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:28:00.382168454Z [2024-04-15T02:28:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:28:00.744081548Z [2024-04-15T02:28:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status queued for try_number 1 2024-04-15T02:28:00.747107933Z [2024-04-15T02:28:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status queued for try_number 1 2024-04-15T02:28:00.747341861Z [2024-04-15T02:28:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status queued for try_number 1 2024-04-15T02:28:00.747548746Z [2024-04-15T02:28:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status queued for try_number 1 2024-04-15T02:28:00.768045545Z [2024-04-15T02:28:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d26b73a-e335-44f0-850f-b4d088d6e48e 2024-04-15T02:28:00.771198443Z [2024-04-15T02:28:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90a6af41-6161-4ee6-9a61-182e61cb137c 2024-04-15T02:28:00.771485796Z [2024-04-15T02:28:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8984c72f-66c9-41db-802d-b8a42d1fcd11 2024-04-15T02:28:00.771712876Z [2024-04-15T02:28:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to a273b88d-e856-4988-9829-0173540b5916 2024-04-15T02:28:02.062874532Z [2024-04-15T02:28:02.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:28:02.063150307Z [2024-04-15T02:28:02.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:26:00+00:00, run_id=scheduled__2024-04-15T02:26:00+00:00, run_start_date=2024-04-15 02:28:00.290289+00:00, run_end_date=2024-04-15 02:28:02.062733+00:00, run_duration=1.772444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:26:00+00:00, data_interval_end=2024-04-15 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:28:02.072231649Z [2024-04-15T02:28:02.071+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:28:02.078709294Z [2024-04-15T02:28:02.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:28:02.078827156Z [2024-04-15T02:28:02.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:27:00+00:00, run_id=scheduled__2024-04-15T02:27:00+00:00, run_start_date=2024-04-15 02:28:00.291944+00:00, run_end_date=2024-04-15 02:28:02.078632+00:00, run_duration=1.786688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:27:00+00:00, data_interval_end=2024-04-15 02:28:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:28:02.087338096Z [2024-04-15T02:28:02.086+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:02.125410107Z [2024-04-15T02:28:02.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:26:00+00:00 exited with status success for try_number 1 2024-04-15T02:28:02.125454442Z [2024-04-15T02:28:02.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status success for try_number 1 2024-04-15T02:28:02.130967517Z [2024-04-15T02:28:02.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:26:00+00:00, map_index=-1, run_start_date=2024-04-15 02:28:01.421767+00:00, run_end_date=2024-04-15 02:28:01.737232+00:00, run_duration=0.315465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:28:00.375565+00:00, queued_by_job_id=1, pid=15257 2024-04-15T02:28:02.131060630Z [2024-04-15T02:28:02.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:27:00+00:00, map_index=-1, run_start_date=2024-04-15 02:28:01.319889+00:00, run_end_date=2024-04-15 02:28:01.744144+00:00, run_duration=0.424255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:28:00.375565+00:00, queued_by_job_id=1, pid=15256 2024-04-15T02:28:04.467825504Z [2024-04-15T02:28:04.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:28:04.467985226Z [2024-04-15T02:28:04.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:27:00+00:00, run_id=scheduled__2024-04-15T02:27:00+00:00, run_start_date=2024-04-15 02:28:00.294456+00:00, run_end_date=2024-04-15 02:28:04.467749+00:00, run_duration=4.173293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:27:00+00:00, data_interval_end=2024-04-15 02:28:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:28:04.488928707Z [2024-04-15T02:28:04.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:04.499782587Z [2024-04-15T02:28:04.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:28:04.500087755Z [2024-04-15T02:28:04.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:27:00+00:00, run_id=scheduled__2024-04-15T02:27:00+00:00, run_start_date=2024-04-15 02:28:00.293210+00:00, run_end_date=2024-04-15 02:28:04.499712+00:00, run_duration=4.206502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:27:00+00:00, data_interval_end=2024-04-15 02:28:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:28:04.512876129Z [2024-04-15T02:28:04.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:28:00+00:00, run_after=2024-04-15T02:29:00+00:00 2024-04-15T02:28:04.574504136Z [2024-04-15T02:28:04.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status success for try_number 1 2024-04-15T02:28:04.574532937Z [2024-04-15T02:28:04.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:27:00+00:00 exited with status success for try_number 1 2024-04-15T02:28:04.581190840Z [2024-04-15T02:28:04.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:27:00+00:00, map_index=-1, run_start_date=2024-04-15 02:28:02.438191+00:00, run_end_date=2024-04-15 02:28:03.646790+00:00, run_duration=1.208599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:28:00.375565+00:00, queued_by_job_id=1, pid=15281 2024-04-15T02:28:04.581316019Z [2024-04-15T02:28:04.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:27:00+00:00, map_index=-1, run_start_date=2024-04-15 02:28:02.390352+00:00, run_end_date=2024-04-15 02:28:04.085697+00:00, run_duration=1.695345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:28:00.375565+00:00, queued_by_job_id=1, pid=15280 2024-04-15T02:29:00.841565239Z [2024-04-15T02:29:00.840+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:29:00.874954926Z [2024-04-15T02:29:00.866+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:00.885899406Z [2024-04-15T02:29:00.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:00.972467859Z [2024-04-15T02:29:00.971+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:29:00.972511585Z 2024-04-15T02:29:00.972521976Z 2024-04-15T02:29:00.972530546Z 2024-04-15T02:29:00.972922151Z [2024-04-15T02:29:00.972+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:29:00.973325870Z [2024-04-15T02:29:00.973+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:29:00.973785666Z [2024-04-15T02:29:00.973+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:29:00.974738708Z [2024-04-15T02:29:00.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:29:00.974788666Z 2024-04-15T02:29:00.974798991Z 2024-04-15T02:29:00.974807565Z 2024-04-15T02:29:00.979207990Z [2024-04-15T02:29:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:29:00.979584488Z [2024-04-15T02:29:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:29:00.980035666Z [2024-04-15T02:29:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:29:00.980277180Z [2024-04-15T02:29:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:29:00.980541860Z [2024-04-15T02:29:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:29:00.980790420Z [2024-04-15T02:29:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:29:01.234317499Z [2024-04-15T02:29:01.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status queued for try_number 1 2024-04-15T02:29:01.235494226Z [2024-04-15T02:29:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status queued for try_number 1 2024-04-15T02:29:01.236030062Z [2024-04-15T02:29:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status queued for try_number 1 2024-04-15T02:29:01.250114302Z [2024-04-15T02:29:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to f84ef334-9904-4f8b-9c13-ebaedb9c03ca 2024-04-15T02:29:01.250522926Z [2024-04-15T02:29:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49ed6733-097a-441d-9e45-08711ba9d5d2 2024-04-15T02:29:01.252665251Z [2024-04-15T02:29:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to a555fa3c-fe2f-450e-8ddc-7c5ca4c4fed0 2024-04-15T02:29:02.670001282Z [2024-04-15T02:29:02.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:29:02.670952114Z [2024-04-15T02:29:02.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:28:00+00:00, run_id=scheduled__2024-04-15T02:28:00+00:00, run_start_date=2024-04-15 02:29:00.898305+00:00, run_end_date=2024-04-15 02:29:02.669900+00:00, run_duration=1.771595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:28:00+00:00, data_interval_end=2024-04-15 02:29:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:29:02.679642757Z [2024-04-15T02:29:02.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:02.735880625Z [2024-04-15T02:29:02.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status success for try_number 1 2024-04-15T02:29:02.742944903Z [2024-04-15T02:29:02.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:28:00+00:00, map_index=-1, run_start_date=2024-04-15 02:29:01.735989+00:00, run_end_date=2024-04-15 02:29:02.108637+00:00, run_duration=0.372648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:29:00.975970+00:00, queued_by_job_id=1, pid=15312 2024-04-15T02:29:04.911273888Z [2024-04-15T02:29:04.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:29:04.911572583Z [2024-04-15T02:29:04.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:28:00+00:00, run_id=scheduled__2024-04-15T02:28:00+00:00, run_start_date=2024-04-15 02:29:00.899686+00:00, run_end_date=2024-04-15 02:29:04.911163+00:00, run_duration=4.011477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:28:00+00:00, data_interval_end=2024-04-15 02:29:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:29:04.918855798Z [2024-04-15T02:29:04.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:04.965573087Z [2024-04-15T02:29:04.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status success for try_number 1 2024-04-15T02:29:04.970511046Z [2024-04-15T02:29:04.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:28:00+00:00, map_index=-1, run_start_date=2024-04-15 02:29:02.659514+00:00, run_end_date=2024-04-15 02:29:04.296657+00:00, run_duration=1.637143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:29:00.975970+00:00, queued_by_job_id=1, pid=15330 2024-04-15T02:29:06.032605479Z [2024-04-15T02:29:06.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:29:06.032979609Z [2024-04-15T02:29:06.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:28:00+00:00, run_id=scheduled__2024-04-15T02:28:00+00:00, run_start_date=2024-04-15 02:29:00.901386+00:00, run_end_date=2024-04-15 02:29:06.032553+00:00, run_duration=5.131167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:28:00+00:00, data_interval_end=2024-04-15 02:29:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:29:06.044487519Z [2024-04-15T02:29:06.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:29:00+00:00, run_after=2024-04-15T02:30:00+00:00 2024-04-15T02:29:06.083025789Z [2024-04-15T02:29:06.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status success for try_number 1 2024-04-15T02:29:06.091491308Z [2024-04-15T02:29:06.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:28:00+00:00, map_index=-1, run_start_date=2024-04-15 02:29:02.774186+00:00, run_end_date=2024-04-15 02:29:05.349996+00:00, run_duration=2.57581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:29:00.975970+00:00, queued_by_job_id=1, pid=15331 2024-04-15T02:30:00.712569737Z [2024-04-15T02:30:00.712+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:30:00.730193599Z [2024-04-15T02:30:00.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:30:00.739160473Z [2024-04-15T02:30:00.738+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:30:00.751568948Z [2024-04-15T02:30:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:00.763068844Z [2024-04-15T02:30:00.762+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:00.888143122Z [2024-04-15T02:30:00.887+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T02:30:00.888190715Z 2024-04-15T02:30:00.888222187Z 2024-04-15T02:30:00.888233965Z 2024-04-15T02:30:00.888241332Z 2024-04-15T02:30:00.888248490Z 2024-04-15T02:30:00.888407096Z [2024-04-15T02:30:00.887+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:30:00.888456105Z [2024-04-15T02:30:00.888+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:30:00.888464941Z [2024-04-15T02:30:00.888+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:30:00.888586410Z [2024-04-15T02:30:00.888+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:30:00.888598480Z [2024-04-15T02:30:00.888+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:30:00.889743616Z [2024-04-15T02:30:00.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:00.889769879Z 2024-04-15T02:30:00.889784221Z 2024-04-15T02:30:00.889799643Z 2024-04-15T02:30:00.889812341Z 2024-04-15T02:30:00.889826103Z 2024-04-15T02:30:00.895854016Z [2024-04-15T02:30:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:30:00.896022740Z [2024-04-15T02:30:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:00.896284345Z [2024-04-15T02:30:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:00.896448113Z [2024-04-15T02:30:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:30:00.896724238Z [2024-04-15T02:30:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:00.896917221Z [2024-04-15T02:30:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:30:00.897105552Z [2024-04-15T02:30:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:00.897259709Z [2024-04-15T02:30:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:30:00.897514593Z [2024-04-15T02:30:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:00.897674040Z [2024-04-15T02:30:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:30:01.507102138Z [2024-04-15T02:30:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.507131934Z [2024-04-15T02:30:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.507188053Z [2024-04-15T02:30:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.507373062Z [2024-04-15T02:30:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.507378930Z [2024-04-15T02:30:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:01.515315655Z [2024-04-15T02:30:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to a06275a3-9c12-443c-b34e-afa00b4c38d0 2024-04-15T02:30:01.515402272Z [2024-04-15T02:30:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to e419679a-cbee-427f-b9c4-a66765954507 2024-04-15T02:30:01.515541938Z [2024-04-15T02:30:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 199eaedf-e129-4eff-bc7c-9719f43d897b 2024-04-15T02:30:01.515637443Z [2024-04-15T02:30:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ad189e1-0c11-4a53-ae54-da139aae657b 2024-04-15T02:30:01.515782821Z [2024-04-15T02:30:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19fddfc2-f90b-400a-b202-56dd6cc24462 2024-04-15T02:30:03.167945006Z [2024-04-15T02:30:03.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:03.168496504Z [2024-04-15T02:30:03.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:29:00+00:00, run_id=scheduled__2024-04-15T02:29:00+00:00, run_start_date=2024-04-15 02:30:00.776789+00:00, run_end_date=2024-04-15 02:30:03.168131+00:00, run_duration=2.391342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:29:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:30:03.181473638Z [2024-04-15T02:30:03.181+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:03.198412893Z [2024-04-15T02:30:03.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:03.198847334Z [2024-04-15T02:30:03.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:28:00+00:00, run_id=scheduled__2024-04-15T02:28:00+00:00, run_start_date=2024-04-15 02:30:00.775747+00:00, run_end_date=2024-04-15 02:30:03.198572+00:00, run_duration=2.422825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:28:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:30:03.208014691Z [2024-04-15T02:30:03.207+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:30:03.282992033Z [2024-04-15T02:30:03.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:28:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:03.283004913Z [2024-04-15T02:30:03.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:03.290944739Z [2024-04-15T02:30:03.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:29:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:02.175864+00:00, run_end_date=2024-04-15 02:30:02.685043+00:00, run_duration=0.509179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.891215+00:00, queued_by_job_id=1, pid=15365 2024-04-15T02:30:03.291145275Z [2024-04-15T02:30:03.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:28:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:02.553303+00:00, run_end_date=2024-04-15 02:30:02.952056+00:00, run_duration=0.398753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.891215+00:00, queued_by_job_id=1, pid=15372 2024-04-15T02:30:04.391190496Z [2024-04-15T02:30:04.389+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:30:04.391213260Z 2024-04-15T02:30:04.391217109Z [2024-04-15T02:30:04.390+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:30:04.391220792Z [2024-04-15T02:30:04.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:04.391223691Z 2024-04-15T02:30:04.406904114Z [2024-04-15T02:30:04.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:30:04.406924448Z [2024-04-15T02:30:04.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:04.481857285Z [2024-04-15T02:30:04.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:04.481898997Z [2024-04-15T02:30:04.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:04.487019092Z [2024-04-15T02:30:04.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05fb9326-ff81-4ae8-b080-0f6eac735959 2024-04-15T02:30:04.487149634Z [2024-04-15T02:30:04.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:03.325332+00:00, run_end_date=2024-04-15 02:30:03.694073+00:00, run_duration=0.368741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.891215+00:00, queued_by_job_id=1, pid=15396 2024-04-15T02:30:05.658500270Z [2024-04-15T02:30:05.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:05.658805086Z [2024-04-15T02:30:05.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:29:00+00:00, run_id=scheduled__2024-04-15T02:29:00+00:00, run_start_date=2024-04-15 02:30:00.778801+00:00, run_end_date=2024-04-15 02:30:05.658414+00:00, run_duration=4.879613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:29:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:30:05.671522099Z [2024-04-15T02:30:05.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:05.681487748Z [2024-04-15T02:30:05.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:05.681835836Z [2024-04-15T02:30:05.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:29:00+00:00, run_id=scheduled__2024-04-15T02:29:00+00:00, run_start_date=2024-04-15 02:30:00.777798+00:00, run_end_date=2024-04-15 02:30:05.681385+00:00, run_duration=4.903587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:29:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:30:05.692693763Z [2024-04-15T02:30:05.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:31:00+00:00 2024-04-15T02:30:05.748060450Z [2024-04-15T02:30:05.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:05.748911787Z [2024-04-15T02:30:05.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:29:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:05.760345475Z [2024-04-15T02:30:05.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:29:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:03.469916+00:00, run_end_date=2024-04-15 02:30:04.918806+00:00, run_duration=1.44889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.891215+00:00, queued_by_job_id=1, pid=15397 2024-04-15T02:30:05.760794630Z [2024-04-15T02:30:05.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:29:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:03.268265+00:00, run_end_date=2024-04-15 02:30:05.401011+00:00, run_duration=2.132746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:00.891215+00:00, queued_by_job_id=1, pid=15395 2024-04-15T02:30:06.836205362Z [2024-04-15T02:30:06.835+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:30:06.836246891Z 2024-04-15T02:30:06.836255806Z [2024-04-15T02:30:06.836+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:30:06.836916353Z [2024-04-15T02:30:06.836+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:06.836935536Z 2024-04-15T02:30:06.839341176Z [2024-04-15T02:30:06.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:30:06.839646866Z [2024-04-15T02:30:06.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:30:06.887054300Z [2024-04-15T02:30:06.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:06.887096858Z [2024-04-15T02:30:06.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:06.893726908Z [2024-04-15T02:30:06.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b1fa0c6-7057-46ed-8564-df07825987b3 2024-04-15T02:30:06.893981465Z [2024-04-15T02:30:06.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:05.987964+00:00, run_end_date=2024-04-15 02:30:06.417579+00:00, run_duration=0.429615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:04.392576+00:00, queued_by_job_id=1, pid=15420 2024-04-15T02:30:08.977252842Z [2024-04-15T02:30:08.976+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:30:08.977300345Z 2024-04-15T02:30:08.977736697Z [2024-04-15T02:30:08.977+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:30:08.979685810Z [2024-04-15T02:30:08.978+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:08.979712154Z 2024-04-15T02:30:08.984141115Z [2024-04-15T02:30:08.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:08.984462435Z [2024-04-15T02:30:08.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:09.027677838Z [2024-04-15T02:30:09.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status queued for try_number 1 2024-04-15T02:30:09.027705741Z [2024-04-15T02:30:09.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:09.034084812Z [2024-04-15T02:30:09.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3f4fcf9-c48c-4617-b1fe-66631efc151f 2024-04-15T02:30:09.034273871Z [2024-04-15T02:30:09.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=0, run_start_date=2024-04-15 02:30:08.411982+00:00, run_end_date=2024-04-15 02:30:08.694868+00:00, run_duration=0.282886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:06.837332+00:00, queued_by_job_id=1, pid=15428 2024-04-15T02:30:11.923894116Z [2024-04-15T02:30:11.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:11.925276253Z [2024-04-15T02:30:11.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:25:00+00:00, run_id=scheduled__2024-04-15T02:25:00+00:00, run_start_date=2024-04-15 02:30:00.774457+00:00, run_end_date=2024-04-15 02:30:11.923803+00:00, run_duration=11.149346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:25:00+00:00, data_interval_end=2024-04-15 02:30:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:30:11.931003432Z [2024-04-15T02:30:11.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:30:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:30:11.966248283Z [2024-04-15T02:30:11.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:25:00+00:00 exited with status success for try_number 1 2024-04-15T02:30:11.977129109Z [2024-04-15T02:30:11.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:25:00+00:00, map_index=-1, run_start_date=2024-04-15 02:30:10.608739+00:00, run_end_date=2024-04-15 02:30:10.989100+00:00, run_duration=0.380361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:08.979575+00:00, queued_by_job_id=1, pid=15436 2024-04-15T02:30:35.687582316Z [2024-04-15T02:30:35.686+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:30:35.687643590Z 2024-04-15T02:30:35.687654363Z [2024-04-15T02:30:35.687+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-15T02:30:35.688358199Z [2024-04-15T02:30:35.688+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:30:35.688429061Z 2024-04-15T02:30:35.691604103Z [2024-04-15T02:30:35.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240415023034_453796', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:30:35.691672549Z [2024-04-15T02:30:35.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240415023034_453796', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-15T02:30:35.749564130Z [2024-04-15T02:30:35.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415023034_453796 exited with status queued for try_number 1 2024-04-15T02:30:35.759738521Z [2024-04-15T02:30:35.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7870e4c4-7d00-4f97-9c25-0ebdceac10fc 2024-04-15T02:30:36.904563962Z [2024-04-15T02:30:36.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:30:36.904858425Z [2024-04-15T02:30:36.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-15 02:30:34.829306+00:00, run_id=vdu_alarm_20240415023034_453796, run_start_date=2024-04-15 02:30:35.642483+00:00, run_end_date=2024-04-15 02:30:36.904469+00:00, run_duration=1.261986, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-15 02:30:34.829306+00:00, data_interval_end=2024-04-15 02:30:34.829306+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-15T02:30:36.909565620Z [2024-04-15T02:30:36.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-15T02:30:37.995407112Z [2024-04-15T02:30:37.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240415023034_453796 exited with status success for try_number 1 2024-04-15T02:30:37.999909870Z [2024-04-15T02:30:37.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240415023034_453796, map_index=-1, run_start_date=2024-04-15 02:30:36.388990+00:00, run_end_date=2024-04-15 02:30:36.841120+00:00, run_duration=0.45213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:30:35.688796+00:00, queued_by_job_id=1, pid=15438 2024-04-15T02:31:00.861337820Z [2024-04-15T02:31:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:00.870904228Z [2024-04-15T02:31:00.870+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:31:00.902222005Z [2024-04-15T02:31:00.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:00.960120130Z [2024-04-15T02:31:00.959+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:31:00.960141746Z 2024-04-15T02:31:00.960145639Z 2024-04-15T02:31:00.960162647Z 2024-04-15T02:31:00.960328719Z [2024-04-15T02:31:00.959+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:31:00.960583229Z [2024-04-15T02:31:00.960+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:31:00.960781190Z [2024-04-15T02:31:00.960+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:31:00.961427772Z [2024-04-15T02:31:00.961+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:31:00.961441050Z 2024-04-15T02:31:00.961445597Z 2024-04-15T02:31:00.961448761Z 2024-04-15T02:31:00.964300527Z [2024-04-15T02:31:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:31:00.964495400Z [2024-04-15T02:31:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:31:00.964819279Z [2024-04-15T02:31:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:31:00.965002515Z [2024-04-15T02:31:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:31:00.965307701Z [2024-04-15T02:31:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:31:00.965489757Z [2024-04-15T02:31:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:31:01.158275257Z [2024-04-15T02:31:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:31:01.158500053Z [2024-04-15T02:31:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:31:01.158657981Z [2024-04-15T02:31:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:31:01.168374872Z [2024-04-15T02:31:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9937f021-ecf7-4c0a-ac82-880e3b847aee 2024-04-15T02:31:01.168599824Z [2024-04-15T02:31:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f9e948-2881-4856-b238-028aae28efdb 2024-04-15T02:31:01.168824813Z [2024-04-15T02:31:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0134dbce-9eb2-49ac-8592-32c6d5b041b3 2024-04-15T02:31:02.302518042Z [2024-04-15T02:31:02.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:31:02.302981208Z [2024-04-15T02:31:02.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:31:00.916916+00:00, run_end_date=2024-04-15 02:31:02.302514+00:00, run_duration=1.385598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:31:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:31:02.313972514Z [2024-04-15T02:31:02.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:02.356920125Z [2024-04-15T02:31:02.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:31:02.366283923Z [2024-04-15T02:31:02.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:31:01.716207+00:00, run_end_date=2024-04-15 02:31:02.049160+00:00, run_duration=0.332953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:31:00.962018+00:00, queued_by_job_id=1, pid=15465 2024-04-15T02:31:04.859734116Z [2024-04-15T02:31:04.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:31:04.860325937Z [2024-04-15T02:31:04.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:31:00.918264+00:00, run_end_date=2024-04-15 02:31:04.859713+00:00, run_duration=3.941449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:31:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:31:04.872728792Z [2024-04-15T02:31:04.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:04.881551418Z [2024-04-15T02:31:04.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:31:04.881907996Z [2024-04-15T02:31:04.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:31:00.919654+00:00, run_end_date=2024-04-15 02:31:04.881379+00:00, run_duration=3.961725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:31:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:31:04.891118405Z [2024-04-15T02:31:04.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:31:00+00:00, run_after=2024-04-15T02:32:00+00:00 2024-04-15T02:31:04.942964011Z [2024-04-15T02:31:04.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:31:04.943253397Z [2024-04-15T02:31:04.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:31:04.954712672Z [2024-04-15T02:31:04.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:31:02.637309+00:00, run_end_date=2024-04-15 02:31:04.171731+00:00, run_duration=1.534422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:31:00.962018+00:00, queued_by_job_id=1, pid=15484 2024-04-15T02:31:04.955148056Z [2024-04-15T02:31:04.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:31:02.557644+00:00, run_end_date=2024-04-15 02:31:04.176091+00:00, run_duration=1.618447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:31:00.962018+00:00, queued_by_job_id=1, pid=15483 2024-04-15T02:31:05.686777520Z [2024-04-15T02:31:05.686+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:32:00.771443574Z [2024-04-15T02:32:00.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:00.777489524Z [2024-04-15T02:32:00.777+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:32:00.782843331Z [2024-04-15T02:32:00.782+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:32:00.792999002Z [2024-04-15T02:32:00.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:00.852953387Z [2024-04-15T02:32:00.852+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:32:00.852972981Z 2024-04-15T02:32:00.852977205Z 2024-04-15T02:32:00.852980280Z 2024-04-15T02:32:00.852983309Z 2024-04-15T02:32:00.853051160Z [2024-04-15T02:32:00.852+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:32:00.853271204Z [2024-04-15T02:32:00.853+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:32:00.853464264Z [2024-04-15T02:32:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:32:00.853642992Z [2024-04-15T02:32:00.853+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:32:00.854241138Z [2024-04-15T02:32:00.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:32:00.854252784Z 2024-04-15T02:32:00.854256330Z 2024-04-15T02:32:00.854259664Z 2024-04-15T02:32:00.854262854Z 2024-04-15T02:32:00.857331765Z [2024-04-15T02:32:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:32:00.857575341Z [2024-04-15T02:32:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:32:00.857981756Z [2024-04-15T02:32:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:32:00.858178684Z [2024-04-15T02:32:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:32:00.858487358Z [2024-04-15T02:32:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:32:00.858659675Z [2024-04-15T02:32:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:32:00.858933965Z [2024-04-15T02:32:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:32:00.859113046Z [2024-04-15T02:32:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:32:01.462721731Z [2024-04-15T02:32:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:32:01.464922845Z [2024-04-15T02:32:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status queued for try_number 1 2024-04-15T02:32:01.465162170Z [2024-04-15T02:32:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status queued for try_number 1 2024-04-15T02:32:01.465333232Z [2024-04-15T02:32:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status queued for try_number 1 2024-04-15T02:32:01.477384458Z [2024-04-15T02:32:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6074716-42c2-49e4-811c-c05c0b59eeea 2024-04-15T02:32:01.479218111Z [2024-04-15T02:32:01.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcc0cee2-8804-492d-8ea0-ee0b5d12f973 2024-04-15T02:32:01.479522982Z [2024-04-15T02:32:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7701006f-7e05-4ae0-b127-39ee309ca3e9 2024-04-15T02:32:01.479759602Z [2024-04-15T02:32:01.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15e7b2e9-eab4-4c43-a175-0d81624d1c39 2024-04-15T02:32:02.745875392Z [2024-04-15T02:32:02.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:32:02.746162274Z [2024-04-15T02:32:02.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:32:00.802003+00:00, run_end_date=2024-04-15 02:32:02.745837+00:00, run_duration=1.943834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:32:02.753631581Z [2024-04-15T02:32:02.753+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:32:02.760372931Z [2024-04-15T02:32:02.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:32:02.760717853Z [2024-04-15T02:32:02.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:31:00+00:00, run_id=scheduled__2024-04-15T02:31:00+00:00, run_start_date=2024-04-15 02:32:00.803035+00:00, run_end_date=2024-04-15 02:32:02.760454+00:00, run_duration=1.957419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:31:00+00:00, data_interval_end=2024-04-15 02:32:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:32:02.770170470Z [2024-04-15T02:32:02.769+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:02.826106177Z [2024-04-15T02:32:02.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:32:02.826170469Z [2024-04-15T02:32:02.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status success for try_number 1 2024-04-15T02:32:02.832601091Z [2024-04-15T02:32:02.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:32:01.826308+00:00, run_end_date=2024-04-15 02:32:02.189080+00:00, run_duration=0.362772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:32:00.855031+00:00, queued_by_job_id=1, pid=15518 2024-04-15T02:32:02.832861665Z [2024-04-15T02:32:02.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:31:00+00:00, map_index=-1, run_start_date=2024-04-15 02:32:01.833107+00:00, run_end_date=2024-04-15 02:32:02.420756+00:00, run_duration=0.587649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:32:00.855031+00:00, queued_by_job_id=1, pid=15519 2024-04-15T02:32:04.785031680Z [2024-04-15T02:32:04.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:32:04.785308477Z [2024-04-15T02:32:04.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:31:00+00:00, run_id=scheduled__2024-04-15T02:31:00+00:00, run_start_date=2024-04-15 02:32:00.804009+00:00, run_end_date=2024-04-15 02:32:04.785011+00:00, run_duration=3.981002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:31:00+00:00, data_interval_end=2024-04-15 02:32:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:32:04.795616238Z [2024-04-15T02:32:04.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:05.900946228Z [2024-04-15T02:32:05.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:32:05.901290631Z [2024-04-15T02:32:05.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:31:00+00:00, run_id=scheduled__2024-04-15T02:31:00+00:00, run_start_date=2024-04-15 02:32:00.804970+00:00, run_end_date=2024-04-15 02:32:05.900805+00:00, run_duration=5.095835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:31:00+00:00, data_interval_end=2024-04-15 02:32:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:32:05.909170871Z [2024-04-15T02:32:05.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:32:00+00:00, run_after=2024-04-15T02:33:00+00:00 2024-04-15T02:32:05.946171626Z [2024-04-15T02:32:05.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status success for try_number 1 2024-04-15T02:32:05.946193631Z [2024-04-15T02:32:05.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:31:00+00:00 exited with status success for try_number 1 2024-04-15T02:32:05.952131822Z [2024-04-15T02:32:05.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:31:00+00:00, map_index=-1, run_start_date=2024-04-15 02:32:03.316842+00:00, run_end_date=2024-04-15 02:32:04.727468+00:00, run_duration=1.410626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:32:00.855031+00:00, queued_by_job_id=1, pid=15543 2024-04-15T02:32:05.952482600Z [2024-04-15T02:32:05.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:31:00+00:00, map_index=-1, run_start_date=2024-04-15 02:32:03.203469+00:00, run_end_date=2024-04-15 02:32:05.099815+00:00, run_duration=1.896346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:32:00.855031+00:00, queued_by_job_id=1, pid=15542 2024-04-15T02:33:00.675954527Z [2024-04-15T02:33:00.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:00.686173920Z [2024-04-15T02:33:00.685+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:33:00.701948748Z [2024-04-15T02:33:00.701+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:00.788909824Z [2024-04-15T02:33:00.788+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:33:00.788957902Z 2024-04-15T02:33:00.788967886Z 2024-04-15T02:33:00.788976885Z 2024-04-15T02:33:00.789525053Z [2024-04-15T02:33:00.788+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:33:00.789992735Z [2024-04-15T02:33:00.789+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:33:00.790428564Z [2024-04-15T02:33:00.790+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:33:00.791842923Z [2024-04-15T02:33:00.791+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:33:00.791869075Z 2024-04-15T02:33:00.791878911Z 2024-04-15T02:33:00.791887806Z 2024-04-15T02:33:00.798820329Z [2024-04-15T02:33:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:33:00.799242873Z [2024-04-15T02:33:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:33:00.799830797Z [2024-04-15T02:33:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:33:00.800181585Z [2024-04-15T02:33:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:33:00.800590236Z [2024-04-15T02:33:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:33:00.800816090Z [2024-04-15T02:33:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:33:01.068111826Z [2024-04-15T02:33:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status queued for try_number 1 2024-04-15T02:33:01.068165674Z [2024-04-15T02:33:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status queued for try_number 1 2024-04-15T02:33:01.068305103Z [2024-04-15T02:33:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status queued for try_number 1 2024-04-15T02:33:01.074974886Z [2024-04-15T02:33:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to b559a61a-ed24-47ce-86d5-8711a785346e 2024-04-15T02:33:01.075134211Z [2024-04-15T02:33:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01c3fbcb-44ae-4de9-a7b7-2ee441b7c526 2024-04-15T02:33:01.075325518Z [2024-04-15T02:33:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6508d239-fc63-4e0b-a333-9f4ef02739aa 2024-04-15T02:33:02.206333475Z [2024-04-15T02:33:02.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:33:02.206682582Z [2024-04-15T02:33:02.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:32:00+00:00, run_id=scheduled__2024-04-15T02:32:00+00:00, run_start_date=2024-04-15 02:33:00.716564+00:00, run_end_date=2024-04-15 02:33:02.206345+00:00, run_duration=1.489781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:32:00+00:00, data_interval_end=2024-04-15 02:33:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:33:02.216239988Z [2024-04-15T02:33:02.215+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:02.267536113Z [2024-04-15T02:33:02.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status success for try_number 1 2024-04-15T02:33:02.272130071Z [2024-04-15T02:33:02.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:32:00+00:00, map_index=-1, run_start_date=2024-04-15 02:33:01.566298+00:00, run_end_date=2024-04-15 02:33:01.985668+00:00, run_duration=0.41937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:33:00.793865+00:00, queued_by_job_id=1, pid=15575 2024-04-15T02:33:04.479388570Z [2024-04-15T02:33:04.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:33:04.479659051Z [2024-04-15T02:33:04.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:32:00+00:00, run_id=scheduled__2024-04-15T02:32:00+00:00, run_start_date=2024-04-15 02:33:00.718196+00:00, run_end_date=2024-04-15 02:33:04.479235+00:00, run_duration=3.761039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:32:00+00:00, data_interval_end=2024-04-15 02:33:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:33:04.504117326Z [2024-04-15T02:33:04.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:04.561671805Z [2024-04-15T02:33:04.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status success for try_number 1 2024-04-15T02:33:04.569523886Z [2024-04-15T02:33:04.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:32:00+00:00, map_index=-1, run_start_date=2024-04-15 02:33:02.712594+00:00, run_end_date=2024-04-15 02:33:04.139396+00:00, run_duration=1.426802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:33:00.793865+00:00, queued_by_job_id=1, pid=15593 2024-04-15T02:33:04.679232151Z [2024-04-15T02:33:04.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:33:04.679516957Z [2024-04-15T02:33:04.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:32:00+00:00, run_id=scheduled__2024-04-15T02:32:00+00:00, run_start_date=2024-04-15 02:33:00.719403+00:00, run_end_date=2024-04-15 02:33:04.679095+00:00, run_duration=3.959692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:32:00+00:00, data_interval_end=2024-04-15 02:33:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:33:04.693330203Z [2024-04-15T02:33:04.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:33:00+00:00, run_after=2024-04-15T02:34:00+00:00 2024-04-15T02:33:05.821280960Z [2024-04-15T02:33:05.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status success for try_number 1 2024-04-15T02:33:05.827489616Z [2024-04-15T02:33:05.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:32:00+00:00, map_index=-1, run_start_date=2024-04-15 02:33:02.793722+00:00, run_end_date=2024-04-15 02:33:04.605114+00:00, run_duration=1.811392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:33:00.793865+00:00, queued_by_job_id=1, pid=15594 2024-04-15T02:34:00.109049900Z [2024-04-15T02:34:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:00.119165691Z [2024-04-15T02:34:00.118+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:34:00.133838631Z [2024-04-15T02:34:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:00.145361217Z [2024-04-15T02:34:00.144+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:34:00.243194494Z [2024-04-15T02:34:00.242+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:34:00.243259769Z 2024-04-15T02:34:00.243270052Z 2024-04-15T02:34:00.243277769Z 2024-04-15T02:34:00.243285050Z 2024-04-15T02:34:00.243293295Z [2024-04-15T02:34:00.242+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:34:00.243444830Z [2024-04-15T02:34:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:34:00.243878005Z [2024-04-15T02:34:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:34:00.243891071Z [2024-04-15T02:34:00.243+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:34:00.244282978Z [2024-04-15T02:34:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:34:00.244295101Z 2024-04-15T02:34:00.244302305Z 2024-04-15T02:34:00.244309631Z 2024-04-15T02:34:00.244316819Z 2024-04-15T02:34:00.249231614Z [2024-04-15T02:34:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:34:00.249392593Z [2024-04-15T02:34:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:34:00.249680054Z [2024-04-15T02:34:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:34:00.249692901Z [2024-04-15T02:34:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:34:00.249915771Z [2024-04-15T02:34:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:34:00.249944081Z [2024-04-15T02:34:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:34:00.250238528Z [2024-04-15T02:34:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:34:00.250250658Z [2024-04-15T02:34:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:34:00.878511644Z [2024-04-15T02:34:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status queued for try_number 1 2024-04-15T02:34:00.878594808Z [2024-04-15T02:34:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status queued for try_number 1 2024-04-15T02:34:00.878599760Z [2024-04-15T02:34:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status queued for try_number 1 2024-04-15T02:34:00.878629460Z [2024-04-15T02:34:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status queued for try_number 1 2024-04-15T02:34:00.904841689Z [2024-04-15T02:34:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 212e8f29-07d8-4a75-860f-acad64856913 2024-04-15T02:34:00.904997718Z [2024-04-15T02:34:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9117c3f8-9514-4cce-8b37-3049011a4fa5 2024-04-15T02:34:00.905143659Z [2024-04-15T02:34:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4489a4e9-1b2a-4ca6-806a-b447c0353dc9 2024-04-15T02:34:00.905298975Z [2024-04-15T02:34:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to e47b7ec1-1490-48a1-8806-98bd93b79386 2024-04-15T02:34:01.978745063Z [2024-04-15T02:34:01.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:34:01.979490786Z [2024-04-15T02:34:01.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:32:00+00:00, run_id=scheduled__2024-04-15T02:32:00+00:00, run_start_date=2024-04-15 02:34:00.161344+00:00, run_end_date=2024-04-15 02:34:01.979016+00:00, run_duration=1.817672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:32:00+00:00, data_interval_end=2024-04-15 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:34:01.987144598Z [2024-04-15T02:34:01.986+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:34:01.993221129Z [2024-04-15T02:34:01.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:34:01.993915016Z [2024-04-15T02:34:01.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:33:00+00:00, run_id=scheduled__2024-04-15T02:33:00+00:00, run_start_date=2024-04-15 02:34:00.162676+00:00, run_end_date=2024-04-15 02:34:01.993580+00:00, run_duration=1.830904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:33:00+00:00, data_interval_end=2024-04-15 02:34:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:34:02.007814434Z [2024-04-15T02:34:02.007+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:02.054661977Z [2024-04-15T02:34:02.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:32:00+00:00 exited with status success for try_number 1 2024-04-15T02:34:02.055241245Z [2024-04-15T02:34:02.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status success for try_number 1 2024-04-15T02:34:02.066770868Z [2024-04-15T02:34:02.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:32:00+00:00, map_index=-1, run_start_date=2024-04-15 02:34:01.101235+00:00, run_end_date=2024-04-15 02:34:01.518842+00:00, run_duration=0.417607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:34:00.245284+00:00, queued_by_job_id=1, pid=15628 2024-04-15T02:34:02.067245141Z [2024-04-15T02:34:02.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:33:00+00:00, map_index=-1, run_start_date=2024-04-15 02:34:01.189110+00:00, run_end_date=2024-04-15 02:34:01.613380+00:00, run_duration=0.42427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:34:00.245284+00:00, queued_by_job_id=1, pid=15629 2024-04-15T02:34:04.215860471Z [2024-04-15T02:34:04.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:34:04.216222016Z [2024-04-15T02:34:04.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:33:00+00:00, run_id=scheduled__2024-04-15T02:33:00+00:00, run_start_date=2024-04-15 02:34:00.163962+00:00, run_end_date=2024-04-15 02:34:04.215780+00:00, run_duration=4.051818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:33:00+00:00, data_interval_end=2024-04-15 02:34:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:34:04.243935795Z [2024-04-15T02:34:04.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:04.256515165Z [2024-04-15T02:34:04.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:34:04.256906187Z [2024-04-15T02:34:04.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:33:00+00:00, run_id=scheduled__2024-04-15T02:33:00+00:00, run_start_date=2024-04-15 02:34:00.165193+00:00, run_end_date=2024-04-15 02:34:04.256421+00:00, run_duration=4.091228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:33:00+00:00, data_interval_end=2024-04-15 02:34:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:34:04.266655310Z [2024-04-15T02:34:04.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:34:00+00:00, run_after=2024-04-15T02:35:00+00:00 2024-04-15T02:34:04.310135949Z [2024-04-15T02:34:04.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status success for try_number 1 2024-04-15T02:34:04.310339370Z [2024-04-15T02:34:04.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:33:00+00:00 exited with status success for try_number 1 2024-04-15T02:34:04.319969930Z [2024-04-15T02:34:04.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:33:00+00:00, map_index=-1, run_start_date=2024-04-15 02:34:02.180892+00:00, run_end_date=2024-04-15 02:34:03.470459+00:00, run_duration=1.289567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:34:00.245284+00:00, queued_by_job_id=1, pid=15652 2024-04-15T02:34:04.319991503Z [2024-04-15T02:34:04.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:33:00+00:00, map_index=-1, run_start_date=2024-04-15 02:34:02.204890+00:00, run_end_date=2024-04-15 02:34:03.914523+00:00, run_duration=1.709633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:34:00.245284+00:00, queued_by_job_id=1, pid=15653 2024-04-15T02:35:00.043583513Z [2024-04-15T02:35:00.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:00.052777625Z [2024-04-15T02:35:00.052+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:35:00.069148600Z [2024-04-15T02:35:00.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:35:00.087873535Z [2024-04-15T02:35:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:00.233878646Z [2024-04-15T02:35:00.233+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:35:00.233933371Z 2024-04-15T02:35:00.233944396Z 2024-04-15T02:35:00.233953369Z 2024-04-15T02:35:00.233963243Z 2024-04-15T02:35:00.234009759Z [2024-04-15T02:35:00.233+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:35:00.234380320Z [2024-04-15T02:35:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:35:00.234751789Z [2024-04-15T02:35:00.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:35:00.235269643Z [2024-04-15T02:35:00.234+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:35:00.237135606Z [2024-04-15T02:35:00.236+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:00.237161015Z 2024-04-15T02:35:00.237171196Z 2024-04-15T02:35:00.237181297Z 2024-04-15T02:35:00.237190166Z 2024-04-15T02:35:00.245698808Z [2024-04-15T02:35:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:35:00.246381803Z [2024-04-15T02:35:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:00.246803710Z [2024-04-15T02:35:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:35:00.247151559Z [2024-04-15T02:35:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:35:00.247779673Z [2024-04-15T02:35:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:35:00.248159107Z [2024-04-15T02:35:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:35:00.248579642Z [2024-04-15T02:35:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:35:00.248869057Z [2024-04-15T02:35:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:35:00.798455218Z [2024-04-15T02:35:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:00.798480027Z [2024-04-15T02:35:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:00.798589123Z [2024-04-15T02:35:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:00.798683974Z [2024-04-15T02:35:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:00.811805942Z [2024-04-15T02:35:00.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to b05f3491-a4d7-47c2-bb02-1b694043a270 2024-04-15T02:35:00.811913948Z [2024-04-15T02:35:00.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcecb4ff-05e9-4bf4-8d3c-2c08ec7b0fa2 2024-04-15T02:35:00.812026188Z [2024-04-15T02:35:00.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78c42043-2f49-4299-a18e-adcb1d9cfe0b 2024-04-15T02:35:00.812124135Z [2024-04-15T02:35:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf46b575-5f0c-4bdd-b559-f02780d60762 2024-04-15T02:35:02.006032245Z [2024-04-15T02:35:02.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:35:02.006661742Z [2024-04-15T02:35:02.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:34:00+00:00, run_id=scheduled__2024-04-15T02:34:00+00:00, run_start_date=2024-04-15 02:35:00.112336+00:00, run_end_date=2024-04-15 02:35:02.005943+00:00, run_duration=1.893607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:34:00+00:00, data_interval_end=2024-04-15 02:35:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:35:02.025403975Z [2024-04-15T02:35:02.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:02.104710843Z [2024-04-15T02:35:02.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:02.125432917Z [2024-04-15T02:35:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:34:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:01.355416+00:00, run_end_date=2024-04-15 02:35:01.799644+00:00, run_duration=0.444228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:00.240039+00:00, queued_by_job_id=1, pid=15686 2024-04-15T02:35:03.008403417Z [2024-04-15T02:35:03.007+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:35:03.008421973Z 2024-04-15T02:35:03.008425698Z [2024-04-15T02:35:03.008+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:35:03.009104258Z [2024-04-15T02:35:03.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:03.009186347Z 2024-04-15T02:35:03.013936983Z [2024-04-15T02:35:03.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:35:03.014205407Z [2024-04-15T02:35:03.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:03.093386361Z [2024-04-15T02:35:03.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:03.093431737Z [2024-04-15T02:35:03.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:03.107554681Z [2024-04-15T02:35:03.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0017615f-bb84-44d0-978f-b434bd8ff2a0 2024-04-15T02:35:03.107973882Z [2024-04-15T02:35:03.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:02.291992+00:00, run_end_date=2024-04-15 02:35:02.737624+00:00, run_duration=0.445632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:00.240039+00:00, queued_by_job_id=1, pid=15705 2024-04-15T02:35:04.266794581Z [2024-04-15T02:35:04.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:35:04.267224594Z [2024-04-15T02:35:04.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:34:00+00:00, run_id=scheduled__2024-04-15T02:34:00+00:00, run_start_date=2024-04-15 02:35:00.114508+00:00, run_end_date=2024-04-15 02:35:04.266633+00:00, run_duration=4.152125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:34:00+00:00, data_interval_end=2024-04-15 02:35:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:35:04.276616255Z [2024-04-15T02:35:04.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:04.362220830Z [2024-04-15T02:35:04.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:04.371053995Z [2024-04-15T02:35:04.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:34:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:02.311822+00:00, run_end_date=2024-04-15 02:35:03.678353+00:00, run_duration=1.366531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:00.240039+00:00, queued_by_job_id=1, pid=15706 2024-04-15T02:35:05.419586987Z [2024-04-15T02:35:05.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:35:05.420458198Z [2024-04-15T02:35:05.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:34:00+00:00, run_id=scheduled__2024-04-15T02:34:00+00:00, run_start_date=2024-04-15 02:35:00.116744+00:00, run_end_date=2024-04-15 02:35:05.419525+00:00, run_duration=5.302781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:34:00+00:00, data_interval_end=2024-04-15 02:35:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:35:05.440349102Z [2024-04-15T02:35:05.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:36:00+00:00 2024-04-15T02:35:05.477350512Z [2024-04-15T02:35:05.476+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:35:05.477377364Z 2024-04-15T02:35:05.477381528Z [2024-04-15T02:35:05.477+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:35:05.477884025Z [2024-04-15T02:35:05.477+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:05.477891949Z 2024-04-15T02:35:05.482261077Z [2024-04-15T02:35:05.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:35:05.482302094Z [2024-04-15T02:35:05.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:35:05.526237307Z [2024-04-15T02:35:05.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:05.527022321Z [2024-04-15T02:35:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:05.527582677Z [2024-04-15T02:35:05.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:05.543770011Z [2024-04-15T02:35:05.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:04.736907+00:00, run_end_date=2024-04-15 02:35:05.135554+00:00, run_duration=0.398647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:03.009537+00:00, queued_by_job_id=1, pid=15735 2024-04-15T02:35:05.544453938Z [2024-04-15T02:35:05.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:34:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:02.720741+00:00, run_end_date=2024-04-15 02:35:04.511933+00:00, run_duration=1.791192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:00.240039+00:00, queued_by_job_id=1, pid=15722 2024-04-15T02:35:05.545031821Z [2024-04-15T02:35:05.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77361a76-bf92-4093-bbe3-4dbdcfa38482 2024-04-15T02:35:07.836160846Z [2024-04-15T02:35:07.835+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:35:07.836260797Z 2024-04-15T02:35:07.836325770Z [2024-04-15T02:35:07.835+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:35:07.837206954Z [2024-04-15T02:35:07.836+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:35:07.837250434Z 2024-04-15T02:35:07.842130007Z [2024-04-15T02:35:07.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:35:07.842192788Z [2024-04-15T02:35:07.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:07.905798489Z [2024-04-15T02:35:07.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status queued for try_number 1 2024-04-15T02:35:07.906289248Z [2024-04-15T02:35:07.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:07.916127334Z [2024-04-15T02:35:07.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04ece443-b626-4545-9e0e-fea04a46e528 2024-04-15T02:35:07.916673648Z [2024-04-15T02:35:07.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=0, run_start_date=2024-04-15 02:35:07.012404+00:00, run_end_date=2024-04-15 02:35:07.433806+00:00, run_duration=0.421402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:05.478153+00:00, queued_by_job_id=1, pid=15743 2024-04-15T02:35:10.433071091Z [2024-04-15T02:35:10.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:35:10.433201491Z [2024-04-15T02:35:10.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:30:00+00:00, run_id=scheduled__2024-04-15T02:30:00+00:00, run_start_date=2024-04-15 02:35:00.107781+00:00, run_end_date=2024-04-15 02:35:10.432968+00:00, run_duration=10.325187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:30:00+00:00, data_interval_end=2024-04-15 02:35:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:35:10.442568838Z [2024-04-15T02:35:10.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:35:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:35:10.478380622Z [2024-04-15T02:35:10.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:30:00+00:00 exited with status success for try_number 1 2024-04-15T02:35:10.486851370Z [2024-04-15T02:35:10.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:30:00+00:00, map_index=-1, run_start_date=2024-04-15 02:35:09.417178+00:00, run_end_date=2024-04-15 02:35:09.795071+00:00, run_duration=0.377893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:35:07.837826+00:00, queued_by_job_id=1, pid=15751 2024-04-15T02:36:00.059468498Z [2024-04-15T02:36:00.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:36:00.074814704Z [2024-04-15T02:36:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:00.083973067Z [2024-04-15T02:36:00.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:36:00.097159007Z [2024-04-15T02:36:00.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:00.177278044Z [2024-04-15T02:36:00.176+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:36:00.177316671Z 2024-04-15T02:36:00.177320907Z 2024-04-15T02:36:00.177323867Z 2024-04-15T02:36:00.177326928Z 2024-04-15T02:36:00.177372927Z [2024-04-15T02:36:00.177+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:36:00.177377194Z [2024-04-15T02:36:00.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:36:00.177452385Z [2024-04-15T02:36:00.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:36:00.177497291Z [2024-04-15T02:36:00.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:36:00.177963031Z [2024-04-15T02:36:00.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:36:00.177968614Z 2024-04-15T02:36:00.177971768Z 2024-04-15T02:36:00.177974989Z 2024-04-15T02:36:00.177977952Z 2024-04-15T02:36:00.180950688Z [2024-04-15T02:36:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:36:00.181026746Z [2024-04-15T02:36:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:36:00.181157335Z [2024-04-15T02:36:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:36:00.181227570Z [2024-04-15T02:36:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:36:00.181683061Z [2024-04-15T02:36:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:36:00.181796748Z [2024-04-15T02:36:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:36:00.181973390Z [2024-04-15T02:36:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:36:00.182044579Z [2024-04-15T02:36:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:36:00.523890804Z [2024-04-15T02:36:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status queued for try_number 1 2024-04-15T02:36:00.524243247Z [2024-04-15T02:36:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:36:00.524469263Z [2024-04-15T02:36:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:36:00.524681766Z [2024-04-15T02:36:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:36:00.533242736Z [2024-04-15T02:36:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 801701ca-b404-40c3-ae67-c0d2ac501087 2024-04-15T02:36:00.533541084Z [2024-04-15T02:36:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f9b39ff-9298-465e-b218-6e0efc63259e 2024-04-15T02:36:00.533766687Z [2024-04-15T02:36:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5074aca4-57ae-48c6-9022-dbb59cc335da 2024-04-15T02:36:00.534044411Z [2024-04-15T02:36:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70bb0819-805f-416f-ad16-896544051d9d 2024-04-15T02:36:01.670586432Z [2024-04-15T02:36:01.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:36:01.671066227Z [2024-04-15T02:36:01.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:34:00+00:00, run_id=scheduled__2024-04-15T02:34:00+00:00, run_start_date=2024-04-15 02:36:00.110603+00:00, run_end_date=2024-04-15 02:36:01.670536+00:00, run_duration=1.559933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:34:00+00:00, data_interval_end=2024-04-15 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:36:01.682450365Z [2024-04-15T02:36:01.682+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:36:01.689369153Z [2024-04-15T02:36:01.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:36:01.689564338Z [2024-04-15T02:36:01.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:35:00+00:00, run_id=scheduled__2024-04-15T02:35:00+00:00, run_start_date=2024-04-15 02:36:00.112108+00:00, run_end_date=2024-04-15 02:36:01.689290+00:00, run_duration=1.577182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:35:00+00:00, data_interval_end=2024-04-15 02:36:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:36:01.698658634Z [2024-04-15T02:36:01.698+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:01.745526367Z [2024-04-15T02:36:01.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:34:00+00:00 exited with status success for try_number 1 2024-04-15T02:36:01.745570532Z [2024-04-15T02:36:01.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:36:01.757069981Z [2024-04-15T02:36:01.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:36:01.114195+00:00, run_end_date=2024-04-15 02:36:01.487495+00:00, run_duration=0.3733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:36:00.178628+00:00, queued_by_job_id=1, pid=15775 2024-04-15T02:36:01.757494707Z [2024-04-15T02:36:01.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:34:00+00:00, map_index=-1, run_start_date=2024-04-15 02:36:01.020463+00:00, run_end_date=2024-04-15 02:36:01.357586+00:00, run_duration=0.337123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:36:00.178628+00:00, queued_by_job_id=1, pid=15774 2024-04-15T02:36:03.921247982Z [2024-04-15T02:36:03.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:36:03.921583258Z [2024-04-15T02:36:03.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:35:00+00:00, run_id=scheduled__2024-04-15T02:35:00+00:00, run_start_date=2024-04-15 02:36:00.113244+00:00, run_end_date=2024-04-15 02:36:03.921030+00:00, run_duration=3.807786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:35:00+00:00, data_interval_end=2024-04-15 02:36:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:36:03.929836005Z [2024-04-15T02:36:03.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:03.971433433Z [2024-04-15T02:36:03.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:36:03.978406079Z [2024-04-15T02:36:03.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:36:02.069289+00:00, run_end_date=2024-04-15 02:36:03.299009+00:00, run_duration=1.22972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:36:00.178628+00:00, queued_by_job_id=1, pid=15798 2024-04-15T02:36:05.237284235Z [2024-04-15T02:36:05.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:36:05.237711824Z [2024-04-15T02:36:05.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:35:00+00:00, run_id=scheduled__2024-04-15T02:35:00+00:00, run_start_date=2024-04-15 02:36:00.114382+00:00, run_end_date=2024-04-15 02:36:05.237099+00:00, run_duration=5.122717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:35:00+00:00, data_interval_end=2024-04-15 02:36:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:36:05.253444237Z [2024-04-15T02:36:05.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:36:00+00:00, run_after=2024-04-15T02:37:00+00:00 2024-04-15T02:36:05.302533849Z [2024-04-15T02:36:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:36:05.310544641Z [2024-04-15T02:36:05.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:36:02.189677+00:00, run_end_date=2024-04-15 02:36:04.880824+00:00, run_duration=2.691147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:36:00.178628+00:00, queued_by_job_id=1, pid=15799 2024-04-15T02:36:05.773387140Z [2024-04-15T02:36:05.772+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:37:01.071104068Z [2024-04-15T02:37:01.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:01.085648322Z [2024-04-15T02:37:01.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:01.093004918Z [2024-04-15T02:37:01.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:37:01.154502011Z [2024-04-15T02:37:01.154+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:37:01.154540977Z 2024-04-15T02:37:01.154547183Z 2024-04-15T02:37:01.154551931Z 2024-04-15T02:37:01.154705107Z [2024-04-15T02:37:01.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:37:01.154916751Z [2024-04-15T02:37:01.154+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:37:01.155011952Z [2024-04-15T02:37:01.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:37:01.156002862Z [2024-04-15T02:37:01.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:37:01.156042873Z 2024-04-15T02:37:01.156048891Z 2024-04-15T02:37:01.156053340Z 2024-04-15T02:37:01.160716917Z [2024-04-15T02:37:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:37:01.160875171Z [2024-04-15T02:37:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:37:01.161059449Z [2024-04-15T02:37:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:37:01.161133375Z [2024-04-15T02:37:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:37:01.161329806Z [2024-04-15T02:37:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:37:01.161396716Z [2024-04-15T02:37:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:37:01.475695278Z [2024-04-15T02:37:01.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status queued for try_number 1 2024-04-15T02:37:01.475744229Z [2024-04-15T02:37:01.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status queued for try_number 1 2024-04-15T02:37:01.475995176Z [2024-04-15T02:37:01.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status queued for try_number 1 2024-04-15T02:37:01.484149835Z [2024-04-15T02:37:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99d21d41-11b8-4fac-a56a-64449c434b9c 2024-04-15T02:37:01.484309850Z [2024-04-15T02:37:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d9eb2b9-6493-4cf0-82a1-6a25e944910a 2024-04-15T02:37:01.484593899Z [2024-04-15T02:37:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to dae4b790-cfe1-4dc1-a8fa-2932383e7aab 2024-04-15T02:37:02.678109565Z [2024-04-15T02:37:02.677+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:37:02.678866046Z [2024-04-15T02:37:02.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:36:00+00:00, run_id=scheduled__2024-04-15T02:36:00+00:00, run_start_date=2024-04-15 02:37:01.104461+00:00, run_end_date=2024-04-15 02:37:02.678540+00:00, run_duration=1.574079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:36:00+00:00, data_interval_end=2024-04-15 02:37:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:37:02.691643121Z [2024-04-15T02:37:02.691+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:02.771713270Z [2024-04-15T02:37:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status success for try_number 1 2024-04-15T02:37:02.784381944Z [2024-04-15T02:37:02.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:36:00+00:00, map_index=-1, run_start_date=2024-04-15 02:37:01.970043+00:00, run_end_date=2024-04-15 02:37:02.406107+00:00, run_duration=0.436064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:37:01.156730+00:00, queued_by_job_id=1, pid=15831 2024-04-15T02:37:04.984322488Z [2024-04-15T02:37:04.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:37:04.985034347Z [2024-04-15T02:37:04.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:36:00+00:00, run_id=scheduled__2024-04-15T02:36:00+00:00, run_start_date=2024-04-15 02:37:01.105549+00:00, run_end_date=2024-04-15 02:37:04.984508+00:00, run_duration=3.878959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:36:00+00:00, data_interval_end=2024-04-15 02:37:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:37:05.005466273Z [2024-04-15T02:37:05.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:05.066455849Z [2024-04-15T02:37:05.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status success for try_number 1 2024-04-15T02:37:05.073271808Z [2024-04-15T02:37:05.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:36:00+00:00, map_index=-1, run_start_date=2024-04-15 02:37:02.923860+00:00, run_end_date=2024-04-15 02:37:04.412672+00:00, run_duration=1.488812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:37:01.156730+00:00, queued_by_job_id=1, pid=15850 2024-04-15T02:37:06.158817079Z [2024-04-15T02:37:06.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:37:06.159565080Z [2024-04-15T02:37:06.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:36:00+00:00, run_id=scheduled__2024-04-15T02:36:00+00:00, run_start_date=2024-04-15 02:37:01.106510+00:00, run_end_date=2024-04-15 02:37:06.158601+00:00, run_duration=5.052091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:36:00+00:00, data_interval_end=2024-04-15 02:37:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:37:06.175402773Z [2024-04-15T02:37:06.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:37:00+00:00, run_after=2024-04-15T02:38:00+00:00 2024-04-15T02:37:06.221013353Z [2024-04-15T02:37:06.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status success for try_number 1 2024-04-15T02:37:06.228911953Z [2024-04-15T02:37:06.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:36:00+00:00, map_index=-1, run_start_date=2024-04-15 02:37:02.832793+00:00, run_end_date=2024-04-15 02:37:05.043872+00:00, run_duration=2.211079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:37:01.156730+00:00, queued_by_job_id=1, pid=15849 2024-04-15T02:38:00.107928024Z [2024-04-15T02:38:00.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:38:00.124673698Z [2024-04-15T02:38:00.124+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:00.150269876Z [2024-04-15T02:38:00.149+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:38:00.170620864Z [2024-04-15T02:38:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:00.283943896Z [2024-04-15T02:38:00.283+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:38:00.283979431Z 2024-04-15T02:38:00.283987052Z 2024-04-15T02:38:00.283992945Z 2024-04-15T02:38:00.284027077Z 2024-04-15T02:38:00.284656847Z [2024-04-15T02:38:00.283+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:38:00.285131854Z [2024-04-15T02:38:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:38:00.285527349Z [2024-04-15T02:38:00.285+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:38:00.285887406Z [2024-04-15T02:38:00.285+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:38:00.287136514Z [2024-04-15T02:38:00.286+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:38:00.287204486Z 2024-04-15T02:38:00.287213005Z 2024-04-15T02:38:00.287218947Z 2024-04-15T02:38:00.287225541Z 2024-04-15T02:38:00.293280662Z [2024-04-15T02:38:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:38:00.293744630Z [2024-04-15T02:38:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:38:00.294336293Z [2024-04-15T02:38:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:38:00.294809551Z [2024-04-15T02:38:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:38:00.295250658Z [2024-04-15T02:38:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:38:00.295629814Z [2024-04-15T02:38:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:38:00.296175879Z [2024-04-15T02:38:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:38:00.296466463Z [2024-04-15T02:38:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:38:00.912522122Z [2024-04-15T02:38:00.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status queued for try_number 1 2024-04-15T02:38:00.914025320Z [2024-04-15T02:38:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status queued for try_number 1 2024-04-15T02:38:00.914314707Z [2024-04-15T02:38:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status queued for try_number 1 2024-04-15T02:38:00.914547685Z [2024-04-15T02:38:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status queued for try_number 1 2024-04-15T02:38:00.931531956Z [2024-04-15T02:38:00.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e62b2c2-e1c2-478c-b3c2-e106122aa516 2024-04-15T02:38:00.932858981Z [2024-04-15T02:38:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to f63e1dda-d1b3-439f-8d06-713755c8fc4c 2024-04-15T02:38:00.933072909Z [2024-04-15T02:38:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cb0ac75-2cec-481e-9678-eff8a5ba7624 2024-04-15T02:38:00.933208141Z [2024-04-15T02:38:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f03d9fd-835e-42d5-bedb-7a1a521fcc80 2024-04-15T02:38:02.196123764Z [2024-04-15T02:38:02.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:38:02.197114672Z [2024-04-15T02:38:02.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:36:00+00:00, run_id=scheduled__2024-04-15T02:36:00+00:00, run_start_date=2024-04-15 02:38:00.180938+00:00, run_end_date=2024-04-15 02:38:02.196002+00:00, run_duration=2.015064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:36:00+00:00, data_interval_end=2024-04-15 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:38:02.211599037Z [2024-04-15T02:38:02.211+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:38:02.221745318Z [2024-04-15T02:38:02.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:38:02.222254276Z [2024-04-15T02:38:02.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:37:00+00:00, run_id=scheduled__2024-04-15T02:37:00+00:00, run_start_date=2024-04-15 02:38:00.182143+00:00, run_end_date=2024-04-15 02:38:02.221807+00:00, run_duration=2.039664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:37:00+00:00, data_interval_end=2024-04-15 02:38:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:38:02.238171732Z [2024-04-15T02:38:02.237+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:02.302673684Z [2024-04-15T02:38:02.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:36:00+00:00 exited with status success for try_number 1 2024-04-15T02:38:02.302713012Z [2024-04-15T02:38:02.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status success for try_number 1 2024-04-15T02:38:02.310416647Z [2024-04-15T02:38:02.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:36:00+00:00, map_index=-1, run_start_date=2024-04-15 02:38:01.092925+00:00, run_end_date=2024-04-15 02:38:01.472772+00:00, run_duration=0.379847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:38:00.288654+00:00, queued_by_job_id=1, pid=15884 2024-04-15T02:38:02.310603154Z [2024-04-15T02:38:02.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:37:00+00:00, map_index=-1, run_start_date=2024-04-15 02:38:01.080941+00:00, run_end_date=2024-04-15 02:38:01.412187+00:00, run_duration=0.331246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:38:00.288654+00:00, queued_by_job_id=1, pid=15883 2024-04-15T02:38:04.494577762Z [2024-04-15T02:38:04.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:38:04.495079605Z [2024-04-15T02:38:04.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:37:00+00:00, run_id=scheduled__2024-04-15T02:37:00+00:00, run_start_date=2024-04-15 02:38:00.183270+00:00, run_end_date=2024-04-15 02:38:04.494465+00:00, run_duration=4.311195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:37:00+00:00, data_interval_end=2024-04-15 02:38:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:38:04.508024165Z [2024-04-15T02:38:04.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:04.517277153Z [2024-04-15T02:38:04.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:38:04.517525507Z [2024-04-15T02:38:04.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:37:00+00:00, run_id=scheduled__2024-04-15T02:37:00+00:00, run_start_date=2024-04-15 02:38:00.184271+00:00, run_end_date=2024-04-15 02:38:04.517064+00:00, run_duration=4.332793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:37:00+00:00, data_interval_end=2024-04-15 02:38:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:38:04.527428893Z [2024-04-15T02:38:04.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:38:00+00:00, run_after=2024-04-15T02:39:00+00:00 2024-04-15T02:38:04.573215310Z [2024-04-15T02:38:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status success for try_number 1 2024-04-15T02:38:04.573506536Z [2024-04-15T02:38:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:37:00+00:00 exited with status success for try_number 1 2024-04-15T02:38:04.593646757Z [2024-04-15T02:38:04.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:37:00+00:00, map_index=-1, run_start_date=2024-04-15 02:38:02.438360+00:00, run_end_date=2024-04-15 02:38:03.758211+00:00, run_duration=1.319851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:38:00.288654+00:00, queued_by_job_id=1, pid=15908 2024-04-15T02:38:04.593899301Z [2024-04-15T02:38:04.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:37:00+00:00, map_index=-1, run_start_date=2024-04-15 02:38:02.200411+00:00, run_end_date=2024-04-15 02:38:03.947797+00:00, run_duration=1.747386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:38:00.288654+00:00, queued_by_job_id=1, pid=15906 2024-04-15T02:39:00.401132020Z [2024-04-15T02:39:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:00.414991515Z [2024-04-15T02:39:00.414+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:39:00.430253331Z [2024-04-15T02:39:00.430+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:00.491224460Z [2024-04-15T02:39:00.490+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:39:00.491262139Z 2024-04-15T02:39:00.491265766Z 2024-04-15T02:39:00.491269146Z 2024-04-15T02:39:00.491431697Z [2024-04-15T02:39:00.491+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:39:00.491624611Z [2024-04-15T02:39:00.491+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:39:00.491900719Z [2024-04-15T02:39:00.491+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:39:00.493225743Z [2024-04-15T02:39:00.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:39:00.493238492Z 2024-04-15T02:39:00.493246403Z 2024-04-15T02:39:00.493249594Z 2024-04-15T02:39:00.497162940Z [2024-04-15T02:39:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:39:00.497461973Z [2024-04-15T02:39:00.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:39:00.497976877Z [2024-04-15T02:39:00.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:39:00.498160602Z [2024-04-15T02:39:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:39:00.498457976Z [2024-04-15T02:39:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:39:00.498625310Z [2024-04-15T02:39:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:39:00.694981126Z [2024-04-15T02:39:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status queued for try_number 1 2024-04-15T02:39:00.695148412Z [2024-04-15T02:39:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status queued for try_number 1 2024-04-15T02:39:00.695351221Z [2024-04-15T02:39:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status queued for try_number 1 2024-04-15T02:39:00.704119746Z [2024-04-15T02:39:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1020b8a-82b2-49b4-b93f-9e340d7f7e32 2024-04-15T02:39:00.704336388Z [2024-04-15T02:39:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79d82406-1adf-458b-afba-d4e31f8518e6 2024-04-15T02:39:00.704522753Z [2024-04-15T02:39:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bed225d-30c4-47aa-9480-355938fe2000 2024-04-15T02:39:01.863122128Z [2024-04-15T02:39:01.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:39:01.863631820Z [2024-04-15T02:39:01.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:38:00+00:00, run_id=scheduled__2024-04-15T02:38:00+00:00, run_start_date=2024-04-15 02:39:00.440512+00:00, run_end_date=2024-04-15 02:39:01.863038+00:00, run_duration=1.422526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:38:00+00:00, data_interval_end=2024-04-15 02:39:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:39:01.873274600Z [2024-04-15T02:39:01.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:03.068863203Z [2024-04-15T02:39:03.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status success for try_number 1 2024-04-15T02:39:03.076384714Z [2024-04-15T02:39:03.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:38:00+00:00, map_index=-1, run_start_date=2024-04-15 02:39:01.415386+00:00, run_end_date=2024-04-15 02:39:01.815108+00:00, run_duration=0.399722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:39:00.493900+00:00, queued_by_job_id=1, pid=15940 2024-04-15T02:39:04.137187069Z [2024-04-15T02:39:04.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:39:04.137641542Z [2024-04-15T02:39:04.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:38:00+00:00, run_id=scheduled__2024-04-15T02:38:00+00:00, run_start_date=2024-04-15 02:39:00.441510+00:00, run_end_date=2024-04-15 02:39:04.137085+00:00, run_duration=3.695575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:38:00+00:00, data_interval_end=2024-04-15 02:39:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:39:04.161909882Z [2024-04-15T02:39:04.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:04.169995568Z [2024-04-15T02:39:04.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:39:04.170173041Z [2024-04-15T02:39:04.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:38:00+00:00, run_id=scheduled__2024-04-15T02:38:00+00:00, run_start_date=2024-04-15 02:39:00.442336+00:00, run_end_date=2024-04-15 02:39:04.169673+00:00, run_duration=3.727337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:38:00+00:00, data_interval_end=2024-04-15 02:39:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:39:04.178121164Z [2024-04-15T02:39:04.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:39:00+00:00, run_after=2024-04-15T02:40:00+00:00 2024-04-15T02:39:04.230186743Z [2024-04-15T02:39:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status success for try_number 1 2024-04-15T02:39:04.230283454Z [2024-04-15T02:39:04.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status success for try_number 1 2024-04-15T02:39:04.239745540Z [2024-04-15T02:39:04.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:38:00+00:00, map_index=-1, run_start_date=2024-04-15 02:39:02.319919+00:00, run_end_date=2024-04-15 02:39:03.592245+00:00, run_duration=1.272326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:39:00.493900+00:00, queued_by_job_id=1, pid=15959 2024-04-15T02:39:04.240283083Z [2024-04-15T02:39:04.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:38:00+00:00, map_index=-1, run_start_date=2024-04-15 02:39:02.198293+00:00, run_end_date=2024-04-15 02:39:03.867891+00:00, run_duration=1.669598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:39:00.493900+00:00, queued_by_job_id=1, pid=15958 2024-04-15T02:40:00.564157574Z [2024-04-15T02:40:00.563+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:40:00.574244199Z [2024-04-15T02:40:00.573+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:00.585886363Z [2024-04-15T02:40:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:40:00.596118772Z [2024-04-15T02:40:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:00.603053443Z [2024-04-15T02:40:00.602+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:40:00.679130089Z [2024-04-15T02:40:00.678+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-15T02:40:00.679150509Z 2024-04-15T02:40:00.679154026Z 2024-04-15T02:40:00.679157839Z 2024-04-15T02:40:00.679160951Z 2024-04-15T02:40:00.679164132Z 2024-04-15T02:40:00.679597065Z [2024-04-15T02:40:00.679+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:40:00.680075238Z [2024-04-15T02:40:00.679+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:40:00.680526429Z [2024-04-15T02:40:00.680+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:40:00.682064152Z [2024-04-15T02:40:00.681+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:40:00.682590847Z [2024-04-15T02:40:00.682+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:40:00.684504090Z [2024-04-15T02:40:00.684+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:00.684515633Z 2024-04-15T02:40:00.684519519Z 2024-04-15T02:40:00.684523179Z 2024-04-15T02:40:00.684526383Z 2024-04-15T02:40:00.684529550Z 2024-04-15T02:40:00.695648266Z [2024-04-15T02:40:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:40:00.695937307Z [2024-04-15T02:40:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:00.696370984Z [2024-04-15T02:40:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:00.696566026Z [2024-04-15T02:40:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:40:00.696923701Z [2024-04-15T02:40:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:00.697120805Z [2024-04-15T02:40:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:40:00.697421281Z [2024-04-15T02:40:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:00.697655024Z [2024-04-15T02:40:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:40:00.698386929Z [2024-04-15T02:40:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:00.698610999Z [2024-04-15T02:40:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:40:01.186534881Z [2024-04-15T02:40:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.186623936Z [2024-04-15T02:40:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.186732164Z [2024-04-15T02:40:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.186823468Z [2024-04-15T02:40:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.186943273Z [2024-04-15T02:40:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:01.196554266Z [2024-04-15T02:40:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3058ab9-c84a-410c-804e-2f4f37544ac6 2024-04-15T02:40:01.199651114Z [2024-04-15T02:40:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94fb7470-2100-4fab-b572-be505150b9fc 2024-04-15T02:40:01.199795670Z [2024-04-15T02:40:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb4cb0da-772c-4185-8b46-3645dc82d28b 2024-04-15T02:40:01.199941777Z [2024-04-15T02:40:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to bccc157a-4df9-4418-84a0-7ed376f0fd37 2024-04-15T02:40:01.200084169Z [2024-04-15T02:40:01.199+0000] {scheduler_job.py:635} INFO - Setting external_id for to 042b3871-bb28-4bd4-9ce8-2c296740c220 2024-04-15T02:40:02.496372498Z [2024-04-15T02:40:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:02.497416823Z [2024-04-15T02:40:02.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:38:00+00:00, run_id=scheduled__2024-04-15T02:38:00+00:00, run_start_date=2024-04-15 02:40:00.612540+00:00, run_end_date=2024-04-15 02:40:02.496147+00:00, run_duration=1.883607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:38:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:40:02.510541044Z [2024-04-15T02:40:02.509+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:40:02.644796386Z [2024-04-15T02:40:02.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:38:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:02.649258968Z [2024-04-15T02:40:02.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:38:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:01.579963+00:00, run_end_date=2024-04-15 02:40:02.054957+00:00, run_duration=0.474994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:00.690810+00:00, queued_by_job_id=1, pid=15988 2024-04-15T02:40:03.963922317Z [2024-04-15T02:40:03.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:03.964306961Z [2024-04-15T02:40:03.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:39:00+00:00, run_id=scheduled__2024-04-15T02:39:00+00:00, run_start_date=2024-04-15 02:40:00.613411+00:00, run_end_date=2024-04-15 02:40:03.963886+00:00, run_duration=3.350475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:39:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:40:03.975553041Z [2024-04-15T02:40:03.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:04.024689356Z [2024-04-15T02:40:04.024+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:40:04.024742442Z 2024-04-15T02:40:04.024770856Z [2024-04-15T02:40:04.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:40:04.025386664Z [2024-04-15T02:40:04.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:04.025401030Z 2024-04-15T02:40:04.028477252Z [2024-04-15T02:40:04.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:40:04.028683250Z [2024-04-15T02:40:04.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:04.101095847Z [2024-04-15T02:40:04.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:04.101229387Z [2024-04-15T02:40:04.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:04.101335842Z [2024-04-15T02:40:04.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:04.107154232Z [2024-04-15T02:40:04.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:39:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:02.615034+00:00, run_end_date=2024-04-15 02:40:03.116260+00:00, run_duration=0.501226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:00.690810+00:00, queued_by_job_id=1, pid=16002 2024-04-15T02:40:04.107442293Z [2024-04-15T02:40:04.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:03.276402+00:00, run_end_date=2024-04-15 02:40:03.645312+00:00, run_duration=0.36891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:00.690810+00:00, queued_by_job_id=1, pid=16023 2024-04-15T02:40:04.107630639Z [2024-04-15T02:40:04.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 133f34f1-658f-4ebe-b2f0-12d3367207d6 2024-04-15T02:40:05.233557143Z [2024-04-15T02:40:05.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:05.233797830Z [2024-04-15T02:40:05.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:39:00+00:00, run_id=scheduled__2024-04-15T02:39:00+00:00, run_start_date=2024-04-15 02:40:00.614397+00:00, run_end_date=2024-04-15 02:40:05.233546+00:00, run_duration=4.619149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:39:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:40:05.241373215Z [2024-04-15T02:40:05.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:05.246410883Z [2024-04-15T02:40:05.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:05.246653156Z [2024-04-15T02:40:05.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:39:00+00:00, run_id=scheduled__2024-04-15T02:39:00+00:00, run_start_date=2024-04-15 02:40:00.615519+00:00, run_end_date=2024-04-15 02:40:05.246419+00:00, run_duration=4.6309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:39:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:40:05.288205469Z [2024-04-15T02:40:05.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:41:00+00:00 2024-04-15T02:40:05.338812780Z [2024-04-15T02:40:05.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:05.339023207Z [2024-04-15T02:40:05.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:39:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:05.344620023Z [2024-04-15T02:40:05.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:39:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:03.326810+00:00, run_end_date=2024-04-15 02:40:05.067506+00:00, run_duration=1.740696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:00.690810+00:00, queued_by_job_id=1, pid=16024 2024-04-15T02:40:05.344637094Z [2024-04-15T02:40:05.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:39:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:03.445561+00:00, run_end_date=2024-04-15 02:40:04.743944+00:00, run_duration=1.298383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:00.690810+00:00, queued_by_job_id=1, pid=16025 2024-04-15T02:40:06.451327525Z [2024-04-15T02:40:06.450+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:40:06.451368139Z 2024-04-15T02:40:06.452039260Z [2024-04-15T02:40:06.451+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:40:06.453331978Z [2024-04-15T02:40:06.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:06.453356681Z 2024-04-15T02:40:06.457996654Z [2024-04-15T02:40:06.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:40:06.458470127Z [2024-04-15T02:40:06.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:40:06.515286230Z [2024-04-15T02:40:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:06.516449345Z [2024-04-15T02:40:06.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:06.523718601Z [2024-04-15T02:40:06.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0df581d8-df11-48b5-94ea-ea6f814a3eab 2024-04-15T02:40:06.524177839Z [2024-04-15T02:40:06.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:05.671871+00:00, run_end_date=2024-04-15 02:40:06.047573+00:00, run_duration=0.375702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:04.025741+00:00, queued_by_job_id=1, pid=16048 2024-04-15T02:40:09.093951198Z [2024-04-15T02:40:09.092+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:40:09.093987574Z 2024-04-15T02:40:09.094167414Z [2024-04-15T02:40:09.093+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:40:09.095470947Z [2024-04-15T02:40:09.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:40:09.095493681Z 2024-04-15T02:40:09.100910049Z [2024-04-15T02:40:09.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:40:09.101033004Z [2024-04-15T02:40:09.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:09.167489400Z [2024-04-15T02:40:09.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status queued for try_number 1 2024-04-15T02:40:09.167624694Z [2024-04-15T02:40:09.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:09.177356399Z [2024-04-15T02:40:09.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3c582d2-f123-47a9-8f99-3b8b0d4b9204 2024-04-15T02:40:09.177543357Z [2024-04-15T02:40:09.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=0, run_start_date=2024-04-15 02:40:08.130384+00:00, run_end_date=2024-04-15 02:40:08.561959+00:00, run_duration=0.431575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:06.454373+00:00, queued_by_job_id=1, pid=16056 2024-04-15T02:40:11.429013269Z [2024-04-15T02:40:11.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:40:11.429060672Z [2024-04-15T02:40:11.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:35:00+00:00, run_id=scheduled__2024-04-15T02:35:00+00:00, run_start_date=2024-04-15 02:40:00.611409+00:00, run_end_date=2024-04-15 02:40:11.428744+00:00, run_duration=10.817335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:35:00+00:00, data_interval_end=2024-04-15 02:40:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:40:11.435708930Z [2024-04-15T02:40:11.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:40:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:40:11.469595374Z [2024-04-15T02:40:11.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:35:00+00:00 exited with status success for try_number 1 2024-04-15T02:40:11.479195757Z [2024-04-15T02:40:11.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:35:00+00:00, map_index=-1, run_start_date=2024-04-15 02:40:10.719506+00:00, run_end_date=2024-04-15 02:40:11.164476+00:00, run_duration=0.44497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:40:09.096246+00:00, queued_by_job_id=1, pid=16064 2024-04-15T02:41:00.953878107Z [2024-04-15T02:41:00.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:00.969140922Z [2024-04-15T02:41:00.968+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:00.975550123Z [2024-04-15T02:41:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:41:01.041065201Z [2024-04-15T02:41:01.040+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:41:01.041111210Z 2024-04-15T02:41:01.041122170Z 2024-04-15T02:41:01.041131529Z 2024-04-15T02:41:01.041368699Z [2024-04-15T02:41:01.040+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:41:01.041575701Z [2024-04-15T02:41:01.041+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:41:01.041843763Z [2024-04-15T02:41:01.041+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:41:01.042726478Z [2024-04-15T02:41:01.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:41:01.042749162Z 2024-04-15T02:41:01.042762539Z 2024-04-15T02:41:01.042773657Z 2024-04-15T02:41:01.045553183Z [2024-04-15T02:41:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:41:01.045747609Z [2024-04-15T02:41:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:41:01.046054384Z [2024-04-15T02:41:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:41:01.046242759Z [2024-04-15T02:41:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:41:01.046551444Z [2024-04-15T02:41:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:41:01.046758858Z [2024-04-15T02:41:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:41:01.328850598Z [2024-04-15T02:41:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:41:01.328999717Z [2024-04-15T02:41:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:41:01.329137711Z [2024-04-15T02:41:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:41:01.336277567Z [2024-04-15T02:41:01.335+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55e3a973-6fc0-443f-8986-11a552c44a1b 2024-04-15T02:41:01.336345345Z [2024-04-15T02:41:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f6bf92d-5c04-4823-8def-d13b56b12ccc 2024-04-15T02:41:01.336532171Z [2024-04-15T02:41:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54147b30-b129-444a-b0d0-99fe892d5142 2024-04-15T02:41:02.593607925Z [2024-04-15T02:41:02.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:41:02.607491436Z [2024-04-15T02:41:02.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:41:02.029161+00:00, run_end_date=2024-04-15 02:41:02.407494+00:00, run_duration=0.378333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:41:01.043417+00:00, queued_by_job_id=1, pid=16086 2024-04-15T02:41:03.653730173Z [2024-04-15T02:41:03.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:41:03.654098439Z [2024-04-15T02:41:03.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:41:00.985101+00:00, run_end_date=2024-04-15 02:41:03.653713+00:00, run_duration=2.668612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:41:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:41:03.662969748Z [2024-04-15T02:41:03.662+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:05.826228424Z [2024-04-15T02:41:05.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:41:05.826532630Z [2024-04-15T02:41:05.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:41:00.986343+00:00, run_end_date=2024-04-15 02:41:05.826106+00:00, run_duration=4.839763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:41:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:41:05.835493473Z [2024-04-15T02:41:05.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:05.842206966Z [2024-04-15T02:41:05.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:41:05.842409704Z [2024-04-15T02:41:05.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:41:00.987360+00:00, run_end_date=2024-04-15 02:41:05.842111+00:00, run_duration=4.854751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:41:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:41:05.851172331Z [2024-04-15T02:41:05.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:41:00+00:00, run_after=2024-04-15T02:42:00+00:00 2024-04-15T02:41:05.890816399Z [2024-04-15T02:41:05.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:41:05.891050867Z [2024-04-15T02:41:05.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:41:05.898976146Z [2024-04-15T02:41:05.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:41:03.116968+00:00, run_end_date=2024-04-15 02:41:05.188932+00:00, run_duration=2.071964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:41:01.043417+00:00, queued_by_job_id=1, pid=16104 2024-04-15T02:41:05.899315683Z [2024-04-15T02:41:05.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:41:03.137231+00:00, run_end_date=2024-04-15 02:41:05.589756+00:00, run_duration=2.452525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:41:01.043417+00:00, queued_by_job_id=1, pid=16105 2024-04-15T02:41:05.911480200Z [2024-04-15T02:41:05.911+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:42:00.785488919Z [2024-04-15T02:42:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:00.793193286Z [2024-04-15T02:42:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:42:00.800262801Z [2024-04-15T02:42:00.799+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:42:00.811966867Z [2024-04-15T02:42:00.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:00.897415765Z [2024-04-15T02:42:00.897+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:42:00.897437481Z 2024-04-15T02:42:00.897449055Z 2024-04-15T02:42:00.897451945Z 2024-04-15T02:42:00.897454590Z 2024-04-15T02:42:00.897510829Z [2024-04-15T02:42:00.897+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:42:00.897606236Z [2024-04-15T02:42:00.897+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:42:00.897710081Z [2024-04-15T02:42:00.897+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:42:00.897814892Z [2024-04-15T02:42:00.897+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:42:00.898691354Z [2024-04-15T02:42:00.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:42:00.898703009Z 2024-04-15T02:42:00.898706872Z 2024-04-15T02:42:00.898709984Z 2024-04-15T02:42:00.898713036Z 2024-04-15T02:42:00.903527956Z [2024-04-15T02:42:00.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:42:00.903682771Z [2024-04-15T02:42:00.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:42:00.903943093Z [2024-04-15T02:42:00.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:42:00.904065080Z [2024-04-15T02:42:00.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:42:00.904297461Z [2024-04-15T02:42:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:42:00.904422439Z [2024-04-15T02:42:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:42:00.904636811Z [2024-04-15T02:42:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:42:00.904749804Z [2024-04-15T02:42:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:42:01.320895560Z [2024-04-15T02:42:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:42:01.320949160Z [2024-04-15T02:42:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status queued for try_number 1 2024-04-15T02:42:01.321054904Z [2024-04-15T02:42:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status queued for try_number 1 2024-04-15T02:42:01.321146559Z [2024-04-15T02:42:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status queued for try_number 1 2024-04-15T02:42:01.329042946Z [2024-04-15T02:42:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 777e060f-dadb-4010-9e48-f89367342823 2024-04-15T02:42:01.329132259Z [2024-04-15T02:42:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5701e4c-cd9e-436a-a757-bc27fcb478e3 2024-04-15T02:42:01.329306023Z [2024-04-15T02:42:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 405b3e8f-dc93-464e-a26f-4b5244c8ba6b 2024-04-15T02:42:01.329453680Z [2024-04-15T02:42:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4205202-2233-4440-8d34-7914b4757348 2024-04-15T02:42:02.473610491Z [2024-04-15T02:42:02.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:42:02.473972502Z [2024-04-15T02:42:02.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:42:00.823627+00:00, run_end_date=2024-04-15 02:42:02.473551+00:00, run_duration=1.649924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:42:02.481565551Z [2024-04-15T02:42:02.481+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:42:02.487405954Z [2024-04-15T02:42:02.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:42:02.487654427Z [2024-04-15T02:42:02.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:41:00+00:00, run_id=scheduled__2024-04-15T02:41:00+00:00, run_start_date=2024-04-15 02:42:00.824828+00:00, run_end_date=2024-04-15 02:42:02.487353+00:00, run_duration=1.662525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:41:00+00:00, data_interval_end=2024-04-15 02:42:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:42:02.496620883Z [2024-04-15T02:42:02.496+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:02.537581093Z [2024-04-15T02:42:02.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:42:02.537601276Z [2024-04-15T02:42:02.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status success for try_number 1 2024-04-15T02:42:02.542963174Z [2024-04-15T02:42:02.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:42:01.780274+00:00, run_end_date=2024-04-15 02:42:02.107152+00:00, run_duration=0.326878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:42:00.899735+00:00, queued_by_job_id=1, pid=16139 2024-04-15T02:42:02.543160843Z [2024-04-15T02:42:02.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:41:00+00:00, map_index=-1, run_start_date=2024-04-15 02:42:01.728365+00:00, run_end_date=2024-04-15 02:42:02.069982+00:00, run_duration=0.341617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:42:00.899735+00:00, queued_by_job_id=1, pid=16138 2024-04-15T02:42:04.674090737Z [2024-04-15T02:42:04.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:42:04.675139876Z [2024-04-15T02:42:04.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:41:00+00:00, run_id=scheduled__2024-04-15T02:41:00+00:00, run_start_date=2024-04-15 02:42:00.825823+00:00, run_end_date=2024-04-15 02:42:04.674598+00:00, run_duration=3.848775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:41:00+00:00, data_interval_end=2024-04-15 02:42:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:42:04.684740541Z [2024-04-15T02:42:04.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:04.732165502Z [2024-04-15T02:42:04.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status success for try_number 1 2024-04-15T02:42:04.737451006Z [2024-04-15T02:42:04.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:41:00+00:00, map_index=-1, run_start_date=2024-04-15 02:42:02.618796+00:00, run_end_date=2024-04-15 02:42:04.043666+00:00, run_duration=1.42487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:42:00.899735+00:00, queued_by_job_id=1, pid=16162 2024-04-15T02:42:05.906065375Z [2024-04-15T02:42:05.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:42:05.906523822Z [2024-04-15T02:42:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:41:00+00:00, run_id=scheduled__2024-04-15T02:41:00+00:00, run_start_date=2024-04-15 02:42:00.826816+00:00, run_end_date=2024-04-15 02:42:05.905966+00:00, run_duration=5.07915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:41:00+00:00, data_interval_end=2024-04-15 02:42:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:42:05.930408460Z [2024-04-15T02:42:05.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:42:00+00:00, run_after=2024-04-15T02:43:00+00:00 2024-04-15T02:42:05.974837399Z [2024-04-15T02:42:05.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:41:00+00:00 exited with status success for try_number 1 2024-04-15T02:42:05.984595120Z [2024-04-15T02:42:05.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:41:00+00:00, map_index=-1, run_start_date=2024-04-15 02:42:02.759383+00:00, run_end_date=2024-04-15 02:42:04.950020+00:00, run_duration=2.190637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:42:00.899735+00:00, queued_by_job_id=1, pid=16163 2024-04-15T02:43:00.246583115Z [2024-04-15T02:43:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:00.256064069Z [2024-04-15T02:43:00.255+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:43:00.267732561Z [2024-04-15T02:43:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:00.356743685Z [2024-04-15T02:43:00.350+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:43:00.356767301Z 2024-04-15T02:43:00.356771830Z 2024-04-15T02:43:00.356775627Z 2024-04-15T02:43:00.356779436Z [2024-04-15T02:43:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:43:00.356783138Z [2024-04-15T02:43:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:43:00.356786692Z [2024-04-15T02:43:00.351+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:43:00.356790932Z [2024-04-15T02:43:00.352+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:43:00.356794508Z 2024-04-15T02:43:00.356798010Z 2024-04-15T02:43:00.356801711Z 2024-04-15T02:43:00.356805990Z [2024-04-15T02:43:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:43:00.356809966Z [2024-04-15T02:43:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:43:00.356823966Z [2024-04-15T02:43:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:43:00.356827685Z [2024-04-15T02:43:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:43:00.356831232Z [2024-04-15T02:43:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:43:00.356834859Z [2024-04-15T02:43:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:43:00.622151044Z [2024-04-15T02:43:00.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status queued for try_number 1 2024-04-15T02:43:00.622179087Z [2024-04-15T02:43:00.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status queued for try_number 1 2024-04-15T02:43:00.622249817Z [2024-04-15T02:43:00.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status queued for try_number 1 2024-04-15T02:43:00.628791959Z [2024-04-15T02:43:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93061a18-df26-43b8-85c1-7474fae8ba6d 2024-04-15T02:43:00.628831053Z [2024-04-15T02:43:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99d62d09-ee28-4a2c-a3ec-967aea59f154 2024-04-15T02:43:00.628973911Z [2024-04-15T02:43:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e18830c-b65c-4361-9693-158102780218 2024-04-15T02:43:01.808280686Z [2024-04-15T02:43:01.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:43:01.808982390Z [2024-04-15T02:43:01.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:42:00+00:00, run_id=scheduled__2024-04-15T02:42:00+00:00, run_start_date=2024-04-15 02:43:00.280691+00:00, run_end_date=2024-04-15 02:43:01.808192+00:00, run_duration=1.527501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:42:00+00:00, data_interval_end=2024-04-15 02:43:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:43:01.830101475Z [2024-04-15T02:43:01.829+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:01.873747279Z [2024-04-15T02:43:01.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status success for try_number 1 2024-04-15T02:43:01.879535395Z [2024-04-15T02:43:01.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:42:00+00:00, map_index=-1, run_start_date=2024-04-15 02:43:01.080813+00:00, run_end_date=2024-04-15 02:43:01.487883+00:00, run_duration=0.40707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:43:00.353067+00:00, queued_by_job_id=1, pid=16196 2024-04-15T02:43:04.046935057Z [2024-04-15T02:43:04.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:43:04.047247950Z [2024-04-15T02:43:04.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:42:00+00:00, run_id=scheduled__2024-04-15T02:42:00+00:00, run_start_date=2024-04-15 02:43:00.281984+00:00, run_end_date=2024-04-15 02:43:04.046836+00:00, run_duration=3.764852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:42:00+00:00, data_interval_end=2024-04-15 02:43:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:43:04.055847030Z [2024-04-15T02:43:04.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:04.061006179Z [2024-04-15T02:43:04.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:43:04.061281627Z [2024-04-15T02:43:04.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:42:00+00:00, run_id=scheduled__2024-04-15T02:42:00+00:00, run_start_date=2024-04-15 02:43:00.283031+00:00, run_end_date=2024-04-15 02:43:04.060907+00:00, run_duration=3.777876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:42:00+00:00, data_interval_end=2024-04-15 02:43:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:43:04.069168613Z [2024-04-15T02:43:04.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:43:00+00:00, run_after=2024-04-15T02:44:00+00:00 2024-04-15T02:43:04.109727127Z [2024-04-15T02:43:04.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status success for try_number 1 2024-04-15T02:43:04.110107202Z [2024-04-15T02:43:04.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status success for try_number 1 2024-04-15T02:43:04.120081053Z [2024-04-15T02:43:04.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:42:00+00:00, map_index=-1, run_start_date=2024-04-15 02:43:01.995551+00:00, run_end_date=2024-04-15 02:43:03.418663+00:00, run_duration=1.423112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:43:00.353067+00:00, queued_by_job_id=1, pid=16214 2024-04-15T02:43:04.120502400Z [2024-04-15T02:43:04.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:42:00+00:00, map_index=-1, run_start_date=2024-04-15 02:43:02.023895+00:00, run_end_date=2024-04-15 02:43:03.622236+00:00, run_duration=1.598341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:43:00.353067+00:00, queued_by_job_id=1, pid=16215 2024-04-15T02:44:00.465862884Z [2024-04-15T02:44:00.465+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:00.476686950Z [2024-04-15T02:44:00.476+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:44:00.491668466Z [2024-04-15T02:44:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:00.501661330Z [2024-04-15T02:44:00.501+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:44:00.619706477Z [2024-04-15T02:44:00.619+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:44:00.619750446Z 2024-04-15T02:44:00.619761287Z 2024-04-15T02:44:00.619770225Z 2024-04-15T02:44:00.619779171Z 2024-04-15T02:44:00.620328349Z [2024-04-15T02:44:00.619+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:44:00.620350330Z [2024-04-15T02:44:00.619+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:44:00.620358165Z [2024-04-15T02:44:00.620+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:44:00.620364819Z [2024-04-15T02:44:00.620+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:44:00.620922165Z [2024-04-15T02:44:00.620+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:44:00.620944644Z 2024-04-15T02:44:00.620950430Z 2024-04-15T02:44:00.620954863Z 2024-04-15T02:44:00.620959343Z 2024-04-15T02:44:00.624518142Z [2024-04-15T02:44:00.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:44:00.624778496Z [2024-04-15T02:44:00.624+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:44:00.625376830Z [2024-04-15T02:44:00.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:44:00.625390745Z [2024-04-15T02:44:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:44:00.625562779Z [2024-04-15T02:44:00.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:44:00.625772539Z [2024-04-15T02:44:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:44:00.626049710Z [2024-04-15T02:44:00.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:44:00.626228522Z [2024-04-15T02:44:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:44:00.906119736Z [2024-04-15T02:44:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status queued for try_number 1 2024-04-15T02:44:00.906411905Z [2024-04-15T02:44:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status queued for try_number 1 2024-04-15T02:44:00.906506464Z [2024-04-15T02:44:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status queued for try_number 1 2024-04-15T02:44:00.906662043Z [2024-04-15T02:44:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status queued for try_number 1 2024-04-15T02:44:00.920718593Z [2024-04-15T02:44:00.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ef8fe99-4b02-4e68-9d1f-2ccf2b408bb7 2024-04-15T02:44:00.923431683Z [2024-04-15T02:44:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c8d1e41-4e10-4708-9481-bbe6809394a1 2024-04-15T02:44:00.923635966Z [2024-04-15T02:44:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to d39c1fbc-53d6-4565-a12e-3e53d3cea2e3 2024-04-15T02:44:00.923813625Z [2024-04-15T02:44:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6c92f58-9986-40e6-a66b-eb55a9878bce 2024-04-15T02:44:01.723627095Z [2024-04-15T02:44:01.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:44:01.723949781Z [2024-04-15T02:44:01.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:42:00+00:00, run_id=scheduled__2024-04-15T02:42:00+00:00, run_start_date=2024-04-15 02:44:00.512970+00:00, run_end_date=2024-04-15 02:44:01.723471+00:00, run_duration=1.210501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:42:00+00:00, data_interval_end=2024-04-15 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:44:01.739007417Z [2024-04-15T02:44:01.738+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:44:02.851013008Z [2024-04-15T02:44:02.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:44:02.851035296Z [2024-04-15T02:44:02.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:43:00+00:00, run_id=scheduled__2024-04-15T02:43:00+00:00, run_start_date=2024-04-15 02:44:00.514099+00:00, run_end_date=2024-04-15 02:44:02.848637+00:00, run_duration=2.334538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:43:00+00:00, data_interval_end=2024-04-15 02:44:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:44:02.865206397Z [2024-04-15T02:44:02.857+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:02.912313446Z [2024-04-15T02:44:02.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:42:00+00:00 exited with status success for try_number 1 2024-04-15T02:44:02.912698192Z [2024-04-15T02:44:02.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status success for try_number 1 2024-04-15T02:44:02.919815640Z [2024-04-15T02:44:02.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:42:00+00:00, map_index=-1, run_start_date=2024-04-15 02:44:01.321501+00:00, run_end_date=2024-04-15 02:44:01.677612+00:00, run_duration=0.356111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:44:00.621699+00:00, queued_by_job_id=1, pid=16248 2024-04-15T02:44:02.919829302Z [2024-04-15T02:44:02.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:43:00+00:00, map_index=-1, run_start_date=2024-04-15 02:44:01.458546+00:00, run_end_date=2024-04-15 02:44:01.915751+00:00, run_duration=0.457205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:44:00.621699+00:00, queued_by_job_id=1, pid=16249 2024-04-15T02:44:03.969504032Z [2024-04-15T02:44:03.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:44:03.969728491Z [2024-04-15T02:44:03.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:43:00+00:00, run_id=scheduled__2024-04-15T02:43:00+00:00, run_start_date=2024-04-15 02:44:00.515169+00:00, run_end_date=2024-04-15 02:44:03.969345+00:00, run_duration=3.454176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:43:00+00:00, data_interval_end=2024-04-15 02:44:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:44:03.981613779Z [2024-04-15T02:44:03.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:04.044769708Z [2024-04-15T02:44:04.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status success for try_number 1 2024-04-15T02:44:04.051982632Z [2024-04-15T02:44:04.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:43:00+00:00, map_index=-1, run_start_date=2024-04-15 02:44:02.500677+00:00, run_end_date=2024-04-15 02:44:03.761782+00:00, run_duration=1.261105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:44:00.621699+00:00, queued_by_job_id=1, pid=16273 2024-04-15T02:44:06.216566223Z [2024-04-15T02:44:06.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:44:06.217092539Z [2024-04-15T02:44:06.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:43:00+00:00, run_id=scheduled__2024-04-15T02:43:00+00:00, run_start_date=2024-04-15 02:44:00.516208+00:00, run_end_date=2024-04-15 02:44:06.216426+00:00, run_duration=5.700218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:43:00+00:00, data_interval_end=2024-04-15 02:44:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:44:06.227361134Z [2024-04-15T02:44:06.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:44:00+00:00, run_after=2024-04-15T02:45:00+00:00 2024-04-15T02:44:06.276327616Z [2024-04-15T02:44:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:43:00+00:00 exited with status success for try_number 1 2024-04-15T02:44:06.287285367Z [2024-04-15T02:44:06.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:43:00+00:00, map_index=-1, run_start_date=2024-04-15 02:44:02.455250+00:00, run_end_date=2024-04-15 02:44:05.214285+00:00, run_duration=2.759035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:44:00.621699+00:00, queued_by_job_id=1, pid=16272 2024-04-15T02:45:00.749164628Z [2024-04-15T02:45:00.748+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:00.764305972Z [2024-04-15T02:45:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:45:00.772533186Z [2024-04-15T02:45:00.772+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:45:00.785294921Z [2024-04-15T02:45:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:00.883849193Z [2024-04-15T02:45:00.883+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:45:00.883890447Z 2024-04-15T02:45:00.883901429Z 2024-04-15T02:45:00.883910172Z 2024-04-15T02:45:00.883918794Z 2024-04-15T02:45:00.884160503Z [2024-04-15T02:45:00.883+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:45:00.884521157Z [2024-04-15T02:45:00.884+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:45:00.884858115Z [2024-04-15T02:45:00.884+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:45:00.885701279Z [2024-04-15T02:45:00.884+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:45:00.886486473Z [2024-04-15T02:45:00.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:00.886506758Z 2024-04-15T02:45:00.886516569Z 2024-04-15T02:45:00.886525240Z 2024-04-15T02:45:00.886533755Z 2024-04-15T02:45:00.894231917Z [2024-04-15T02:45:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-15T02:45:00.894571859Z [2024-04-15T02:45:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:00.895052578Z [2024-04-15T02:45:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:45:00.895324663Z [2024-04-15T02:45:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:45:00.895859624Z [2024-04-15T02:45:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:45:00.896146767Z [2024-04-15T02:45:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:45:00.896573235Z [2024-04-15T02:45:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:45:00.896836227Z [2024-04-15T02:45:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:45:01.222562791Z [2024-04-15T02:45:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:01.222605492Z [2024-04-15T02:45:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:01.222677544Z [2024-04-15T02:45:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:01.222730745Z [2024-04-15T02:45:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:01.231468266Z [2024-04-15T02:45:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd56cae4-a4ce-458d-9425-0ec9f51e3b45 2024-04-15T02:45:01.231525580Z [2024-04-15T02:45:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47abbd22-4c50-45ab-b1c3-63927815f309 2024-04-15T02:45:01.231647335Z [2024-04-15T02:45:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39cd176e-eae7-4567-bcdf-0d55d774c2b3 2024-04-15T02:45:01.231723376Z [2024-04-15T02:45:01.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4383309b-1a45-447f-80cd-55f163361d52 2024-04-15T02:45:02.388145022Z [2024-04-15T02:45:02.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:45:02.388351517Z [2024-04-15T02:45:02.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:44:00+00:00, run_id=scheduled__2024-04-15T02:44:00+00:00, run_start_date=2024-04-15 02:45:00.799750+00:00, run_end_date=2024-04-15 02:45:02.388048+00:00, run_duration=1.588298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:44:00+00:00, data_interval_end=2024-04-15 02:45:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:45:02.397589982Z [2024-04-15T02:45:02.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:02.773860850Z [2024-04-15T02:45:02.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:02.782730688Z [2024-04-15T02:45:02.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:44:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:01.864867+00:00, run_end_date=2024-04-15 02:45:02.352449+00:00, run_duration=0.487582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:00.888597+00:00, queued_by_job_id=1, pid=16306 2024-04-15T02:45:03.897910204Z [2024-04-15T02:45:03.897+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:45:03.897942526Z 2024-04-15T02:45:03.897956903Z [2024-04-15T02:45:03.897+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:45:03.898772659Z [2024-04-15T02:45:03.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:03.898788196Z 2024-04-15T02:45:03.906616121Z [2024-04-15T02:45:03.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='split_metrics', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-15T02:45:03.907025015Z [2024-04-15T02:45:03.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'split_metrics', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:03.975554153Z [2024-04-15T02:45:03.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:03.975644422Z [2024-04-15T02:45:03.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.extract_metrics_from_vnfrs run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:03.990796233Z [2024-04-15T02:45:03.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to dba70f96-a4f5-4ae2-accd-4a2f3a28eb35 2024-04-15T02:45:03.991093725Z [2024-04-15T02:45:03.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:02.579574+00:00, run_end_date=2024-04-15 02:45:02.929010+00:00, run_duration=0.349436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:00.888597+00:00, queued_by_job_id=1, pid=16330 2024-04-15T02:45:04.057714801Z [2024-04-15T02:45:04.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:45:04.057840558Z [2024-04-15T02:45:04.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:44:00+00:00, run_id=scheduled__2024-04-15T02:44:00+00:00, run_start_date=2024-04-15 02:45:00.800845+00:00, run_end_date=2024-04-15 02:45:04.057559+00:00, run_duration=3.256714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:44:00+00:00, data_interval_end=2024-04-15 02:45:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:45:04.070561927Z [2024-04-15T02:45:04.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:04.113095481Z [2024-04-15T02:45:04.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:04.121644513Z [2024-04-15T02:45:04.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:44:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:02.658189+00:00, run_end_date=2024-04-15 02:45:03.873763+00:00, run_duration=1.215574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:00.888597+00:00, queued_by_job_id=1, pid=16331 2024-04-15T02:45:05.178154081Z [2024-04-15T02:45:05.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:45:05.178464729Z [2024-04-15T02:45:05.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:44:00+00:00, run_id=scheduled__2024-04-15T02:44:00+00:00, run_start_date=2024-04-15 02:45:00.801937+00:00, run_end_date=2024-04-15 02:45:05.177923+00:00, run_duration=4.375986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:44:00+00:00, data_interval_end=2024-04-15 02:45:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:45:05.185810139Z [2024-04-15T02:45:05.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:46:00+00:00 2024-04-15T02:45:05.226545954Z [2024-04-15T02:45:05.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:05.239838714Z [2024-04-15T02:45:05.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:44:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:02.735832+00:00, run_end_date=2024-04-15 02:45:04.238719+00:00, run_duration=1.502887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:00.888597+00:00, queued_by_job_id=1, pid=16332 2024-04-15T02:45:06.324987913Z [2024-04-15T02:45:06.324+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:45:06.325052416Z 2024-04-15T02:45:06.325065366Z [2024-04-15T02:45:06.324+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:45:06.325734500Z [2024-04-15T02:45:06.325+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:06.325759950Z 2024-04-15T02:45:06.328739605Z [2024-04-15T02:45:06.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='collect_metrics', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-15T02:45:06.328778370Z [2024-04-15T02:45:06.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'collect_metrics', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:45:06.399194355Z [2024-04-15T02:45:06.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:06.399344424Z [2024-04-15T02:45:06.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.split_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:06.416305642Z [2024-04-15T02:45:06.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6a6c489-8b5a-42cf-9b74-5e2dcd1833d4 2024-04-15T02:45:06.416542737Z [2024-04-15T02:45:06.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=split_metrics, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:05.554937+00:00, run_end_date=2024-04-15 02:45:05.921399+00:00, run_duration=0.366462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:03.903518+00:00, queued_by_job_id=1, pid=16355 2024-04-15T02:45:09.015577900Z [2024-04-15T02:45:09.015+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-15T02:45:09.015615947Z 2024-04-15T02:45:09.015861220Z [2024-04-15T02:45:09.015+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:45:09.016648295Z [2024-04-15T02:45:09.016+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:45:09.016665286Z 2024-04-15T02:45:09.019458538Z [2024-04-15T02:45:09.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='send_prometheus', run_id='scheduled__2024-04-15T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:45:09.019745732Z [2024-04-15T02:45:09.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'send_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:09.094573825Z [2024-04-15T02:45:09.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status queued for try_number 1 2024-04-15T02:45:09.096513514Z [2024-04-15T02:45:09.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.collect_metrics run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:09.107636610Z [2024-04-15T02:45:09.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4a59cc9-c5d5-4749-ae7e-109fd313936d 2024-04-15T02:45:09.108028704Z [2024-04-15T02:45:09.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=collect_metrics, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=0, run_start_date=2024-04-15 02:45:08.101857+00:00, run_end_date=2024-04-15 02:45:08.456922+00:00, run_duration=0.355065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:06.326162+00:00, queued_by_job_id=1, pid=16363 2024-04-15T02:45:11.691303576Z [2024-04-15T02:45:11.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:45:11.692255289Z [2024-04-15T02:45:11.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:40:00+00:00, run_id=scheduled__2024-04-15T02:40:00+00:00, run_start_date=2024-04-15 02:45:00.798290+00:00, run_end_date=2024-04-15 02:45:11.691437+00:00, run_duration=10.893147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:40:00+00:00, data_interval_end=2024-04-15 02:45:00+00:00, dag_hash=9aa0980e685397e335ef2428222cfe05 2024-04-15T02:45:11.707049700Z [2024-04-15T02:45:11.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:45:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:45:11.755231816Z [2024-04-15T02:45:11.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.send_prometheus run_id=scheduled__2024-04-15T02:40:00+00:00 exited with status success for try_number 1 2024-04-15T02:45:11.762393144Z [2024-04-15T02:45:11.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=send_prometheus, run_id=scheduled__2024-04-15T02:40:00+00:00, map_index=-1, run_start_date=2024-04-15 02:45:10.673779+00:00, run_end_date=2024-04-15 02:45:11.072397+00:00, run_duration=0.398618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:45:09.017083+00:00, queued_by_job_id=1, pid=16371 2024-04-15T02:46:00.991950531Z [2024-04-15T02:46:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:01.010361790Z [2024-04-15T02:46:01.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:01.017993922Z [2024-04-15T02:46:01.017+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:46:01.026604347Z [2024-04-15T02:46:01.026+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:46:01.147089441Z [2024-04-15T02:46:01.146+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:46:01.147133190Z 2024-04-15T02:46:01.147170771Z 2024-04-15T02:46:01.147181647Z 2024-04-15T02:46:01.147191699Z 2024-04-15T02:46:01.147292530Z [2024-04-15T02:46:01.146+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:46:01.147734575Z [2024-04-15T02:46:01.147+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:46:01.148215046Z [2024-04-15T02:46:01.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:46:01.148709109Z [2024-04-15T02:46:01.148+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:46:01.151191085Z [2024-04-15T02:46:01.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:46:01.151216598Z 2024-04-15T02:46:01.151226414Z 2024-04-15T02:46:01.151235023Z 2024-04-15T02:46:01.151243546Z 2024-04-15T02:46:01.161935045Z [2024-04-15T02:46:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:46:01.162093934Z [2024-04-15T02:46:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:46:01.162367823Z [2024-04-15T02:46:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:46:01.162456844Z [2024-04-15T02:46:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:46:01.162777021Z [2024-04-15T02:46:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:46:01.162910024Z [2024-04-15T02:46:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:46:01.163240424Z [2024-04-15T02:46:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:46:01.163470505Z [2024-04-15T02:46:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:46:01.769778810Z [2024-04-15T02:46:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status queued for try_number 1 2024-04-15T02:46:01.769943776Z [2024-04-15T02:46:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:46:01.770143173Z [2024-04-15T02:46:01.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:46:01.770281170Z [2024-04-15T02:46:01.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status queued for try_number 1 2024-04-15T02:46:01.786257888Z [2024-04-15T02:46:01.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c04c5a5-795d-4dbb-9bbf-92b66f288c6f 2024-04-15T02:46:01.786463108Z [2024-04-15T02:46:01.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16e51cf1-1f40-4a65-9ed3-732f007ae4ea 2024-04-15T02:46:01.786774114Z [2024-04-15T02:46:01.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fb5499e-029a-4276-9916-01d66bfc0d88 2024-04-15T02:46:01.787135168Z [2024-04-15T02:46:01.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72440c62-a8a4-4dd0-a265-92c5b8c4ba09 2024-04-15T02:46:02.925732051Z [2024-04-15T02:46:02.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:46:02.926061408Z [2024-04-15T02:46:02.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:44:00+00:00, run_id=scheduled__2024-04-15T02:44:00+00:00, run_start_date=2024-04-15 02:46:01.041356+00:00, run_end_date=2024-04-15 02:46:02.925695+00:00, run_duration=1.884339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:44:00+00:00, data_interval_end=2024-04-15 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:46:02.932628357Z [2024-04-15T02:46:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:46:02.937764562Z [2024-04-15T02:46:02.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:46:02.938096518Z [2024-04-15T02:46:02.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:45:00+00:00, run_id=scheduled__2024-04-15T02:45:00+00:00, run_start_date=2024-04-15 02:46:01.042925+00:00, run_end_date=2024-04-15 02:46:02.937698+00:00, run_duration=1.894773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:45:00+00:00, data_interval_end=2024-04-15 02:46:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:46:02.948470422Z [2024-04-15T02:46:02.948+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:03.006176205Z [2024-04-15T02:46:03.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:44:00+00:00 exited with status success for try_number 1 2024-04-15T02:46:03.009521650Z [2024-04-15T02:46:03.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:46:03.017378950Z [2024-04-15T02:46:03.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:44:00+00:00, map_index=-1, run_start_date=2024-04-15 02:46:01.810275+00:00, run_end_date=2024-04-15 02:46:02.131024+00:00, run_duration=0.320749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:46:01.156507+00:00, queued_by_job_id=1, pid=16395 2024-04-15T02:46:03.017634295Z [2024-04-15T02:46:03.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:46:02.048034+00:00, run_end_date=2024-04-15 02:46:02.389771+00:00, run_duration=0.341737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:46:01.156507+00:00, queued_by_job_id=1, pid=16396 2024-04-15T02:46:04.987458326Z [2024-04-15T02:46:04.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:46:04.987914310Z [2024-04-15T02:46:04.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:45:00+00:00, run_id=scheduled__2024-04-15T02:45:00+00:00, run_start_date=2024-04-15 02:46:01.044355+00:00, run_end_date=2024-04-15 02:46:04.987204+00:00, run_duration=3.942849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:45:00+00:00, data_interval_end=2024-04-15 02:46:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:46:05.013443742Z [2024-04-15T02:46:05.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:05.021951701Z [2024-04-15T02:46:05.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:46:05.022334860Z [2024-04-15T02:46:05.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:45:00+00:00, run_id=scheduled__2024-04-15T02:45:00+00:00, run_start_date=2024-04-15 02:46:01.045891+00:00, run_end_date=2024-04-15 02:46:05.021875+00:00, run_duration=3.975984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:45:00+00:00, data_interval_end=2024-04-15 02:46:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:46:05.030595068Z [2024-04-15T02:46:05.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:46:00+00:00, run_after=2024-04-15T02:47:00+00:00 2024-04-15T02:46:05.068549144Z [2024-04-15T02:46:05.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:46:05.069088791Z [2024-04-15T02:46:05.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:45:00+00:00 exited with status success for try_number 1 2024-04-15T02:46:05.080509022Z [2024-04-15T02:46:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:46:02.843773+00:00, run_end_date=2024-04-15 02:46:04.588358+00:00, run_duration=1.744585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:46:01.156507+00:00, queued_by_job_id=1, pid=16420 2024-04-15T02:46:05.081145859Z [2024-04-15T02:46:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:45:00+00:00, map_index=-1, run_start_date=2024-04-15 02:46:02.786454+00:00, run_end_date=2024-04-15 02:46:04.182532+00:00, run_duration=1.396078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:46:01.156507+00:00, queued_by_job_id=1, pid=16419 2024-04-15T02:46:05.999656868Z [2024-04-15T02:46:05.998+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-15T02:47:00.173200832Z [2024-04-15T02:47:00.172+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:47:00.188333772Z [2024-04-15T02:47:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:00.215221735Z [2024-04-15T02:47:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:00.297577309Z [2024-04-15T02:47:00.297+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-15T02:47:00.297621372Z 2024-04-15T02:47:00.297657378Z 2024-04-15T02:47:00.297666723Z 2024-04-15T02:47:00.297716403Z [2024-04-15T02:47:00.297+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:47:00.297983359Z [2024-04-15T02:47:00.297+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:47:00.298183987Z [2024-04-15T02:47:00.297+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:47:00.299109635Z [2024-04-15T02:47:00.298+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:47:00.299125743Z 2024-04-15T02:47:00.299134501Z 2024-04-15T02:47:00.299143549Z 2024-04-15T02:47:00.304891119Z [2024-04-15T02:47:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:47:00.305108354Z [2024-04-15T02:47:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:47:00.305411222Z [2024-04-15T02:47:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:47:00.305579789Z [2024-04-15T02:47:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:47:00.305952998Z [2024-04-15T02:47:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:47:00.306161224Z [2024-04-15T02:47:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:47:00.637578288Z [2024-04-15T02:47:00.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status queued for try_number 1 2024-04-15T02:47:00.637808828Z [2024-04-15T02:47:00.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status queued for try_number 1 2024-04-15T02:47:00.637952109Z [2024-04-15T02:47:00.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status queued for try_number 1 2024-04-15T02:47:00.648118476Z [2024-04-15T02:47:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c52c1ac-c295-41d7-9e21-cd7b1e07333f 2024-04-15T02:47:00.648310206Z [2024-04-15T02:47:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef63ae42-5048-4b25-a494-e3d72e9d0bf1 2024-04-15T02:47:00.648487251Z [2024-04-15T02:47:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5401d01-cfdc-4ada-9362-b5f4bb391557 2024-04-15T02:47:01.812365369Z [2024-04-15T02:47:01.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:47:01.812727471Z [2024-04-15T02:47:01.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:46:00+00:00, run_id=scheduled__2024-04-15T02:46:00+00:00, run_start_date=2024-04-15 02:47:00.230420+00:00, run_end_date=2024-04-15 02:47:01.812300+00:00, run_duration=1.58188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:46:00+00:00, data_interval_end=2024-04-15 02:47:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:47:01.820693148Z [2024-04-15T02:47:01.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:01.856740508Z [2024-04-15T02:47:01.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status success for try_number 1 2024-04-15T02:47:01.862384093Z [2024-04-15T02:47:01.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:46:00+00:00, map_index=-1, run_start_date=2024-04-15 02:47:01.054530+00:00, run_end_date=2024-04-15 02:47:01.407669+00:00, run_duration=0.353139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:47:00.300200+00:00, queued_by_job_id=1, pid=16453 2024-04-15T02:47:04.034510915Z [2024-04-15T02:47:04.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:47:04.034776877Z [2024-04-15T02:47:04.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:46:00+00:00, run_id=scheduled__2024-04-15T02:46:00+00:00, run_start_date=2024-04-15 02:47:00.231980+00:00, run_end_date=2024-04-15 02:47:04.034457+00:00, run_duration=3.802477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:46:00+00:00, data_interval_end=2024-04-15 02:47:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:47:04.050031456Z [2024-04-15T02:47:04.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:04.059136129Z [2024-04-15T02:47:04.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:47:04.060114878Z [2024-04-15T02:47:04.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:46:00+00:00, run_id=scheduled__2024-04-15T02:46:00+00:00, run_start_date=2024-04-15 02:47:00.233283+00:00, run_end_date=2024-04-15 02:47:04.059327+00:00, run_duration=3.826044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:46:00+00:00, data_interval_end=2024-04-15 02:47:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:47:04.079548846Z [2024-04-15T02:47:04.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:47:00+00:00, run_after=2024-04-15T02:48:00+00:00 2024-04-15T02:47:04.122244456Z [2024-04-15T02:47:04.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status success for try_number 1 2024-04-15T02:47:04.122717283Z [2024-04-15T02:47:04.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status success for try_number 1 2024-04-15T02:47:04.134542637Z [2024-04-15T02:47:04.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:46:00+00:00, map_index=-1, run_start_date=2024-04-15 02:47:01.917341+00:00, run_end_date=2024-04-15 02:47:03.160007+00:00, run_duration=1.242666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:47:00.300200+00:00, queued_by_job_id=1, pid=16471 2024-04-15T02:47:04.135323510Z [2024-04-15T02:47:04.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:46:00+00:00, map_index=-1, run_start_date=2024-04-15 02:47:01.921711+00:00, run_end_date=2024-04-15 02:47:03.509304+00:00, run_duration=1.587593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:47:00.300200+00:00, queued_by_job_id=1, pid=16472 2024-04-15T02:48:00.537804585Z [2024-04-15T02:48:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:00.546070911Z [2024-04-15T02:48:00.545+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:48:00.558164862Z [2024-04-15T02:48:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:00.568093396Z [2024-04-15T02:48:00.564+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-15T02:48:00.648023283Z [2024-04-15T02:48:00.647+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-15T02:48:00.648062786Z 2024-04-15T02:48:00.648073959Z 2024-04-15T02:48:00.648082915Z 2024-04-15T02:48:00.648091991Z 2024-04-15T02:48:00.648527450Z [2024-04-15T02:48:00.648+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-15T02:48:00.649015762Z [2024-04-15T02:48:00.648+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:48:00.649375171Z [2024-04-15T02:48:00.649+0000] {scheduler_job.py:425} INFO - DAG vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 has 0/16 running and queued tasks 2024-04-15T02:48:00.649709841Z [2024-04-15T02:48:00.649+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 has 0/16 running and queued tasks 2024-04-15T02:48:00.650812410Z [2024-04-15T02:48:00.650+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-15T02:48:00.650822866Z 2024-04-15T02:48:00.650826598Z 2024-04-15T02:48:00.650829696Z 2024-04-15T02:48:00.650832417Z 2024-04-15T02:48:00.658346935Z [2024-04-15T02:48:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-15T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:48:00.658853320Z [2024-04-15T02:48:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:48:00.659571636Z [2024-04-15T02:48:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:48:00.659923027Z [2024-04-15T02:48:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:48:00.660417732Z [2024-04-15T02:48:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:48:00.660655462Z [2024-04-15T02:48:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:48:00.661017524Z [2024-04-15T02:48:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-15T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-15T02:48:00.661274292Z [2024-04-15T02:48:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:48:00.953724867Z [2024-04-15T02:48:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status queued for try_number 1 2024-04-15T02:48:00.954245964Z [2024-04-15T02:48:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status queued for try_number 1 2024-04-15T02:48:00.954472928Z [2024-04-15T02:48:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status queued for try_number 1 2024-04-15T02:48:00.954673606Z [2024-04-15T02:48:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status queued for try_number 1 2024-04-15T02:48:00.971629104Z [2024-04-15T02:48:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa62c146-2e2a-4b3d-9c88-134c3008717b 2024-04-15T02:48:00.972021182Z [2024-04-15T02:48:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaa6b2da-68a8-4233-a12e-72c195bf73e1 2024-04-15T02:48:00.972223319Z [2024-04-15T02:48:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to baa0c6b3-3c46-4e61-af07-f093bc5f6910 2024-04-15T02:48:00.972476526Z [2024-04-15T02:48:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7c8dbbf-4cbc-4f38-8305-03316615e7d3 2024-04-15T02:48:02.188164652Z [2024-04-15T02:48:02.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:48:02.188744293Z [2024-04-15T02:48:02.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-15 02:46:00+00:00, run_id=scheduled__2024-04-15T02:46:00+00:00, run_start_date=2024-04-15 02:48:00.572688+00:00, run_end_date=2024-04-15 02:48:02.188045+00:00, run_duration=1.615357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:46:00+00:00, data_interval_end=2024-04-15 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-15T02:48:02.195989136Z [2024-04-15T02:48:02.195+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:50:00+00:00 2024-04-15T02:48:02.201587992Z [2024-04-15T02:48:02.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:48:02.202102192Z [2024-04-15T02:48:02.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, execution_date=2024-04-15 02:47:00+00:00, run_id=scheduled__2024-04-15T02:47:00+00:00, run_start_date=2024-04-15 02:48:00.573747+00:00, run_end_date=2024-04-15 02:48:02.201805+00:00, run_duration=1.628058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:47:00+00:00, data_interval_end=2024-04-15 02:48:00+00:00, dag_hash=ce6a696bd38724c30ad17c3651f2c03c 2024-04-15T02:48:02.211246276Z [2024-04-15T02:48:02.211+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459 to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:02.251364701Z [2024-04-15T02:48:02.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-15T02:46:00+00:00 exited with status success for try_number 1 2024-04-15T02:48:02.251633273Z [2024-04-15T02:48:02.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status success for try_number 1 2024-04-15T02:48:02.257671793Z [2024-04-15T02:48:02.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_172e2afb-8179-474c-8a5c-ceb888f33459, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:47:00+00:00, map_index=-1, run_start_date=2024-04-15 02:48:01.398938+00:00, run_end_date=2024-04-15 02:48:01.707083+00:00, run_duration=0.308145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:48:00.654156+00:00, queued_by_job_id=1, pid=16507 2024-04-15T02:48:02.258027962Z [2024-04-15T02:48:02.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-15T02:46:00+00:00, map_index=-1, run_start_date=2024-04-15 02:48:01.343436+00:00, run_end_date=2024-04-15 02:48:01.718407+00:00, run_duration=0.374971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:48:00.654156+00:00, queued_by_job_id=1, pid=16506 2024-04-15T02:48:04.436689399Z [2024-04-15T02:48:04.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:48:04.437007750Z [2024-04-15T02:48:04.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:47:00+00:00, run_id=scheduled__2024-04-15T02:47:00+00:00, run_start_date=2024-04-15 02:48:00.574696+00:00, run_end_date=2024-04-15 02:48:04.436579+00:00, run_duration=3.861883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:47:00+00:00, data_interval_end=2024-04-15 02:48:00+00:00, dag_hash=0f47f592773ca6a7fce7dde7da515271 2024-04-15T02:48:04.446930437Z [2024-04-15T02:48:04.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:04.454426313Z [2024-04-15T02:48:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-15T02:48:04.454580388Z [2024-04-15T02:48:04.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, execution_date=2024-04-15 02:47:00+00:00, run_id=scheduled__2024-04-15T02:47:00+00:00, run_start_date=2024-04-15 02:48:00.575649+00:00, run_end_date=2024-04-15 02:48:04.454209+00:00, run_duration=3.87856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-15 02:47:00+00:00, data_interval_end=2024-04-15 02:48:00+00:00, dag_hash=b297840c7ce590f8bbbf6737fb0a02dd 2024-04-15T02:48:04.479384908Z [2024-04-15T02:48:04.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93 to 2024-04-15T02:48:00+00:00, run_after=2024-04-15T02:49:00+00:00 2024-04-15T02:48:04.536456356Z [2024-04-15T02:48:04.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status success for try_number 1 2024-04-15T02:48:04.536865046Z [2024-04-15T02:48:04.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-15T02:47:00+00:00 exited with status success for try_number 1 2024-04-15T02:48:04.546682621Z [2024-04-15T02:48:04.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:47:00+00:00, map_index=-1, run_start_date=2024-04-15 02:48:02.492522+00:00, run_end_date=2024-04-15 02:48:04.137322+00:00, run_duration=1.6448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:48:00.654156+00:00, queued_by_job_id=1, pid=16531 2024-04-15T02:48:04.547085331Z [2024-04-15T02:48:04.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_457ccb38-384c-49f6-ad0a-cfcbbcf50d93, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-15T02:47:00+00:00, map_index=-1, run_start_date=2024-04-15 02:48:02.431929+00:00, run_end_date=2024-04-15 02:48:03.800124+00:00, run_duration=1.368195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-15 02:48:00.654156+00:00, queued_by_job_id=1, pid=16530 2024-04-14T22:30:53.237719034Z 2024-04-14T22:30:53.237749640Z Cleaning logs every 900 seconds 2024-04-14T22:30:53.237759827Z Trimming airflow logs to 15 days. 2024-04-14T22:45:00.286131606Z Trimming airflow logs to 15 days. 2024-04-14T22:45:01.319596665Z Trimming airflow logs to 15 days. 2024-04-14T23:00:00.382980456Z Trimming airflow logs to 15 days. 2024-04-14T23:00:01.419634546Z Trimming airflow logs to 15 days. 2024-04-14T23:15:00.470097542Z Trimming airflow logs to 15 days. 2024-04-14T23:15:01.491660032Z Trimming airflow logs to 15 days. 2024-04-14T23:30:00.528140406Z Trimming airflow logs to 15 days. 2024-04-14T23:30:01.550213843Z Trimming airflow logs to 15 days. 2024-04-14T23:45:00.596812680Z Trimming airflow logs to 15 days. 2024-04-14T23:45:01.628404985Z Trimming airflow logs to 15 days. 2024-04-15T00:00:00.671542551Z Trimming airflow logs to 15 days. 2024-04-15T00:00:01.699102458Z Trimming airflow logs to 15 days. 2024-04-15T00:15:00.737867394Z Trimming airflow logs to 15 days. 2024-04-15T00:15:01.771366868Z Trimming airflow logs to 15 days. 2024-04-15T00:30:00.806976347Z Trimming airflow logs to 15 days. 2024-04-15T00:30:01.844486905Z Trimming airflow logs to 15 days. 2024-04-15T00:45:00.880571581Z Trimming airflow logs to 15 days. 2024-04-15T00:45:01.917324912Z Trimming airflow logs to 15 days. 2024-04-15T01:00:00.942968499Z Trimming airflow logs to 15 days. 2024-04-15T01:00:01.972183718Z Trimming airflow logs to 15 days. 2024-04-15T01:15:01.003451685Z Trimming airflow logs to 15 days. 2024-04-15T01:30:00.022356257Z Trimming airflow logs to 15 days. 2024-04-15T01:30:01.052481272Z Trimming airflow logs to 15 days. 2024-04-15T01:45:00.086675226Z Trimming airflow logs to 15 days. 2024-04-15T01:45:01.116909003Z Trimming airflow logs to 15 days. 2024-04-15T02:00:00.157131324Z Trimming airflow logs to 15 days. 2024-04-15T02:00:01.180189472Z Trimming airflow logs to 15 days. 2024-04-15T02:15:00.224148094Z Trimming airflow logs to 15 days. 2024-04-15T02:15:01.255511038Z Trimming airflow logs to 15 days. 2024-04-15T02:30:00.281179900Z Trimming airflow logs to 15 days. 2024-04-15T02:30:01.324078192Z Trimming airflow logs to 15 days. 2024-04-15T02:45:00.371225343Z Trimming airflow logs to 15 days. 2024-04-15T02:45:01.395429413Z Trimming airflow logs to 15 days.