2024-05-25T22:37:57.744460136Z ... 2024-05-25T22:37:58.717006676Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-25T22:38:00.071039654Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-25T22:38:04.650896920Z [2024-05-25T22:38:04.645+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-05-25T22:38:05.673840723Z [2024-05-25T22:38:05.659+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-05-25T22:38:21.179894415Z 2024-05-25T22:38:22.152993915Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-25T22:38:23.145360852Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-25T22:38:28.825147249Z ____________ _____________ 2024-05-25T22:38:28.825164548Z ____ |__( )_________ __/__ /________ __ 2024-05-25T22:38:28.825170409Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-05-25T22:38:28.825173624Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-05-25T22:38:28.825176696Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-05-25T22:38:28.825180147Z [2024-05-25T22:38:28.824+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-05-25T22:38:28.825379400Z [2024-05-25T22:38:28.824+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-05-25T22:38:29.303633385Z [2024-05-25T22:38:29.300+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-05-25T22:38:29.330730429Z [2024-05-25T22:38:29.325+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-05-25T22:38:29.332014283Z [2024-05-25T22:38:29.313+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 16 2024-05-25T22:38:29.334837764Z [2024-05-25T22:38:29.334+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-05-25T22:38:29.335931739Z [2024-05-25T22:38:29.335+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T22:39:31.625834375Z [2024-05-25T22:39:31.624+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:39:31.739665637Z [2024-05-25T22:39:31.736+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:39:31.739680429Z 2024-05-25T22:39:31.739684086Z [2024-05-25T22:39:31.737+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:39:31.739690354Z [2024-05-25T22:39:31.737+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:39:31.739693433Z 2024-05-25T22:39:31.744186646Z [2024-05-25T22:39:31.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:39:31.744202406Z [2024-05-25T22:39:31.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:39:32.050106687Z [2024-05-25T22:39:32.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:36:00+00:00 exited with status queued for try_number 1 2024-05-25T22:39:32.084118661Z [2024-05-25T22:39:32.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23b57efe-29eb-4b2f-bc61-de36723ee355 2024-05-25T22:40:04.470582905Z [2024-05-25T22:40:04.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:36:00+00:00 exited with status success for try_number 1 2024-05-25T22:40:04.475908881Z [2024-05-25T22:40:04.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:36:00+00:00, map_index=-1, run_start_date=2024-05-25 22:39:33.184762+00:00, run_end_date=2024-05-25 22:40:03.701818+00:00, run_duration=30.517056, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:39:31.738188+00:00, queued_by_job_id=1, pid=49 2024-05-25T22:40:14.544375258Z [2024-05-25T22:40:14.544+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:40:14.544414394Z 2024-05-25T22:40:14.544664169Z [2024-05-25T22:40:14.544+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:40:14.545457309Z [2024-05-25T22:40:14.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:40:14.545470132Z 2024-05-25T22:40:14.547466445Z [2024-05-25T22:40:14.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:36:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:40:14.547683911Z [2024-05-25T22:40:14.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:40:14.594606007Z [2024-05-25T22:40:14.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:36:00+00:00 exited with status queued for try_number 2 2024-05-25T22:40:14.598994754Z [2024-05-25T22:40:14.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8274070f-4aa6-4c6f-9e17-2011ee4938be 2024-05-25T22:40:46.634857635Z [2024-05-25T22:40:46.633+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T22:40:46.635375792Z [2024-05-25T22:40:46.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:36:00+00:00, run_id=scheduled__2024-05-25T22:36:00+00:00, run_start_date=2024-05-25 22:39:31.645274+00:00, run_end_date=2024-05-25 22:40:46.634860+00:00, run_duration=74.989586, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:36:00+00:00, data_interval_end=2024-05-25 22:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:40:46.648128855Z [2024-05-25T22:40:46.647+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:38:00+00:00, run_after=2024-05-25T22:40:00+00:00 2024-05-25T22:40:46.688081571Z [2024-05-25T22:40:46.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:36:00+00:00 exited with status success for try_number 2 2024-05-25T22:40:46.696149948Z [2024-05-25T22:40:46.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:36:00+00:00, map_index=-1, run_start_date=2024-05-25 22:40:15.353622+00:00, run_end_date=2024-05-25 22:40:45.742588+00:00, run_duration=30.388966, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:40:14.545838+00:00, queued_by_job_id=1, pid=63 2024-05-25T22:40:46.969638817Z [2024-05-25T22:40:46.969+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:40:47.006112349Z [2024-05-25T22:40:47.005+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:40:47.006142226Z 2024-05-25T22:40:47.006267064Z [2024-05-25T22:40:47.006+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:40:47.006820647Z [2024-05-25T22:40:47.006+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:40:47.006826642Z 2024-05-25T22:40:47.009030400Z [2024-05-25T22:40:47.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:40:47.009181805Z [2024-05-25T22:40:47.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:40:47.065679278Z [2024-05-25T22:40:47.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:38:00+00:00 exited with status queued for try_number 1 2024-05-25T22:40:47.071944365Z [2024-05-25T22:40:47.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16751614-a895-4aeb-b08d-c2d4691ae8a1 2024-05-25T22:41:18.842502874Z [2024-05-25T22:41:18.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:38:00+00:00 exited with status success for try_number 1 2024-05-25T22:41:18.847823080Z [2024-05-25T22:41:18.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:38:00+00:00, map_index=-1, run_start_date=2024-05-25 22:40:47.628165+00:00, run_end_date=2024-05-25 22:41:18.021233+00:00, run_duration=30.393068, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:40:47.007157+00:00, queued_by_job_id=1, pid=71 2024-05-25T22:41:28.995878563Z [2024-05-25T22:41:28.994+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:41:28.995919123Z 2024-05-25T22:41:28.995937794Z [2024-05-25T22:41:28.995+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:41:28.997002953Z [2024-05-25T22:41:28.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:41:28.997012884Z 2024-05-25T22:41:28.999487344Z [2024-05-25T22:41:28.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:38:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:41:28.999652999Z [2024-05-25T22:41:28.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:41:29.056089492Z [2024-05-25T22:41:29.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:38:00+00:00 exited with status queued for try_number 2 2024-05-25T22:41:29.064275427Z [2024-05-25T22:41:29.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 412f0763-57f0-421c-9e67-1507bce05f94 2024-05-25T22:42:00.681092852Z [2024-05-25T22:42:00.680+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T22:42:00.681458173Z [2024-05-25T22:42:00.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:38:00+00:00, run_id=scheduled__2024-05-25T22:38:00+00:00, run_start_date=2024-05-25 22:40:46.979213+00:00, run_end_date=2024-05-25 22:42:00.681115+00:00, run_duration=73.701902, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:38:00+00:00, data_interval_end=2024-05-25 22:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:42:00.691281733Z [2024-05-25T22:42:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:40:00+00:00, run_after=2024-05-25T22:42:00+00:00 2024-05-25T22:42:00.732700894Z [2024-05-25T22:42:00.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:38:00+00:00 exited with status success for try_number 2 2024-05-25T22:42:00.734994515Z [2024-05-25T22:42:00.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:38:00+00:00, map_index=-1, run_start_date=2024-05-25 22:41:29.673862+00:00, run_end_date=2024-05-25 22:42:00.064988+00:00, run_duration=30.391126, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:41:28.997419+00:00, queued_by_job_id=1, pid=88 2024-05-25T22:42:00.964565116Z [2024-05-25T22:42:00.964+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:42:00.996015377Z [2024-05-25T22:42:00.995+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:42:00.996040799Z 2024-05-25T22:42:00.996339014Z [2024-05-25T22:42:00.995+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:42:00.996955907Z [2024-05-25T22:42:00.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:42:00.996967138Z 2024-05-25T22:42:00.998968006Z [2024-05-25T22:42:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:42:01.001997188Z [2024-05-25T22:42:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:42:01.045840662Z [2024-05-25T22:42:01.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:42:01.055028829Z [2024-05-25T22:42:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7565b9d2-235b-46ca-902e-58469e879fe5 2024-05-25T22:42:02.717137273Z [2024-05-25T22:42:02.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:42:02.717645185Z [2024-05-25T22:42:02.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:40:00+00:00, run_id=scheduled__2024-05-25T22:40:00+00:00, run_start_date=2024-05-25 22:42:00.973826+00:00, run_end_date=2024-05-25 22:42:02.717060+00:00, run_duration=1.743234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:40:00+00:00, data_interval_end=2024-05-25 22:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:42:02.725895128Z [2024-05-25T22:42:02.725+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:42:00+00:00, run_after=2024-05-25T22:44:00+00:00 2024-05-25T22:42:02.768226582Z [2024-05-25T22:42:02.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:42:02.781275348Z [2024-05-25T22:42:02.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:42:01.783095+00:00, run_end_date=2024-05-25 22:42:02.246171+00:00, run_duration=0.463076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:42:00.997423+00:00, queued_by_job_id=1, pid=93 2024-05-25T22:43:29.926197154Z [2024-05-25T22:43:29.925+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T22:44:00.775677473Z [2024-05-25T22:44:00.774+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:44:00.817127776Z [2024-05-25T22:44:00.816+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:44:00.817141655Z 2024-05-25T22:44:00.817172767Z [2024-05-25T22:44:00.817+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:44:00.817744889Z [2024-05-25T22:44:00.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:44:00.817762566Z 2024-05-25T22:44:00.819700162Z [2024-05-25T22:44:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:44:00.819890160Z [2024-05-25T22:44:00.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:44:00.880991789Z [2024-05-25T22:44:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:42:00+00:00 exited with status queued for try_number 1 2024-05-25T22:44:00.888490450Z [2024-05-25T22:44:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to a202bcb3-59b5-4850-a231-43a82dc96afa 2024-05-25T22:44:02.367208988Z [2024-05-25T22:44:02.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:44:02.367759126Z [2024-05-25T22:44:02.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:42:00+00:00, run_id=scheduled__2024-05-25T22:42:00+00:00, run_start_date=2024-05-25 22:44:00.789201+00:00, run_end_date=2024-05-25 22:44:02.367163+00:00, run_duration=1.577962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:42:00+00:00, data_interval_end=2024-05-25 22:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:44:02.375355336Z [2024-05-25T22:44:02.375+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:44:00+00:00, run_after=2024-05-25T22:46:00+00:00 2024-05-25T22:44:02.403847856Z [2024-05-25T22:44:02.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:42:00+00:00 exited with status success for try_number 1 2024-05-25T22:44:02.410758598Z [2024-05-25T22:44:02.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:42:00+00:00, map_index=-1, run_start_date=2024-05-25 22:44:01.504755+00:00, run_end_date=2024-05-25 22:44:01.854213+00:00, run_duration=0.349458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:44:00.817943+00:00, queued_by_job_id=1, pid=124 2024-05-25T22:46:00.628605416Z [2024-05-25T22:46:00.627+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:46:00.692823836Z [2024-05-25T22:46:00.692+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:46:00.692835135Z 2024-05-25T22:46:00.692966596Z [2024-05-25T22:46:00.692+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:46:00.693573281Z [2024-05-25T22:46:00.693+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:46:00.693584964Z 2024-05-25T22:46:00.696144809Z [2024-05-25T22:46:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:46:00.696397351Z [2024-05-25T22:46:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:46:00.802710677Z [2024-05-25T22:46:00.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:44:00+00:00 exited with status queued for try_number 1 2024-05-25T22:46:00.818417153Z [2024-05-25T22:46:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53548b6c-8e0e-4cf8-9012-bb54e5b90b72 2024-05-25T22:46:02.530675251Z [2024-05-25T22:46:02.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:46:02.531631440Z [2024-05-25T22:46:02.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:44:00+00:00, run_id=scheduled__2024-05-25T22:44:00+00:00, run_start_date=2024-05-25 22:46:00.645309+00:00, run_end_date=2024-05-25 22:46:02.530550+00:00, run_duration=1.885241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:44:00+00:00, data_interval_end=2024-05-25 22:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:46:02.541039573Z [2024-05-25T22:46:02.540+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:46:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:46:02.572399067Z [2024-05-25T22:46:02.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:44:00+00:00 exited with status success for try_number 1 2024-05-25T22:46:02.577957172Z [2024-05-25T22:46:02.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:44:00+00:00, map_index=-1, run_start_date=2024-05-25 22:46:01.562799+00:00, run_end_date=2024-05-25 22:46:01.988423+00:00, run_duration=0.425624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:46:00.694052+00:00, queued_by_job_id=1, pid=157 2024-05-25T22:47:14.649143148Z [2024-05-25T22:47:14.648+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:14.696850536Z [2024-05-25T22:47:14.696+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:14.696873747Z 2024-05-25T22:47:14.697149227Z [2024-05-25T22:47:14.696+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:47:14.697728989Z [2024-05-25T22:47:14.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:14.697740568Z 2024-05-25T22:47:14.700586339Z [2024-05-25T22:47:14.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:47:14.701108940Z [2024-05-25T22:47:14.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:47:14.793033554Z [2024-05-25T22:47:14.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:14.812319278Z [2024-05-25T22:47:14.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7424cce-910f-46b5-8541-42c368eb9849 2024-05-25T22:47:15.955156191Z [2024-05-25T22:47:15.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:47:15.955614714Z [2024-05-25T22:47:15.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:46:00+00:00, run_id=scheduled__2024-05-25T22:46:00+00:00, run_start_date=2024-05-25 22:47:14.668184+00:00, run_end_date=2024-05-25 22:47:15.955249+00:00, run_duration=1.287065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:46:00+00:00, data_interval_end=2024-05-25 22:47:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:47:15.967091725Z [2024-05-25T22:47:15.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:15.995356276Z [2024-05-25T22:47:15.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:16.003597240Z [2024-05-25T22:47:16.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:46:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:15.486526+00:00, run_end_date=2024-05-25 22:47:15.796328+00:00, run_duration=0.309802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:14.698544+00:00, queued_by_job_id=1, pid=192 2024-05-25T22:47:21.782698258Z [2024-05-25T22:47:21.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:21.818528797Z [2024-05-25T22:47:21.818+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:21.818544167Z 2024-05-25T22:47:21.818593037Z [2024-05-25T22:47:21.818+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:47:21.819203615Z [2024-05-25T22:47:21.819+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:21.819213153Z 2024-05-25T22:47:21.821220026Z [2024-05-25T22:47:21.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:47:21.821294497Z [2024-05-25T22:47:21.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:47:21.873346876Z [2024-05-25T22:47:21.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:21.878852706Z [2024-05-25T22:47:21.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9625f49e-4bc6-4823-8e87-c9c0de692e6d 2024-05-25T22:47:21.921180135Z [2024-05-25T22:47:21.920+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:47:21.988701352Z [2024-05-25T22:47:21.988+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:21.988720840Z 2024-05-25T22:47:21.988896248Z [2024-05-25T22:47:21.988+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:47:21.989599349Z [2024-05-25T22:47:21.989+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:21.989608475Z 2024-05-25T22:47:21.992126918Z [2024-05-25T22:47:21.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:47:21.992435352Z [2024-05-25T22:47:21.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:47:22.105276462Z [2024-05-25T22:47:22.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:22.110097931Z [2024-05-25T22:47:22.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 307b4c8a-c9b2-4268-84a0-568a0e4819f9 2024-05-25T22:47:24.756598576Z [2024-05-25T22:47:24.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:45:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:47:24.837871180Z [2024-05-25T22:47:24.837+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:24.837883782Z 2024-05-25T22:47:24.837950775Z [2024-05-25T22:47:24.837+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:47:24.838533827Z [2024-05-25T22:47:24.838+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:24.838538822Z 2024-05-25T22:47:24.841345230Z [2024-05-25T22:47:24.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T22:47:24.841568250Z [2024-05-25T22:47:24.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:24.890325493Z [2024-05-25T22:47:24.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:24.898921990Z [2024-05-25T22:47:24.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f4bb1c9-24a3-45bc-a8c1-88059a4b4e66 2024-05-25T22:47:26.046030310Z [2024-05-25T22:47:26.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:47:26.046286052Z [2024-05-25T22:47:26.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:46:00+00:00, run_id=scheduled__2024-05-25T22:46:00+00:00, run_start_date=2024-05-25 22:47:21.790591+00:00, run_end_date=2024-05-25 22:47:26.045972+00:00, run_duration=4.255381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:46:00+00:00, data_interval_end=2024-05-25 22:47:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:47:26.056903566Z [2024-05-25T22:47:26.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:26.065207194Z [2024-05-25T22:47:26.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:47:26.065729838Z [2024-05-25T22:47:26.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:46:00+00:00, run_id=scheduled__2024-05-25T22:46:00+00:00, run_start_date=2024-05-25 22:47:21.933679+00:00, run_end_date=2024-05-25 22:47:26.065131+00:00, run_duration=4.131452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:46:00+00:00, data_interval_end=2024-05-25 22:47:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:47:26.074764446Z [2024-05-25T22:47:26.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:26.112241664Z [2024-05-25T22:47:26.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:26.112277726Z [2024-05-25T22:47:26.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:26.123497722Z [2024-05-25T22:47:26.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:46:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:23.764741+00:00, run_end_date=2024-05-25 22:47:25.059369+00:00, run_duration=1.294628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:21.819501+00:00, queued_by_job_id=1, pid=215 2024-05-25T22:47:26.123982368Z [2024-05-25T22:47:26.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:46:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:23.860063+00:00, run_end_date=2024-05-25 22:47:25.341128+00:00, run_duration=1.481065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:21.990024+00:00, queued_by_job_id=1, pid=216 2024-05-25T22:47:27.190936865Z [2024-05-25T22:47:27.190+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:27.190955160Z 2024-05-25T22:47:27.191192897Z [2024-05-25T22:47:27.190+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:47:27.192222251Z [2024-05-25T22:47:27.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:27.192240435Z 2024-05-25T22:47:27.196271184Z [2024-05-25T22:47:27.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T22:47:27.196498017Z [2024-05-25T22:47:27.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:27.241450651Z [2024-05-25T22:47:27.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:27.241560226Z [2024-05-25T22:47:27.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:27.247484314Z [2024-05-25T22:47:27.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:26.650375+00:00, run_end_date=2024-05-25 22:47:26.967051+00:00, run_duration=0.316676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:24.838826+00:00, queued_by_job_id=1, pid=234 2024-05-25T22:47:27.247774661Z [2024-05-25T22:47:27.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1383c3cc-e295-4ba1-98a8-bf3f9724cd44 2024-05-25T22:47:29.888426108Z [2024-05-25T22:47:29.888+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:29.888447476Z 2024-05-25T22:47:29.888990596Z [2024-05-25T22:47:29.888+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:47:29.889901926Z [2024-05-25T22:47:29.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:29.889916206Z 2024-05-25T22:47:29.899354536Z [2024-05-25T22:47:29.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T22:47:29.899552372Z [2024-05-25T22:47:29.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:47:29.942491900Z [2024-05-25T22:47:29.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:29.942575180Z [2024-05-25T22:47:29.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:29.947660422Z [2024-05-25T22:47:29.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06241394-56c2-4b1d-851a-461dfa8a0cd4 2024-05-25T22:47:29.947874936Z [2024-05-25T22:47:29.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:28.837879+00:00, run_end_date=2024-05-25 22:47:29.160469+00:00, run_duration=0.32259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:27.192737+00:00, queued_by_job_id=1, pid=247 2024-05-25T22:47:32.455197029Z [2024-05-25T22:47:32.454+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:32.455231173Z 2024-05-25T22:47:32.455405287Z [2024-05-25T22:47:32.455+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:47:32.456111334Z [2024-05-25T22:47:32.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:32.456152318Z 2024-05-25T22:47:32.459106213Z [2024-05-25T22:47:32.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:47:32.459302279Z [2024-05-25T22:47:32.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:32.519776686Z [2024-05-25T22:47:32.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:32.520020254Z [2024-05-25T22:47:32.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:32.530035405Z [2024-05-25T22:47:32.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=0, run_start_date=2024-05-25 22:47:31.531427+00:00, run_end_date=2024-05-25 22:47:31.855180+00:00, run_duration=0.323753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:29.890464+00:00, queued_by_job_id=1, pid=255 2024-05-25T22:47:32.530202915Z [2024-05-25T22:47:32.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to c878758e-a96d-422a-ae95-3d9766fff349 2024-05-25T22:47:35.018144231Z [2024-05-25T22:47:35.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:47:35.018312758Z [2024-05-25T22:47:35.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:40:00+00:00, run_id=scheduled__2024-05-25T22:40:00+00:00, run_start_date=2024-05-25 22:47:24.769955+00:00, run_end_date=2024-05-25 22:47:35.018055+00:00, run_duration=10.2481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:40:00+00:00, data_interval_end=2024-05-25 22:45:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T22:47:35.025838361Z [2024-05-25T22:47:35.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:45:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:47:36.143542818Z [2024-05-25T22:47:36.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:36.173202953Z [2024-05-25T22:47:36.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:34.667410+00:00, run_end_date=2024-05-25 22:47:34.957015+00:00, run_duration=0.289605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:32.456588+00:00, queued_by_job_id=1, pid=263 2024-05-25T22:47:53.371323340Z [2024-05-25T22:47:53.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:53.417460173Z [2024-05-25T22:47:53.417+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:53.417482781Z 2024-05-25T22:47:53.417504235Z [2024-05-25T22:47:53.417+0000] {scheduler_job.py:425} INFO - DAG vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:47:53.418412688Z [2024-05-25T22:47:53.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:53.418425658Z 2024-05-25T22:47:53.420583165Z [2024-05-25T22:47:53.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:47:53.420645763Z [2024-05-25T22:47:53.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:47:53.474337754Z [2024-05-25T22:47:53.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:53.483442265Z [2024-05-25T22:47:53.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb2fd7bf-c01c-42b2-8914-e98ad569327e 2024-05-25T22:47:54.034869075Z [2024-05-25T22:47:54.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:47:54.078601630Z [2024-05-25T22:47:54.078+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:54.078622707Z 2024-05-25T22:47:54.078788312Z [2024-05-25T22:47:54.078+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:47:54.079240546Z [2024-05-25T22:47:54.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:54.079248052Z 2024-05-25T22:47:54.081209424Z [2024-05-25T22:47:54.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:47:54.081369182Z [2024-05-25T22:47:54.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:47:54.158533200Z [2024-05-25T22:47:54.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:54.164667825Z [2024-05-25T22:47:54.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0a014a1-552d-460a-a3c7-0d499c039dd4 2024-05-25T22:47:56.474284651Z [2024-05-25T22:47:56.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:45:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:47:56.520912405Z [2024-05-25T22:47:56.520+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:56.520962845Z 2024-05-25T22:47:56.520970818Z [2024-05-25T22:47:56.520+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:47:56.521579715Z [2024-05-25T22:47:56.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:56.521595800Z 2024-05-25T22:47:56.523414821Z [2024-05-25T22:47:56.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T22:47:56.523669472Z [2024-05-25T22:47:56.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:56.568294857Z [2024-05-25T22:47:56.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:56.573798690Z [2024-05-25T22:47:56.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f9707b2-5e59-4e37-aca8-16c70500410f 2024-05-25T22:47:57.779963013Z [2024-05-25T22:47:57.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:47:57.780267836Z [2024-05-25T22:47:57.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, execution_date=2024-05-25 22:46:00+00:00, run_id=scheduled__2024-05-25T22:46:00+00:00, run_start_date=2024-05-25 22:47:54.049217+00:00, run_end_date=2024-05-25 22:47:57.779908+00:00, run_duration=3.730691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:46:00+00:00, data_interval_end=2024-05-25 22:47:00+00:00, dag_hash=847797f7193a09f78d58873de954be5f 2024-05-25T22:47:57.794280556Z [2024-05-25T22:47:57.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:57.801590722Z [2024-05-25T22:47:57.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:47:57.801940586Z [2024-05-25T22:47:57.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, execution_date=2024-05-25 22:46:00+00:00, run_id=scheduled__2024-05-25T22:46:00+00:00, run_start_date=2024-05-25 22:47:53.382339+00:00, run_end_date=2024-05-25 22:47:57.801531+00:00, run_duration=4.419192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:46:00+00:00, data_interval_end=2024-05-25 22:47:00+00:00, dag_hash=68e89c02681f04d6f47e2682b2dfde48 2024-05-25T22:47:57.810848565Z [2024-05-25T22:47:57.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:47:00+00:00, run_after=2024-05-25T22:48:00+00:00 2024-05-25T22:47:57.857338149Z [2024-05-25T22:47:57.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:57.857489431Z [2024-05-25T22:47:57.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:57.864887871Z [2024-05-25T22:47:57.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:46:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:55.995798+00:00, run_end_date=2024-05-25 22:47:57.580146+00:00, run_duration=1.584348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:54.079640+00:00, queued_by_job_id=1, pid=284 2024-05-25T22:47:57.865224154Z [2024-05-25T22:47:57.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:46:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:55.311784+00:00, run_end_date=2024-05-25 22:47:56.670631+00:00, run_duration=1.358847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:53.418797+00:00, queued_by_job_id=1, pid=273 2024-05-25T22:47:58.931606371Z [2024-05-25T22:47:58.931+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:47:58.931643554Z 2024-05-25T22:47:58.931657549Z [2024-05-25T22:47:58.931+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:47:58.932527141Z [2024-05-25T22:47:58.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:47:58.932540936Z 2024-05-25T22:47:58.934826681Z [2024-05-25T22:47:58.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='split_metrics', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T22:47:58.934913971Z [2024-05-25T22:47:58.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'split_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:47:58.982860579Z [2024-05-25T22:47:58.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.split_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:47:58.982902050Z [2024-05-25T22:47:58.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:47:58.987089741Z [2024-05-25T22:47:58.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:47:58.308953+00:00, run_end_date=2024-05-25 22:47:58.665147+00:00, run_duration=0.356194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:56.521857+00:00, queued_by_job_id=1, pid=297 2024-05-25T22:47:58.987172212Z [2024-05-25T22:47:58.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e47d0f7-7da9-4c90-acb6-46ccccf81e45 2024-05-25T22:48:00.376280251Z [2024-05-25T22:48:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:00.383411956Z [2024-05-25T22:48:00.383+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:48:00.391306892Z [2024-05-25T22:48:00.391+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:48:00.402441255Z [2024-05-25T22:48:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:00.413479659Z [2024-05-25T22:48:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:00.420591110Z [2024-05-25T22:48:00.420+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:48:00.517254922Z [2024-05-25T22:48:00.516+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-25T22:48:00.517265613Z 2024-05-25T22:48:00.517269455Z 2024-05-25T22:48:00.517272662Z 2024-05-25T22:48:00.517285713Z 2024-05-25T22:48:00.517288700Z 2024-05-25T22:48:00.517291641Z 2024-05-25T22:48:00.517411005Z [2024-05-25T22:48:00.517+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:48:00.517511137Z [2024-05-25T22:48:00.517+0000] {scheduler_job.py:425} INFO - DAG vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:48:00.517538756Z [2024-05-25T22:48:00.517+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:48:00.517550290Z [2024-05-25T22:48:00.517+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:48:00.517678401Z [2024-05-25T22:48:00.517+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:48:00.517690652Z [2024-05-25T22:48:00.517+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:48:00.518465726Z [2024-05-25T22:48:00.518+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:00.518472338Z 2024-05-25T22:48:00.518475852Z 2024-05-25T22:48:00.518478818Z 2024-05-25T22:48:00.518481921Z 2024-05-25T22:48:00.518484789Z 2024-05-25T22:48:00.518487977Z 2024-05-25T22:48:00.525007679Z [2024-05-25T22:48:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:00.525075463Z [2024-05-25T22:48:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:48:00.525270489Z [2024-05-25T22:48:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:00.525363780Z [2024-05-25T22:48:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:48:00.525675642Z [2024-05-25T22:48:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:00.525813470Z [2024-05-25T22:48:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:48:00.526035503Z [2024-05-25T22:48:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:00.539032598Z [2024-05-25T22:48:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:48:00.539259903Z [2024-05-25T22:48:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:00.539335594Z [2024-05-25T22:48:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:48:00.539499038Z [2024-05-25T22:48:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:00.539613622Z [2024-05-25T22:48:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:48:01.345239996Z [2024-05-25T22:48:01.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:01.345566324Z [2024-05-25T22:48:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:01.345990526Z [2024-05-25T22:48:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:01.346425348Z [2024-05-25T22:48:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:01.346603391Z [2024-05-25T22:48:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:01.346701245Z [2024-05-25T22:48:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:01.387301812Z [2024-05-25T22:48:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 225470d6-0048-4719-908e-5489d5319ed7 2024-05-25T22:48:01.389247528Z [2024-05-25T22:48:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3b17d94-6ea5-4e6b-a884-ee3fcb205580 2024-05-25T22:48:01.391186527Z [2024-05-25T22:48:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c60e065-ddaa-4882-b99a-59a438957684 2024-05-25T22:48:01.391387683Z [2024-05-25T22:48:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6b4a291-2dac-4429-a0e9-4b7add5f5cb3 2024-05-25T22:48:01.391596586Z [2024-05-25T22:48:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03758a77-7c1d-4ee7-a1ba-36918394d2cc 2024-05-25T22:48:01.392144426Z [2024-05-25T22:48:01.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b680459-f7a4-46cd-b665-6d80c691d501 2024-05-25T22:48:02.876309609Z [2024-05-25T22:48:02.875+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:02.876323567Z 2024-05-25T22:48:02.876620714Z [2024-05-25T22:48:02.876+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:48:02.877241090Z [2024-05-25T22:48:02.877+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:02.877251872Z 2024-05-25T22:48:02.880684272Z [2024-05-25T22:48:02.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='collect_metrics', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T22:48:02.880919961Z [2024-05-25T22:48:02.880+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'collect_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:48:02.996163578Z [2024-05-25T22:48:02.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.collect_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:02.996495117Z [2024-05-25T22:48:02.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.split_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:03.023438869Z [2024-05-25T22:48:03.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=split_metrics, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:00.625434+00:00, run_end_date=2024-05-25 22:48:01.487868+00:00, run_duration=0.862434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:47:58.932757+00:00, queued_by_job_id=1, pid=311 2024-05-25T22:48:03.023905982Z [2024-05-25T22:48:03.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to 530619cb-327c-4562-803a-140bdfdf1a88 2024-05-25T22:48:03.085491887Z [2024-05-25T22:48:03.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:03.086141280Z [2024-05-25T22:48:03.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:46:00+00:00, run_id=scheduled__2024-05-25T22:46:00+00:00, run_start_date=2024-05-25 22:48:00.430806+00:00, run_end_date=2024-05-25 22:48:03.085724+00:00, run_duration=2.654918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:46:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:48:03.094180556Z [2024-05-25T22:48:03.093+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:48:03.109628239Z [2024-05-25T22:48:03.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:03.112127826Z [2024-05-25T22:48:03.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:47:00+00:00, run_id=scheduled__2024-05-25T22:47:00+00:00, run_start_date=2024-05-25 22:48:00.434699+00:00, run_end_date=2024-05-25 22:48:03.109537+00:00, run_duration=2.674838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:47:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:48:03.126305242Z [2024-05-25T22:48:03.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:04.435631300Z [2024-05-25T22:48:04.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:46:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:04.435654915Z [2024-05-25T22:48:04.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:04.438771717Z [2024-05-25T22:48:04.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:46:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:02.437925+00:00, run_end_date=2024-05-25 22:48:03.008844+00:00, run_duration=0.570919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:00.519454+00:00, queued_by_job_id=1, pid=323 2024-05-25T22:48:04.438796726Z [2024-05-25T22:48:04.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:47:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:02.307149+00:00, run_end_date=2024-05-25 22:48:03.002201+00:00, run_duration=0.695052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:00.519454+00:00, queued_by_job_id=1, pid=322 2024-05-25T22:48:06.919851004Z [2024-05-25T22:48:06.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:06.920110435Z [2024-05-25T22:48:06.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:47:00+00:00, run_id=scheduled__2024-05-25T22:47:00+00:00, run_start_date=2024-05-25 22:48:00.433664+00:00, run_end_date=2024-05-25 22:48:06.919867+00:00, run_duration=6.486203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:47:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:48:06.938654420Z [2024-05-25T22:48:06.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:06.968760475Z [2024-05-25T22:48:06.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:06.969183501Z [2024-05-25T22:48:06.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, execution_date=2024-05-25 22:47:00+00:00, run_id=scheduled__2024-05-25T22:47:00+00:00, run_start_date=2024-05-25 22:48:00.431190+00:00, run_end_date=2024-05-25 22:48:06.968698+00:00, run_duration=6.537508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:47:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=68e89c02681f04d6f47e2682b2dfde48 2024-05-25T22:48:06.984546885Z [2024-05-25T22:48:06.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:07.110096893Z [2024-05-25T22:48:07.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:07.110286839Z [2024-05-25T22:48:07.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:07.124815513Z [2024-05-25T22:48:07.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:47:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:04.391941+00:00, run_end_date=2024-05-25 22:48:06.364578+00:00, run_duration=1.972637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:00.519454+00:00, queued_by_job_id=1, pid=354 2024-05-25T22:48:07.125461760Z [2024-05-25T22:48:07.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:47:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:04.981581+00:00, run_end_date=2024-05-25 22:48:06.670411+00:00, run_duration=1.68883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:00.519454+00:00, queued_by_job_id=1, pid=358 2024-05-25T22:48:08.217034144Z [2024-05-25T22:48:08.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:08.217873275Z [2024-05-25T22:48:08.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, execution_date=2024-05-25 22:47:00+00:00, run_id=scheduled__2024-05-25T22:47:00+00:00, run_start_date=2024-05-25 22:48:00.432766+00:00, run_end_date=2024-05-25 22:48:08.216957+00:00, run_duration=7.784191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:47:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=847797f7193a09f78d58873de954be5f 2024-05-25T22:48:08.230772974Z [2024-05-25T22:48:08.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:08.329232601Z [2024-05-25T22:48:08.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:08.345640244Z [2024-05-25T22:48:08.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:47:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:04.929444+00:00, run_end_date=2024-05-25 22:48:07.577245+00:00, run_duration=2.647801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:00.519454+00:00, queued_by_job_id=1, pid=355 2024-05-25T22:48:09.394707531Z [2024-05-25T22:48:09.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:09.394909007Z [2024-05-25T22:48:09.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:47:00+00:00, run_id=scheduled__2024-05-25T22:47:00+00:00, run_start_date=2024-05-25 22:48:00.432461+00:00, run_end_date=2024-05-25 22:48:09.394557+00:00, run_duration=8.962096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:47:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:48:09.403733544Z [2024-05-25T22:48:09.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:09.418014319Z [2024-05-25T22:48:09.417+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:09.418044302Z 2024-05-25T22:48:09.418080381Z [2024-05-25T22:48:09.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:48:09.419867104Z [2024-05-25T22:48:09.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:09.419891885Z 2024-05-25T22:48:09.420749207Z [2024-05-25T22:48:09.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='send_prometheus', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:09.420918091Z [2024-05-25T22:48:09.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'send_prometheus', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:09.506141723Z [2024-05-25T22:48:09.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.send_prometheus run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:09.506166035Z [2024-05-25T22:48:09.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:09.506865200Z [2024-05-25T22:48:09.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.collect_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:09.528317029Z [2024-05-25T22:48:09.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1607a0ca-4b2a-4582-9b02-4ff7062ec69b 2024-05-25T22:48:09.528501370Z [2024-05-25T22:48:09.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=collect_metrics, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=0, run_start_date=2024-05-25 22:48:07.913875+00:00, run_end_date=2024-05-25 22:48:08.299857+00:00, run_duration=0.385982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:02.877712+00:00, queued_by_job_id=1, pid=389 2024-05-25T22:48:09.528727474Z [2024-05-25T22:48:09.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:47:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:06.856002+00:00, run_end_date=2024-05-25 22:48:09.059028+00:00, run_duration=2.203026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:00.519454+00:00, queued_by_job_id=1, pid=378 2024-05-25T22:48:11.820550371Z [2024-05-25T22:48:11.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:11.821293184Z [2024-05-25T22:48:11.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, execution_date=2024-05-25 22:40:00+00:00, run_id=scheduled__2024-05-25T22:40:00+00:00, run_start_date=2024-05-25 22:47:56.483786+00:00, run_end_date=2024-05-25 22:48:11.820909+00:00, run_duration=15.337123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:40:00+00:00, data_interval_end=2024-05-25 22:45:00+00:00, dag_hash=1dbec3dcc3d200fba4bc5403c88ddf87 2024-05-25T22:48:11.828165587Z [2024-05-25T22:48:11.827+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:45:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:48:11.853560517Z [2024-05-25T22:48:11.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.send_prometheus run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:11.861055046Z [2024-05-25T22:48:11.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=send_prometheus, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:11.255628+00:00, run_end_date=2024-05-25 22:48:11.599268+00:00, run_duration=0.34364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:09.418870+00:00, queued_by_job_id=1, pid=397 2024-05-25T22:48:25.903404827Z [2024-05-25T22:48:25.902+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:48:25.940419741Z [2024-05-25T22:48:25.940+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:25.940455643Z 2024-05-25T22:48:25.940624989Z [2024-05-25T22:48:25.940+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:48:25.941280461Z [2024-05-25T22:48:25.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:25.941292849Z 2024-05-25T22:48:25.943476087Z [2024-05-25T22:48:25.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:25.943488422Z [2024-05-25T22:48:25.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:48:26.012953667Z [2024-05-25T22:48:26.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:26.019590019Z [2024-05-25T22:48:26.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50b8056b-5979-4816-8170-8ab39b9063d5 2024-05-25T22:48:28.209925130Z [2024-05-25T22:48:28.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:45:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:48:28.270343870Z [2024-05-25T22:48:28.269+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:28.270394455Z 2024-05-25T22:48:28.270406027Z [2024-05-25T22:48:28.270+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:48:28.271123257Z [2024-05-25T22:48:28.270+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:28.271159529Z 2024-05-25T22:48:28.273175746Z [2024-05-25T22:48:28.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T22:48:28.273525770Z [2024-05-25T22:48:28.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:28.369084115Z [2024-05-25T22:48:28.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:28.374968292Z [2024-05-25T22:48:28.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to d602a9b3-97d5-4d96-b9e8-a9889056979f 2024-05-25T22:48:29.564018628Z [2024-05-25T22:48:29.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:29.564563088Z [2024-05-25T22:48:29.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:47:00+00:00, run_id=scheduled__2024-05-25T22:47:00+00:00, run_start_date=2024-05-25 22:48:25.912609+00:00, run_end_date=2024-05-25 22:48:29.563839+00:00, run_duration=3.65123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:47:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=ded14311230b5272cb16458378f2887a 2024-05-25T22:48:29.573793573Z [2024-05-25T22:48:29.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:29.611890665Z [2024-05-25T22:48:29.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:29.617396799Z [2024-05-25T22:48:29.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:47:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:27.776946+00:00, run_end_date=2024-05-25 22:48:29.303390+00:00, run_duration=1.526444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:25.941695+00:00, queued_by_job_id=1, pid=417 2024-05-25T22:48:30.037016757Z [2024-05-25T22:48:30.036+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T22:48:30.487559230Z [2024-05-25T22:48:30.486+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:30.487592720Z 2024-05-25T22:48:30.487740675Z [2024-05-25T22:48:30.487+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:48:30.488460066Z [2024-05-25T22:48:30.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:30.488519029Z 2024-05-25T22:48:30.490889707Z [2024-05-25T22:48:30.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='split_metrics', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T22:48:30.490932679Z [2024-05-25T22:48:30.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'split_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:30.541621298Z [2024-05-25T22:48:30.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.split_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:30.542078775Z [2024-05-25T22:48:30.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:30.549417810Z [2024-05-25T22:48:30.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:29.859170+00:00, run_end_date=2024-05-25 22:48:30.301452+00:00, run_duration=0.442282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:28.271292+00:00, queued_by_job_id=1, pid=430 2024-05-25T22:48:30.550417421Z [2024-05-25T22:48:30.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1718ca49-2c86-473d-92f3-a6e13622a6c7 2024-05-25T22:48:32.826170181Z [2024-05-25T22:48:32.825+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:32.826241973Z 2024-05-25T22:48:32.826251109Z [2024-05-25T22:48:32.825+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:48:32.826858275Z [2024-05-25T22:48:32.826+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:32.826914309Z 2024-05-25T22:48:32.829965945Z [2024-05-25T22:48:32.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='collect_metrics', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T22:48:32.830198710Z [2024-05-25T22:48:32.829+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'collect_metrics', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:48:32.894138762Z [2024-05-25T22:48:32.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.collect_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:32.895303739Z [2024-05-25T22:48:32.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.split_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:32.902530330Z [2024-05-25T22:48:32.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=split_metrics, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:32.116489+00:00, run_end_date=2024-05-25 22:48:32.492082+00:00, run_duration=0.375593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:30.488832+00:00, queued_by_job_id=1, pid=443 2024-05-25T22:48:32.902993905Z [2024-05-25T22:48:32.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5d3a0f9-6751-4a00-9ca9-728e4901ff9a 2024-05-25T22:48:35.113544420Z [2024-05-25T22:48:35.113+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:35.113575397Z 2024-05-25T22:48:35.113707576Z [2024-05-25T22:48:35.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:48:35.114341573Z [2024-05-25T22:48:35.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:35.114353220Z 2024-05-25T22:48:35.116460488Z [2024-05-25T22:48:35.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='send_prometheus', run_id='scheduled__2024-05-25T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:35.116644402Z [2024-05-25T22:48:35.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'send_prometheus', 'scheduled__2024-05-25T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:48:35.177159821Z [2024-05-25T22:48:35.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.send_prometheus run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:35.177235566Z [2024-05-25T22:48:35.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.collect_metrics run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:35.203657269Z [2024-05-25T22:48:35.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=collect_metrics, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=0, run_start_date=2024-05-25 22:48:34.367342+00:00, run_end_date=2024-05-25 22:48:34.750906+00:00, run_duration=0.383564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:32.827113+00:00, queued_by_job_id=1, pid=451 2024-05-25T22:48:35.204112886Z [2024-05-25T22:48:35.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bc33e22-1087-4306-bb5b-e53bd8dc09de 2024-05-25T22:48:37.462898545Z [2024-05-25T22:48:37.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:37.463506157Z [2024-05-25T22:48:37.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:40:00+00:00, run_id=scheduled__2024-05-25T22:40:00+00:00, run_start_date=2024-05-25 22:48:28.226603+00:00, run_end_date=2024-05-25 22:48:37.463003+00:00, run_duration=9.2364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:40:00+00:00, data_interval_end=2024-05-25 22:45:00+00:00, dag_hash=b1570d86a8ad859e741d41dd72819c29 2024-05-25T22:48:37.472972131Z [2024-05-25T22:48:37.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:45:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:48:37.516335842Z [2024-05-25T22:48:37.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.send_prometheus run_id=scheduled__2024-05-25T22:40:00+00:00 exited with status success for try_number 1 2024-05-25T22:48:37.525000967Z [2024-05-25T22:48:37.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=send_prometheus, run_id=scheduled__2024-05-25T22:40:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:36.892172+00:00, run_end_date=2024-05-25 22:48:37.287813+00:00, run_duration=0.395641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:35.114752+00:00, queued_by_job_id=1, pid=459 2024-05-25T22:48:56.606660476Z [2024-05-25T22:48:56.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:48:56.637271887Z [2024-05-25T22:48:56.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:48:56.637309185Z 2024-05-25T22:48:56.637405009Z [2024-05-25T22:48:56.637+0000] {scheduler_job.py:425} INFO - DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:48:56.637935444Z [2024-05-25T22:48:56.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:48:56.637943041Z 2024-05-25T22:48:56.639802555Z [2024-05-25T22:48:56.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:48:56.639959698Z [2024-05-25T22:48:56.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:48:56.689550629Z [2024-05-25T22:48:56.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status queued for try_number 1 2024-05-25T22:48:56.702293040Z [2024-05-25T22:48:56.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76d05387-ee70-43c4-bc01-725cce4c1cdc 2024-05-25T22:48:59.968227311Z [2024-05-25T22:48:59.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:48:59.968557049Z [2024-05-25T22:48:59.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:47:00+00:00, run_id=scheduled__2024-05-25T22:47:00+00:00, run_start_date=2024-05-25 22:48:56.616184+00:00, run_end_date=2024-05-25 22:48:59.967960+00:00, run_duration=3.351776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:47:00+00:00, data_interval_end=2024-05-25 22:48:00+00:00, dag_hash=7f71adaaf8a4925c4149aea32d65d9d5 2024-05-25T22:48:59.977520378Z [2024-05-25T22:48:59.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:48:00+00:00, run_after=2024-05-25T22:49:00+00:00 2024-05-25T22:49:00.013622989Z [2024-05-25T22:49:00.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:47:00+00:00 exited with status success for try_number 1 2024-05-25T22:49:00.020371206Z [2024-05-25T22:49:00.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:47:00+00:00, map_index=-1, run_start_date=2024-05-25 22:48:58.259660+00:00, run_end_date=2024-05-25 22:48:59.676560+00:00, run_duration=1.4169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:48:56.638240+00:00, queued_by_job_id=1, pid=467 2024-05-25T22:49:00.576017920Z [2024-05-25T22:49:00.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:00.581999144Z [2024-05-25T22:49:00.581+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:49:00.587775019Z [2024-05-25T22:49:00.587+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:49:00.597924564Z [2024-05-25T22:49:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:00.614269404Z [2024-05-25T22:49:00.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:00.625048161Z [2024-05-25T22:49:00.624+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:00.632791577Z [2024-05-25T22:49:00.632+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:49:00.805140650Z [2024-05-25T22:49:00.804+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-05-25T22:49:00.805190716Z 2024-05-25T22:49:00.805200556Z 2024-05-25T22:49:00.805209251Z 2024-05-25T22:49:00.805217451Z 2024-05-25T22:49:00.805225866Z 2024-05-25T22:49:00.805234648Z 2024-05-25T22:49:00.805242948Z 2024-05-25T22:49:00.805379524Z [2024-05-25T22:49:00.805+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:49:00.805672508Z [2024-05-25T22:49:00.805+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:49:00.805877603Z [2024-05-25T22:49:00.805+0000] {scheduler_job.py:425} INFO - DAG vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:49:00.806039181Z [2024-05-25T22:49:00.805+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:49:00.806238778Z [2024-05-25T22:49:00.806+0000] {scheduler_job.py:425} INFO - DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:49:00.806527342Z [2024-05-25T22:49:00.806+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:49:00.806691477Z [2024-05-25T22:49:00.806+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:49:00.807669998Z [2024-05-25T22:49:00.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:49:00.807689164Z 2024-05-25T22:49:00.807697316Z 2024-05-25T22:49:00.807704201Z 2024-05-25T22:49:00.807710596Z 2024-05-25T22:49:00.807716988Z 2024-05-25T22:49:00.807723121Z 2024-05-25T22:49:00.807729768Z 2024-05-25T22:49:00.815764415Z [2024-05-25T22:49:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:00.815794718Z [2024-05-25T22:49:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:00.816115457Z [2024-05-25T22:49:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:00.816276059Z [2024-05-25T22:49:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:00.819079786Z [2024-05-25T22:49:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:00.819236086Z [2024-05-25T22:49:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:00.819249551Z [2024-05-25T22:49:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:00.819280919Z [2024-05-25T22:49:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:00.819289474Z [2024-05-25T22:49:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:00.819297748Z [2024-05-25T22:49:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:00.819306632Z [2024-05-25T22:49:00.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:00.819314967Z [2024-05-25T22:49:00.818+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:49:00.819323219Z [2024-05-25T22:49:00.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:00.819331654Z [2024-05-25T22:49:00.818+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:01.546388379Z [2024-05-25T22:49:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:49:01.546448272Z [2024-05-25T22:49:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:49:01.546453274Z [2024-05-25T22:49:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:49:01.546480088Z [2024-05-25T22:49:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:49:01.546574749Z [2024-05-25T22:49:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:49:01.546632418Z [2024-05-25T22:49:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:49:01.546664644Z [2024-05-25T22:49:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:49:01.562659004Z [2024-05-25T22:49:01.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9363a452-877d-4e1f-8572-b372b32b8c55 2024-05-25T22:49:01.562727861Z [2024-05-25T22:49:01.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a8d6fdd-50e0-4f53-92e6-e319f69a4d20 2024-05-25T22:49:01.562812454Z [2024-05-25T22:49:01.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0faf84a2-bcbe-4019-84be-83e926ab0dcb 2024-05-25T22:49:01.562919883Z [2024-05-25T22:49:01.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05f60459-61a2-42be-8419-76181b1aa147 2024-05-25T22:49:01.563013243Z [2024-05-25T22:49:01.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to b06e4b9e-4975-4dfb-b8a3-3f9636bfeafa 2024-05-25T22:49:01.563101673Z [2024-05-25T22:49:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to de33906f-2976-43be-a6c2-89feac3abb9a 2024-05-25T22:49:01.563195548Z [2024-05-25T22:49:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b316634-4456-4f90-8a62-b7650033755d 2024-05-25T22:49:03.091390248Z [2024-05-25T22:49:03.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status failed for try_number 1 2024-05-25T22:49:03.100832473Z [2024-05-25T22:49:03.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:00.809215+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:49:03.103230003Z [2024-05-25T22:49:03.102+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:03.109647190Z [2024-05-25T22:49:03.109+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:03.143905917Z [2024-05-25T22:49:03.143+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T224800, start_date=, end_date=20240525T224903 2024-05-25T22:49:03.387400947Z [2024-05-25T22:49:03.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:49:03.387665191Z [2024-05-25T22:49:03.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:49:00.658540+00:00, run_end_date=2024-05-25 22:49:03.387313+00:00, run_duration=2.728773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:49:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:49:03.398865186Z [2024-05-25T22:49:03.398+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:04.806719826Z [2024-05-25T22:49:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status success for try_number 1 2024-05-25T22:49:04.812533390Z [2024-05-25T22:49:04.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=2024-05-25 22:49:02.677964+00:00, run_end_date=2024-05-25 22:49:03.315496+00:00, run_duration=0.637532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:00.809215+00:00, queued_by_job_id=1, pid=488 2024-05-25T22:49:05.056253717Z [2024-05-25T22:49:05.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status failed for try_number 1 2024-05-25T22:49:05.062536134Z [2024-05-25T22:49:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:00.809215+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:49:05.062981470Z [2024-05-25T22:49:05.062+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:05.065209378Z [2024-05-25T22:49:05.064+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:05.076914907Z [2024-05-25T22:49:05.076+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T224800, start_date=, end_date=20240525T224905 2024-05-25T22:49:06.150219626Z [2024-05-25T22:49:06.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:49:06.150617137Z [2024-05-25T22:49:06.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:49:00.647775+00:00, run_end_date=2024-05-25 22:49:06.150084+00:00, run_duration=5.502309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:49:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:49:06.164672557Z [2024-05-25T22:49:06.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:06.190333626Z [2024-05-25T22:49:06.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:49:06.190490223Z [2024-05-25T22:49:06.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:49:00.655604+00:00, run_end_date=2024-05-25 22:49:06.190219+00:00, run_duration=5.534615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:49:00+00:00, dag_hash=7f71adaaf8a4925c4149aea32d65d9d5 2024-05-25T22:49:06.203004735Z [2024-05-25T22:49:06.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:06.291453607Z [2024-05-25T22:49:06.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status success for try_number 1 2024-05-25T22:49:06.291481448Z [2024-05-25T22:49:06.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status success for try_number 1 2024-05-25T22:49:06.298329715Z [2024-05-25T22:49:06.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=2024-05-25 22:49:03.449426+00:00, run_end_date=2024-05-25 22:49:05.163353+00:00, run_duration=1.713927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:00.809215+00:00, queued_by_job_id=1, pid=517 2024-05-25T22:49:06.298382269Z [2024-05-25T22:49:06.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=2024-05-25 22:49:03.391240+00:00, run_end_date=2024-05-25 22:49:05.456751+00:00, run_duration=2.065511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:00.809215+00:00, queued_by_job_id=1, pid=516 2024-05-25T22:49:06.674665397Z [2024-05-25T22:49:06.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:49:06.674750923Z [2024-05-25T22:49:06.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:49:00.650417+00:00, run_end_date=2024-05-25 22:49:06.674450+00:00, run_duration=6.024033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:49:00+00:00, dag_hash=ded14311230b5272cb16458378f2887a 2024-05-25T22:49:06.683253569Z [2024-05-25T22:49:06.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:06.745324974Z [2024-05-25T22:49:06.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status success for try_number 1 2024-05-25T22:49:06.753672659Z [2024-05-25T22:49:06.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=2024-05-25 22:49:04.383653+00:00, run_end_date=2024-05-25 22:49:06.221813+00:00, run_duration=1.83816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:00.809215+00:00, queued_by_job_id=1, pid=534 2024-05-25T22:49:07.831833153Z [2024-05-25T22:49:07.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:49:07.832326131Z [2024-05-25T22:49:07.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:49:00.654839+00:00, run_end_date=2024-05-25 22:49:07.831589+00:00, run_duration=7.17675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:49:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:49:07.844361983Z [2024-05-25T22:49:07.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:07.919757581Z [2024-05-25T22:49:07.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status success for try_number 1 2024-05-25T22:49:07.933486703Z [2024-05-25T22:49:07.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=2024-05-25 22:49:05.141793+00:00, run_end_date=2024-05-25 22:49:06.903992+00:00, run_duration=1.762199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:00.809215+00:00, queued_by_job_id=1, pid=555 2024-05-25T22:49:14.072665930Z [2024-05-25T22:49:14.072+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:49:14.072704677Z 2024-05-25T22:49:14.072710618Z [2024-05-25T22:49:14.072+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:49:14.073184794Z [2024-05-25T22:49:14.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:49:14.073198080Z 2024-05-25T22:49:14.076327259Z [2024-05-25T22:49:14.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:14.076513967Z [2024-05-25T22:49:14.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:49:14.169487340Z [2024-05-25T22:49:14.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 2 2024-05-25T22:49:14.181641461Z [2024-05-25T22:49:14.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20b202b7-6670-4c07-881b-9f1a9c7a3c3a 2024-05-25T22:49:15.179130660Z [2024-05-25T22:49:15.178+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:49:15.179177850Z 2024-05-25T22:49:15.179373183Z [2024-05-25T22:49:15.179+0000] {scheduler_job.py:425} INFO - DAG vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 has 0/16 running and queued tasks 2024-05-25T22:49:15.180363921Z [2024-05-25T22:49:15.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:49:15.180387611Z 2024-05-25T22:49:15.183389187Z [2024-05-25T22:49:15.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:49:15.183680001Z [2024-05-25T22:49:15.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:49:15.264498933Z [2024-05-25T22:49:15.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 2 2024-05-25T22:49:15.273451086Z [2024-05-25T22:49:15.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to a362005a-7c19-494f-aa81-b1f92c65779a 2024-05-25T22:49:16.544721068Z [2024-05-25T22:49:16.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status failed for try_number 2 2024-05-25T22:49:16.554900806Z [2024-05-25T22:49:16.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 22:49:03.117992+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:14.073603+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:49:16.555754708Z [2024-05-25T22:49:16.555+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:16.564621344Z [2024-05-25T22:49:16.564+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:16.578812587Z [2024-05-25T22:49:16.578+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T224800, start_date=, end_date=20240525T224916 2024-05-25T22:49:16.951354453Z [2024-05-25T22:49:16.950+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T22:49:16.951631946Z [2024-05-25T22:49:16.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:49:00.661032+00:00, run_end_date=2024-05-25 22:49:16.951261+00:00, run_duration=16.290229, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:49:00+00:00, dag_hash=847797f7193a09f78d58873de954be5f 2024-05-25T22:49:16.959907174Z [2024-05-25T22:49:16.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:49:18.083796343Z [2024-05-25T22:49:18.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status failed for try_number 2 2024-05-25T22:49:18.090857018Z [2024-05-25T22:49:18.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 22:49:05.067587+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:49:15.180869+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:49:18.091798550Z [2024-05-25T22:49:18.091+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:18.095692650Z [2024-05-25T22:49:18.095+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:49:18.108731735Z [2024-05-25T22:49:18.108+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T224800, start_date=, end_date=20240525T224918 2024-05-25T22:49:18.589597473Z [2024-05-25T22:49:18.589+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T22:49:18.589727373Z [2024-05-25T22:49:18.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:49:00.652716+00:00, run_end_date=2024-05-25 22:49:18.589380+00:00, run_duration=17.936664, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:49:00+00:00, dag_hash=68e89c02681f04d6f47e2682b2dfde48 2024-05-25T22:49:18.597439606Z [2024-05-25T22:49:18.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_fd84dd44-64f0-46c2-9218-bdaf287e6c21 to 2024-05-25T22:49:00+00:00, run_after=2024-05-25T22:50:00+00:00 2024-05-25T22:50:00.806726384Z [2024-05-25T22:50:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:00.822935429Z [2024-05-25T22:50:00.816+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:50:00.831216502Z [2024-05-25T22:50:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:50:00.843848411Z [2024-05-25T22:50:00.843+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:50:00.852551282Z [2024-05-25T22:50:00.852+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:50:00.867372759Z [2024-05-25T22:50:00.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:50:00.881951359Z [2024-05-25T22:50:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:00.897586058Z [2024-05-25T22:50:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:01.102385746Z [2024-05-25T22:50:01.101+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-05-25T22:50:01.102431553Z 2024-05-25T22:50:01.102440966Z 2024-05-25T22:50:01.102449888Z 2024-05-25T22:50:01.102459974Z 2024-05-25T22:50:01.102468417Z 2024-05-25T22:50:01.102476606Z 2024-05-25T22:50:01.102484955Z 2024-05-25T22:50:01.102493224Z 2024-05-25T22:50:01.102501417Z [2024-05-25T22:50:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:50:01.102553071Z [2024-05-25T22:50:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:50:01.102609521Z [2024-05-25T22:50:01.102+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:50:01.102773921Z [2024-05-25T22:50:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:50:01.102821578Z [2024-05-25T22:50:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:50:01.102990683Z [2024-05-25T22:50:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:50:01.103053937Z [2024-05-25T22:50:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:50:01.103183104Z [2024-05-25T22:50:01.103+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:50:01.104213630Z [2024-05-25T22:50:01.103+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:50:01.104240341Z 2024-05-25T22:50:01.104251463Z 2024-05-25T22:50:01.104261868Z 2024-05-25T22:50:01.104272184Z 2024-05-25T22:50:01.104281680Z 2024-05-25T22:50:01.104291442Z 2024-05-25T22:50:01.104300876Z 2024-05-25T22:50:01.104310401Z 2024-05-25T22:50:01.115455416Z [2024-05-25T22:50:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T22:50:01.115497586Z [2024-05-25T22:50:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:01.115719673Z [2024-05-25T22:50:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T22:50:01.115748690Z [2024-05-25T22:50:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:01.115990674Z [2024-05-25T22:50:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:01.116020100Z [2024-05-25T22:50:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:50:01.116274961Z [2024-05-25T22:50:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:01.116300794Z [2024-05-25T22:50:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:50:01.116543421Z [2024-05-25T22:50:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:01.116570717Z [2024-05-25T22:50:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:50:01.116804632Z [2024-05-25T22:50:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:01.116829821Z [2024-05-25T22:50:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:50:01.117010094Z [2024-05-25T22:50:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:01.117042081Z [2024-05-25T22:50:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:50:01.117402126Z [2024-05-25T22:50:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:01.117563904Z [2024-05-25T22:50:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:50:01.944482124Z [2024-05-25T22:50:01.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.946601463Z [2024-05-25T22:50:01.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.946839475Z [2024-05-25T22:50:01.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.947152000Z [2024-05-25T22:50:01.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.947325954Z [2024-05-25T22:50:01.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.947463903Z [2024-05-25T22:50:01.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.947643887Z [2024-05-25T22:50:01.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.947772230Z [2024-05-25T22:50:01.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:01.965692461Z [2024-05-25T22:50:01.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb226121-b228-46d0-a8d3-6e3ad3e7a01e 2024-05-25T22:50:01.965952891Z [2024-05-25T22:50:01.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57702954-f5c3-406f-ba89-b57e20a78707 2024-05-25T22:50:01.966143567Z [2024-05-25T22:50:01.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 041d4f94-20d4-4cc2-9107-0d16c632fb8f 2024-05-25T22:50:01.966332456Z [2024-05-25T22:50:01.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6dd31b0e-38bf-4db7-8f3e-75031cf2f701 2024-05-25T22:50:01.966539346Z [2024-05-25T22:50:01.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d73e7da-64d4-42c6-bf22-78bc77a3d2b7 2024-05-25T22:50:01.966723898Z [2024-05-25T22:50:01.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76946e20-39c1-41f6-bd40-fd19243dad08 2024-05-25T22:50:01.966901642Z [2024-05-25T22:50:01.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69870078-5106-415d-bea3-6983c651f368 2024-05-25T22:50:01.967104793Z [2024-05-25T22:50:01.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to c847673e-da3d-48ea-af86-e0afb2d25753 2024-05-25T22:50:05.177542714Z [2024-05-25T22:50:05.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:50:05.178020937Z [2024-05-25T22:50:05.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:48:00+00:00, run_id=scheduled__2024-05-25T22:48:00+00:00, run_start_date=2024-05-25 22:50:00.922737+00:00, run_end_date=2024-05-25 22:50:05.177612+00:00, run_duration=4.254875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:48:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:50:05.185677041Z [2024-05-25T22:50:05.185+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:52:00+00:00 2024-05-25T22:50:05.203462369Z [2024-05-25T22:50:05.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:50:05.203934941Z [2024-05-25T22:50:05.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:49:00+00:00, run_id=scheduled__2024-05-25T22:49:00+00:00, run_start_date=2024-05-25 22:50:00.931616+00:00, run_end_date=2024-05-25 22:50:05.203581+00:00, run_duration=4.271965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:49:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:50:05.226481247Z [2024-05-25T22:50:05.226+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:05.472260940Z [2024-05-25T22:50:05.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:48:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:05.472379198Z [2024-05-25T22:50:05.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:05.505188647Z [2024-05-25T22:50:05.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:48:00+00:00, map_index=-1, run_start_date=2024-05-25 22:50:02.209044+00:00, run_end_date=2024-05-25 22:50:03.849088+00:00, run_duration=1.640044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=606 2024-05-25T22:50:05.505549735Z [2024-05-25T22:50:05.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:49:00+00:00, map_index=-1, run_start_date=2024-05-25 22:50:03.657397+00:00, run_end_date=2024-05-25 22:50:04.330148+00:00, run_duration=0.672751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=620 2024-05-25T22:50:06.946549692Z [2024-05-25T22:50:06.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status failed for try_number 1 2024-05-25T22:50:06.946586987Z [2024-05-25T22:50:06.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status failed for try_number 1 2024-05-25T22:50:06.964965533Z [2024-05-25T22:50:06.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:50:06.965323356Z [2024-05-25T22:50:06.965+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:06.969362679Z [2024-05-25T22:50:06.969+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:06.988014883Z [2024-05-25T22:50:06.987+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=extract_metrics_from_vnfrs, execution_date=20240525T224500, start_date=, end_date=20240525T225006 2024-05-25T22:50:07.007277542Z [2024-05-25T22:50:07.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:50:07.007732916Z [2024-05-25T22:50:07.007+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:07.010565532Z [2024-05-25T22:50:07.010+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:07.027655956Z [2024-05-25T22:50:07.026+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T224900, start_date=, end_date=20240525T225007 2024-05-25T22:50:08.049065052Z [2024-05-25T22:50:08.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:50:08.049710492Z [2024-05-25T22:50:08.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:49:00+00:00, run_id=scheduled__2024-05-25T22:49:00+00:00, run_start_date=2024-05-25 22:50:00.924359+00:00, run_end_date=2024-05-25 22:50:08.048903+00:00, run_duration=7.124544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:49:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:50:08.061409198Z [2024-05-25T22:50:08.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:08.088541752Z [2024-05-25T22:50:08.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:50:08.088948504Z [2024-05-25T22:50:08.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:49:00+00:00, run_id=scheduled__2024-05-25T22:49:00+00:00, run_start_date=2024-05-25 22:50:00.929557+00:00, run_end_date=2024-05-25 22:50:08.088328+00:00, run_duration=7.158771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:49:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:50:08.102820830Z [2024-05-25T22:50:08.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:08.182040579Z [2024-05-25T22:50:08.181+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:50:08.182077764Z 2024-05-25T22:50:08.182532565Z [2024-05-25T22:50:08.181+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:50:08.183992916Z [2024-05-25T22:50:08.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:50:08.184007105Z 2024-05-25T22:50:08.189811345Z [2024-05-25T22:50:08.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T22:50:08.190183409Z [2024-05-25T22:50:08.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:08.261560390Z [2024-05-25T22:50:08.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:08.262154961Z [2024-05-25T22:50:08.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:08.262625970Z [2024-05-25T22:50:08.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:08.263118221Z [2024-05-25T22:50:08.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status failed for try_number 1 2024-05-25T22:50:08.263724226Z [2024-05-25T22:50:08.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:08.279879745Z [2024-05-25T22:50:08.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:49:00+00:00, map_index=-1, run_start_date=2024-05-25 22:50:05.244240+00:00, run_end_date=2024-05-25 22:50:07.339016+00:00, run_duration=2.094776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=633 2024-05-25T22:50:08.280264379Z [2024-05-25T22:50:08.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 403ce4cb-6bc0-40de-9cdc-210e4bf324bc 2024-05-25T22:50:08.280600064Z [2024-05-25T22:50:08.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:45:00+00:00, map_index=-1, run_start_date=2024-05-25 22:50:06.747412+00:00, run_end_date=2024-05-25 22:50:07.126942+00:00, run_duration=0.37953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=676 2024-05-25T22:50:08.280914924Z [2024-05-25T22:50:08.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:49:00+00:00, map_index=-1, run_start_date=2024-05-25 22:50:06.465280+00:00, run_end_date=2024-05-25 22:50:07.773383+00:00, run_duration=1.308103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=670 2024-05-25T22:50:08.281177898Z [2024-05-25T22:50:08.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:01.106652+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:50:08.281752292Z [2024-05-25T22:50:08.281+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:08.286060513Z [2024-05-25T22:50:08.285+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:08.299941112Z [2024-05-25T22:50:08.299+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T224900, start_date=, end_date=20240525T225008 2024-05-25T22:50:10.753906528Z [2024-05-25T22:50:10.753+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:50:10.753931702Z 2024-05-25T22:50:10.754036862Z [2024-05-25T22:50:10.753+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:50:10.754851260Z [2024-05-25T22:50:10.754+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:50:10.754865717Z 2024-05-25T22:50:10.757282997Z [2024-05-25T22:50:10.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T22:50:10.757520531Z [2024-05-25T22:50:10.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:50:10.844647571Z [2024-05-25T22:50:10.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:10.844904533Z [2024-05-25T22:50:10.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:10.854231264Z [2024-05-25T22:50:10.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T22:45:00+00:00, map_index=-1, run_start_date=2024-05-25 22:50:10.013262+00:00, run_end_date=2024-05-25 22:50:10.462750+00:00, run_duration=0.449488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:08.185971+00:00, queued_by_job_id=1, pid=699 2024-05-25T22:50:10.854569222Z [2024-05-25T22:50:10.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1971b6a-e415-4854-bd3c-4a5dbed1806e 2024-05-25T22:50:13.272250184Z [2024-05-25T22:50:13.271+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:50:13.272291322Z 2024-05-25T22:50:13.272299754Z [2024-05-25T22:50:13.272+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:50:13.272895334Z [2024-05-25T22:50:13.272+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:50:13.272918561Z 2024-05-25T22:50:13.276029856Z [2024-05-25T22:50:13.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:13.276170801Z [2024-05-25T22:50:13.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:13.351043940Z [2024-05-25T22:50:13.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status queued for try_number 1 2024-05-25T22:50:13.351269749Z [2024-05-25T22:50:13.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:13.359167653Z [2024-05-25T22:50:13.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T22:45:00+00:00, map_index=0, run_start_date=2024-05-25 22:50:12.294909+00:00, run_end_date=2024-05-25 22:50:12.679436+00:00, run_duration=0.384527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:10.755307+00:00, queued_by_job_id=1, pid=707 2024-05-25T22:50:13.359475376Z [2024-05-25T22:50:13.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to f77f1bf9-0e2f-4109-8676-7cb951412a22 2024-05-25T22:50:15.699198153Z [2024-05-25T22:50:15.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:50:15.699559187Z [2024-05-25T22:50:15.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:45:00+00:00, run_id=scheduled__2024-05-25T22:45:00+00:00, run_start_date=2024-05-25 22:50:00.918314+00:00, run_end_date=2024-05-25 22:50:15.699197+00:00, run_duration=14.780883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:45:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T22:50:15.706831022Z [2024-05-25T22:50:15.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:50:15.798826878Z [2024-05-25T22:50:15.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status success for try_number 1 2024-05-25T22:50:15.807418503Z [2024-05-25T22:50:15.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T22:45:00+00:00, map_index=-1, run_start_date=2024-05-25 22:50:14.886397+00:00, run_end_date=2024-05-25 22:50:15.257843+00:00, run_duration=0.371446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:13.273195+00:00, queued_by_job_id=1, pid=724 2024-05-25T22:50:18.059312282Z [2024-05-25T22:50:18.058+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-25T22:50:18.059376406Z 2024-05-25T22:50:18.059385016Z 2024-05-25T22:50:18.059390988Z [2024-05-25T22:50:18.058+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:50:18.059564319Z [2024-05-25T22:50:18.059+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:50:18.060706054Z [2024-05-25T22:50:18.060+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:50:18.060741989Z 2024-05-25T22:50:18.060752576Z 2024-05-25T22:50:18.065496929Z [2024-05-25T22:50:18.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:45:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-05-25T22:50:18.065684560Z [2024-05-25T22:50:18.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:50:18.066163060Z [2024-05-25T22:50:18.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:49:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:18.066382372Z [2024-05-25T22:50:18.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:50:18.226393851Z [2024-05-25T22:50:18.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status queued for try_number 2 2024-05-25T22:50:18.226679921Z [2024-05-25T22:50:18.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status queued for try_number 2 2024-05-25T22:50:18.235006376Z [2024-05-25T22:50:18.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3128c008-2270-43eb-a13f-1390b4f3d8e5 2024-05-25T22:50:18.235279047Z [2024-05-25T22:50:18.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46a7f046-6c82-490f-b5b7-a3b7efbd6c87 2024-05-25T22:50:18.315394681Z [2024-05-25T22:50:18.314+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:50:18.315483508Z 2024-05-25T22:50:18.316370221Z [2024-05-25T22:50:18.316+0000] {scheduler_job.py:425} INFO - DAG vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb has 0/16 running and queued tasks 2024-05-25T22:50:18.318423994Z [2024-05-25T22:50:18.317+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:50:18.318436663Z 2024-05-25T22:50:18.322167712Z [2024-05-25T22:50:18.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:49:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:50:18.322472090Z [2024-05-25T22:50:18.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:50:18.438495094Z [2024-05-25T22:50:18.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status queued for try_number 2 2024-05-25T22:50:18.453691217Z [2024-05-25T22:50:18.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d57f482-b19a-46a4-bed9-eb5a71ae6106 2024-05-25T22:50:20.390073006Z [2024-05-25T22:50:20.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:45:00+00:00 exited with status failed for try_number 2 2024-05-25T22:50:20.390168711Z [2024-05-25T22:50:20.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status failed for try_number 2 2024-05-25T22:50:20.390227196Z [2024-05-25T22:50:20.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:49:00+00:00 exited with status failed for try_number 2 2024-05-25T22:50:20.400109525Z [2024-05-25T22:50:20.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 22:50:08.288846+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:18.319196+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:50:20.400565657Z [2024-05-25T22:50:20.400+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:20.402849875Z [2024-05-25T22:50:20.402+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:20.418303755Z [2024-05-25T22:50:20.417+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T224900, start_date=, end_date=20240525T225020 2024-05-25T22:50:20.427665534Z [2024-05-25T22:50:20.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 22:50:06.974427+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:18.061470+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:50:20.427999285Z [2024-05-25T22:50:20.427+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:20.430637591Z [2024-05-25T22:50:20.430+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:20.442118189Z [2024-05-25T22:50:20.441+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=extract_metrics_from_vnfrs, execution_date=20240525T224500, start_date=, end_date=20240525T225020 2024-05-25T22:50:20.451475526Z [2024-05-25T22:50:20.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:49:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 22:50:07.012922+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:50:18.061470+00:00, queued_by_job_id=1, pid=None 2024-05-25T22:50:20.451725499Z [2024-05-25T22:50:20.451+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:20.454161090Z [2024-05-25T22:50:20.453+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T22:50:20.489144243Z [2024-05-25T22:50:20.487+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T224900, start_date=, end_date=20240525T225020 2024-05-25T22:50:21.578117709Z [2024-05-25T22:50:21.577+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T22:50:21.578619206Z [2024-05-25T22:50:21.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:49:00+00:00, run_id=scheduled__2024-05-25T22:49:00+00:00, run_start_date=2024-05-25 22:50:00.925880+00:00, run_end_date=2024-05-25 22:50:21.577928+00:00, run_duration=20.652048, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:49:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=ded14311230b5272cb16458378f2887a 2024-05-25T22:50:21.594351064Z [2024-05-25T22:50:21.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:21.602613065Z [2024-05-25T22:50:21.602+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T22:50:21.602857060Z [2024-05-25T22:50:21.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:49:00+00:00, run_id=scheduled__2024-05-25T22:49:00+00:00, run_start_date=2024-05-25 22:50:00.927726+00:00, run_end_date=2024-05-25 22:50:21.602380+00:00, run_duration=20.674654, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:49:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=7f71adaaf8a4925c4149aea32d65d9d5 2024-05-25T22:50:21.614106016Z [2024-05-25T22:50:21.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:51:00+00:00 2024-05-25T22:50:24.656440227Z [2024-05-25T22:50:24.655+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T22:50:24.656813480Z [2024-05-25T22:50:24.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb, execution_date=2024-05-25 22:45:00+00:00, run_id=scheduled__2024-05-25T22:45:00+00:00, run_start_date=2024-05-25 22:50:00.920805+00:00, run_end_date=2024-05-25 22:50:24.656207+00:00, run_duration=23.735402, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:45:00+00:00, data_interval_end=2024-05-25 22:50:00+00:00, dag_hash=b1570d86a8ad859e741d41dd72819c29 2024-05-25T22:50:24.676097845Z [2024-05-25T22:50:24.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_634c4e17-5a7e-4f5d-9c10-919c7fad93bb to 2024-05-25T22:50:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:51:00.274013348Z [2024-05-25T22:51:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:51:00+00:00, run_after=2024-05-25T22:52:00+00:00 2024-05-25T22:51:00.289217404Z [2024-05-25T22:51:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:51:00+00:00, run_after=2024-05-25T22:52:00+00:00 2024-05-25T22:51:00.297712323Z [2024-05-25T22:51:00.297+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:51:00.369119341Z [2024-05-25T22:51:00.368+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T22:51:00.369165420Z 2024-05-25T22:51:00.369202511Z 2024-05-25T22:51:00.369211527Z 2024-05-25T22:51:00.369298386Z [2024-05-25T22:51:00.368+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:51:00.369571188Z [2024-05-25T22:51:00.369+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:51:00.369729945Z [2024-05-25T22:51:00.369+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:51:00.370449076Z [2024-05-25T22:51:00.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:51:00.370463441Z 2024-05-25T22:51:00.370472143Z 2024-05-25T22:51:00.370480507Z 2024-05-25T22:51:00.377244817Z [2024-05-25T22:51:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:51:00.377695482Z [2024-05-25T22:51:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:51:00.378704641Z [2024-05-25T22:51:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:51:00.380125582Z [2024-05-25T22:51:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:51:00.380994351Z [2024-05-25T22:51:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:51:00.381449969Z [2024-05-25T22:51:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:51:00.631510038Z [2024-05-25T22:51:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:51:00.631563139Z [2024-05-25T22:51:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:51:00.631567084Z [2024-05-25T22:51:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:51:00.641550545Z [2024-05-25T22:51:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbb5362f-e0c8-43bc-85c4-b22bd5002516 2024-05-25T22:51:00.641875739Z [2024-05-25T22:51:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83ff594c-a3c0-43d3-a44c-0f01555bc884 2024-05-25T22:51:00.642097844Z [2024-05-25T22:51:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18e0d9b5-45be-477a-8b75-9adaeabed276 2024-05-25T22:51:01.894685571Z [2024-05-25T22:51:01.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:51:01.894842462Z [2024-05-25T22:51:01.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:50:00+00:00, run_id=scheduled__2024-05-25T22:50:00+00:00, run_start_date=2024-05-25 22:51:00.309577+00:00, run_end_date=2024-05-25 22:51:01.894524+00:00, run_duration=1.584947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:50:00+00:00, data_interval_end=2024-05-25 22:51:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:51:01.914367214Z [2024-05-25T22:51:01.913+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:51:00+00:00, run_after=2024-05-25T22:52:00+00:00 2024-05-25T22:51:01.948156653Z [2024-05-25T22:51:01.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:51:01.953456841Z [2024-05-25T22:51:01.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=-1, run_start_date=2024-05-25 22:51:01.220033+00:00, run_end_date=2024-05-25 22:51:01.629510+00:00, run_duration=0.409477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:51:00.371253+00:00, queued_by_job_id=1, pid=772 2024-05-25T22:51:04.115676982Z [2024-05-25T22:51:04.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:51:04.119736395Z [2024-05-25T22:51:04.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:50:00+00:00, run_id=scheduled__2024-05-25T22:50:00+00:00, run_start_date=2024-05-25 22:51:00.311005+00:00, run_end_date=2024-05-25 22:51:04.115644+00:00, run_duration=3.804639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:50:00+00:00, data_interval_end=2024-05-25 22:51:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:51:04.162741266Z [2024-05-25T22:51:04.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:51:00+00:00, run_after=2024-05-25T22:52:00+00:00 2024-05-25T22:51:04.241395759Z [2024-05-25T22:51:04.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:51:04.247945230Z [2024-05-25T22:51:04.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=-1, run_start_date=2024-05-25 22:51:02.149056+00:00, run_end_date=2024-05-25 22:51:03.556461+00:00, run_duration=1.407405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:51:00.371253+00:00, queued_by_job_id=1, pid=790 2024-05-25T22:51:04.491417928Z [2024-05-25T22:51:04.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:51:04.491446670Z [2024-05-25T22:51:04.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:50:00+00:00, run_id=scheduled__2024-05-25T22:50:00+00:00, run_start_date=2024-05-25 22:51:00.312139+00:00, run_end_date=2024-05-25 22:51:04.474806+00:00, run_duration=4.162667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:50:00+00:00, data_interval_end=2024-05-25 22:51:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:51:04.498208653Z [2024-05-25T22:51:04.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:51:00+00:00, run_after=2024-05-25T22:52:00+00:00 2024-05-25T22:51:04.527355490Z [2024-05-25T22:51:04.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:51:04.533743136Z [2024-05-25T22:51:04.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=-1, run_start_date=2024-05-25 22:51:02.285203+00:00, run_end_date=2024-05-25 22:51:04.151727+00:00, run_duration=1.866524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:51:00.371253+00:00, queued_by_job_id=1, pid=791 2024-05-25T22:52:00.063376421Z [2024-05-25T22:52:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:52:00+00:00, run_after=2024-05-25T22:53:00+00:00 2024-05-25T22:52:00.082601302Z [2024-05-25T22:52:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:52:00+00:00, run_after=2024-05-25T22:53:00+00:00 2024-05-25T22:52:00.095556978Z [2024-05-25T22:52:00.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:52:00.107781076Z [2024-05-25T22:52:00.107+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:52:00.229750845Z [2024-05-25T22:52:00.229+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T22:52:00.229769952Z 2024-05-25T22:52:00.229782180Z 2024-05-25T22:52:00.229785688Z 2024-05-25T22:52:00.229789359Z 2024-05-25T22:52:00.229793323Z [2024-05-25T22:52:00.229+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:52:00.229907246Z [2024-05-25T22:52:00.229+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:52:00.230031250Z [2024-05-25T22:52:00.229+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:52:00.230125972Z [2024-05-25T22:52:00.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:52:00.230730786Z [2024-05-25T22:52:00.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:52:00.230736704Z 2024-05-25T22:52:00.230740419Z 2024-05-25T22:52:00.230743906Z 2024-05-25T22:52:00.230755060Z 2024-05-25T22:52:00.235178684Z [2024-05-25T22:52:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:52:00.235568146Z [2024-05-25T22:52:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:52:00.236103087Z [2024-05-25T22:52:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:52:00.236454505Z [2024-05-25T22:52:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:52:00.236976327Z [2024-05-25T22:52:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:52:00.237247440Z [2024-05-25T22:52:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:52:00.237573032Z [2024-05-25T22:52:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:52:00.237738915Z [2024-05-25T22:52:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:52:01.011241145Z [2024-05-25T22:52:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:52:01.012209993Z [2024-05-25T22:52:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:51:00+00:00 exited with status queued for try_number 1 2024-05-25T22:52:01.012703935Z [2024-05-25T22:52:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:51:00+00:00 exited with status queued for try_number 1 2024-05-25T22:52:01.012903751Z [2024-05-25T22:52:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:51:00+00:00 exited with status queued for try_number 1 2024-05-25T22:52:01.054427598Z [2024-05-25T22:52:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ee0223e-ffe3-4c40-9b76-d82e0520aa5a 2024-05-25T22:52:01.054956726Z [2024-05-25T22:52:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e556d0e-a892-41f4-8bb9-5c66d883d718 2024-05-25T22:52:01.055172562Z [2024-05-25T22:52:01.055+0000] {scheduler_job.py:635} INFO - Setting external_id for to b41962af-fde3-499e-b27a-d4dad659e026 2024-05-25T22:52:01.055356825Z [2024-05-25T22:52:01.055+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17450b76-6ead-416f-bd3a-ad0e6a740401 2024-05-25T22:52:03.452470452Z [2024-05-25T22:52:03.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:52:03.452893378Z [2024-05-25T22:52:03.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:50:00+00:00, run_id=scheduled__2024-05-25T22:50:00+00:00, run_start_date=2024-05-25 22:52:00.155330+00:00, run_end_date=2024-05-25 22:52:03.452473+00:00, run_duration=3.297143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:50:00+00:00, data_interval_end=2024-05-25 22:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:52:03.471334736Z [2024-05-25T22:52:03.471+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:52:00+00:00, run_after=2024-05-25T22:54:00+00:00 2024-05-25T22:52:03.511147717Z [2024-05-25T22:52:03.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:52:03.511301731Z [2024-05-25T22:52:03.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:51:00+00:00, run_id=scheduled__2024-05-25T22:51:00+00:00, run_start_date=2024-05-25 22:52:00.157652+00:00, run_end_date=2024-05-25 22:52:03.511089+00:00, run_duration=3.353437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:51:00+00:00, data_interval_end=2024-05-25 22:52:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:52:03.534056299Z [2024-05-25T22:52:03.533+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:52:00+00:00, run_after=2024-05-25T22:53:00+00:00 2024-05-25T22:52:03.805719191Z [2024-05-25T22:52:03.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:52:03.805801068Z [2024-05-25T22:52:03.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:51:00+00:00 exited with status success for try_number 1 2024-05-25T22:52:03.847401604Z [2024-05-25T22:52:03.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=-1, run_start_date=2024-05-25 22:52:01.700038+00:00, run_end_date=2024-05-25 22:52:02.522769+00:00, run_duration=0.822731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:52:00.231563+00:00, queued_by_job_id=1, pid=824 2024-05-25T22:52:03.847604025Z [2024-05-25T22:52:03.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:51:00+00:00, map_index=-1, run_start_date=2024-05-25 22:52:01.837979+00:00, run_end_date=2024-05-25 22:52:02.710036+00:00, run_duration=0.872057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:52:00.231563+00:00, queued_by_job_id=1, pid=825 2024-05-25T22:52:06.625763606Z [2024-05-25T22:52:06.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:52:06.626432445Z [2024-05-25T22:52:06.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:51:00+00:00, run_id=scheduled__2024-05-25T22:51:00+00:00, run_start_date=2024-05-25 22:52:00.159388+00:00, run_end_date=2024-05-25 22:52:06.625673+00:00, run_duration=6.466285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:51:00+00:00, data_interval_end=2024-05-25 22:52:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:52:06.636716042Z [2024-05-25T22:52:06.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:52:00+00:00, run_after=2024-05-25T22:53:00+00:00 2024-05-25T22:52:06.643331615Z [2024-05-25T22:52:06.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:52:06.643680920Z [2024-05-25T22:52:06.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:51:00+00:00, run_id=scheduled__2024-05-25T22:51:00+00:00, run_start_date=2024-05-25 22:52:00.160956+00:00, run_end_date=2024-05-25 22:52:06.643294+00:00, run_duration=6.482338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:51:00+00:00, data_interval_end=2024-05-25 22:52:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:52:06.654913871Z [2024-05-25T22:52:06.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:52:00+00:00, run_after=2024-05-25T22:53:00+00:00 2024-05-25T22:52:06.765974458Z [2024-05-25T22:52:06.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:51:00+00:00 exited with status success for try_number 1 2024-05-25T22:52:06.771951450Z [2024-05-25T22:52:06.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:51:00+00:00, map_index=-1, run_start_date=2024-05-25 22:52:04.077444+00:00, run_end_date=2024-05-25 22:52:06.232501+00:00, run_duration=2.155057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:52:00.231563+00:00, queued_by_job_id=1, pid=848 2024-05-25T22:52:07.987953478Z [2024-05-25T22:52:07.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:51:00+00:00 exited with status success for try_number 1 2024-05-25T22:52:08.020668112Z [2024-05-25T22:52:08.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:51:00+00:00, map_index=-1, run_start_date=2024-05-25 22:52:04.022899+00:00, run_end_date=2024-05-25 22:52:06.483856+00:00, run_duration=2.460957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:52:00.231563+00:00, queued_by_job_id=1, pid=849 2024-05-25T22:53:00.517437885Z [2024-05-25T22:53:00.516+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:53:00.529761101Z [2024-05-25T22:53:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:53:00+00:00, run_after=2024-05-25T22:54:00+00:00 2024-05-25T22:53:00.541134818Z [2024-05-25T22:53:00.540+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:53:00+00:00, run_after=2024-05-25T22:54:00+00:00 2024-05-25T22:53:00.603499824Z [2024-05-25T22:53:00.603+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T22:53:00.603534113Z 2024-05-25T22:53:00.603539352Z 2024-05-25T22:53:00.603543285Z 2024-05-25T22:53:00.603848864Z [2024-05-25T22:53:00.603+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:53:00.604911464Z [2024-05-25T22:53:00.603+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:53:00.604935510Z [2024-05-25T22:53:00.604+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:53:00.604940009Z [2024-05-25T22:53:00.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:53:00.604943558Z 2024-05-25T22:53:00.604947411Z 2024-05-25T22:53:00.604951073Z 2024-05-25T22:53:00.608315330Z [2024-05-25T22:53:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:53:00.608576030Z [2024-05-25T22:53:00.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:53:00.608876122Z [2024-05-25T22:53:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:53:00.609022683Z [2024-05-25T22:53:00.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:53:00.609280951Z [2024-05-25T22:53:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:53:00.609424327Z [2024-05-25T22:53:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:53:01.108214015Z [2024-05-25T22:53:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status queued for try_number 1 2024-05-25T22:53:01.108293009Z [2024-05-25T22:53:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status queued for try_number 1 2024-05-25T22:53:01.108399439Z [2024-05-25T22:53:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status queued for try_number 1 2024-05-25T22:53:01.133433936Z [2024-05-25T22:53:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d321e3a-dc80-46d5-9db6-3f64d300122e 2024-05-25T22:53:01.133778758Z [2024-05-25T22:53:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0de029fe-9035-4823-b486-69715c023a8a 2024-05-25T22:53:01.133788972Z [2024-05-25T22:53:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 990d9a5c-c4e2-4282-abfe-07e5ececb41f 2024-05-25T22:53:03.537598732Z [2024-05-25T22:53:03.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:53:03.538434158Z [2024-05-25T22:53:03.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:52:00+00:00, run_id=scheduled__2024-05-25T22:52:00+00:00, run_start_date=2024-05-25 22:53:00.552986+00:00, run_end_date=2024-05-25 22:53:03.537520+00:00, run_duration=2.984534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:52:00+00:00, data_interval_end=2024-05-25 22:53:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:53:03.559318249Z [2024-05-25T22:53:03.558+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:53:00+00:00, run_after=2024-05-25T22:54:00+00:00 2024-05-25T22:53:03.716680825Z [2024-05-25T22:53:03.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status success for try_number 1 2024-05-25T22:53:03.735753092Z [2024-05-25T22:53:03.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:52:00+00:00, map_index=-1, run_start_date=2024-05-25 22:53:02.054438+00:00, run_end_date=2024-05-25 22:53:02.631914+00:00, run_duration=0.577476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:53:00.605668+00:00, queued_by_job_id=1, pid=881 2024-05-25T22:53:06.587461365Z [2024-05-25T22:53:06.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:53:06.587882480Z [2024-05-25T22:53:06.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:52:00+00:00, run_id=scheduled__2024-05-25T22:52:00+00:00, run_start_date=2024-05-25 22:53:00.550373+00:00, run_end_date=2024-05-25 22:53:06.587320+00:00, run_duration=6.036947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:52:00+00:00, data_interval_end=2024-05-25 22:53:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:53:06.603618225Z [2024-05-25T22:53:06.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:53:00+00:00, run_after=2024-05-25T22:54:00+00:00 2024-05-25T22:53:06.615207691Z [2024-05-25T22:53:06.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:53:06.616166924Z [2024-05-25T22:53:06.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:52:00+00:00, run_id=scheduled__2024-05-25T22:52:00+00:00, run_start_date=2024-05-25 22:53:00.551693+00:00, run_end_date=2024-05-25 22:53:06.615061+00:00, run_duration=6.063368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:52:00+00:00, data_interval_end=2024-05-25 22:53:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:53:06.637441674Z [2024-05-25T22:53:06.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:53:00+00:00, run_after=2024-05-25T22:54:00+00:00 2024-05-25T22:53:06.694705686Z [2024-05-25T22:53:06.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status success for try_number 1 2024-05-25T22:53:06.695013836Z [2024-05-25T22:53:06.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status success for try_number 1 2024-05-25T22:53:06.704047998Z [2024-05-25T22:53:06.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:52:00+00:00, map_index=-1, run_start_date=2024-05-25 22:53:03.734532+00:00, run_end_date=2024-05-25 22:53:05.493260+00:00, run_duration=1.758728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:53:00.605668+00:00, queued_by_job_id=1, pid=900 2024-05-25T22:53:06.704125993Z [2024-05-25T22:53:06.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:52:00+00:00, map_index=-1, run_start_date=2024-05-25 22:53:03.649295+00:00, run_end_date=2024-05-25 22:53:05.755817+00:00, run_duration=2.106522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:53:00.605668+00:00, queued_by_job_id=1, pid=899 2024-05-25T22:53:30.080006591Z [2024-05-25T22:53:30.078+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T22:54:00.468063617Z [2024-05-25T22:54:00.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:54:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:54:00.482607393Z [2024-05-25T22:54:00.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:54:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:54:00.489892846Z [2024-05-25T22:54:00.489+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:54:00.497442191Z [2024-05-25T22:54:00.496+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:54:00.557745417Z [2024-05-25T22:54:00.557+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T22:54:00.557770236Z 2024-05-25T22:54:00.557774397Z 2024-05-25T22:54:00.557777777Z 2024-05-25T22:54:00.557781302Z 2024-05-25T22:54:00.557890557Z [2024-05-25T22:54:00.557+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:54:00.558028013Z [2024-05-25T22:54:00.557+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:54:00.558138051Z [2024-05-25T22:54:00.558+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:54:00.558267929Z [2024-05-25T22:54:00.558+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:54:00.558956707Z [2024-05-25T22:54:00.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:54:00.558964620Z 2024-05-25T22:54:00.558967927Z 2024-05-25T22:54:00.558971025Z 2024-05-25T22:54:00.558974144Z 2024-05-25T22:54:00.562010862Z [2024-05-25T22:54:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:54:00.562202957Z [2024-05-25T22:54:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:54:00.562462035Z [2024-05-25T22:54:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:54:00.562599571Z [2024-05-25T22:54:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:54:00.562878634Z [2024-05-25T22:54:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:54:00.563021560Z [2024-05-25T22:54:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:54:00.563281378Z [2024-05-25T22:54:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:54:00.563406723Z [2024-05-25T22:54:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:54:00.845644595Z [2024-05-25T22:54:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status queued for try_number 1 2024-05-25T22:54:00.845752156Z [2024-05-25T22:54:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:53:00+00:00 exited with status queued for try_number 1 2024-05-25T22:54:00.845862485Z [2024-05-25T22:54:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:53:00+00:00 exited with status queued for try_number 1 2024-05-25T22:54:00.845971452Z [2024-05-25T22:54:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:53:00+00:00 exited with status queued for try_number 1 2024-05-25T22:54:00.857115245Z [2024-05-25T22:54:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 866627d3-59d4-49c1-901f-4a91b77dc460 2024-05-25T22:54:00.857346057Z [2024-05-25T22:54:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd8f0bd0-aaf6-4851-8e88-2ed1c47a4e07 2024-05-25T22:54:00.857498542Z [2024-05-25T22:54:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to f800a1cf-644c-47bc-b48f-863991dfef8c 2024-05-25T22:54:00.857635655Z [2024-05-25T22:54:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to a076bd5e-9bef-4bff-b203-6ee22d8cb9ff 2024-05-25T22:54:02.009237249Z [2024-05-25T22:54:02.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:54:02.009681622Z [2024-05-25T22:54:02.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:52:00+00:00, run_id=scheduled__2024-05-25T22:52:00+00:00, run_start_date=2024-05-25 22:54:00.506237+00:00, run_end_date=2024-05-25 22:54:02.009209+00:00, run_duration=1.502972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:52:00+00:00, data_interval_end=2024-05-25 22:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:54:02.017900578Z [2024-05-25T22:54:02.017+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:54:00+00:00, run_after=2024-05-25T22:56:00+00:00 2024-05-25T22:54:02.035207810Z [2024-05-25T22:54:02.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:54:02.035471981Z [2024-05-25T22:54:02.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:53:00+00:00, run_id=scheduled__2024-05-25T22:53:00+00:00, run_start_date=2024-05-25 22:54:00.509467+00:00, run_end_date=2024-05-25 22:54:02.035121+00:00, run_duration=1.525654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:53:00+00:00, data_interval_end=2024-05-25 22:54:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:54:02.046978622Z [2024-05-25T22:54:02.046+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:54:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:54:02.083196278Z [2024-05-25T22:54:02.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:52:00+00:00 exited with status success for try_number 1 2024-05-25T22:54:02.083498614Z [2024-05-25T22:54:02.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:53:00+00:00 exited with status success for try_number 1 2024-05-25T22:54:02.097917869Z [2024-05-25T22:54:02.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:52:00+00:00, map_index=-1, run_start_date=2024-05-25 22:54:01.473708+00:00, run_end_date=2024-05-25 22:54:01.778096+00:00, run_duration=0.304388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:54:00.559733+00:00, queued_by_job_id=1, pid=934 2024-05-25T22:54:02.098380064Z [2024-05-25T22:54:02.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:53:00+00:00, map_index=-1, run_start_date=2024-05-25 22:54:01.465470+00:00, run_end_date=2024-05-25 22:54:01.884710+00:00, run_duration=0.41924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:54:00.559733+00:00, queued_by_job_id=1, pid=933 2024-05-25T22:54:04.517476684Z [2024-05-25T22:54:04.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:54:04.518001581Z [2024-05-25T22:54:04.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:53:00+00:00, run_id=scheduled__2024-05-25T22:53:00+00:00, run_start_date=2024-05-25 22:54:00.510425+00:00, run_end_date=2024-05-25 22:54:04.517319+00:00, run_duration=4.006894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:53:00+00:00, data_interval_end=2024-05-25 22:54:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:54:04.537214360Z [2024-05-25T22:54:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:54:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:54:04.549520109Z [2024-05-25T22:54:04.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:54:04.550012602Z [2024-05-25T22:54:04.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:53:00+00:00, run_id=scheduled__2024-05-25T22:53:00+00:00, run_start_date=2024-05-25 22:54:00.508150+00:00, run_end_date=2024-05-25 22:54:04.549473+00:00, run_duration=4.041323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:53:00+00:00, data_interval_end=2024-05-25 22:54:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:54:04.570712757Z [2024-05-25T22:54:04.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:54:00+00:00, run_after=2024-05-25T22:55:00+00:00 2024-05-25T22:54:04.607803408Z [2024-05-25T22:54:04.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:53:00+00:00 exited with status success for try_number 1 2024-05-25T22:54:04.608263575Z [2024-05-25T22:54:04.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:53:00+00:00 exited with status success for try_number 1 2024-05-25T22:54:04.620067550Z [2024-05-25T22:54:04.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:53:00+00:00, map_index=-1, run_start_date=2024-05-25 22:54:02.591003+00:00, run_end_date=2024-05-25 22:54:04.184665+00:00, run_duration=1.593662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:54:00.559733+00:00, queued_by_job_id=1, pid=957 2024-05-25T22:54:04.620496773Z [2024-05-25T22:54:04.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:53:00+00:00, map_index=-1, run_start_date=2024-05-25 22:54:02.731669+00:00, run_end_date=2024-05-25 22:54:04.193111+00:00, run_duration=1.461442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:54:00.559733+00:00, queued_by_job_id=1, pid=958 2024-05-25T22:55:00.408010782Z [2024-05-25T22:55:00.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:55:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:55:00.426719137Z [2024-05-25T22:55:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:55:00+00:00, run_after=2024-05-25T22:56:00+00:00 2024-05-25T22:55:00.441009566Z [2024-05-25T22:55:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:55:00+00:00, run_after=2024-05-25T22:56:00+00:00 2024-05-25T22:55:00.452132968Z [2024-05-25T22:55:00.450+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:55:00.588087450Z [2024-05-25T22:55:00.587+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T22:55:00.588128757Z 2024-05-25T22:55:00.588136046Z 2024-05-25T22:55:00.588141431Z 2024-05-25T22:55:00.588146561Z 2024-05-25T22:55:00.588778870Z [2024-05-25T22:55:00.588+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:55:00.589345952Z [2024-05-25T22:55:00.588+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:55:00.589700019Z [2024-05-25T22:55:00.589+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:55:00.590034236Z [2024-05-25T22:55:00.589+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:55:00.592010447Z [2024-05-25T22:55:00.591+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:55:00.592031548Z 2024-05-25T22:55:00.592037212Z 2024-05-25T22:55:00.592042373Z 2024-05-25T22:55:00.592047728Z 2024-05-25T22:55:00.601409673Z [2024-05-25T22:55:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T22:55:00.601705048Z [2024-05-25T22:55:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:55:00.602147589Z [2024-05-25T22:55:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:55:00.602377611Z [2024-05-25T22:55:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:55:00.602782043Z [2024-05-25T22:55:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:55:00.603028343Z [2024-05-25T22:55:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:55:00.603577950Z [2024-05-25T22:55:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:55:00.603770268Z [2024-05-25T22:55:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:55:01.020273941Z [2024-05-25T22:55:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:55:01.020317930Z [2024-05-25T22:55:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status queued for try_number 1 2024-05-25T22:55:01.020380866Z [2024-05-25T22:55:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status queued for try_number 1 2024-05-25T22:55:01.020401022Z [2024-05-25T22:55:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status queued for try_number 1 2024-05-25T22:55:01.043350006Z [2024-05-25T22:55:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9eccb98c-7c67-4326-9547-af17a2201003 2024-05-25T22:55:01.043536569Z [2024-05-25T22:55:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23c4ac8e-f8bc-4173-84e4-59a2a59188f7 2024-05-25T22:55:01.043748437Z [2024-05-25T22:55:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b7bb584-3123-40a7-8597-4d5ca26d5ad1 2024-05-25T22:55:01.046283687Z [2024-05-25T22:55:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85ed7f97-bc38-4678-928b-0a4850ca1aaa 2024-05-25T22:55:02.351075413Z [2024-05-25T22:55:02.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:55:02.351385217Z [2024-05-25T22:55:02.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:54:00+00:00, run_id=scheduled__2024-05-25T22:54:00+00:00, run_start_date=2024-05-25 22:55:00.482593+00:00, run_end_date=2024-05-25 22:55:02.350950+00:00, run_duration=1.868357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:54:00+00:00, data_interval_end=2024-05-25 22:55:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:55:02.361370021Z [2024-05-25T22:55:02.361+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:55:00+00:00, run_after=2024-05-25T22:56:00+00:00 2024-05-25T22:55:02.398564739Z [2024-05-25T22:55:02.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status success for try_number 1 2024-05-25T22:55:02.404713718Z [2024-05-25T22:55:02.404+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:54:00+00:00, map_index=-1, run_start_date=2024-05-25 22:55:01.590789+00:00, run_end_date=2024-05-25 22:55:02.015189+00:00, run_duration=0.4244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:55:00.595471+00:00, queued_by_job_id=1, pid=991 2024-05-25T22:55:03.499089708Z [2024-05-25T22:55:03.498+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:55:03.499117002Z 2024-05-25T22:55:03.499195385Z [2024-05-25T22:55:03.499+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:55:03.502425490Z [2024-05-25T22:55:03.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:55:03.502447106Z 2024-05-25T22:55:03.508894900Z [2024-05-25T22:55:03.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T22:55:03.509121293Z [2024-05-25T22:55:03.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:55:03.611980930Z [2024-05-25T22:55:03.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:55:03.620085787Z [2024-05-25T22:55:03.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to afa325dc-6f5f-4e68-aed1-812fda65ab37 2024-05-25T22:55:03.723636653Z [2024-05-25T22:55:03.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:55:03.728552476Z [2024-05-25T22:55:03.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=-1, run_start_date=2024-05-25 22:55:02.928540+00:00, run_end_date=2024-05-25 22:55:03.373895+00:00, run_duration=0.445355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:55:00.595471+00:00, queued_by_job_id=1, pid=1016 2024-05-25T22:55:05.659710558Z [2024-05-25T22:55:05.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:55:05.659836766Z [2024-05-25T22:55:05.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:54:00+00:00, run_id=scheduled__2024-05-25T22:54:00+00:00, run_start_date=2024-05-25 22:55:00.485498+00:00, run_end_date=2024-05-25 22:55:05.659474+00:00, run_duration=5.173976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:54:00+00:00, data_interval_end=2024-05-25 22:55:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:55:05.684648024Z [2024-05-25T22:55:05.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:55:00+00:00, run_after=2024-05-25T22:56:00+00:00 2024-05-25T22:55:05.755841953Z [2024-05-25T22:55:05.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status success for try_number 1 2024-05-25T22:55:05.765539036Z [2024-05-25T22:55:05.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:54:00+00:00, map_index=-1, run_start_date=2024-05-25 22:55:02.749618+00:00, run_end_date=2024-05-25 22:55:04.456571+00:00, run_duration=1.706953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:55:00.595471+00:00, queued_by_job_id=1, pid=1015 2024-05-25T22:55:05.939633437Z [2024-05-25T22:55:05.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:55:05.940355818Z [2024-05-25T22:55:05.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:54:00+00:00, run_id=scheduled__2024-05-25T22:54:00+00:00, run_start_date=2024-05-25 22:55:00.479849+00:00, run_end_date=2024-05-25 22:55:05.940004+00:00, run_duration=5.460155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:54:00+00:00, data_interval_end=2024-05-25 22:55:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:55:05.953264773Z [2024-05-25T22:55:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:55:00+00:00, run_after=2024-05-25T22:56:00+00:00 2024-05-25T22:55:06.008829769Z [2024-05-25T22:55:06.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status success for try_number 1 2024-05-25T22:55:06.017837943Z [2024-05-25T22:55:06.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:54:00+00:00, map_index=-1, run_start_date=2024-05-25 22:55:02.932356+00:00, run_end_date=2024-05-25 22:55:05.638977+00:00, run_duration=2.706621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:55:00.595471+00:00, queued_by_job_id=1, pid=1017 2024-05-25T22:55:07.121866152Z [2024-05-25T22:55:07.121+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:55:07.121899112Z 2024-05-25T22:55:07.122173105Z [2024-05-25T22:55:07.121+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:55:07.122962222Z [2024-05-25T22:55:07.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:55:07.122976171Z 2024-05-25T22:55:07.126225801Z [2024-05-25T22:55:07.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T22:55:07.126530790Z [2024-05-25T22:55:07.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T22:55:07.202265725Z [2024-05-25T22:55:07.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:55:07.203195027Z [2024-05-25T22:55:07.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:55:07.210969277Z [2024-05-25T22:55:07.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=-1, run_start_date=2024-05-25 22:55:05.568190+00:00, run_end_date=2024-05-25 22:55:06.022211+00:00, run_duration=0.454021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:55:03.502887+00:00, queued_by_job_id=1, pid=1040 2024-05-25T22:55:07.211177952Z [2024-05-25T22:55:07.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 046b0afc-2b48-4861-a12f-30edcd8257c6 2024-05-25T22:55:09.645144565Z [2024-05-25T22:55:09.644+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T22:55:09.645192583Z 2024-05-25T22:55:09.645662601Z [2024-05-25T22:55:09.645+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:55:09.647320427Z [2024-05-25T22:55:09.646+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:55:09.647374356Z 2024-05-25T22:55:09.652051371Z [2024-05-25T22:55:09.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:55:09.652396912Z [2024-05-25T22:55:09.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T22:55:09.719758257Z [2024-05-25T22:55:09.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status queued for try_number 1 2024-05-25T22:55:09.720088517Z [2024-05-25T22:55:09.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:55:09.726271176Z [2024-05-25T22:55:09.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=0, run_start_date=2024-05-25 22:55:08.807801+00:00, run_end_date=2024-05-25 22:55:09.247918+00:00, run_duration=0.440117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:55:07.123425+00:00, queued_by_job_id=1, pid=1048 2024-05-25T22:55:09.726636329Z [2024-05-25T22:55:09.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f1bdd1f-363f-4b29-ba31-5504c4325388 2024-05-25T22:55:11.999712970Z [2024-05-25T22:55:11.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:55:12.000199737Z [2024-05-25T22:55:11.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:50:00+00:00, run_id=scheduled__2024-05-25T22:50:00+00:00, run_start_date=2024-05-25 22:55:00.477046+00:00, run_end_date=2024-05-25 22:55:11.999670+00:00, run_duration=11.522624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:50:00+00:00, data_interval_end=2024-05-25 22:55:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T22:55:12.013635048Z [2024-05-25T22:55:12.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:55:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:55:12.057412415Z [2024-05-25T22:55:12.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:50:00+00:00 exited with status success for try_number 1 2024-05-25T22:55:12.067077256Z [2024-05-25T22:55:12.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T22:50:00+00:00, map_index=-1, run_start_date=2024-05-25 22:55:11.280917+00:00, run_end_date=2024-05-25 22:55:11.631910+00:00, run_duration=0.350993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:55:09.648459+00:00, queued_by_job_id=1, pid=1056 2024-05-25T22:56:00.401348602Z [2024-05-25T22:56:00.400+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:56:00.413693262Z [2024-05-25T22:56:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:56:00+00:00, run_after=2024-05-25T22:57:00+00:00 2024-05-25T22:56:00.420277753Z [2024-05-25T22:56:00.419+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:56:00.432015567Z [2024-05-25T22:56:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:56:00+00:00, run_after=2024-05-25T22:57:00+00:00 2024-05-25T22:56:00.510471348Z [2024-05-25T22:56:00.510+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T22:56:00.510510725Z 2024-05-25T22:56:00.510521498Z 2024-05-25T22:56:00.510526038Z 2024-05-25T22:56:00.510530199Z 2024-05-25T22:56:00.510729618Z [2024-05-25T22:56:00.510+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:56:00.510979188Z [2024-05-25T22:56:00.510+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:56:00.511220457Z [2024-05-25T22:56:00.511+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:56:00.511452661Z [2024-05-25T22:56:00.511+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:56:00.512126770Z [2024-05-25T22:56:00.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:56:00.512138727Z 2024-05-25T22:56:00.512142133Z 2024-05-25T22:56:00.512145007Z 2024-05-25T22:56:00.512147911Z 2024-05-25T22:56:00.515897509Z [2024-05-25T22:56:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:56:00.516198336Z [2024-05-25T22:56:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:56:00.516612120Z [2024-05-25T22:56:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:56:00.516876501Z [2024-05-25T22:56:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:56:00.517238845Z [2024-05-25T22:56:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:56:00.517546722Z [2024-05-25T22:56:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:56:00.517884528Z [2024-05-25T22:56:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:56:00.518137555Z [2024-05-25T22:56:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:56:00.866659246Z [2024-05-25T22:56:00.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status queued for try_number 1 2024-05-25T22:56:00.867871225Z [2024-05-25T22:56:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T22:56:00.868173993Z [2024-05-25T22:56:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T22:56:00.868381332Z [2024-05-25T22:56:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T22:56:00.884295565Z [2024-05-25T22:56:00.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07506316-6bbd-4aae-9196-fd2a20fa16d8 2024-05-25T22:56:00.884662590Z [2024-05-25T22:56:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 738f01bd-03be-46bb-a6e6-83adef71da9d 2024-05-25T22:56:00.884928402Z [2024-05-25T22:56:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 539f7246-ea85-4bd2-8a05-b0da4ae03d08 2024-05-25T22:56:00.885243032Z [2024-05-25T22:56:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to cccac641-6e84-4f64-8297-031d3949f50e 2024-05-25T22:56:02.090355507Z [2024-05-25T22:56:02.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:56:02.090959377Z [2024-05-25T22:56:02.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:55:00+00:00, run_id=scheduled__2024-05-25T22:55:00+00:00, run_start_date=2024-05-25 22:56:00.445763+00:00, run_end_date=2024-05-25 22:56:02.090584+00:00, run_duration=1.644821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:55:00+00:00, data_interval_end=2024-05-25 22:56:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:56:02.108166940Z [2024-05-25T22:56:02.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:56:00+00:00, run_after=2024-05-25T22:57:00+00:00 2024-05-25T22:56:03.202204525Z [2024-05-25T22:56:03.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:56:03.202227637Z [2024-05-25T22:56:03.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:54:00+00:00, run_id=scheduled__2024-05-25T22:54:00+00:00, run_start_date=2024-05-25 22:56:00.442314+00:00, run_end_date=2024-05-25 22:56:03.199848+00:00, run_duration=2.757534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:54:00+00:00, data_interval_end=2024-05-25 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:56:03.209214032Z [2024-05-25T22:56:03.208+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:56:00+00:00, run_after=2024-05-25T22:58:00+00:00 2024-05-25T22:56:03.268465138Z [2024-05-25T22:56:03.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:54:00+00:00 exited with status success for try_number 1 2024-05-25T22:56:03.268505513Z [2024-05-25T22:56:03.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T22:56:03.276663313Z [2024-05-25T22:56:03.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 22:56:01.566774+00:00, run_end_date=2024-05-25 22:56:01.987994+00:00, run_duration=0.42122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:56:00.513061+00:00, queued_by_job_id=1, pid=1080 2024-05-25T22:56:03.276920143Z [2024-05-25T22:56:03.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:54:00+00:00, map_index=-1, run_start_date=2024-05-25 22:56:01.655810+00:00, run_end_date=2024-05-25 22:56:02.078712+00:00, run_duration=0.422902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:56:00.513061+00:00, queued_by_job_id=1, pid=1081 2024-05-25T22:56:05.634331105Z [2024-05-25T22:56:05.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:56:05.634570688Z [2024-05-25T22:56:05.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:55:00+00:00, run_id=scheduled__2024-05-25T22:55:00+00:00, run_start_date=2024-05-25 22:56:00.443569+00:00, run_end_date=2024-05-25 22:56:05.634267+00:00, run_duration=5.190698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:55:00+00:00, data_interval_end=2024-05-25 22:56:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:56:05.643552347Z [2024-05-25T22:56:05.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:56:00+00:00, run_after=2024-05-25T22:57:00+00:00 2024-05-25T22:56:05.654221787Z [2024-05-25T22:56:05.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:56:05.654620081Z [2024-05-25T22:56:05.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:55:00+00:00, run_id=scheduled__2024-05-25T22:55:00+00:00, run_start_date=2024-05-25 22:56:00.444720+00:00, run_end_date=2024-05-25 22:56:05.654302+00:00, run_duration=5.209582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:55:00+00:00, data_interval_end=2024-05-25 22:56:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:56:05.681293572Z [2024-05-25T22:56:05.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:56:00+00:00, run_after=2024-05-25T22:57:00+00:00 2024-05-25T22:56:05.741717934Z [2024-05-25T22:56:05.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T22:56:05.754405022Z [2024-05-25T22:56:05.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 22:56:02.737112+00:00, run_end_date=2024-05-25 22:56:04.597233+00:00, run_duration=1.860121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:56:00.513061+00:00, queued_by_job_id=1, pid=1104 2024-05-25T22:56:06.004187581Z [2024-05-25T22:56:06.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T22:56:06.012363193Z [2024-05-25T22:56:06.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 22:56:02.838215+00:00, run_end_date=2024-05-25 22:56:05.452393+00:00, run_duration=2.614178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:56:00.513061+00:00, queued_by_job_id=1, pid=1105 2024-05-25T22:57:00.979759570Z [2024-05-25T22:57:00.979+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:57:00.995335415Z [2024-05-25T22:57:00.995+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:57:00+00:00, run_after=2024-05-25T22:58:00+00:00 2024-05-25T22:57:01.016880797Z [2024-05-25T22:57:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:57:00+00:00, run_after=2024-05-25T22:58:00+00:00 2024-05-25T22:57:01.081363831Z [2024-05-25T22:57:01.080+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T22:57:01.081384633Z 2024-05-25T22:57:01.081388882Z 2024-05-25T22:57:01.081392231Z 2024-05-25T22:57:01.081994603Z [2024-05-25T22:57:01.081+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:57:01.082164325Z [2024-05-25T22:57:01.082+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:57:01.082305761Z [2024-05-25T22:57:01.082+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:57:01.082992336Z [2024-05-25T22:57:01.082+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:57:01.083020394Z 2024-05-25T22:57:01.083035174Z 2024-05-25T22:57:01.083039845Z 2024-05-25T22:57:01.086598180Z [2024-05-25T22:57:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:57:01.086765962Z [2024-05-25T22:57:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:57:01.087011726Z [2024-05-25T22:57:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:57:01.087149242Z [2024-05-25T22:57:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:57:01.087495601Z [2024-05-25T22:57:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:57:01.087711185Z [2024-05-25T22:57:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:57:01.480156452Z [2024-05-25T22:57:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status queued for try_number 1 2024-05-25T22:57:01.480858317Z [2024-05-25T22:57:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status queued for try_number 1 2024-05-25T22:57:01.480868167Z [2024-05-25T22:57:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status queued for try_number 1 2024-05-25T22:57:01.493950797Z [2024-05-25T22:57:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3b66368-e113-4b77-8dfd-467804520efa 2024-05-25T22:57:01.494122079Z [2024-05-25T22:57:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d97aaed-92e6-413e-9d67-6ab3be43dc22 2024-05-25T22:57:01.494271595Z [2024-05-25T22:57:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb5de184-e5f8-4bd9-97e2-4189584e443c 2024-05-25T22:57:03.172025501Z [2024-05-25T22:57:03.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:57:03.172052487Z [2024-05-25T22:57:03.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:56:00+00:00, run_id=scheduled__2024-05-25T22:56:00+00:00, run_start_date=2024-05-25 22:57:01.030514+00:00, run_end_date=2024-05-25 22:57:03.166407+00:00, run_duration=2.135893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:56:00+00:00, data_interval_end=2024-05-25 22:57:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:57:03.184565281Z [2024-05-25T22:57:03.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:57:00+00:00, run_after=2024-05-25T22:58:00+00:00 2024-05-25T22:57:03.240181916Z [2024-05-25T22:57:03.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status success for try_number 1 2024-05-25T22:57:03.250049821Z [2024-05-25T22:57:03.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:56:00+00:00, map_index=-1, run_start_date=2024-05-25 22:57:02.245295+00:00, run_end_date=2024-05-25 22:57:02.981079+00:00, run_duration=0.735784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:57:01.084188+00:00, queued_by_job_id=1, pid=1137 2024-05-25T22:57:06.875916701Z [2024-05-25T22:57:06.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:57:06.888735632Z [2024-05-25T22:57:06.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:56:00+00:00, run_id=scheduled__2024-05-25T22:56:00+00:00, run_start_date=2024-05-25 22:57:01.031645+00:00, run_end_date=2024-05-25 22:57:06.887741+00:00, run_duration=5.856096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:56:00+00:00, data_interval_end=2024-05-25 22:57:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:57:06.933795520Z [2024-05-25T22:57:06.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:57:00+00:00, run_after=2024-05-25T22:58:00+00:00 2024-05-25T22:57:07.057336937Z [2024-05-25T22:57:07.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status success for try_number 1 2024-05-25T22:57:07.072700965Z [2024-05-25T22:57:07.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:56:00+00:00, map_index=-1, run_start_date=2024-05-25 22:57:04.563322+00:00, run_end_date=2024-05-25 22:57:06.552363+00:00, run_duration=1.989041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:57:01.084188+00:00, queued_by_job_id=1, pid=1156 2024-05-25T22:57:07.215424434Z [2024-05-25T22:57:07.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:57:07.216523244Z [2024-05-25T22:57:07.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:56:00+00:00, run_id=scheduled__2024-05-25T22:56:00+00:00, run_start_date=2024-05-25 22:57:01.029255+00:00, run_end_date=2024-05-25 22:57:07.216103+00:00, run_duration=6.186848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:56:00+00:00, data_interval_end=2024-05-25 22:57:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:57:07.243152755Z [2024-05-25T22:57:07.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:57:00+00:00, run_after=2024-05-25T22:58:00+00:00 2024-05-25T22:57:07.376511231Z [2024-05-25T22:57:07.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status success for try_number 1 2024-05-25T22:57:07.401016935Z [2024-05-25T22:57:07.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:56:00+00:00, map_index=-1, run_start_date=2024-05-25 22:57:04.089730+00:00, run_end_date=2024-05-25 22:57:06.881023+00:00, run_duration=2.791293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:57:01.084188+00:00, queued_by_job_id=1, pid=1155 2024-05-25T22:58:00.268577612Z [2024-05-25T22:58:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:58:00+00:00, run_after=2024-05-25T22:59:00+00:00 2024-05-25T22:58:00.283780372Z [2024-05-25T22:58:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:58:00+00:00, run_after=2024-05-25T22:59:00+00:00 2024-05-25T22:58:00.309055688Z [2024-05-25T22:58:00.308+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:58:00.317863100Z [2024-05-25T22:58:00.317+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:58:00.408341817Z [2024-05-25T22:58:00.407+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T22:58:00.408379635Z 2024-05-25T22:58:00.408389056Z 2024-05-25T22:58:00.408397198Z 2024-05-25T22:58:00.408430040Z 2024-05-25T22:58:00.408552712Z [2024-05-25T22:58:00.408+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T22:58:00.408782310Z [2024-05-25T22:58:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:58:00.409007344Z [2024-05-25T22:58:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:58:00.409292523Z [2024-05-25T22:58:00.408+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:58:00.410255129Z [2024-05-25T22:58:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:58:00.410274659Z 2024-05-25T22:58:00.410283561Z 2024-05-25T22:58:00.410291272Z 2024-05-25T22:58:00.410298981Z 2024-05-25T22:58:00.417805192Z [2024-05-25T22:58:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:58:00.418055371Z [2024-05-25T22:58:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T22:58:00.418402216Z [2024-05-25T22:58:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:58:00.418653967Z [2024-05-25T22:58:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:58:00.419021393Z [2024-05-25T22:58:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:58:00.419276700Z [2024-05-25T22:58:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:58:00.419753397Z [2024-05-25T22:58:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:58:00.420004087Z [2024-05-25T22:58:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:58:00.780086884Z [2024-05-25T22:58:00.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status queued for try_number 1 2024-05-25T22:58:00.780259068Z [2024-05-25T22:58:00.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:57:00+00:00 exited with status queued for try_number 1 2024-05-25T22:58:00.780395270Z [2024-05-25T22:58:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:57:00+00:00 exited with status queued for try_number 1 2024-05-25T22:58:00.780546299Z [2024-05-25T22:58:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:57:00+00:00 exited with status queued for try_number 1 2024-05-25T22:58:00.793101913Z [2024-05-25T22:58:00.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec10089a-a716-4895-ba45-9ea1099c4ee1 2024-05-25T22:58:00.793426930Z [2024-05-25T22:58:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to b519761c-6c2f-48ef-896d-3dc9b759429d 2024-05-25T22:58:00.793664056Z [2024-05-25T22:58:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to efad520e-388d-4687-b148-061b5ef73c83 2024-05-25T22:58:00.793850433Z [2024-05-25T22:58:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ab26837-3d82-47d1-84db-d7282af59090 2024-05-25T22:58:03.215680100Z [2024-05-25T22:58:03.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:58:03.215711051Z [2024-05-25T22:58:03.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:56:00+00:00, run_id=scheduled__2024-05-25T22:56:00+00:00, run_start_date=2024-05-25 22:58:00.329828+00:00, run_end_date=2024-05-25 22:58:03.212955+00:00, run_duration=2.883127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:56:00+00:00, data_interval_end=2024-05-25 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T22:58:03.231497309Z [2024-05-25T22:58:03.227+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T22:58:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:58:03.248782929Z [2024-05-25T22:58:03.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:58:03.249520686Z [2024-05-25T22:58:03.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:57:00+00:00, run_id=scheduled__2024-05-25T22:57:00+00:00, run_start_date=2024-05-25 22:58:00.333451+00:00, run_end_date=2024-05-25 22:58:03.249058+00:00, run_duration=2.915607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:57:00+00:00, data_interval_end=2024-05-25 22:58:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:58:03.270914338Z [2024-05-25T22:58:03.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:58:00+00:00, run_after=2024-05-25T22:59:00+00:00 2024-05-25T22:58:03.341310186Z [2024-05-25T22:58:03.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:56:00+00:00 exited with status success for try_number 1 2024-05-25T22:58:03.341578436Z [2024-05-25T22:58:03.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:57:00+00:00 exited with status success for try_number 1 2024-05-25T22:58:03.347821663Z [2024-05-25T22:58:03.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:56:00+00:00, map_index=-1, run_start_date=2024-05-25 22:58:01.518714+00:00, run_end_date=2024-05-25 22:58:02.321342+00:00, run_duration=0.802628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:58:00.413552+00:00, queued_by_job_id=1, pid=1189 2024-05-25T22:58:03.348131352Z [2024-05-25T22:58:03.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:57:00+00:00, map_index=-1, run_start_date=2024-05-25 22:58:01.461695+00:00, run_end_date=2024-05-25 22:58:02.420745+00:00, run_duration=0.95905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:58:00.413552+00:00, queued_by_job_id=1, pid=1190 2024-05-25T22:58:05.527191379Z [2024-05-25T22:58:05.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:58:05.527542478Z [2024-05-25T22:58:05.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:57:00+00:00, run_id=scheduled__2024-05-25T22:57:00+00:00, run_start_date=2024-05-25 22:58:00.335779+00:00, run_end_date=2024-05-25 22:58:05.527064+00:00, run_duration=5.191285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:57:00+00:00, data_interval_end=2024-05-25 22:58:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:58:05.545772218Z [2024-05-25T22:58:05.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:58:00+00:00, run_after=2024-05-25T22:59:00+00:00 2024-05-25T22:58:05.555283753Z [2024-05-25T22:58:05.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:58:05.555679338Z [2024-05-25T22:58:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:57:00+00:00, run_id=scheduled__2024-05-25T22:57:00+00:00, run_start_date=2024-05-25 22:58:00.334595+00:00, run_end_date=2024-05-25 22:58:05.555358+00:00, run_duration=5.220763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:57:00+00:00, data_interval_end=2024-05-25 22:58:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:58:05.566516954Z [2024-05-25T22:58:05.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:58:00+00:00, run_after=2024-05-25T22:59:00+00:00 2024-05-25T22:58:05.600047397Z [2024-05-25T22:58:05.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:57:00+00:00 exited with status success for try_number 1 2024-05-25T22:58:05.600214277Z [2024-05-25T22:58:05.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:57:00+00:00 exited with status success for try_number 1 2024-05-25T22:58:05.606510056Z [2024-05-25T22:58:05.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:57:00+00:00, map_index=-1, run_start_date=2024-05-25 22:58:03.622806+00:00, run_end_date=2024-05-25 22:58:05.051469+00:00, run_duration=1.428663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:58:00.413552+00:00, queued_by_job_id=1, pid=1214 2024-05-25T22:58:05.606729481Z [2024-05-25T22:58:05.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:57:00+00:00, map_index=-1, run_start_date=2024-05-25 22:58:03.428298+00:00, run_end_date=2024-05-25 22:58:05.166692+00:00, run_duration=1.738394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:58:00.413552+00:00, queued_by_job_id=1, pid=1212 2024-05-25T22:58:30.150016564Z [2024-05-25T22:58:30.149+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T22:59:00.659195377Z [2024-05-25T22:59:00.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:59:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:59:00.677834199Z [2024-05-25T22:59:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:59:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:59:00.686882492Z [2024-05-25T22:59:00.686+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T22:59:00.777347492Z [2024-05-25T22:59:00.776+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T22:59:00.777378666Z 2024-05-25T22:59:00.777389362Z 2024-05-25T22:59:00.777394718Z 2024-05-25T22:59:00.777416796Z [2024-05-25T22:59:00.776+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:59:00.777421732Z [2024-05-25T22:59:00.776+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T22:59:00.777426596Z [2024-05-25T22:59:00.777+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T22:59:00.778793761Z [2024-05-25T22:59:00.777+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T22:59:00.778837601Z 2024-05-25T22:59:00.778845729Z 2024-05-25T22:59:00.778852993Z 2024-05-25T22:59:00.782199842Z [2024-05-25T22:59:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:59:00.782509230Z [2024-05-25T22:59:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T22:59:00.782586112Z [2024-05-25T22:59:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:59:00.782826531Z [2024-05-25T22:59:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T22:59:00.783352305Z [2024-05-25T22:59:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T22:59:00.783371500Z [2024-05-25T22:59:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:59:01.096243831Z [2024-05-25T22:59:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status queued for try_number 1 2024-05-25T22:59:01.098331400Z [2024-05-25T22:59:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status queued for try_number 1 2024-05-25T22:59:01.099177938Z [2024-05-25T22:59:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status queued for try_number 1 2024-05-25T22:59:01.118324505Z [2024-05-25T22:59:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 651bc8e9-ac52-422d-a23e-6c7dea6187c5 2024-05-25T22:59:01.118637637Z [2024-05-25T22:59:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to d228e024-b620-4a55-8082-6200a21d7862 2024-05-25T22:59:01.118873838Z [2024-05-25T22:59:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to d27deea5-83f9-4197-8e18-cd3f5226ccb1 2024-05-25T22:59:02.387142243Z [2024-05-25T22:59:02.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:59:02.389359825Z [2024-05-25T22:59:02.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:58:00+00:00, run_id=scheduled__2024-05-25T22:58:00+00:00, run_start_date=2024-05-25 22:59:00.701465+00:00, run_end_date=2024-05-25 22:59:02.388894+00:00, run_duration=1.687429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:58:00+00:00, data_interval_end=2024-05-25 22:59:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T22:59:02.414687193Z [2024-05-25T22:59:02.414+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T22:59:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:59:03.599357648Z [2024-05-25T22:59:03.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status success for try_number 1 2024-05-25T22:59:03.608484395Z [2024-05-25T22:59:03.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:58:00+00:00, map_index=-1, run_start_date=2024-05-25 22:59:01.777252+00:00, run_end_date=2024-05-25 22:59:02.275833+00:00, run_duration=0.498581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:59:00.778626+00:00, queued_by_job_id=1, pid=1246 2024-05-25T22:59:05.311750887Z [2024-05-25T22:59:05.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:59:05.312168261Z [2024-05-25T22:59:05.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:58:00+00:00, run_id=scheduled__2024-05-25T22:58:00+00:00, run_start_date=2024-05-25 22:59:00.700157+00:00, run_end_date=2024-05-25 22:59:05.311751+00:00, run_duration=4.611594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:58:00+00:00, data_interval_end=2024-05-25 22:59:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T22:59:05.329923044Z [2024-05-25T22:59:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:59:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:59:05.347618933Z [2024-05-25T22:59:05.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T22:59:05.347655073Z [2024-05-25T22:59:05.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:58:00+00:00, run_id=scheduled__2024-05-25T22:58:00+00:00, run_start_date=2024-05-25 22:59:00.702618+00:00, run_end_date=2024-05-25 22:59:05.344314+00:00, run_duration=4.641696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:58:00+00:00, data_interval_end=2024-05-25 22:59:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T22:59:05.366742773Z [2024-05-25T22:59:05.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T22:59:00+00:00, run_after=2024-05-25T23:00:00+00:00 2024-05-25T22:59:05.427787266Z [2024-05-25T22:59:05.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status success for try_number 1 2024-05-25T22:59:05.427809527Z [2024-05-25T22:59:05.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status success for try_number 1 2024-05-25T22:59:05.436294238Z [2024-05-25T22:59:05.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:58:00+00:00, map_index=-1, run_start_date=2024-05-25 22:59:03.006230+00:00, run_end_date=2024-05-25 22:59:04.676690+00:00, run_duration=1.67046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:59:00.778626+00:00, queued_by_job_id=1, pid=1265 2024-05-25T22:59:05.436463319Z [2024-05-25T22:59:05.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:58:00+00:00, map_index=-1, run_start_date=2024-05-25 22:59:02.919212+00:00, run_end_date=2024-05-25 22:59:04.853940+00:00, run_duration=1.934728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 22:59:00.778626+00:00, queued_by_job_id=1, pid=1264 2024-05-25T23:00:01.100646271Z [2024-05-25T23:00:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:00:01.119245403Z [2024-05-25T23:00:01.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:01:00+00:00 2024-05-25T23:00:01.128145713Z [2024-05-25T23:00:01.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:00:01.161595739Z [2024-05-25T23:00:01.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:01:00+00:00 2024-05-25T23:00:01.174287006Z [2024-05-25T23:00:01.173+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:00:01.301395870Z [2024-05-25T23:00:01.300+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T23:00:01.301420346Z 2024-05-25T23:00:01.301423766Z 2024-05-25T23:00:01.301427590Z 2024-05-25T23:00:01.301430592Z 2024-05-25T23:00:01.301433784Z 2024-05-25T23:00:01.301707279Z [2024-05-25T23:00:01.301+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:00:01.302104566Z [2024-05-25T23:00:01.301+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:00:01.302300212Z [2024-05-25T23:00:01.302+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:00:01.302492077Z [2024-05-25T23:00:01.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:00:01.302838511Z [2024-05-25T23:00:01.302+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:00:01.304047200Z [2024-05-25T23:00:01.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:00:01.304067328Z 2024-05-25T23:00:01.304075232Z 2024-05-25T23:00:01.304082596Z 2024-05-25T23:00:01.304089448Z 2024-05-25T23:00:01.304095687Z 2024-05-25T23:00:01.312006277Z [2024-05-25T23:00:01.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:00:01.312269418Z [2024-05-25T23:00:01.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:00:01.312500657Z [2024-05-25T23:00:01.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:00:01.312637475Z [2024-05-25T23:00:01.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:00:01.313022110Z [2024-05-25T23:00:01.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:00:01.313173462Z [2024-05-25T23:00:01.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:00:01.313477478Z [2024-05-25T23:00:01.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:00:01.313707289Z [2024-05-25T23:00:01.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:00:01.313944317Z [2024-05-25T23:00:01.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:00:01.314070937Z [2024-05-25T23:00:01.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:00:01.697204208Z [2024-05-25T23:00:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:01.697263145Z [2024-05-25T23:00:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:01.697405307Z [2024-05-25T23:00:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:59:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:01.697501916Z [2024-05-25T23:00:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:59:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:01.697594376Z [2024-05-25T23:00:01.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:59:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:01.711157923Z [2024-05-25T23:00:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5493dd6-2917-455e-a41f-45c3f717f9b5 2024-05-25T23:00:01.711254379Z [2024-05-25T23:00:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60c8febb-f6f9-4a07-9abb-9cd85e1d9461 2024-05-25T23:00:01.711425139Z [2024-05-25T23:00:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0f44b31-caf1-4a46-a05f-aa0ecab09382 2024-05-25T23:00:01.711586339Z [2024-05-25T23:00:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31c00998-2f7d-45d9-bc2a-399a9eff2bf8 2024-05-25T23:00:01.711742231Z [2024-05-25T23:00:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f2a1197-2977-48d3-9c67-5fea87c31b99 2024-05-25T23:00:04.087721468Z [2024-05-25T23:00:04.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:00:04.088563009Z [2024-05-25T23:00:04.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 22:58:00+00:00, run_id=scheduled__2024-05-25T22:58:00+00:00, run_start_date=2024-05-25 23:00:01.195146+00:00, run_end_date=2024-05-25 23:00:04.087796+00:00, run_duration=2.89265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:58:00+00:00, data_interval_end=2024-05-25 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:00:04.098767382Z [2024-05-25T23:00:04.098+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:00:04.105319604Z [2024-05-25T23:00:04.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:00:04.105695770Z [2024-05-25T23:00:04.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 22:59:00+00:00, run_id=scheduled__2024-05-25T22:59:00+00:00, run_start_date=2024-05-25 23:00:01.200785+00:00, run_end_date=2024-05-25 23:00:04.105343+00:00, run_duration=2.904558, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:59:00+00:00, data_interval_end=2024-05-25 23:00:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:00:04.123175748Z [2024-05-25T23:00:04.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:01:00+00:00 2024-05-25T23:00:04.227805248Z [2024-05-25T23:00:04.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T22:58:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:04.227997726Z [2024-05-25T23:00:04.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:59:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:04.237904726Z [2024-05-25T23:00:04.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T22:58:00+00:00, map_index=-1, run_start_date=2024-05-25 23:00:02.613716+00:00, run_end_date=2024-05-25 23:00:03.177508+00:00, run_duration=0.563792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:01.306199+00:00, queued_by_job_id=1, pid=1299 2024-05-25T23:00:04.238020605Z [2024-05-25T23:00:04.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:59:00+00:00, map_index=-1, run_start_date=2024-05-25 23:00:02.663211+00:00, run_end_date=2024-05-25 23:00:03.244810+00:00, run_duration=0.581599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:01.306199+00:00, queued_by_job_id=1, pid=1300 2024-05-25T23:00:05.163954928Z [2024-05-25T23:00:05.163+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:00:05.163990552Z 2024-05-25T23:00:05.164716277Z [2024-05-25T23:00:05.164+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:00:05.168519415Z [2024-05-25T23:00:05.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:00:05.168553295Z 2024-05-25T23:00:05.174384031Z [2024-05-25T23:00:05.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:00:05.177381302Z [2024-05-25T23:00:05.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:00:05.310416907Z [2024-05-25T23:00:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:05.311085384Z [2024-05-25T23:00:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:05.325269330Z [2024-05-25T23:00:05.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:00:04.294577+00:00, run_end_date=2024-05-25 23:00:04.928762+00:00, run_duration=0.634185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:01.306199+00:00, queued_by_job_id=1, pid=1329 2024-05-25T23:00:05.325745583Z [2024-05-25T23:00:05.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29e03def-6eef-4940-b88b-5ff3b4d6ea29 2024-05-25T23:00:06.566096366Z [2024-05-25T23:00:06.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:00:06.566564043Z [2024-05-25T23:00:06.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:59:00+00:00, run_id=scheduled__2024-05-25T22:59:00+00:00, run_start_date=2024-05-25 23:00:01.197400+00:00, run_end_date=2024-05-25 23:00:06.566004+00:00, run_duration=5.368604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:59:00+00:00, data_interval_end=2024-05-25 23:00:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:00:06.575206887Z [2024-05-25T23:00:06.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:01:00+00:00 2024-05-25T23:00:06.618118439Z [2024-05-25T23:00:06.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:59:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:06.622389995Z [2024-05-25T23:00:06.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:59:00+00:00, map_index=-1, run_start_date=2024-05-25 23:00:04.325746+00:00, run_end_date=2024-05-25 23:00:06.016233+00:00, run_duration=1.690487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:01.306199+00:00, queued_by_job_id=1, pid=1330 2024-05-25T23:00:08.844055449Z [2024-05-25T23:00:08.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:00:08.844311127Z [2024-05-25T23:00:08.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:59:00+00:00, run_id=scheduled__2024-05-25T22:59:00+00:00, run_start_date=2024-05-25 23:00:01.199108+00:00, run_end_date=2024-05-25 23:00:08.843971+00:00, run_duration=7.644863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:59:00+00:00, data_interval_end=2024-05-25 23:00:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:00:08.862500728Z [2024-05-25T23:00:08.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:01:00+00:00 2024-05-25T23:00:08.910242889Z [2024-05-25T23:00:08.909+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:00:08.910265132Z 2024-05-25T23:00:08.910393294Z [2024-05-25T23:00:08.910+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:00:08.911051089Z [2024-05-25T23:00:08.910+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:00:08.911072304Z 2024-05-25T23:00:08.913686710Z [2024-05-25T23:00:08.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:00:08.914385992Z [2024-05-25T23:00:08.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:00:08.982427479Z [2024-05-25T23:00:08.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:08.985134699Z [2024-05-25T23:00:08.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T22:59:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:08.985555989Z [2024-05-25T23:00:08.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:08.992926715Z [2024-05-25T23:00:08.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T22:59:00+00:00, map_index=-1, run_start_date=2024-05-25 23:00:04.344164+00:00, run_end_date=2024-05-25 23:00:07.691201+00:00, run_duration=3.347037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:01.306199+00:00, queued_by_job_id=1, pid=1331 2024-05-25T23:00:08.993184044Z [2024-05-25T23:00:08.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18567fe0-590e-49a2-be23-76b0b2465eed 2024-05-25T23:00:08.993574115Z [2024-05-25T23:00:08.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:00:07.529943+00:00, run_end_date=2024-05-25 23:00:07.993546+00:00, run_duration=0.463603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:05.169070+00:00, queued_by_job_id=1, pid=1354 2024-05-25T23:00:11.517520590Z [2024-05-25T23:00:11.516+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:00:11.517546257Z 2024-05-25T23:00:11.517550650Z [2024-05-25T23:00:11.516+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:00:11.517554405Z [2024-05-25T23:00:11.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:00:11.517557528Z 2024-05-25T23:00:11.523053436Z [2024-05-25T23:00:11.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:00:11.523266446Z [2024-05-25T23:00:11.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:00:11.626702857Z [2024-05-25T23:00:11.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:00:11.626975319Z [2024-05-25T23:00:11.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:11.641274325Z [2024-05-25T23:00:11.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89d8a6ee-793d-4ee0-ad4f-7a7c8ba6cd4c 2024-05-25T23:00:11.641670690Z [2024-05-25T23:00:11.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=0, run_start_date=2024-05-25 23:00:10.845229+00:00, run_end_date=2024-05-25 23:00:11.308694+00:00, run_duration=0.463465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:08.911454+00:00, queued_by_job_id=1, pid=1362 2024-05-25T23:00:14.948472382Z [2024-05-25T23:00:14.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:00:14.948661529Z [2024-05-25T23:00:14.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 22:55:00+00:00, run_id=scheduled__2024-05-25T22:55:00+00:00, run_start_date=2024-05-25 23:00:01.192922+00:00, run_end_date=2024-05-25 23:00:14.948402+00:00, run_duration=13.75548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:55:00+00:00, data_interval_end=2024-05-25 23:00:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:00:14.955971924Z [2024-05-25T23:00:14.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:00:14.980430443Z [2024-05-25T23:00:14.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:00:14.985168780Z [2024-05-25T23:00:14.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:00:13.397738+00:00, run_end_date=2024-05-25 23:00:13.799306+00:00, run_duration=0.401568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:00:11.518058+00:00, queued_by_job_id=1, pid=1370 2024-05-25T23:01:00.335583406Z [2024-05-25T23:01:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:00.342022531Z [2024-05-25T23:01:00.341+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:01:00.353577802Z [2024-05-25T23:01:00.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:00.408648011Z [2024-05-25T23:01:00.408+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:01:00.408709050Z 2024-05-25T23:01:00.408719767Z 2024-05-25T23:01:00.408728573Z 2024-05-25T23:01:00.408904736Z [2024-05-25T23:01:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:01:00.409239478Z [2024-05-25T23:01:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:01:00.409494807Z [2024-05-25T23:01:00.409+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:01:00.410319327Z [2024-05-25T23:01:00.410+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:01:00.410334147Z 2024-05-25T23:01:00.410338764Z 2024-05-25T23:01:00.410367311Z 2024-05-25T23:01:00.414002643Z [2024-05-25T23:01:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:01:00.414333268Z [2024-05-25T23:01:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:01:00.414726783Z [2024-05-25T23:01:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:01:00.414973868Z [2024-05-25T23:01:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:01:00.415339184Z [2024-05-25T23:01:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:01:00.415638387Z [2024-05-25T23:01:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:01:00.614808810Z [2024-05-25T23:01:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:00.614887391Z [2024-05-25T23:01:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:00.614913286Z [2024-05-25T23:01:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:00.623775723Z [2024-05-25T23:01:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 950ffc18-df07-4fbd-978a-2ae494824133 2024-05-25T23:01:00.623838018Z [2024-05-25T23:01:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23e60967-d59b-4807-a401-bf1f5f8fd1b2 2024-05-25T23:01:00.623962835Z [2024-05-25T23:01:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ca3e80e-7689-4d09-bb66-8507940925b0 2024-05-25T23:01:02.270287859Z [2024-05-25T23:01:02.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:01:02.271296142Z [2024-05-25T23:01:02.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:01:00.362382+00:00, run_end_date=2024-05-25 23:01:02.270143+00:00, run_duration=1.907761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:01:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:01:02.285275527Z [2024-05-25T23:01:02.284+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:02.337086160Z [2024-05-25T23:01:02.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:02.342843336Z [2024-05-25T23:01:02.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:01.201858+00:00, run_end_date=2024-05-25 23:01:01.663969+00:00, run_duration=0.462111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:00.411340+00:00, queued_by_job_id=1, pid=1392 2024-05-25T23:01:04.549857756Z [2024-05-25T23:01:04.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:01:04.550231525Z [2024-05-25T23:01:04.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:01:00.363498+00:00, run_end_date=2024-05-25 23:01:04.549778+00:00, run_duration=4.18628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:01:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:01:04.559386961Z [2024-05-25T23:01:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:04.615008167Z [2024-05-25T23:01:04.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:04.622369424Z [2024-05-25T23:01:04.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:02.383034+00:00, run_end_date=2024-05-25 23:01:04.387435+00:00, run_duration=2.004401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:00.411340+00:00, queued_by_job_id=1, pid=1411 2024-05-25T23:01:05.687834195Z [2024-05-25T23:01:05.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:01:05.687866531Z [2024-05-25T23:01:05.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:01:00.364496+00:00, run_end_date=2024-05-25 23:01:05.686602+00:00, run_duration=5.322106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:01:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:01:05.697176772Z [2024-05-25T23:01:05.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:05.732218062Z [2024-05-25T23:01:05.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:05.739432224Z [2024-05-25T23:01:05.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:02.336205+00:00, run_end_date=2024-05-25 23:01:04.618130+00:00, run_duration=2.281925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:00.411340+00:00, queued_by_job_id=1, pid=1410 2024-05-25T23:01:43.985216896Z [2024-05-25T23:01:43.984+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:01:44.009633634Z [2024-05-25T23:01:44.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:44.055301754Z [2024-05-25T23:01:44.054+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-25T23:01:44.055336912Z 2024-05-25T23:01:44.055344163Z 2024-05-25T23:01:44.055590987Z [2024-05-25T23:01:44.055+0000] {scheduler_job.py:425} INFO - DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:01:44.055766908Z [2024-05-25T23:01:44.055+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:01:44.056826799Z [2024-05-25T23:01:44.056+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:01:44.056835778Z 2024-05-25T23:01:44.056839030Z 2024-05-25T23:01:44.059774055Z [2024-05-25T23:01:44.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:01:44.059976622Z [2024-05-25T23:01:44.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:01:44.060269473Z [2024-05-25T23:01:44.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:01:44.060418833Z [2024-05-25T23:01:44.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:01:44.348899769Z [2024-05-25T23:01:44.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:44.349642825Z [2024-05-25T23:01:44.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:44.359435197Z [2024-05-25T23:01:44.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7034bec4-706d-4680-8c48-d6c010e7d132 2024-05-25T23:01:44.359746835Z [2024-05-25T23:01:44.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29162b1b-5557-4612-8cfe-f2f999540556 2024-05-25T23:01:45.530917925Z [2024-05-25T23:01:45.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:01:45.586899999Z [2024-05-25T23:01:45.586+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:01:45.586927756Z 2024-05-25T23:01:45.586977488Z [2024-05-25T23:01:45.586+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:01:45.587537788Z [2024-05-25T23:01:45.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:01:45.587548389Z 2024-05-25T23:01:45.589687818Z [2024-05-25T23:01:45.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:01:45.589779595Z [2024-05-25T23:01:45.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:01:45.634491491Z [2024-05-25T23:01:45.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:45.638899087Z [2024-05-25T23:01:45.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6446576b-3cab-49e3-a08d-4c338fd8a648 2024-05-25T23:01:48.021933798Z [2024-05-25T23:01:48.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:01:48.022798813Z [2024-05-25T23:01:48.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:01:44.018793+00:00, run_end_date=2024-05-25 23:01:48.022156+00:00, run_duration=4.003363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:01:00+00:00, dag_hash=b109d800f139ed8336ee47aad2a37de1 2024-05-25T23:01:48.053240704Z [2024-05-25T23:01:48.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:48.064600557Z [2024-05-25T23:01:48.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:01:48.064847776Z [2024-05-25T23:01:48.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:01:44.019374+00:00, run_end_date=2024-05-25 23:01:48.064402+00:00, run_duration=4.045028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:01:00+00:00, dag_hash=096cdbf19148bbc536f1886c61f056aa 2024-05-25T23:01:48.081212921Z [2024-05-25T23:01:48.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:01:00+00:00, run_after=2024-05-25T23:02:00+00:00 2024-05-25T23:01:48.114446604Z [2024-05-25T23:01:48.113+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:01:48.114504847Z 2024-05-25T23:01:48.114524193Z [2024-05-25T23:01:48.114+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:01:48.114890871Z [2024-05-25T23:01:48.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:01:48.114926404Z 2024-05-25T23:01:48.117608791Z [2024-05-25T23:01:48.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='split_metrics', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:01:48.117639070Z [2024-05-25T23:01:48.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'split_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:01:48.182903595Z [2024-05-25T23:01:48.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.split_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:48.183353904Z [2024-05-25T23:01:48.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:48.183857826Z [2024-05-25T23:01:48.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:48.184098673Z [2024-05-25T23:01:48.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:48.206852230Z [2024-05-25T23:01:48.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:46.246103+00:00, run_end_date=2024-05-25 23:01:47.774246+00:00, run_duration=1.528143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:44.057369+00:00, queued_by_job_id=1, pid=1450 2024-05-25T23:01:48.207250920Z [2024-05-25T23:01:48.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:46.308990+00:00, run_end_date=2024-05-25 23:01:47.540396+00:00, run_duration=1.231406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:44.057369+00:00, queued_by_job_id=1, pid=1451 2024-05-25T23:01:48.207620072Z [2024-05-25T23:01:48.207+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fff8774-2032-4b2f-afca-88b8d7437fa4 2024-05-25T23:01:48.207934552Z [2024-05-25T23:01:48.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:47.338442+00:00, run_end_date=2024-05-25 23:01:47.710593+00:00, run_duration=0.372151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:45.587873+00:00, queued_by_job_id=1, pid=1468 2024-05-25T23:01:50.475316901Z [2024-05-25T23:01:50.474+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:01:50.475349639Z 2024-05-25T23:01:50.475367069Z [2024-05-25T23:01:50.475+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:01:50.475988489Z [2024-05-25T23:01:50.475+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:01:50.476034706Z 2024-05-25T23:01:50.478192668Z [2024-05-25T23:01:50.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='collect_metrics', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:01:50.478372451Z [2024-05-25T23:01:50.478+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'collect_metrics', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:01:50.531248905Z [2024-05-25T23:01:50.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.collect_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:50.531293576Z [2024-05-25T23:01:50.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.split_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:50.538803849Z [2024-05-25T23:01:50.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=split_metrics, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:49.884942+00:00, run_end_date=2024-05-25 23:01:50.259217+00:00, run_duration=0.374275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:48.114979+00:00, queued_by_job_id=1, pid=1481 2024-05-25T23:01:50.538944402Z [2024-05-25T23:01:50.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4956a36-8a7b-4f2a-8ea2-e8524af1065d 2024-05-25T23:01:53.160935944Z [2024-05-25T23:01:53.160+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:01:53.160983128Z 2024-05-25T23:01:53.161212990Z [2024-05-25T23:01:53.160+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:01:53.162202032Z [2024-05-25T23:01:53.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:01:53.162216590Z 2024-05-25T23:01:53.165351508Z [2024-05-25T23:01:53.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='send_prometheus', run_id='scheduled__2024-05-25T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:01:53.165509816Z [2024-05-25T23:01:53.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'send_prometheus', 'scheduled__2024-05-25T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:01:53.231827528Z [2024-05-25T23:01:53.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.send_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:01:53.232007954Z [2024-05-25T23:01:53.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.collect_metrics run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:53.239400266Z [2024-05-25T23:01:53.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=collect_metrics, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=0, run_start_date=2024-05-25 23:01:52.018516+00:00, run_end_date=2024-05-25 23:01:52.358118+00:00, run_duration=0.339602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:50.476260+00:00, queued_by_job_id=1, pid=1489 2024-05-25T23:01:53.239900451Z [2024-05-25T23:01:53.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 268bdb42-bf53-4e67-a9ac-3d744b178bf2 2024-05-25T23:01:55.478380264Z [2024-05-25T23:01:55.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:01:55.478709551Z [2024-05-25T23:01:55.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 22:55:00+00:00, run_id=scheduled__2024-05-25T22:55:00+00:00, run_start_date=2024-05-25 23:01:45.543551+00:00, run_end_date=2024-05-25 23:01:55.478295+00:00, run_duration=9.934744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 22:55:00+00:00, data_interval_end=2024-05-25 23:00:00+00:00, dag_hash=3d061e3d103aaba1b7b64117505ce2f4 2024-05-25T23:01:55.487806595Z [2024-05-25T23:01:55.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:00:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:01:55.512934651Z [2024-05-25T23:01:55.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.send_prometheus run_id=scheduled__2024-05-25T22:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:01:55.517864880Z [2024-05-25T23:01:55.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=send_prometheus, run_id=scheduled__2024-05-25T22:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:01:54.878119+00:00, run_end_date=2024-05-25 23:01:55.270710+00:00, run_duration=0.392591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:01:53.162601+00:00, queued_by_job_id=1, pid=1497 2024-05-25T23:02:00.341162446Z [2024-05-25T23:02:00.340+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:02:00.359959333Z [2024-05-25T23:02:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:00.375333252Z [2024-05-25T23:02:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:00.390444478Z [2024-05-25T23:02:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:00.399178564Z [2024-05-25T23:02:00.398+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:02:00.406939414Z [2024-05-25T23:02:00.406+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:02:00.530315988Z [2024-05-25T23:02:00.529+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-25T23:02:00.530342518Z 2024-05-25T23:02:00.530349508Z 2024-05-25T23:02:00.530368126Z 2024-05-25T23:02:00.530371691Z 2024-05-25T23:02:00.530375410Z 2024-05-25T23:02:00.530379093Z 2024-05-25T23:02:00.530556298Z [2024-05-25T23:02:00.530+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:02:00.530743878Z [2024-05-25T23:02:00.530+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:02:00.530938516Z [2024-05-25T23:02:00.530+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:02:00.531115804Z [2024-05-25T23:02:00.530+0000] {scheduler_job.py:425} INFO - DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:02:00.531292547Z [2024-05-25T23:02:00.531+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:02:00.531456473Z [2024-05-25T23:02:00.531+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:02:00.532200489Z [2024-05-25T23:02:00.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:02:00.532214945Z 2024-05-25T23:02:00.532219088Z 2024-05-25T23:02:00.532222605Z 2024-05-25T23:02:00.532226140Z 2024-05-25T23:02:00.532229601Z 2024-05-25T23:02:00.532232950Z 2024-05-25T23:02:00.536800079Z [2024-05-25T23:02:00.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:02:00.537000155Z [2024-05-25T23:02:00.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:02:00.537537163Z [2024-05-25T23:02:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:02:00.537756680Z [2024-05-25T23:02:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:02:00.538041292Z [2024-05-25T23:02:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:02:00.538195407Z [2024-05-25T23:02:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:02:00.538447521Z [2024-05-25T23:02:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:02:00.538613766Z [2024-05-25T23:02:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:02:00.538859684Z [2024-05-25T23:02:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:02:00.539027578Z [2024-05-25T23:02:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:02:00.539259917Z [2024-05-25T23:02:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:02:00.539426478Z [2024-05-25T23:02:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:02:01.340638037Z [2024-05-25T23:02:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:02:01.342319231Z [2024-05-25T23:02:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status queued for try_number 1 2024-05-25T23:02:01.342566224Z [2024-05-25T23:02:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status queued for try_number 1 2024-05-25T23:02:01.342760322Z [2024-05-25T23:02:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status queued for try_number 1 2024-05-25T23:02:01.342949857Z [2024-05-25T23:02:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status queued for try_number 1 2024-05-25T23:02:01.343067338Z [2024-05-25T23:02:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status queued for try_number 1 2024-05-25T23:02:01.358686187Z [2024-05-25T23:02:01.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e01a18c-292e-4a74-a360-da8b913899cf 2024-05-25T23:02:01.359897894Z [2024-05-25T23:02:01.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to e33b122d-2372-4164-8f1a-99ee3298d925 2024-05-25T23:02:01.360152651Z [2024-05-25T23:02:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c35b26f-b98d-415b-8517-9962e01b7e5f 2024-05-25T23:02:01.362429990Z [2024-05-25T23:02:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97ca0804-3ab4-457c-8ab9-4681af901c54 2024-05-25T23:02:01.362749590Z [2024-05-25T23:02:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bff4b99-be33-4644-9e3e-195d6dd9f879 2024-05-25T23:02:01.362962132Z [2024-05-25T23:02:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to d26299cd-3829-424a-8663-afb4ccc997e3 2024-05-25T23:02:02.203254749Z [2024-05-25T23:02:02.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:02:02.203760850Z [2024-05-25T23:02:02.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:01:00+00:00, run_id=scheduled__2024-05-25T23:01:00+00:00, run_start_date=2024-05-25 23:02:00.427365+00:00, run_end_date=2024-05-25 23:02:02.203349+00:00, run_duration=1.775984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:01:00+00:00, data_interval_end=2024-05-25 23:02:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:02:02.212980852Z [2024-05-25T23:02:02.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:02.303827880Z [2024-05-25T23:02:02.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status success for try_number 1 2024-05-25T23:02:02.320894808Z [2024-05-25T23:02:02.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:01:00+00:00, map_index=-1, run_start_date=2024-05-25 23:02:01.571186+00:00, run_end_date=2024-05-25 23:02:01.942307+00:00, run_duration=0.371121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:02:00.533469+00:00, queued_by_job_id=1, pid=1509 2024-05-25T23:02:03.429710725Z [2024-05-25T23:02:03.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:02:03.433334457Z [2024-05-25T23:02:03.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:02:00.422048+00:00, run_end_date=2024-05-25 23:02:03.432922+00:00, run_duration=3.010874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:02:03.450608645Z [2024-05-25T23:02:03.450+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:02:03.647005649Z [2024-05-25T23:02:03.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:02:03.654274533Z [2024-05-25T23:02:03.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:02:01.828451+00:00, run_end_date=2024-05-25 23:02:02.291228+00:00, run_duration=0.462777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:02:00.533469+00:00, queued_by_job_id=1, pid=1515 2024-05-25T23:02:05.981086851Z [2024-05-25T23:02:05.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:02:05.981556648Z [2024-05-25T23:02:05.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:01:00+00:00, run_id=scheduled__2024-05-25T23:01:00+00:00, run_start_date=2024-05-25 23:02:00.423312+00:00, run_end_date=2024-05-25 23:02:05.981197+00:00, run_duration=5.557885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:01:00+00:00, data_interval_end=2024-05-25 23:02:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:02:05.993753637Z [2024-05-25T23:02:05.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:06.002421804Z [2024-05-25T23:02:06.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:02:06.003003174Z [2024-05-25T23:02:06.002+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:01:00+00:00, run_id=scheduled__2024-05-25T23:01:00+00:00, run_start_date=2024-05-25 23:02:00.425067+00:00, run_end_date=2024-05-25 23:02:06.002642+00:00, run_duration=5.577575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:01:00+00:00, data_interval_end=2024-05-25 23:02:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:02:06.016215949Z [2024-05-25T23:02:06.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:06.024670965Z [2024-05-25T23:02:06.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:02:06.024990706Z [2024-05-25T23:02:06.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:01:00+00:00, run_id=scheduled__2024-05-25T23:01:00+00:00, run_start_date=2024-05-25 23:02:00.428504+00:00, run_end_date=2024-05-25 23:02:06.024598+00:00, run_duration=5.596094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:01:00+00:00, data_interval_end=2024-05-25 23:02:00+00:00, dag_hash=b109d800f139ed8336ee47aad2a37de1 2024-05-25T23:02:06.033874771Z [2024-05-25T23:02:06.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:06.040624850Z [2024-05-25T23:02:06.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:02:06.040980767Z [2024-05-25T23:02:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:01:00+00:00, run_id=scheduled__2024-05-25T23:01:00+00:00, run_start_date=2024-05-25 23:02:00.426230+00:00, run_end_date=2024-05-25 23:02:06.040576+00:00, run_duration=5.614346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:01:00+00:00, data_interval_end=2024-05-25 23:02:00+00:00, dag_hash=096cdbf19148bbc536f1886c61f056aa 2024-05-25T23:02:06.053258733Z [2024-05-25T23:02:06.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:02:00+00:00, run_after=2024-05-25T23:03:00+00:00 2024-05-25T23:02:06.108744166Z [2024-05-25T23:02:06.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status success for try_number 1 2024-05-25T23:02:06.112016874Z [2024-05-25T23:02:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status success for try_number 1 2024-05-25T23:02:06.112347867Z [2024-05-25T23:02:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status success for try_number 1 2024-05-25T23:02:06.124617762Z [2024-05-25T23:02:06.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:01:00+00:00, map_index=-1, run_start_date=2024-05-25 23:02:03.211610+00:00, run_end_date=2024-05-25 23:02:05.357456+00:00, run_duration=2.145846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:02:00.533469+00:00, queued_by_job_id=1, pid=1541 2024-05-25T23:02:06.128201481Z [2024-05-25T23:02:06.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:01:00+00:00, map_index=-1, run_start_date=2024-05-25 23:02:03.196159+00:00, run_end_date=2024-05-25 23:02:04.985141+00:00, run_duration=1.788982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:02:00.533469+00:00, queued_by_job_id=1, pid=1540 2024-05-25T23:02:06.128657798Z [2024-05-25T23:02:06.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:01:00+00:00, map_index=-1, run_start_date=2024-05-25 23:02:03.392561+00:00, run_end_date=2024-05-25 23:02:05.338354+00:00, run_duration=1.945793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:02:00.533469+00:00, queued_by_job_id=1, pid=1546 2024-05-25T23:02:07.202778034Z [2024-05-25T23:02:07.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:01:00+00:00 exited with status success for try_number 1 2024-05-25T23:02:07.218553506Z [2024-05-25T23:02:07.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:01:00+00:00, map_index=-1, run_start_date=2024-05-25 23:02:04.005729+00:00, run_end_date=2024-05-25 23:02:05.911324+00:00, run_duration=1.905595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:02:00.533469+00:00, queued_by_job_id=1, pid=1563 2024-05-25T23:03:00.326984768Z [2024-05-25T23:03:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:00.350391888Z [2024-05-25T23:03:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:00.359884821Z [2024-05-25T23:03:00.359+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:03:00.368274277Z [2024-05-25T23:03:00.367+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:03:00.383164747Z [2024-05-25T23:03:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:00.500154885Z [2024-05-25T23:03:00.499+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T23:03:00.500183659Z 2024-05-25T23:03:00.500204451Z 2024-05-25T23:03:00.500207964Z 2024-05-25T23:03:00.500211395Z 2024-05-25T23:03:00.500214762Z 2024-05-25T23:03:00.500217882Z [2024-05-25T23:03:00.499+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:03:00.500475015Z [2024-05-25T23:03:00.500+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:03:00.500789220Z [2024-05-25T23:03:00.500+0000] {scheduler_job.py:425} INFO - DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:03:00.501121366Z [2024-05-25T23:03:00.500+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:03:00.501269457Z [2024-05-25T23:03:00.501+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:03:00.502754805Z [2024-05-25T23:03:00.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:03:00.502764547Z 2024-05-25T23:03:00.502768308Z 2024-05-25T23:03:00.502772098Z 2024-05-25T23:03:00.502775546Z 2024-05-25T23:03:00.502785440Z 2024-05-25T23:03:00.511028710Z [2024-05-25T23:03:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:03:00.511154777Z [2024-05-25T23:03:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:03:00.511499015Z [2024-05-25T23:03:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:03:00.511632846Z [2024-05-25T23:03:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:03:00.511999580Z [2024-05-25T23:03:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:03:00.512151990Z [2024-05-25T23:03:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:03:00.512498229Z [2024-05-25T23:03:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:03:00.522422172Z [2024-05-25T23:03:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:03:00.522456002Z [2024-05-25T23:03:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:03:00.522459590Z [2024-05-25T23:03:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:03:00.920906815Z [2024-05-25T23:03:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status queued for try_number 1 2024-05-25T23:03:00.921060966Z [2024-05-25T23:03:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status queued for try_number 1 2024-05-25T23:03:00.921201687Z [2024-05-25T23:03:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status queued for try_number 1 2024-05-25T23:03:00.921373184Z [2024-05-25T23:03:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status queued for try_number 1 2024-05-25T23:03:00.921420692Z [2024-05-25T23:03:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status queued for try_number 1 2024-05-25T23:03:00.940958116Z [2024-05-25T23:03:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9877c603-f4e2-4c2b-a5d4-2cf67caccb49 2024-05-25T23:03:00.941163493Z [2024-05-25T23:03:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to bce0e06b-3f69-4913-9a4e-3494bf081a3b 2024-05-25T23:03:00.941433056Z [2024-05-25T23:03:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7e16aa0-d1b4-4cb0-9f28-0685f1df7d61 2024-05-25T23:03:00.941651973Z [2024-05-25T23:03:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65ee33fb-cd3a-452e-91fb-508d62014a80 2024-05-25T23:03:00.941853738Z [2024-05-25T23:03:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae1ea269-c729-4ffd-85f1-afff36568f0a 2024-05-25T23:03:03.025632717Z [2024-05-25T23:03:03.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:03:03.026088789Z [2024-05-25T23:03:03.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:02:00+00:00, run_id=scheduled__2024-05-25T23:02:00+00:00, run_start_date=2024-05-25 23:03:00.396974+00:00, run_end_date=2024-05-25 23:03:03.025546+00:00, run_duration=2.628572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:02:00+00:00, data_interval_end=2024-05-25 23:03:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:03:03.042554363Z [2024-05-25T23:03:03.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:03.176913157Z [2024-05-25T23:03:03.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status success for try_number 1 2024-05-25T23:03:03.203596552Z [2024-05-25T23:03:03.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:02:00+00:00, map_index=-1, run_start_date=2024-05-25 23:03:01.858137+00:00, run_end_date=2024-05-25 23:03:02.344080+00:00, run_duration=0.485943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:03:00.505222+00:00, queued_by_job_id=1, pid=1591 2024-05-25T23:03:05.444180167Z [2024-05-25T23:03:05.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:03:05.444517612Z [2024-05-25T23:03:05.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:02:00+00:00, run_id=scheduled__2024-05-25T23:02:00+00:00, run_start_date=2024-05-25 23:03:00.403123+00:00, run_end_date=2024-05-25 23:03:05.444204+00:00, run_duration=5.041081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:02:00+00:00, data_interval_end=2024-05-25 23:03:00+00:00, dag_hash=096cdbf19148bbc536f1886c61f056aa 2024-05-25T23:03:05.453328015Z [2024-05-25T23:03:05.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:05.459961529Z [2024-05-25T23:03:05.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:03:05.460302198Z [2024-05-25T23:03:05.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:02:00+00:00, run_id=scheduled__2024-05-25T23:02:00+00:00, run_start_date=2024-05-25 23:03:00.401753+00:00, run_end_date=2024-05-25 23:03:05.460027+00:00, run_duration=5.058274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:02:00+00:00, data_interval_end=2024-05-25 23:03:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:03:05.468621137Z [2024-05-25T23:03:05.468+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:05.483363062Z [2024-05-25T23:03:05.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:03:05.483386261Z [2024-05-25T23:03:05.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:02:00+00:00, run_id=scheduled__2024-05-25T23:02:00+00:00, run_start_date=2024-05-25 23:03:00.398619+00:00, run_end_date=2024-05-25 23:03:05.482128+00:00, run_duration=5.083509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:02:00+00:00, data_interval_end=2024-05-25 23:03:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:03:05.491654919Z [2024-05-25T23:03:05.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:05.498458351Z [2024-05-25T23:03:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:03:05.498909958Z [2024-05-25T23:03:05.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:02:00+00:00, run_id=scheduled__2024-05-25T23:02:00+00:00, run_start_date=2024-05-25 23:03:00.400357+00:00, run_end_date=2024-05-25 23:03:05.498597+00:00, run_duration=5.09824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:02:00+00:00, data_interval_end=2024-05-25 23:03:00+00:00, dag_hash=b109d800f139ed8336ee47aad2a37de1 2024-05-25T23:03:05.509118916Z [2024-05-25T23:03:05.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:03:00+00:00, run_after=2024-05-25T23:04:00+00:00 2024-05-25T23:03:05.536428726Z [2024-05-25T23:03:05.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status success for try_number 1 2024-05-25T23:03:05.536531969Z [2024-05-25T23:03:05.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status success for try_number 1 2024-05-25T23:03:05.536721271Z [2024-05-25T23:03:05.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status success for try_number 1 2024-05-25T23:03:05.536958780Z [2024-05-25T23:03:05.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status success for try_number 1 2024-05-25T23:03:05.543681232Z [2024-05-25T23:03:05.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:02:00+00:00, map_index=-1, run_start_date=2024-05-25 23:03:03.009601+00:00, run_end_date=2024-05-25 23:03:04.796893+00:00, run_duration=1.787292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:03:00.505222+00:00, queued_by_job_id=1, pid=1623 2024-05-25T23:03:05.543960849Z [2024-05-25T23:03:05.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:02:00+00:00, map_index=-1, run_start_date=2024-05-25 23:03:02.947792+00:00, run_end_date=2024-05-25 23:03:05.208307+00:00, run_duration=2.260515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:03:00.505222+00:00, queued_by_job_id=1, pid=1622 2024-05-25T23:03:05.544189743Z [2024-05-25T23:03:05.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:02:00+00:00, map_index=-1, run_start_date=2024-05-25 23:03:03.171434+00:00, run_end_date=2024-05-25 23:03:04.992707+00:00, run_duration=1.821273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:03:00.505222+00:00, queued_by_job_id=1, pid=1624 2024-05-25T23:03:05.544423543Z [2024-05-25T23:03:05.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:02:00+00:00, map_index=-1, run_start_date=2024-05-25 23:03:02.961570+00:00, run_end_date=2024-05-25 23:03:05.103198+00:00, run_duration=2.141628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:03:00.505222+00:00, queued_by_job_id=1, pid=1621 2024-05-25T23:03:30.218935714Z [2024-05-25T23:03:30.218+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:04:00.219160010Z [2024-05-25T23:04:00.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:00.228973296Z [2024-05-25T23:04:00.228+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:04:00.242793809Z [2024-05-25T23:04:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:00.251380671Z [2024-05-25T23:04:00.250+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:04:00.259323484Z [2024-05-25T23:04:00.258+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:04:00.276814580Z [2024-05-25T23:04:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:00.404315628Z [2024-05-25T23:04:00.403+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-25T23:04:00.404362345Z 2024-05-25T23:04:00.404370247Z 2024-05-25T23:04:00.404376863Z 2024-05-25T23:04:00.404382782Z 2024-05-25T23:04:00.404388636Z 2024-05-25T23:04:00.404394469Z 2024-05-25T23:04:00.404782847Z [2024-05-25T23:04:00.404+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:04:00.404947415Z [2024-05-25T23:04:00.404+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:04:00.405139184Z [2024-05-25T23:04:00.404+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:04:00.405317159Z [2024-05-25T23:04:00.405+0000] {scheduler_job.py:425} INFO - DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:04:00.405474723Z [2024-05-25T23:04:00.405+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:04:00.405641522Z [2024-05-25T23:04:00.405+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:04:00.406436240Z [2024-05-25T23:04:00.406+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:04:00.406458095Z 2024-05-25T23:04:00.406467837Z 2024-05-25T23:04:00.406476985Z 2024-05-25T23:04:00.406485823Z 2024-05-25T23:04:00.406521310Z 2024-05-25T23:04:00.406530314Z 2024-05-25T23:04:00.412121029Z [2024-05-25T23:04:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:04:00.412175773Z [2024-05-25T23:04:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:04:00.412412588Z [2024-05-25T23:04:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:04:00.412433880Z [2024-05-25T23:04:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:04:00.412715539Z [2024-05-25T23:04:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:04:00.412784182Z [2024-05-25T23:04:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:04:00.412977317Z [2024-05-25T23:04:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:04:00.412996549Z [2024-05-25T23:04:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:04:00.413456486Z [2024-05-25T23:04:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:04:00.413487143Z [2024-05-25T23:04:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:04:00.413723606Z [2024-05-25T23:04:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:04:00.413775254Z [2024-05-25T23:04:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:04:01.241787100Z [2024-05-25T23:04:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status queued for try_number 1 2024-05-25T23:04:01.241824965Z [2024-05-25T23:04:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status queued for try_number 1 2024-05-25T23:04:01.241881970Z [2024-05-25T23:04:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status queued for try_number 1 2024-05-25T23:04:01.241926207Z [2024-05-25T23:04:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status queued for try_number 1 2024-05-25T23:04:01.242011466Z [2024-05-25T23:04:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status queued for try_number 1 2024-05-25T23:04:01.242071224Z [2024-05-25T23:04:01.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status queued for try_number 1 2024-05-25T23:04:01.261892590Z [2024-05-25T23:04:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 683b1520-955e-4b53-b646-80846554df97 2024-05-25T23:04:01.261968112Z [2024-05-25T23:04:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 559f7a9e-6d0a-47f4-862d-e4dfc9142fba 2024-05-25T23:04:01.262078308Z [2024-05-25T23:04:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61cb63e9-9764-4a6c-bf36-7dd544fe5c2d 2024-05-25T23:04:01.262155723Z [2024-05-25T23:04:01.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbe6fad1-2ec7-444c-a85f-4c8fcedfedd5 2024-05-25T23:04:01.262267217Z [2024-05-25T23:04:01.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6fed5df-58e0-4ee9-adec-d6959a7b9fa6 2024-05-25T23:04:01.262345716Z [2024-05-25T23:04:01.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f03a14b-cdbf-4de1-a814-d043a1979331 2024-05-25T23:04:02.395250854Z [2024-05-25T23:04:02.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:04:02.395535546Z [2024-05-25T23:04:02.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:02:00+00:00, run_id=scheduled__2024-05-25T23:02:00+00:00, run_start_date=2024-05-25 23:04:00.300203+00:00, run_end_date=2024-05-25 23:04:02.395185+00:00, run_duration=2.094982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:02:00+00:00, data_interval_end=2024-05-25 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:04:02.410326897Z [2024-05-25T23:04:02.409+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:04:02.464727295Z [2024-05-25T23:04:02.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:04:02.464933564Z [2024-05-25T23:04:02.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:03:00+00:00, run_id=scheduled__2024-05-25T23:03:00+00:00, run_start_date=2024-05-25 23:04:00.305980+00:00, run_end_date=2024-05-25 23:04:02.464656+00:00, run_duration=2.158676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:03:00+00:00, data_interval_end=2024-05-25 23:04:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:04:02.475799276Z [2024-05-25T23:04:02.475+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:02.505494582Z [2024-05-25T23:04:02.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:02:00+00:00 exited with status success for try_number 1 2024-05-25T23:04:02.517830451Z [2024-05-25T23:04:02.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:02:00+00:00, map_index=-1, run_start_date=2024-05-25 23:04:01.336259+00:00, run_end_date=2024-05-25 23:04:01.674862+00:00, run_duration=0.338603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:04:00.407375+00:00, queued_by_job_id=1, pid=1664 2024-05-25T23:04:03.671962675Z [2024-05-25T23:04:03.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status success for try_number 1 2024-05-25T23:04:03.686301179Z [2024-05-25T23:04:03.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:03:00+00:00, map_index=-1, run_start_date=2024-05-25 23:04:01.989970+00:00, run_end_date=2024-05-25 23:04:02.404256+00:00, run_duration=0.414286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:04:00.407375+00:00, queued_by_job_id=1, pid=1676 2024-05-25T23:04:05.348517931Z [2024-05-25T23:04:05.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:04:05.349088004Z [2024-05-25T23:04:05.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:03:00+00:00, run_id=scheduled__2024-05-25T23:03:00+00:00, run_start_date=2024-05-25 23:04:00.301755+00:00, run_end_date=2024-05-25 23:04:05.348439+00:00, run_duration=5.046684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:03:00+00:00, data_interval_end=2024-05-25 23:04:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:04:05.361002795Z [2024-05-25T23:04:05.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:05.372366914Z [2024-05-25T23:04:05.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:04:05.372552415Z [2024-05-25T23:04:05.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:03:00+00:00, run_id=scheduled__2024-05-25T23:03:00+00:00, run_start_date=2024-05-25 23:04:00.303848+00:00, run_end_date=2024-05-25 23:04:05.372315+00:00, run_duration=5.068467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:03:00+00:00, data_interval_end=2024-05-25 23:04:00+00:00, dag_hash=096cdbf19148bbc536f1886c61f056aa 2024-05-25T23:04:05.387974963Z [2024-05-25T23:04:05.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:05.395043847Z [2024-05-25T23:04:05.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:04:05.395249413Z [2024-05-25T23:04:05.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:03:00+00:00, run_id=scheduled__2024-05-25T23:03:00+00:00, run_start_date=2024-05-25 23:04:00.304880+00:00, run_end_date=2024-05-25 23:04:05.394988+00:00, run_duration=5.090108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:03:00+00:00, data_interval_end=2024-05-25 23:04:00+00:00, dag_hash=b109d800f139ed8336ee47aad2a37de1 2024-05-25T23:04:05.403893730Z [2024-05-25T23:04:05.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:05.478265647Z [2024-05-25T23:04:05.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status success for try_number 1 2024-05-25T23:04:05.478294757Z [2024-05-25T23:04:05.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status success for try_number 1 2024-05-25T23:04:05.478369438Z [2024-05-25T23:04:05.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status success for try_number 1 2024-05-25T23:04:05.494827548Z [2024-05-25T23:04:05.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:03:00+00:00, map_index=-1, run_start_date=2024-05-25 23:04:03.012258+00:00, run_end_date=2024-05-25 23:04:04.444978+00:00, run_duration=1.43272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:04:00.407375+00:00, queued_by_job_id=1, pid=1696 2024-05-25T23:04:05.494863150Z [2024-05-25T23:04:05.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:03:00+00:00, map_index=-1, run_start_date=2024-05-25 23:04:02.965304+00:00, run_end_date=2024-05-25 23:04:04.576746+00:00, run_duration=1.611442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:04:00.407375+00:00, queued_by_job_id=1, pid=1695 2024-05-25T23:04:05.494866811Z [2024-05-25T23:04:05.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:03:00+00:00, map_index=-1, run_start_date=2024-05-25 23:04:03.422680+00:00, run_end_date=2024-05-25 23:04:05.127869+00:00, run_duration=1.705189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:04:00.407375+00:00, queued_by_job_id=1, pid=1712 2024-05-25T23:04:06.555451373Z [2024-05-25T23:04:06.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:04:06.555953423Z [2024-05-25T23:04:06.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:03:00+00:00, run_id=scheduled__2024-05-25T23:03:00+00:00, run_start_date=2024-05-25 23:04:00.302825+00:00, run_end_date=2024-05-25 23:04:06.555143+00:00, run_duration=6.252318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:03:00+00:00, data_interval_end=2024-05-25 23:04:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:04:06.568489932Z [2024-05-25T23:04:06.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:04:00+00:00, run_after=2024-05-25T23:05:00+00:00 2024-05-25T23:04:06.615743062Z [2024-05-25T23:04:06.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:03:00+00:00 exited with status success for try_number 1 2024-05-25T23:04:06.627150899Z [2024-05-25T23:04:06.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:03:00+00:00, map_index=-1, run_start_date=2024-05-25 23:04:03.804396+00:00, run_end_date=2024-05-25 23:04:05.458749+00:00, run_duration=1.654353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:04:00.407375+00:00, queued_by_job_id=1, pid=1718 2024-05-25T23:05:00.144197152Z [2024-05-25T23:05:00.143+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:05:00.175564954Z [2024-05-25T23:05:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:05:00.192909519Z [2024-05-25T23:05:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:00.205663311Z [2024-05-25T23:05:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:00.219676777Z [2024-05-25T23:05:00.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:00.228032137Z [2024-05-25T23:05:00.227+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:05:00.244453754Z [2024-05-25T23:05:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:05:00.425928838Z [2024-05-25T23:05:00.425+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-05-25T23:05:00.425981652Z 2024-05-25T23:05:00.425991401Z 2024-05-25T23:05:00.426001747Z 2024-05-25T23:05:00.426010260Z 2024-05-25T23:05:00.426019175Z 2024-05-25T23:05:00.426027470Z 2024-05-25T23:05:00.426035825Z 2024-05-25T23:05:00.426197326Z [2024-05-25T23:05:00.425+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:05:00.426490390Z [2024-05-25T23:05:00.426+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:05:00.426779646Z [2024-05-25T23:05:00.426+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:05:00.426975453Z [2024-05-25T23:05:00.426+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:05:00.427167955Z [2024-05-25T23:05:00.426+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:05:00.427352363Z [2024-05-25T23:05:00.427+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:05:00.427552694Z [2024-05-25T23:05:00.427+0000] {scheduler_job.py:425} INFO - DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:05:00.428755396Z [2024-05-25T23:05:00.428+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:05:00.428769069Z 2024-05-25T23:05:00.428774823Z 2024-05-25T23:05:00.428780494Z 2024-05-25T23:05:00.428786445Z 2024-05-25T23:05:00.428792098Z 2024-05-25T23:05:00.428819074Z 2024-05-25T23:05:00.428824722Z 2024-05-25T23:05:00.438363344Z [2024-05-25T23:05:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:05:00.438450915Z [2024-05-25T23:05:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:00.438741841Z [2024-05-25T23:05:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:05:00.438840848Z [2024-05-25T23:05:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:00.439142528Z [2024-05-25T23:05:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:00.439263881Z [2024-05-25T23:05:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:05:00.439509834Z [2024-05-25T23:05:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:00.439666974Z [2024-05-25T23:05:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:05:00.439904946Z [2024-05-25T23:05:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:00.440036027Z [2024-05-25T23:05:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:05:00.440292407Z [2024-05-25T23:05:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:00.440425729Z [2024-05-25T23:05:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:05:00.440681695Z [2024-05-25T23:05:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:00.440767448Z [2024-05-25T23:05:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:05:00.976487586Z [2024-05-25T23:05:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:00.978849236Z [2024-05-25T23:05:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:00.978921967Z [2024-05-25T23:05:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:00.979002576Z [2024-05-25T23:05:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:00.979159608Z [2024-05-25T23:05:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:00.979273626Z [2024-05-25T23:05:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:00.979392441Z [2024-05-25T23:05:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:00.994933067Z [2024-05-25T23:05:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to fec64b02-33a6-456f-81d4-2b12367ca65d 2024-05-25T23:05:00.995083600Z [2024-05-25T23:05:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ace8abc-c800-4d09-aae1-b5f7510e454a 2024-05-25T23:05:00.995225743Z [2024-05-25T23:05:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37e82c45-c184-445a-b9db-6d60f0389686 2024-05-25T23:05:00.995362209Z [2024-05-25T23:05:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fdf98bc-fb66-4f7d-8c6b-9c13de65c4d4 2024-05-25T23:05:00.995495884Z [2024-05-25T23:05:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 350c5551-8f0d-429e-b82f-a5ab48450c52 2024-05-25T23:05:00.995725309Z [2024-05-25T23:05:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23ed456f-7b07-498b-bacb-66e08c4d45fa 2024-05-25T23:05:00.995882014Z [2024-05-25T23:05:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 275ca559-2e60-4056-a5e1-c51bd6e75204 2024-05-25T23:05:02.979385102Z [2024-05-25T23:05:02.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:05:02.980119116Z [2024-05-25T23:05:02.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:04:00+00:00, run_id=scheduled__2024-05-25T23:04:00+00:00, run_start_date=2024-05-25 23:05:00.266274+00:00, run_end_date=2024-05-25 23:05:02.979733+00:00, run_duration=2.713459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:04:00+00:00, data_interval_end=2024-05-25 23:05:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:05:02.998272895Z [2024-05-25T23:05:02.997+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:03.121393713Z [2024-05-25T23:05:03.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status success for try_number 1 2024-05-25T23:05:03.127303285Z [2024-05-25T23:05:03.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=2024-05-25 23:05:02.101829+00:00, run_end_date=2024-05-25 23:05:02.636668+00:00, run_duration=0.534839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:00.432508+00:00, queued_by_job_id=1, pid=1756 2024-05-25T23:05:04.388880298Z [2024-05-25T23:05:04.388+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:05:04.388909143Z 2024-05-25T23:05:04.389100798Z [2024-05-25T23:05:04.388+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:05:04.389723464Z [2024-05-25T23:05:04.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:05:04.389735041Z 2024-05-25T23:05:04.393244446Z [2024-05-25T23:05:04.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:05:04.393452459Z [2024-05-25T23:05:04.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:04.542845278Z [2024-05-25T23:05:04.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:04.544732838Z [2024-05-25T23:05:04.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:05:04.546277710Z [2024-05-25T23:05:04.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status failed for try_number 1 2024-05-25T23:05:04.593992275Z [2024-05-25T23:05:04.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:00.432508+00:00, queued_by_job_id=1, pid=None 2024-05-25T23:05:04.599130344Z [2024-05-25T23:05:04.598+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:04.605121017Z [2024-05-25T23:05:04.604+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:04.653673848Z [2024-05-25T23:05:04.653+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T230400, start_date=, end_date=20240525T230504 2024-05-25T23:05:04.670043751Z [2024-05-25T23:05:04.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5585b7ac-7dd8-4464-8a3a-7c3094a84951 2024-05-25T23:05:04.670818460Z [2024-05-25T23:05:04.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:05:03.124391+00:00, run_end_date=2024-05-25 23:05:03.809036+00:00, run_duration=0.684645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:00.432508+00:00, queued_by_job_id=1, pid=1773 2024-05-25T23:05:05.860111898Z [2024-05-25T23:05:05.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:05:05.860413192Z [2024-05-25T23:05:05.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:04:00+00:00, run_id=scheduled__2024-05-25T23:04:00+00:00, run_start_date=2024-05-25 23:05:00.262377+00:00, run_end_date=2024-05-25 23:05:05.860024+00:00, run_duration=5.597647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:04:00+00:00, data_interval_end=2024-05-25 23:05:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:05:05.879087679Z [2024-05-25T23:05:05.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:05.900442512Z [2024-05-25T23:05:05.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:05:05.900742957Z [2024-05-25T23:05:05.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:04:00+00:00, run_id=scheduled__2024-05-25T23:04:00+00:00, run_start_date=2024-05-25 23:05:00.263398+00:00, run_end_date=2024-05-25 23:05:05.900329+00:00, run_duration=5.636931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:04:00+00:00, data_interval_end=2024-05-25 23:05:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:05:05.912696940Z [2024-05-25T23:05:05.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:06.003603603Z [2024-05-25T23:05:06.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status failed for try_number 1 2024-05-25T23:05:06.003670025Z [2024-05-25T23:05:06.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status success for try_number 1 2024-05-25T23:05:06.003697177Z [2024-05-25T23:05:06.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status success for try_number 1 2024-05-25T23:05:06.003762363Z [2024-05-25T23:05:06.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status failed for try_number 1 2024-05-25T23:05:06.014875647Z [2024-05-25T23:05:06.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=2024-05-25 23:05:03.475321+00:00, run_end_date=2024-05-25 23:05:05.477296+00:00, run_duration=2.001975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:00.432508+00:00, queued_by_job_id=1, pid=1784 2024-05-25T23:05:06.014935810Z [2024-05-25T23:05:06.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:00.432508+00:00, queued_by_job_id=1, pid=None 2024-05-25T23:05:06.015346780Z [2024-05-25T23:05:06.015+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:06.018334853Z [2024-05-25T23:05:06.017+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:06.036854526Z [2024-05-25T23:05:06.036+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=extract_metrics_from_vnfrs, execution_date=20240525T230000, start_date=, end_date=20240525T230506 2024-05-25T23:05:06.053707581Z [2024-05-25T23:05:06.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=2024-05-25 23:05:04.074214+00:00, run_end_date=2024-05-25 23:05:05.747069+00:00, run_duration=1.672855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:00.432508+00:00, queued_by_job_id=1, pid=1803 2024-05-25T23:05:06.054002923Z [2024-05-25T23:05:06.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:00.432508+00:00, queued_by_job_id=1, pid=None 2024-05-25T23:05:06.054534073Z [2024-05-25T23:05:06.054+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:06.066005176Z [2024-05-25T23:05:06.065+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:06.080041985Z [2024-05-25T23:05:06.079+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T230400, start_date=, end_date=20240525T230506 2024-05-25T23:05:08.454375795Z [2024-05-25T23:05:08.453+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:05:08.454411887Z 2024-05-25T23:05:08.454800472Z [2024-05-25T23:05:08.454+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:05:08.455431516Z [2024-05-25T23:05:08.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:05:08.455446394Z 2024-05-25T23:05:08.459210278Z [2024-05-25T23:05:08.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:05:08.459663788Z [2024-05-25T23:05:08.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:05:08.514909212Z [2024-05-25T23:05:08.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:08.515395534Z [2024-05-25T23:05:08.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:05:08.527748268Z [2024-05-25T23:05:08.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f907e41-69e7-4144-b607-e92befe32cd7 2024-05-25T23:05:08.528255972Z [2024-05-25T23:05:08.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:05:06.868895+00:00, run_end_date=2024-05-25 23:05:07.284313+00:00, run_duration=0.415418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:04.390156+00:00, queued_by_job_id=1, pid=1836 2024-05-25T23:05:12.374903473Z [2024-05-25T23:05:12.374+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:05:12.374954665Z 2024-05-25T23:05:12.374971686Z [2024-05-25T23:05:12.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:05:12.376157346Z [2024-05-25T23:05:12.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:05:12.376203778Z 2024-05-25T23:05:12.379929870Z [2024-05-25T23:05:12.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:12.380120201Z [2024-05-25T23:05:12.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:12.452407194Z [2024-05-25T23:05:12.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 1 2024-05-25T23:05:12.452481974Z [2024-05-25T23:05:12.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:05:12.457823826Z [2024-05-25T23:05:12.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93bd3ef2-2c60-4767-94a4-227e75a44d12 2024-05-25T23:05:12.458131317Z [2024-05-25T23:05:12.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=0, run_start_date=2024-05-25 23:05:10.049891+00:00, run_end_date=2024-05-25 23:05:11.312501+00:00, run_duration=1.26261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:08.455915+00:00, queued_by_job_id=1, pid=1844 2024-05-25T23:05:15.415416858Z [2024-05-25T23:05:15.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:05:15.416176303Z [2024-05-25T23:05:15.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:05:00.260912+00:00, run_end_date=2024-05-25 23:05:15.415818+00:00, run_duration=15.154906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:05:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:05:15.423437501Z [2024-05-25T23:05:15.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:05:15.469108445Z [2024-05-25T23:05:15.468+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:05:15.469143319Z 2024-05-25T23:05:15.469574438Z [2024-05-25T23:05:15.469+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:05:15.470319323Z [2024-05-25T23:05:15.470+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:05:15.470333091Z 2024-05-25T23:05:15.472794273Z [2024-05-25T23:05:15.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:15.473156213Z [2024-05-25T23:05:15.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:05:15.570662355Z [2024-05-25T23:05:15.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 2 2024-05-25T23:05:15.570987037Z [2024-05-25T23:05:15.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status success for try_number 1 2024-05-25T23:05:15.580209892Z [2024-05-25T23:05:15.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=2024-05-25 23:05:14.077507+00:00, run_end_date=2024-05-25 23:05:14.478953+00:00, run_duration=0.401446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:12.376518+00:00, queued_by_job_id=1, pid=1867 2024-05-25T23:05:15.580777954Z [2024-05-25T23:05:15.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71c27f76-7650-4ac3-961d-dae38f8bcaf2 2024-05-25T23:05:16.306817446Z [2024-05-25T23:05:16.306+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-25T23:05:16.306872279Z 2024-05-25T23:05:16.306880162Z 2024-05-25T23:05:16.307314904Z [2024-05-25T23:05:16.307+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:05:16.307888999Z [2024-05-25T23:05:16.307+0000] {scheduler_job.py:425} INFO - DAG vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 has 0/16 running and queued tasks 2024-05-25T23:05:16.308992321Z [2024-05-25T23:05:16.308+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:05:16.309010507Z 2024-05-25T23:05:16.309017887Z 2024-05-25T23:05:16.312703480Z [2024-05-25T23:05:16.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:00:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:05:16.313021262Z [2024-05-25T23:05:16.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:05:16.313380868Z [2024-05-25T23:05:16.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:05:16.313754662Z [2024-05-25T23:05:16.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:05:16.565798006Z [2024-05-25T23:05:16.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status queued for try_number 2 2024-05-25T23:05:16.565904910Z [2024-05-25T23:05:16.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 2 2024-05-25T23:05:16.583657677Z [2024-05-25T23:05:16.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f984f08-9bd8-49b7-827e-d136734aafac 2024-05-25T23:05:16.583822089Z [2024-05-25T23:05:16.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e6a627c-395e-4253-b76a-5e864c87eb37 2024-05-25T23:05:17.820799441Z [2024-05-25T23:05:17.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status failed for try_number 2 2024-05-25T23:05:17.830248071Z [2024-05-25T23:05:17.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 23:05:04.609696+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:15.470756+00:00, queued_by_job_id=1, pid=None 2024-05-25T23:05:17.831568036Z [2024-05-25T23:05:17.830+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:17.834288294Z [2024-05-25T23:05:17.834+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:17.858628004Z [2024-05-25T23:05:17.857+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240525T230400, start_date=, end_date=20240525T230517 2024-05-25T23:05:18.942638991Z [2024-05-25T23:05:18.942+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T23:05:18.943160182Z [2024-05-25T23:05:18.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:04:00+00:00, run_id=scheduled__2024-05-25T23:04:00+00:00, run_start_date=2024-05-25 23:05:00.264790+00:00, run_end_date=2024-05-25 23:05:18.942540+00:00, run_duration=18.67775, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:04:00+00:00, data_interval_end=2024-05-25 23:05:00+00:00, dag_hash=b109d800f139ed8336ee47aad2a37de1 2024-05-25T23:05:18.953443273Z [2024-05-25T23:05:18.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:19.015606921Z [2024-05-25T23:05:19.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:00:00+00:00 exited with status failed for try_number 2 2024-05-25T23:05:19.016209977Z [2024-05-25T23:05:19.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status failed for try_number 2 2024-05-25T23:05:19.026620068Z [2024-05-25T23:05:19.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:00:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 23:05:06.021705+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:16.310004+00:00, queued_by_job_id=1, pid=None 2024-05-25T23:05:19.027231217Z [2024-05-25T23:05:19.026+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:19.030345940Z [2024-05-25T23:05:19.029+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:19.043479071Z [2024-05-25T23:05:19.043+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=extract_metrics_from_vnfrs, execution_date=20240525T230000, start_date=, end_date=20240525T230519 2024-05-25T23:05:19.051290114Z [2024-05-25T23:05:19.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-25 23:05:06.069527+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:05:16.310004+00:00, queued_by_job_id=1, pid=None 2024-05-25T23:05:19.052018673Z [2024-05-25T23:05:19.051+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:19.055551748Z [2024-05-25T23:05:19.055+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-25T23:05:19.066737234Z [2024-05-25T23:05:19.066+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240525T230400, start_date=, end_date=20240525T230519 2024-05-25T23:05:20.137980093Z [2024-05-25T23:05:20.137+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T23:05:20.138615984Z [2024-05-25T23:05:20.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:04:00+00:00, run_id=scheduled__2024-05-25T23:04:00+00:00, run_start_date=2024-05-25 23:05:00.268091+00:00, run_end_date=2024-05-25 23:05:20.138030+00:00, run_duration=19.869939, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:04:00+00:00, data_interval_end=2024-05-25 23:05:00+00:00, dag_hash=096cdbf19148bbc536f1886c61f056aa 2024-05-25T23:05:20.162559786Z [2024-05-25T23:05:20.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:06:00+00:00 2024-05-25T23:05:22.800566315Z [2024-05-25T23:05:22.799+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-25T23:05:22.807608910Z [2024-05-25T23:05:22.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89, execution_date=2024-05-25 23:00:00+00:00, run_id=scheduled__2024-05-25T23:00:00+00:00, run_start_date=2024-05-25 23:05:00.258652+00:00, run_end_date=2024-05-25 23:05:22.800423+00:00, run_duration=22.541771, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:00:00+00:00, data_interval_end=2024-05-25 23:05:00+00:00, dag_hash=3d061e3d103aaba1b7b64117505ce2f4 2024-05-25T23:05:22.819570564Z [2024-05-25T23:05:22.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_4f5e1033-5282-443b-a4d0-25ffec986b89 to 2024-05-25T23:05:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:06:00.412710628Z [2024-05-25T23:06:00.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:06:00+00:00, run_after=2024-05-25T23:07:00+00:00 2024-05-25T23:06:00.419123991Z [2024-05-25T23:06:00.418+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:06:00.430214179Z [2024-05-25T23:06:00.429+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:06:00+00:00, run_after=2024-05-25T23:07:00+00:00 2024-05-25T23:06:00.438194925Z [2024-05-25T23:06:00.437+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:06:00.521702010Z [2024-05-25T23:06:00.521+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:06:00.521729397Z 2024-05-25T23:06:00.521733703Z 2024-05-25T23:06:00.521756614Z 2024-05-25T23:06:00.521767614Z 2024-05-25T23:06:00.522123810Z [2024-05-25T23:06:00.521+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:06:00.522492686Z [2024-05-25T23:06:00.522+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:06:00.522889865Z [2024-05-25T23:06:00.522+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:06:00.523203289Z [2024-05-25T23:06:00.522+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:06:00.524541209Z [2024-05-25T23:06:00.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:06:00.524558470Z 2024-05-25T23:06:00.524562463Z 2024-05-25T23:06:00.524565698Z 2024-05-25T23:06:00.524568748Z 2024-05-25T23:06:00.531657674Z [2024-05-25T23:06:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:06:00.531981114Z [2024-05-25T23:06:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:06:00.532483710Z [2024-05-25T23:06:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:06:00.532695907Z [2024-05-25T23:06:00.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:06:00.533104567Z [2024-05-25T23:06:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:06:00.533734465Z [2024-05-25T23:06:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:06:00.534329531Z [2024-05-25T23:06:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:06:00.534869649Z [2024-05-25T23:06:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:06:00.962200411Z [2024-05-25T23:06:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status queued for try_number 1 2024-05-25T23:06:00.962258885Z [2024-05-25T23:06:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status queued for try_number 1 2024-05-25T23:06:00.963080051Z [2024-05-25T23:06:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status queued for try_number 1 2024-05-25T23:06:00.963373594Z [2024-05-25T23:06:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status queued for try_number 1 2024-05-25T23:06:00.981475244Z [2024-05-25T23:06:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54014c9f-713f-4161-9486-202db7e84c35 2024-05-25T23:06:00.981527912Z [2024-05-25T23:06:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa5069de-250e-4464-a991-d011922cf9dd 2024-05-25T23:06:00.981669913Z [2024-05-25T23:06:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdf12232-f8a0-4fcb-a8f8-1c58b1047b05 2024-05-25T23:06:00.981755537Z [2024-05-25T23:06:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 355ad80d-f67a-4cbd-b8cf-0a2c3fbb3440 2024-05-25T23:06:02.193908138Z [2024-05-25T23:06:02.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:06:02.194080322Z [2024-05-25T23:06:02.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:04:00+00:00, run_id=scheduled__2024-05-25T23:04:00+00:00, run_start_date=2024-05-25 23:06:00.454847+00:00, run_end_date=2024-05-25 23:06:02.193773+00:00, run_duration=1.738926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:04:00+00:00, data_interval_end=2024-05-25 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:06:02.201621302Z [2024-05-25T23:06:02.201+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:06:00+00:00, run_after=2024-05-25T23:08:00+00:00 2024-05-25T23:06:02.213290233Z [2024-05-25T23:06:02.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:06:02.213495628Z [2024-05-25T23:06:02.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:05:00+00:00, run_id=scheduled__2024-05-25T23:05:00+00:00, run_start_date=2024-05-25 23:06:00.457430+00:00, run_end_date=2024-05-25 23:06:02.213148+00:00, run_duration=1.755718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:05:00+00:00, data_interval_end=2024-05-25 23:06:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:06:02.222932444Z [2024-05-25T23:06:02.222+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:06:00+00:00, run_after=2024-05-25T23:07:00+00:00 2024-05-25T23:06:02.260177417Z [2024-05-25T23:06:02.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:04:00+00:00 exited with status success for try_number 1 2024-05-25T23:06:02.260203632Z [2024-05-25T23:06:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status success for try_number 1 2024-05-25T23:06:02.269083095Z [2024-05-25T23:06:02.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:04:00+00:00, map_index=-1, run_start_date=2024-05-25 23:06:01.432596+00:00, run_end_date=2024-05-25 23:06:01.770224+00:00, run_duration=0.337628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:06:00.526282+00:00, queued_by_job_id=1, pid=1916 2024-05-25T23:06:02.269180276Z [2024-05-25T23:06:02.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:05:00+00:00, map_index=-1, run_start_date=2024-05-25 23:06:01.482216+00:00, run_end_date=2024-05-25 23:06:01.879932+00:00, run_duration=0.397716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:06:00.526282+00:00, queued_by_job_id=1, pid=1917 2024-05-25T23:06:04.692371979Z [2024-05-25T23:06:04.691+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:06:04.692541047Z [2024-05-25T23:06:04.692+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:05:00+00:00, run_id=scheduled__2024-05-25T23:05:00+00:00, run_start_date=2024-05-25 23:06:00.456107+00:00, run_end_date=2024-05-25 23:06:04.692266+00:00, run_duration=4.236159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:05:00+00:00, data_interval_end=2024-05-25 23:06:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:06:04.713260326Z [2024-05-25T23:06:04.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:06:00+00:00, run_after=2024-05-25T23:07:00+00:00 2024-05-25T23:06:04.730133594Z [2024-05-25T23:06:04.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:06:04.730296979Z [2024-05-25T23:06:04.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:05:00+00:00, run_id=scheduled__2024-05-25T23:05:00+00:00, run_start_date=2024-05-25 23:06:00.458661+00:00, run_end_date=2024-05-25 23:06:04.730055+00:00, run_duration=4.271394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:05:00+00:00, data_interval_end=2024-05-25 23:06:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:06:04.750658279Z [2024-05-25T23:06:04.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:06:00+00:00, run_after=2024-05-25T23:07:00+00:00 2024-05-25T23:06:04.783947530Z [2024-05-25T23:06:04.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status success for try_number 1 2024-05-25T23:06:04.783974539Z [2024-05-25T23:06:04.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status success for try_number 1 2024-05-25T23:06:04.797769749Z [2024-05-25T23:06:04.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:05:00+00:00, map_index=-1, run_start_date=2024-05-25 23:06:02.499269+00:00, run_end_date=2024-05-25 23:06:03.708889+00:00, run_duration=1.20962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:06:00.526282+00:00, queued_by_job_id=1, pid=1940 2024-05-25T23:06:04.797899636Z [2024-05-25T23:06:04.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:05:00+00:00, map_index=-1, run_start_date=2024-05-25 23:06:02.566521+00:00, run_end_date=2024-05-25 23:06:04.413835+00:00, run_duration=1.847314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:06:00.526282+00:00, queued_by_job_id=1, pid=1941 2024-05-25T23:07:00.251037590Z [2024-05-25T23:07:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:07:00+00:00, run_after=2024-05-25T23:08:00+00:00 2024-05-25T23:07:00.267315906Z [2024-05-25T23:07:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:07:00+00:00, run_after=2024-05-25T23:08:00+00:00 2024-05-25T23:07:00.275903087Z [2024-05-25T23:07:00.275+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:07:00.378111555Z [2024-05-25T23:07:00.377+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:07:00.378158300Z 2024-05-25T23:07:00.378163191Z 2024-05-25T23:07:00.378167125Z 2024-05-25T23:07:00.378287398Z [2024-05-25T23:07:00.378+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:07:00.378559265Z [2024-05-25T23:07:00.378+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:07:00.378798437Z [2024-05-25T23:07:00.378+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:07:00.379489190Z [2024-05-25T23:07:00.379+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:07:00.379505599Z 2024-05-25T23:07:00.379509580Z 2024-05-25T23:07:00.379513569Z 2024-05-25T23:07:00.382508151Z [2024-05-25T23:07:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:07:00.382721392Z [2024-05-25T23:07:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:07:00.383057374Z [2024-05-25T23:07:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:07:00.383180568Z [2024-05-25T23:07:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:07:00.383405317Z [2024-05-25T23:07:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:07:00.383598623Z [2024-05-25T23:07:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:07:00.920622457Z [2024-05-25T23:07:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status queued for try_number 1 2024-05-25T23:07:00.920829762Z [2024-05-25T23:07:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status queued for try_number 1 2024-05-25T23:07:00.920993717Z [2024-05-25T23:07:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status queued for try_number 1 2024-05-25T23:07:00.941011205Z [2024-05-25T23:07:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fef0717-5235-403f-b3e4-109c939491b7 2024-05-25T23:07:00.941298158Z [2024-05-25T23:07:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50f6a00d-7983-452e-843c-319bb156c707 2024-05-25T23:07:00.941597172Z [2024-05-25T23:07:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to b90e8bb4-fa6b-48dd-ab03-0bf86ffdd36e 2024-05-25T23:07:02.206319135Z [2024-05-25T23:07:02.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:07:02.208481867Z [2024-05-25T23:07:02.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:06:00+00:00, run_id=scheduled__2024-05-25T23:06:00+00:00, run_start_date=2024-05-25 23:07:00.290377+00:00, run_end_date=2024-05-25 23:07:02.208035+00:00, run_duration=1.917658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:06:00+00:00, data_interval_end=2024-05-25 23:07:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:07:02.223356654Z [2024-05-25T23:07:02.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:07:00+00:00, run_after=2024-05-25T23:08:00+00:00 2024-05-25T23:07:02.296051286Z [2024-05-25T23:07:02.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status success for try_number 1 2024-05-25T23:07:02.301647963Z [2024-05-25T23:07:02.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:06:00+00:00, map_index=-1, run_start_date=2024-05-25 23:07:01.422155+00:00, run_end_date=2024-05-25 23:07:01.864074+00:00, run_duration=0.441919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:07:00.380250+00:00, queued_by_job_id=1, pid=1973 2024-05-25T23:07:05.077481182Z [2024-05-25T23:07:05.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:07:05.077754615Z [2024-05-25T23:07:05.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:06:00+00:00, run_id=scheduled__2024-05-25T23:06:00+00:00, run_start_date=2024-05-25 23:07:00.291917+00:00, run_end_date=2024-05-25 23:07:05.077351+00:00, run_duration=4.785434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:06:00+00:00, data_interval_end=2024-05-25 23:07:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:07:05.087425853Z [2024-05-25T23:07:05.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:07:00+00:00, run_after=2024-05-25T23:08:00+00:00 2024-05-25T23:07:05.093920936Z [2024-05-25T23:07:05.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:07:05.094071557Z [2024-05-25T23:07:05.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:06:00+00:00, run_id=scheduled__2024-05-25T23:06:00+00:00, run_start_date=2024-05-25 23:07:00.293470+00:00, run_end_date=2024-05-25 23:07:05.093845+00:00, run_duration=4.800375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:06:00+00:00, data_interval_end=2024-05-25 23:07:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:07:05.102596364Z [2024-05-25T23:07:05.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:07:00+00:00, run_after=2024-05-25T23:08:00+00:00 2024-05-25T23:07:05.137236730Z [2024-05-25T23:07:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status success for try_number 1 2024-05-25T23:07:05.137382327Z [2024-05-25T23:07:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status success for try_number 1 2024-05-25T23:07:05.147264840Z [2024-05-25T23:07:05.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:06:00+00:00, map_index=-1, run_start_date=2024-05-25 23:07:02.629431+00:00, run_end_date=2024-05-25 23:07:04.150462+00:00, run_duration=1.521031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:07:00.380250+00:00, queued_by_job_id=1, pid=1992 2024-05-25T23:07:05.147396743Z [2024-05-25T23:07:05.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:06:00+00:00, map_index=-1, run_start_date=2024-05-25 23:07:02.482012+00:00, run_end_date=2024-05-25 23:07:04.686444+00:00, run_duration=2.204432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:07:00.380250+00:00, queued_by_job_id=1, pid=1991 2024-05-25T23:08:00.227191744Z [2024-05-25T23:08:00.226+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:08:00.264839817Z [2024-05-25T23:08:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:08:00+00:00, run_after=2024-05-25T23:09:00+00:00 2024-05-25T23:08:00.274730565Z [2024-05-25T23:08:00.274+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:08:00.292921264Z [2024-05-25T23:08:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:08:00+00:00, run_after=2024-05-25T23:09:00+00:00 2024-05-25T23:08:00.398653929Z [2024-05-25T23:08:00.398+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:08:00.398704447Z 2024-05-25T23:08:00.398711988Z 2024-05-25T23:08:00.398717524Z 2024-05-25T23:08:00.398722836Z 2024-05-25T23:08:00.398728919Z [2024-05-25T23:08:00.398+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:08:00.398750322Z [2024-05-25T23:08:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:08:00.398787392Z [2024-05-25T23:08:00.398+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:08:00.398989533Z [2024-05-25T23:08:00.398+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:08:00.399496828Z [2024-05-25T23:08:00.399+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:08:00.399507741Z 2024-05-25T23:08:00.399514217Z 2024-05-25T23:08:00.399575861Z 2024-05-25T23:08:00.399582428Z 2024-05-25T23:08:00.403822039Z [2024-05-25T23:08:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:08:00.403843414Z [2024-05-25T23:08:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:08:00.403958844Z [2024-05-25T23:08:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:08:00.404040761Z [2024-05-25T23:08:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:08:00.404233968Z [2024-05-25T23:08:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:08:00.404315016Z [2024-05-25T23:08:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:08:00.404538931Z [2024-05-25T23:08:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:08:00.404577144Z [2024-05-25T23:08:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:08:00.650800414Z [2024-05-25T23:08:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status queued for try_number 1 2024-05-25T23:08:00.651003891Z [2024-05-25T23:08:00.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:07:00+00:00 exited with status queued for try_number 1 2024-05-25T23:08:00.651143259Z [2024-05-25T23:08:00.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:07:00+00:00 exited with status queued for try_number 1 2024-05-25T23:08:00.651288382Z [2024-05-25T23:08:00.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:07:00+00:00 exited with status queued for try_number 1 2024-05-25T23:08:00.666853842Z [2024-05-25T23:08:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to d887065d-5eff-429e-bc74-1c63d67fbfd2 2024-05-25T23:08:00.667069881Z [2024-05-25T23:08:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1c4a5e1-216e-47d5-9381-d2eb111a2294 2024-05-25T23:08:00.667258297Z [2024-05-25T23:08:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14539b88-2c2f-4543-92dd-d4725255d570 2024-05-25T23:08:00.667459670Z [2024-05-25T23:08:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa4aba12-1ff3-463d-93c3-d33dbec843d4 2024-05-25T23:08:01.853233855Z [2024-05-25T23:08:01.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:08:01.853731863Z [2024-05-25T23:08:01.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:06:00+00:00, run_id=scheduled__2024-05-25T23:06:00+00:00, run_start_date=2024-05-25 23:08:00.306208+00:00, run_end_date=2024-05-25 23:08:01.853389+00:00, run_duration=1.547181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:06:00+00:00, data_interval_end=2024-05-25 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:08:01.861034441Z [2024-05-25T23:08:01.860+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:08:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:08:01.869520614Z [2024-05-25T23:08:01.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:08:01.870049535Z [2024-05-25T23:08:01.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:07:00+00:00, run_id=scheduled__2024-05-25T23:07:00+00:00, run_start_date=2024-05-25 23:08:00.309449+00:00, run_end_date=2024-05-25 23:08:01.869707+00:00, run_duration=1.560258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:07:00+00:00, data_interval_end=2024-05-25 23:08:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:08:01.882793660Z [2024-05-25T23:08:01.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:08:00+00:00, run_after=2024-05-25T23:09:00+00:00 2024-05-25T23:08:01.953597910Z [2024-05-25T23:08:01.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:06:00+00:00 exited with status success for try_number 1 2024-05-25T23:08:01.963147261Z [2024-05-25T23:08:01.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:06:00+00:00, map_index=-1, run_start_date=2024-05-25 23:08:01.198518+00:00, run_end_date=2024-05-25 23:08:01.555838+00:00, run_duration=0.35732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:08:00.400382+00:00, queued_by_job_id=1, pid=2025 2024-05-25T23:08:03.091447549Z [2024-05-25T23:08:03.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:07:00+00:00 exited with status success for try_number 1 2024-05-25T23:08:03.105605809Z [2024-05-25T23:08:03.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:07:00+00:00, map_index=-1, run_start_date=2024-05-25 23:08:01.312108+00:00, run_end_date=2024-05-25 23:08:01.734314+00:00, run_duration=0.422206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:08:00.400382+00:00, queued_by_job_id=1, pid=2026 2024-05-25T23:08:04.149771788Z [2024-05-25T23:08:04.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:08:04.150202251Z [2024-05-25T23:08:04.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:07:00+00:00, run_id=scheduled__2024-05-25T23:07:00+00:00, run_start_date=2024-05-25 23:08:00.310729+00:00, run_end_date=2024-05-25 23:08:04.149789+00:00, run_duration=3.83906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:07:00+00:00, data_interval_end=2024-05-25 23:08:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:08:04.163322278Z [2024-05-25T23:08:04.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:08:00+00:00, run_after=2024-05-25T23:09:00+00:00 2024-05-25T23:08:04.173970328Z [2024-05-25T23:08:04.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:08:04.174255968Z [2024-05-25T23:08:04.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:07:00+00:00, run_id=scheduled__2024-05-25T23:07:00+00:00, run_start_date=2024-05-25 23:08:00.312076+00:00, run_end_date=2024-05-25 23:08:04.173962+00:00, run_duration=3.861886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:07:00+00:00, data_interval_end=2024-05-25 23:08:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:08:04.184927294Z [2024-05-25T23:08:04.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:08:00+00:00, run_after=2024-05-25T23:09:00+00:00 2024-05-25T23:08:04.213227126Z [2024-05-25T23:08:04.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:07:00+00:00 exited with status success for try_number 1 2024-05-25T23:08:04.217314421Z [2024-05-25T23:08:04.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:07:00+00:00 exited with status success for try_number 1 2024-05-25T23:08:04.229419023Z [2024-05-25T23:08:04.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:07:00+00:00, map_index=-1, run_start_date=2024-05-25 23:08:02.238023+00:00, run_end_date=2024-05-25 23:08:03.872736+00:00, run_duration=1.634713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:08:00.400382+00:00, queued_by_job_id=1, pid=2049 2024-05-25T23:08:04.230879870Z [2024-05-25T23:08:04.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:07:00+00:00, map_index=-1, run_start_date=2024-05-25 23:08:02.359598+00:00, run_end_date=2024-05-25 23:08:03.683741+00:00, run_duration=1.324143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:08:00.400382+00:00, queued_by_job_id=1, pid=2050 2024-05-25T23:08:30.279886706Z [2024-05-25T23:08:30.279+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:09:00.094122290Z [2024-05-25T23:09:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:09:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:09:00.100553024Z [2024-05-25T23:09:00.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:09:00.111481337Z [2024-05-25T23:09:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:09:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:09:00.183387711Z [2024-05-25T23:09:00.182+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:09:00.183438371Z 2024-05-25T23:09:00.183448560Z 2024-05-25T23:09:00.183457227Z 2024-05-25T23:09:00.183465965Z [2024-05-25T23:09:00.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:09:00.183553958Z [2024-05-25T23:09:00.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:09:00.183755218Z [2024-05-25T23:09:00.183+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:09:00.184490225Z [2024-05-25T23:09:00.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:09:00.184503374Z 2024-05-25T23:09:00.184507955Z 2024-05-25T23:09:00.184512573Z 2024-05-25T23:09:00.189141459Z [2024-05-25T23:09:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:09:00.189417247Z [2024-05-25T23:09:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:09:00.189811548Z [2024-05-25T23:09:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:09:00.190099839Z [2024-05-25T23:09:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:09:00.190559489Z [2024-05-25T23:09:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:09:00.190898590Z [2024-05-25T23:09:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:09:00.436898490Z [2024-05-25T23:09:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status queued for try_number 1 2024-05-25T23:09:00.437113389Z [2024-05-25T23:09:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status queued for try_number 1 2024-05-25T23:09:00.437277297Z [2024-05-25T23:09:00.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status queued for try_number 1 2024-05-25T23:09:00.444823765Z [2024-05-25T23:09:00.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e71d16a-a374-483b-a2f8-f5bc2d032931 2024-05-25T23:09:00.445064324Z [2024-05-25T23:09:00.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 534ad87a-97db-4cb5-961d-a999241442e8 2024-05-25T23:09:00.445254577Z [2024-05-25T23:09:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3f47169-ca12-42f2-b502-1caa752f984e 2024-05-25T23:09:01.636823659Z [2024-05-25T23:09:01.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:09:01.637316092Z [2024-05-25T23:09:01.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:08:00+00:00, run_id=scheduled__2024-05-25T23:08:00+00:00, run_start_date=2024-05-25 23:09:00.123463+00:00, run_end_date=2024-05-25 23:09:01.636945+00:00, run_duration=1.513482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:08:00+00:00, data_interval_end=2024-05-25 23:09:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:09:01.648500730Z [2024-05-25T23:09:01.648+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:09:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:09:01.681130230Z [2024-05-25T23:09:01.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status success for try_number 1 2024-05-25T23:09:01.686587082Z [2024-05-25T23:09:01.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:08:00+00:00, map_index=-1, run_start_date=2024-05-25 23:09:01.106173+00:00, run_end_date=2024-05-25 23:09:01.520558+00:00, run_duration=0.414385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:09:00.185456+00:00, queued_by_job_id=1, pid=2082 2024-05-25T23:09:03.861802956Z [2024-05-25T23:09:03.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:09:03.862268886Z [2024-05-25T23:09:03.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:08:00+00:00, run_id=scheduled__2024-05-25T23:08:00+00:00, run_start_date=2024-05-25 23:09:00.120748+00:00, run_end_date=2024-05-25 23:09:03.861693+00:00, run_duration=3.740945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:08:00+00:00, data_interval_end=2024-05-25 23:09:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:09:03.871569657Z [2024-05-25T23:09:03.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:09:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:09:03.878107321Z [2024-05-25T23:09:03.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:09:03.878464478Z [2024-05-25T23:09:03.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:08:00+00:00, run_id=scheduled__2024-05-25T23:08:00+00:00, run_start_date=2024-05-25 23:09:00.122112+00:00, run_end_date=2024-05-25 23:09:03.878024+00:00, run_duration=3.755912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:08:00+00:00, data_interval_end=2024-05-25 23:09:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:09:03.887623333Z [2024-05-25T23:09:03.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:09:00+00:00, run_after=2024-05-25T23:10:00+00:00 2024-05-25T23:09:03.921930685Z [2024-05-25T23:09:03.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status success for try_number 1 2024-05-25T23:09:03.922520348Z [2024-05-25T23:09:03.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status success for try_number 1 2024-05-25T23:09:03.931417799Z [2024-05-25T23:09:03.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:08:00+00:00, map_index=-1, run_start_date=2024-05-25 23:09:02.038744+00:00, run_end_date=2024-05-25 23:09:03.292294+00:00, run_duration=1.25355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:09:00.185456+00:00, queued_by_job_id=1, pid=2101 2024-05-25T23:09:03.932025670Z [2024-05-25T23:09:03.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:08:00+00:00, map_index=-1, run_start_date=2024-05-25 23:09:02.023372+00:00, run_end_date=2024-05-25 23:09:03.557038+00:00, run_duration=1.533666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:09:00.185456+00:00, queued_by_job_id=1, pid=2100 2024-05-25T23:10:00.521439252Z [2024-05-25T23:10:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:15:00+00:00 2024-05-25T23:10:00.534904892Z [2024-05-25T23:10:00.534+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:11:00+00:00 2024-05-25T23:10:00.548770500Z [2024-05-25T23:10:00.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:11:00+00:00 2024-05-25T23:10:00.556457305Z [2024-05-25T23:10:00.556+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:10:00.566286224Z [2024-05-25T23:10:00.565+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:10:00.727724244Z [2024-05-25T23:10:00.725+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T23:10:00.727761732Z 2024-05-25T23:10:00.727769634Z 2024-05-25T23:10:00.727777183Z 2024-05-25T23:10:00.727783890Z 2024-05-25T23:10:00.727790475Z 2024-05-25T23:10:00.727798041Z [2024-05-25T23:10:00.725+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:10:00.727827734Z [2024-05-25T23:10:00.726+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:10:00.727835098Z [2024-05-25T23:10:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:10:00.727841791Z [2024-05-25T23:10:00.726+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:10:00.727848261Z [2024-05-25T23:10:00.726+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:10:00.727854599Z [2024-05-25T23:10:00.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:10:00.727860950Z 2024-05-25T23:10:00.727867480Z 2024-05-25T23:10:00.727874197Z 2024-05-25T23:10:00.727880550Z 2024-05-25T23:10:00.727886954Z 2024-05-25T23:10:00.747306851Z [2024-05-25T23:10:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:10:00.747336709Z [2024-05-25T23:10:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:10:00.747343469Z [2024-05-25T23:10:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:10:00.747349813Z [2024-05-25T23:10:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:10:00.747355652Z [2024-05-25T23:10:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:10:00.747361178Z [2024-05-25T23:10:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:10:00.747366671Z [2024-05-25T23:10:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:10:00.747468686Z [2024-05-25T23:10:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:10:00.747481976Z [2024-05-25T23:10:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:10:00.747488169Z [2024-05-25T23:10:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:10:01.224129986Z [2024-05-25T23:10:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:01.224207794Z [2024-05-25T23:10:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:01.224293021Z [2024-05-25T23:10:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:09:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:01.224448484Z [2024-05-25T23:10:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:09:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:01.224521388Z [2024-05-25T23:10:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:09:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:01.233840123Z [2024-05-25T23:10:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 193b035e-2972-4189-84c2-34d4d9db1c1d 2024-05-25T23:10:01.233940015Z [2024-05-25T23:10:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7547261a-82bf-4c5b-8c14-9b578f87fb14 2024-05-25T23:10:01.234130665Z [2024-05-25T23:10:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3227007-f23f-4aa3-98c9-9bdd2c7e8fdc 2024-05-25T23:10:01.234277256Z [2024-05-25T23:10:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4edee28-632a-42cc-96b8-c74501677629 2024-05-25T23:10:01.234429810Z [2024-05-25T23:10:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e92e676-7e21-4747-8bf3-2b9e4ac96b60 2024-05-25T23:10:02.517947076Z [2024-05-25T23:10:02.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:10:02.518288045Z [2024-05-25T23:10:02.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:08:00+00:00, run_id=scheduled__2024-05-25T23:08:00+00:00, run_start_date=2024-05-25 23:10:00.584229+00:00, run_end_date=2024-05-25 23:10:02.517986+00:00, run_duration=1.933757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:08:00+00:00, data_interval_end=2024-05-25 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:10:02.526555258Z [2024-05-25T23:10:02.526+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:12:00+00:00 2024-05-25T23:10:02.534208535Z [2024-05-25T23:10:02.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:10:02.534622525Z [2024-05-25T23:10:02.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:09:00+00:00, run_id=scheduled__2024-05-25T23:09:00+00:00, run_start_date=2024-05-25 23:10:00.585995+00:00, run_end_date=2024-05-25 23:10:02.534304+00:00, run_duration=1.948309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:09:00+00:00, data_interval_end=2024-05-25 23:10:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:10:02.545299457Z [2024-05-25T23:10:02.544+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:11:00+00:00 2024-05-25T23:10:02.602734280Z [2024-05-25T23:10:02.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:08:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:02.605062045Z [2024-05-25T23:10:02.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:09:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:02.611728820Z [2024-05-25T23:10:02.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:09:00+00:00, map_index=-1, run_start_date=2024-05-25 23:10:01.758111+00:00, run_end_date=2024-05-25 23:10:02.311194+00:00, run_duration=0.553083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:00.729670+00:00, queued_by_job_id=1, pid=2135 2024-05-25T23:10:02.611970281Z [2024-05-25T23:10:02.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:08:00+00:00, map_index=-1, run_start_date=2024-05-25 23:10:01.892141+00:00, run_end_date=2024-05-25 23:10:02.324969+00:00, run_duration=0.432828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:00.729670+00:00, queued_by_job_id=1, pid=2136 2024-05-25T23:10:03.687149955Z [2024-05-25T23:10:03.686+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:10:03.687178336Z 2024-05-25T23:10:03.687375288Z [2024-05-25T23:10:03.687+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:10:03.688016253Z [2024-05-25T23:10:03.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:10:03.688028615Z 2024-05-25T23:10:03.690282497Z [2024-05-25T23:10:03.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:10:03.690430207Z [2024-05-25T23:10:03.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:10:03.801120307Z [2024-05-25T23:10:03.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:03.801760678Z [2024-05-25T23:10:03.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:03.815485711Z [2024-05-25T23:10:03.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7bcd0e4-affa-40f4-bf7f-01b57af1888e 2024-05-25T23:10:03.815744261Z [2024-05-25T23:10:03.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:05:00+00:00, map_index=-1, run_start_date=2024-05-25 23:10:03.071044+00:00, run_end_date=2024-05-25 23:10:03.484761+00:00, run_duration=0.413717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:00.729670+00:00, queued_by_job_id=1, pid=2167 2024-05-25T23:10:04.950192231Z [2024-05-25T23:10:04.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:10:04.950678293Z [2024-05-25T23:10:04.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:09:00+00:00, run_id=scheduled__2024-05-25T23:09:00+00:00, run_start_date=2024-05-25 23:10:00.587707+00:00, run_end_date=2024-05-25 23:10:04.950388+00:00, run_duration=4.362681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:09:00+00:00, data_interval_end=2024-05-25 23:10:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:10:04.961789088Z [2024-05-25T23:10:04.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:11:00+00:00 2024-05-25T23:10:05.026694142Z [2024-05-25T23:10:05.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:09:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:05.031590226Z [2024-05-25T23:10:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:09:00+00:00, map_index=-1, run_start_date=2024-05-25 23:10:02.996798+00:00, run_end_date=2024-05-25 23:10:04.278371+00:00, run_duration=1.281573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:00.729670+00:00, queued_by_job_id=1, pid=2165 2024-05-25T23:10:06.303411734Z [2024-05-25T23:10:06.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:10:06.303907085Z [2024-05-25T23:10:06.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:09:00+00:00, run_id=scheduled__2024-05-25T23:09:00+00:00, run_start_date=2024-05-25 23:10:00.589136+00:00, run_end_date=2024-05-25 23:10:06.303547+00:00, run_duration=5.714411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:09:00+00:00, data_interval_end=2024-05-25 23:10:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:10:06.312614569Z [2024-05-25T23:10:06.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:11:00+00:00 2024-05-25T23:10:06.351557789Z [2024-05-25T23:10:06.351+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:10:06.351603843Z 2024-05-25T23:10:06.351643434Z [2024-05-25T23:10:06.351+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:10:06.352234779Z [2024-05-25T23:10:06.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:10:06.352302614Z 2024-05-25T23:10:06.354767054Z [2024-05-25T23:10:06.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:10:06.354931487Z [2024-05-25T23:10:06.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:10:06.418414772Z [2024-05-25T23:10:06.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:06.419057832Z [2024-05-25T23:10:06.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:09:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:06.419576900Z [2024-05-25T23:10:06.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:06.429996945Z [2024-05-25T23:10:06.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to af15b66d-f44f-4358-affe-d886e54089c1 2024-05-25T23:10:06.430549453Z [2024-05-25T23:10:06.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:05:00+00:00, map_index=-1, run_start_date=2024-05-25 23:10:05.515168+00:00, run_end_date=2024-05-25 23:10:05.838614+00:00, run_duration=0.323446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:03.688330+00:00, queued_by_job_id=1, pid=2190 2024-05-25T23:10:06.431180190Z [2024-05-25T23:10:06.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:09:00+00:00, map_index=-1, run_start_date=2024-05-25 23:10:03.068908+00:00, run_end_date=2024-05-25 23:10:05.999765+00:00, run_duration=2.930857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:00.729670+00:00, queued_by_job_id=1, pid=2166 2024-05-25T23:10:08.746491031Z [2024-05-25T23:10:08.745+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:10:08.746532495Z 2024-05-25T23:10:08.746940483Z [2024-05-25T23:10:08.746+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:10:08.748255193Z [2024-05-25T23:10:08.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:10:08.748279257Z 2024-05-25T23:10:08.752276466Z [2024-05-25T23:10:08.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:10:08.752759556Z [2024-05-25T23:10:08.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:10:08.813595122Z [2024-05-25T23:10:08.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status queued for try_number 1 2024-05-25T23:10:08.813802801Z [2024-05-25T23:10:08.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:08.820562339Z [2024-05-25T23:10:08.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd45c7df-a384-4bb1-83bb-7869a6e21ed0 2024-05-25T23:10:08.820958315Z [2024-05-25T23:10:08.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:05:00+00:00, map_index=0, run_start_date=2024-05-25 23:10:07.987275+00:00, run_end_date=2024-05-25 23:10:08.416783+00:00, run_duration=0.429508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:06.352740+00:00, queued_by_job_id=1, pid=2198 2024-05-25T23:10:11.418621681Z [2024-05-25T23:10:11.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:10:11.418905066Z [2024-05-25T23:10:11.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:05:00+00:00, run_id=scheduled__2024-05-25T23:05:00+00:00, run_start_date=2024-05-25 23:10:00.582150+00:00, run_end_date=2024-05-25 23:10:11.418367+00:00, run_duration=10.836217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:05:00+00:00, data_interval_end=2024-05-25 23:10:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:10:11.427232061Z [2024-05-25T23:10:11.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:10:00+00:00, run_after=2024-05-25T23:15:00+00:00 2024-05-25T23:10:11.471589104Z [2024-05-25T23:10:11.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:05:00+00:00 exited with status success for try_number 1 2024-05-25T23:10:11.477910654Z [2024-05-25T23:10:11.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:05:00+00:00, map_index=-1, run_start_date=2024-05-25 23:10:10.324220+00:00, run_end_date=2024-05-25 23:10:10.740288+00:00, run_duration=0.416068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:10:08.748975+00:00, queued_by_job_id=1, pid=2206 2024-05-25T23:11:00.508460394Z [2024-05-25T23:11:00.507+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:11:00+00:00, run_after=2024-05-25T23:12:00+00:00 2024-05-25T23:11:00.519234165Z [2024-05-25T23:11:00.518+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:11:00.541993854Z [2024-05-25T23:11:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:11:00+00:00, run_after=2024-05-25T23:12:00+00:00 2024-05-25T23:11:00.654780082Z [2024-05-25T23:11:00.654+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:11:00.654822340Z 2024-05-25T23:11:00.654828180Z 2024-05-25T23:11:00.654833189Z 2024-05-25T23:11:00.655099488Z [2024-05-25T23:11:00.654+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:11:00.655420282Z [2024-05-25T23:11:00.655+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:11:00.655784786Z [2024-05-25T23:11:00.655+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:11:00.660109605Z [2024-05-25T23:11:00.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:11:00.660129057Z 2024-05-25T23:11:00.660133938Z 2024-05-25T23:11:00.660138656Z 2024-05-25T23:11:00.668285149Z [2024-05-25T23:11:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:11:00.668641359Z [2024-05-25T23:11:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:11:00.669206416Z [2024-05-25T23:11:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:11:00.669468487Z [2024-05-25T23:11:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:11:00.670017536Z [2024-05-25T23:11:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:11:00.670241519Z [2024-05-25T23:11:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:11:01.195543812Z [2024-05-25T23:11:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:11:01.195893206Z [2024-05-25T23:11:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:11:01.196106726Z [2024-05-25T23:11:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:11:01.211633777Z [2024-05-25T23:11:01.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbad3789-64b2-420c-8b92-c163bc20cd79 2024-05-25T23:11:01.211971457Z [2024-05-25T23:11:01.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to 170957db-d978-45e9-a0dc-fb25ec263c01 2024-05-25T23:11:01.212195390Z [2024-05-25T23:11:01.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13ba1389-0b20-4285-bdf0-19601e0978c0 2024-05-25T23:11:02.375029034Z [2024-05-25T23:11:02.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:11:02.375986554Z [2024-05-25T23:11:02.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:10:00+00:00, run_id=scheduled__2024-05-25T23:10:00+00:00, run_start_date=2024-05-25 23:11:00.557403+00:00, run_end_date=2024-05-25 23:11:02.375469+00:00, run_duration=1.818066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:10:00+00:00, data_interval_end=2024-05-25 23:11:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:11:02.387668153Z [2024-05-25T23:11:02.387+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:11:00+00:00, run_after=2024-05-25T23:12:00+00:00 2024-05-25T23:11:02.442995682Z [2024-05-25T23:11:02.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:11:02.451704459Z [2024-05-25T23:11:02.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=-1, run_start_date=2024-05-25 23:11:01.564342+00:00, run_end_date=2024-05-25 23:11:01.951397+00:00, run_duration=0.387055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:11:00.661968+00:00, queued_by_job_id=1, pid=2228 2024-05-25T23:11:04.614671300Z [2024-05-25T23:11:04.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:11:04.615308954Z [2024-05-25T23:11:04.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:10:00+00:00, run_id=scheduled__2024-05-25T23:10:00+00:00, run_start_date=2024-05-25 23:11:00.559074+00:00, run_end_date=2024-05-25 23:11:04.614803+00:00, run_duration=4.055729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:10:00+00:00, data_interval_end=2024-05-25 23:11:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:11:04.629539305Z [2024-05-25T23:11:04.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:11:00+00:00, run_after=2024-05-25T23:12:00+00:00 2024-05-25T23:11:04.638005922Z [2024-05-25T23:11:04.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:11:04.638513076Z [2024-05-25T23:11:04.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:10:00+00:00, run_id=scheduled__2024-05-25T23:10:00+00:00, run_start_date=2024-05-25 23:11:00.560360+00:00, run_end_date=2024-05-25 23:11:04.637926+00:00, run_duration=4.077566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:10:00+00:00, data_interval_end=2024-05-25 23:11:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:11:04.666942313Z [2024-05-25T23:11:04.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:11:00+00:00, run_after=2024-05-25T23:12:00+00:00 2024-05-25T23:11:04.697950808Z [2024-05-25T23:11:04.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:11:04.698054651Z [2024-05-25T23:11:04.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:11:04.704884459Z [2024-05-25T23:11:04.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=-1, run_start_date=2024-05-25 23:11:02.626090+00:00, run_end_date=2024-05-25 23:11:04.290002+00:00, run_duration=1.663912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:11:00.661968+00:00, queued_by_job_id=1, pid=2247 2024-05-25T23:11:04.705108379Z [2024-05-25T23:11:04.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=-1, run_start_date=2024-05-25 23:11:02.623454+00:00, run_end_date=2024-05-25 23:11:03.931017+00:00, run_duration=1.307563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:11:00.661968+00:00, queued_by_job_id=1, pid=2246 2024-05-25T23:12:00.505037757Z [2024-05-25T23:12:00.504+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:12:00+00:00, run_after=2024-05-25T23:13:00+00:00 2024-05-25T23:12:00.514614521Z [2024-05-25T23:12:00.514+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:12:00.542299713Z [2024-05-25T23:12:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:12:00+00:00, run_after=2024-05-25T23:13:00+00:00 2024-05-25T23:12:00.554594531Z [2024-05-25T23:12:00.554+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:12:00.696783448Z [2024-05-25T23:12:00.696+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:12:00.696809569Z 2024-05-25T23:12:00.696816406Z 2024-05-25T23:12:00.696821719Z 2024-05-25T23:12:00.696827222Z 2024-05-25T23:12:00.696844028Z [2024-05-25T23:12:00.696+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:12:00.697026062Z [2024-05-25T23:12:00.696+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:12:00.697147210Z [2024-05-25T23:12:00.696+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:12:00.697218521Z [2024-05-25T23:12:00.697+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:12:00.697904656Z [2024-05-25T23:12:00.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:12:00.697915777Z 2024-05-25T23:12:00.697921584Z 2024-05-25T23:12:00.697926994Z 2024-05-25T23:12:00.697932862Z 2024-05-25T23:12:00.701603986Z [2024-05-25T23:12:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:12:00.701687905Z [2024-05-25T23:12:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:12:00.701948331Z [2024-05-25T23:12:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:12:00.702062583Z [2024-05-25T23:12:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:12:00.702313358Z [2024-05-25T23:12:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:12:00.702413861Z [2024-05-25T23:12:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:12:00.702664605Z [2024-05-25T23:12:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:12:00.702724927Z [2024-05-25T23:12:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:12:01.019397258Z [2024-05-25T23:12:01.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:12:01.019484143Z [2024-05-25T23:12:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:11:00+00:00 exited with status queued for try_number 1 2024-05-25T23:12:01.019590441Z [2024-05-25T23:12:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:11:00+00:00 exited with status queued for try_number 1 2024-05-25T23:12:01.019626848Z [2024-05-25T23:12:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:11:00+00:00 exited with status queued for try_number 1 2024-05-25T23:12:01.035511630Z [2024-05-25T23:12:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc18a3a8-4934-4cf3-bbd6-8f90b1a98939 2024-05-25T23:12:01.035574020Z [2024-05-25T23:12:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23632e12-0ff3-4b2f-9130-d5cc2d11b2a7 2024-05-25T23:12:01.035638026Z [2024-05-25T23:12:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16b25423-c077-4eec-ba13-c36dfccc3d14 2024-05-25T23:12:01.035750455Z [2024-05-25T23:12:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 666139cb-72be-4b90-a223-1f2b1370f5ab 2024-05-25T23:12:02.193014420Z [2024-05-25T23:12:02.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:12:02.193174707Z [2024-05-25T23:12:02.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:11:00+00:00, run_id=scheduled__2024-05-25T23:11:00+00:00, run_start_date=2024-05-25 23:12:00.573078+00:00, run_end_date=2024-05-25 23:12:02.192827+00:00, run_duration=1.619749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:11:00+00:00, data_interval_end=2024-05-25 23:12:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:12:02.208042356Z [2024-05-25T23:12:02.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:12:00+00:00, run_after=2024-05-25T23:13:00+00:00 2024-05-25T23:12:02.255167961Z [2024-05-25T23:12:02.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:12:02.261887025Z [2024-05-25T23:12:02.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=-1, run_start_date=2024-05-25 23:12:01.603255+00:00, run_end_date=2024-05-25 23:12:02.097203+00:00, run_duration=0.493948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:12:00.698568+00:00, queued_by_job_id=1, pid=2280 2024-05-25T23:12:03.308439136Z [2024-05-25T23:12:03.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:12:03.309139476Z [2024-05-25T23:12:03.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:10:00+00:00, run_id=scheduled__2024-05-25T23:10:00+00:00, run_start_date=2024-05-25 23:12:00.566783+00:00, run_end_date=2024-05-25 23:12:03.308349+00:00, run_duration=2.741566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:10:00+00:00, data_interval_end=2024-05-25 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:12:03.319335758Z [2024-05-25T23:12:03.319+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:12:00+00:00, run_after=2024-05-25T23:14:00+00:00 2024-05-25T23:12:03.405413889Z [2024-05-25T23:12:03.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:11:00+00:00 exited with status success for try_number 1 2024-05-25T23:12:03.425475489Z [2024-05-25T23:12:03.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:11:00+00:00, map_index=-1, run_start_date=2024-05-25 23:12:01.715736+00:00, run_end_date=2024-05-25 23:12:02.136109+00:00, run_duration=0.420373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:12:00.698568+00:00, queued_by_job_id=1, pid=2281 2024-05-25T23:12:05.626044812Z [2024-05-25T23:12:05.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:12:05.626450813Z [2024-05-25T23:12:05.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:11:00+00:00, run_id=scheduled__2024-05-25T23:11:00+00:00, run_start_date=2024-05-25 23:12:00.570014+00:00, run_end_date=2024-05-25 23:12:05.626139+00:00, run_duration=5.056125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:11:00+00:00, data_interval_end=2024-05-25 23:12:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:12:05.634722802Z [2024-05-25T23:12:05.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:12:00+00:00, run_after=2024-05-25T23:13:00+00:00 2024-05-25T23:12:05.641965532Z [2024-05-25T23:12:05.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:12:05.642455595Z [2024-05-25T23:12:05.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:11:00+00:00, run_id=scheduled__2024-05-25T23:11:00+00:00, run_start_date=2024-05-25 23:12:00.575344+00:00, run_end_date=2024-05-25 23:12:05.642047+00:00, run_duration=5.066703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:11:00+00:00, data_interval_end=2024-05-25 23:12:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:12:05.651465089Z [2024-05-25T23:12:05.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:12:00+00:00, run_after=2024-05-25T23:13:00+00:00 2024-05-25T23:12:05.700717695Z [2024-05-25T23:12:05.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:11:00+00:00 exited with status success for try_number 1 2024-05-25T23:12:05.701169362Z [2024-05-25T23:12:05.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:11:00+00:00 exited with status success for try_number 1 2024-05-25T23:12:05.710699084Z [2024-05-25T23:12:05.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:11:00+00:00, map_index=-1, run_start_date=2024-05-25 23:12:02.936615+00:00, run_end_date=2024-05-25 23:12:04.679208+00:00, run_duration=1.742593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:12:00.698568+00:00, queued_by_job_id=1, pid=2305 2024-05-25T23:12:05.711051084Z [2024-05-25T23:12:05.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:11:00+00:00, map_index=-1, run_start_date=2024-05-25 23:12:02.828120+00:00, run_end_date=2024-05-25 23:12:04.734253+00:00, run_duration=1.906133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:12:00.698568+00:00, queued_by_job_id=1, pid=2304 2024-05-25T23:13:00.360376119Z [2024-05-25T23:13:00.359+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:13:00.373045896Z [2024-05-25T23:13:00.372+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:13:00+00:00, run_after=2024-05-25T23:14:00+00:00 2024-05-25T23:13:00.384922317Z [2024-05-25T23:13:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:13:00+00:00, run_after=2024-05-25T23:14:00+00:00 2024-05-25T23:13:00.439878406Z [2024-05-25T23:13:00.439+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:13:00.439920085Z 2024-05-25T23:13:00.439923853Z 2024-05-25T23:13:00.439926943Z 2024-05-25T23:13:00.440188573Z [2024-05-25T23:13:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:13:00.440468038Z [2024-05-25T23:13:00.440+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:13:00.440658743Z [2024-05-25T23:13:00.440+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:13:00.441241101Z [2024-05-25T23:13:00.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:13:00.441251711Z 2024-05-25T23:13:00.441255215Z 2024-05-25T23:13:00.441258292Z 2024-05-25T23:13:00.444383938Z [2024-05-25T23:13:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:13:00.444803104Z [2024-05-25T23:13:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:13:00.445113969Z [2024-05-25T23:13:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:13:00.445276163Z [2024-05-25T23:13:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:13:00.445560414Z [2024-05-25T23:13:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:13:00.445718488Z [2024-05-25T23:13:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:13:00.888559355Z [2024-05-25T23:13:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status queued for try_number 1 2024-05-25T23:13:00.890676275Z [2024-05-25T23:13:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status queued for try_number 1 2024-05-25T23:13:00.891322377Z [2024-05-25T23:13:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status queued for try_number 1 2024-05-25T23:13:00.916784392Z [2024-05-25T23:13:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to d525d8f8-126b-4f84-b24e-39d29aeed5de 2024-05-25T23:13:00.919884465Z [2024-05-25T23:13:00.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to 053d0fbe-69e1-4a08-a9f6-66519a339d19 2024-05-25T23:13:00.920408366Z [2024-05-25T23:13:00.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77170c91-508a-42d9-bba3-477bfafd2205 2024-05-25T23:13:07.844730113Z [2024-05-25T23:13:07.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:13:07.855993474Z [2024-05-25T23:13:07.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:12:00+00:00, run_id=scheduled__2024-05-25T23:12:00+00:00, run_start_date=2024-05-25 23:13:00.396647+00:00, run_end_date=2024-05-25 23:13:07.847335+00:00, run_duration=7.450688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:12:00+00:00, data_interval_end=2024-05-25 23:13:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:13:07.910930196Z [2024-05-25T23:13:07.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:13:00+00:00, run_after=2024-05-25T23:14:00+00:00 2024-05-25T23:13:08.321703508Z [2024-05-25T23:13:08.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status success for try_number 1 2024-05-25T23:13:08.340442400Z [2024-05-25T23:13:08.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:12:00+00:00, map_index=-1, run_start_date=2024-05-25 23:13:05.226463+00:00, run_end_date=2024-05-25 23:13:07.600794+00:00, run_duration=2.374331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:13:00.442137+00:00, queued_by_job_id=1, pid=2338 2024-05-25T23:13:12.217778139Z [2024-05-25T23:13:12.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:13:12.217912423Z [2024-05-25T23:13:12.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:12:00+00:00, run_id=scheduled__2024-05-25T23:12:00+00:00, run_start_date=2024-05-25 23:13:00.397829+00:00, run_end_date=2024-05-25 23:13:12.217661+00:00, run_duration=11.819832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:12:00+00:00, data_interval_end=2024-05-25 23:13:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:13:12.227798936Z [2024-05-25T23:13:12.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:13:00+00:00, run_after=2024-05-25T23:14:00+00:00 2024-05-25T23:13:12.314615442Z [2024-05-25T23:13:12.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status success for try_number 1 2024-05-25T23:13:12.326208838Z [2024-05-25T23:13:12.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:12:00+00:00, map_index=-1, run_start_date=2024-05-25 23:13:09.901595+00:00, run_end_date=2024-05-25 23:13:11.811795+00:00, run_duration=1.9102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:13:00.442137+00:00, queued_by_job_id=1, pid=2355 2024-05-25T23:13:13.378422444Z [2024-05-25T23:13:13.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:13:13.378631022Z [2024-05-25T23:13:13.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:12:00+00:00, run_id=scheduled__2024-05-25T23:12:00+00:00, run_start_date=2024-05-25 23:13:00.395047+00:00, run_end_date=2024-05-25 23:13:13.378314+00:00, run_duration=12.983267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:12:00+00:00, data_interval_end=2024-05-25 23:13:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:13:13.386664920Z [2024-05-25T23:13:13.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:13:00+00:00, run_after=2024-05-25T23:14:00+00:00 2024-05-25T23:13:13.415160636Z [2024-05-25T23:13:13.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status success for try_number 1 2024-05-25T23:13:13.423569527Z [2024-05-25T23:13:13.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:12:00+00:00, map_index=-1, run_start_date=2024-05-25 23:13:10.491485+00:00, run_end_date=2024-05-25 23:13:12.281979+00:00, run_duration=1.790494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:13:00.442137+00:00, queued_by_job_id=1, pid=2356 2024-05-25T23:13:30.347616192Z [2024-05-25T23:13:30.346+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:14:00.193732817Z [2024-05-25T23:14:00.192+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:14:00.206657407Z [2024-05-25T23:14:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:14:00+00:00, run_after=2024-05-25T23:15:00+00:00 2024-05-25T23:14:00.221225661Z [2024-05-25T23:14:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:14:00+00:00, run_after=2024-05-25T23:15:00+00:00 2024-05-25T23:14:00.227433958Z [2024-05-25T23:14:00.227+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:14:00.332362995Z [2024-05-25T23:14:00.332+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:14:00.332382872Z 2024-05-25T23:14:00.332387746Z 2024-05-25T23:14:00.332390898Z 2024-05-25T23:14:00.332394007Z 2024-05-25T23:14:00.333264588Z [2024-05-25T23:14:00.332+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:14:00.333651513Z [2024-05-25T23:14:00.333+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:14:00.333792605Z [2024-05-25T23:14:00.333+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:14:00.334144779Z [2024-05-25T23:14:00.333+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:14:00.334766057Z [2024-05-25T23:14:00.334+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:14:00.334782472Z 2024-05-25T23:14:00.334786151Z 2024-05-25T23:14:00.334800978Z 2024-05-25T23:14:00.334804825Z 2024-05-25T23:14:00.344784634Z [2024-05-25T23:14:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:14:00.345031010Z [2024-05-25T23:14:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:14:00.345616537Z [2024-05-25T23:14:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:14:00.345862312Z [2024-05-25T23:14:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:14:00.346331057Z [2024-05-25T23:14:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:14:00.346606048Z [2024-05-25T23:14:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:14:00.346907525Z [2024-05-25T23:14:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:14:00.347138359Z [2024-05-25T23:14:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:14:00.743468893Z [2024-05-25T23:14:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status queued for try_number 1 2024-05-25T23:14:00.743489945Z [2024-05-25T23:14:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:13:00+00:00 exited with status queued for try_number 1 2024-05-25T23:14:00.743493388Z [2024-05-25T23:14:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:13:00+00:00 exited with status queued for try_number 1 2024-05-25T23:14:00.743496679Z [2024-05-25T23:14:00.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:13:00+00:00 exited with status queued for try_number 1 2024-05-25T23:14:00.771914867Z [2024-05-25T23:14:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bbeefb0-963b-47c0-9638-ac8eb1404d35 2024-05-25T23:14:00.771934076Z [2024-05-25T23:14:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to e839784d-28ae-4d10-aa50-d06b74cb5e40 2024-05-25T23:14:00.771937817Z [2024-05-25T23:14:00.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 811cc430-d525-4961-b9a4-5b0fcefc4a6c 2024-05-25T23:14:00.771942065Z [2024-05-25T23:14:00.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dc0815f-aaf1-496b-8c09-25913f95e15c 2024-05-25T23:14:03.241528364Z [2024-05-25T23:14:03.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:14:03.241945587Z [2024-05-25T23:14:03.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:12:00+00:00, run_id=scheduled__2024-05-25T23:12:00+00:00, run_start_date=2024-05-25 23:14:00.242336+00:00, run_end_date=2024-05-25 23:14:03.241579+00:00, run_duration=2.999243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:12:00+00:00, data_interval_end=2024-05-25 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:14:03.258893103Z [2024-05-25T23:14:03.258+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:14:00+00:00, run_after=2024-05-25T23:16:00+00:00 2024-05-25T23:14:03.283064831Z [2024-05-25T23:14:03.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:14:03.284219768Z [2024-05-25T23:14:03.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:13:00+00:00, run_id=scheduled__2024-05-25T23:13:00+00:00, run_start_date=2024-05-25 23:14:00.244152+00:00, run_end_date=2024-05-25 23:14:03.283006+00:00, run_duration=3.038854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:13:00+00:00, data_interval_end=2024-05-25 23:14:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:14:03.299774319Z [2024-05-25T23:14:03.299+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:14:00+00:00, run_after=2024-05-25T23:15:00+00:00 2024-05-25T23:14:03.372649449Z [2024-05-25T23:14:03.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:12:00+00:00 exited with status success for try_number 1 2024-05-25T23:14:03.372683985Z [2024-05-25T23:14:03.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:13:00+00:00 exited with status success for try_number 1 2024-05-25T23:14:03.386955434Z [2024-05-25T23:14:03.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:12:00+00:00, map_index=-1, run_start_date=2024-05-25 23:14:01.650266+00:00, run_end_date=2024-05-25 23:14:02.113555+00:00, run_duration=0.463289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:14:00.336885+00:00, queued_by_job_id=1, pid=2389 2024-05-25T23:14:03.387294659Z [2024-05-25T23:14:03.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:13:00+00:00, map_index=-1, run_start_date=2024-05-25 23:14:01.750954+00:00, run_end_date=2024-05-25 23:14:02.287257+00:00, run_duration=0.536303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:14:00.336885+00:00, queued_by_job_id=1, pid=2390 2024-05-25T23:14:05.684843264Z [2024-05-25T23:14:05.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:14:05.685072275Z [2024-05-25T23:14:05.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:13:00+00:00, run_id=scheduled__2024-05-25T23:13:00+00:00, run_start_date=2024-05-25 23:14:00.245609+00:00, run_end_date=2024-05-25 23:14:05.684718+00:00, run_duration=5.439109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:13:00+00:00, data_interval_end=2024-05-25 23:14:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:14:05.715065319Z [2024-05-25T23:14:05.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:14:00+00:00, run_after=2024-05-25T23:15:00+00:00 2024-05-25T23:14:05.733196191Z [2024-05-25T23:14:05.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:14:05.733710679Z [2024-05-25T23:14:05.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:13:00+00:00, run_id=scheduled__2024-05-25T23:13:00+00:00, run_start_date=2024-05-25 23:14:00.247141+00:00, run_end_date=2024-05-25 23:14:05.732937+00:00, run_duration=5.485796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:13:00+00:00, data_interval_end=2024-05-25 23:14:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:14:05.756712002Z [2024-05-25T23:14:05.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:14:00+00:00, run_after=2024-05-25T23:15:00+00:00 2024-05-25T23:14:05.810942372Z [2024-05-25T23:14:05.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:13:00+00:00 exited with status success for try_number 1 2024-05-25T23:14:05.811383444Z [2024-05-25T23:14:05.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:13:00+00:00 exited with status success for try_number 1 2024-05-25T23:14:05.825021269Z [2024-05-25T23:14:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:13:00+00:00, map_index=-1, run_start_date=2024-05-25 23:14:03.033128+00:00, run_end_date=2024-05-25 23:14:04.707526+00:00, run_duration=1.674398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:14:00.336885+00:00, queued_by_job_id=1, pid=2413 2024-05-25T23:14:05.825723171Z [2024-05-25T23:14:05.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:13:00+00:00, map_index=-1, run_start_date=2024-05-25 23:14:03.116816+00:00, run_end_date=2024-05-25 23:14:05.057771+00:00, run_duration=1.940955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:14:00.336885+00:00, queued_by_job_id=1, pid=2414 2024-05-25T23:15:00.586565868Z [2024-05-25T23:15:00.586+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:15:00+00:00, run_after=2024-05-25T23:16:00+00:00 2024-05-25T23:15:00.598713584Z [2024-05-25T23:15:00.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:15:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:15:00.605263405Z [2024-05-25T23:15:00.604+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:15:00.616519536Z [2024-05-25T23:15:00.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:15:00+00:00, run_after=2024-05-25T23:16:00+00:00 2024-05-25T23:15:00.720983986Z [2024-05-25T23:15:00.719+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:15:00.721002548Z 2024-05-25T23:15:00.721006605Z 2024-05-25T23:15:00.721009929Z 2024-05-25T23:15:00.721013593Z 2024-05-25T23:15:00.721016835Z [2024-05-25T23:15:00.720+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:15:00.721019872Z [2024-05-25T23:15:00.720+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:15:00.721022768Z [2024-05-25T23:15:00.720+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:15:00.721025808Z [2024-05-25T23:15:00.720+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:15:00.721734746Z [2024-05-25T23:15:00.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:15:00.721749847Z 2024-05-25T23:15:00.721753756Z 2024-05-25T23:15:00.721757015Z 2024-05-25T23:15:00.721760069Z 2024-05-25T23:15:00.727216292Z [2024-05-25T23:15:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:15:00.727229906Z [2024-05-25T23:15:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:15:00.728482945Z [2024-05-25T23:15:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:15:00.728495144Z [2024-05-25T23:15:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:15:00.728498498Z [2024-05-25T23:15:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:15:00.728501525Z [2024-05-25T23:15:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:15:00.728504735Z [2024-05-25T23:15:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:15:00.728507972Z [2024-05-25T23:15:00.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:15:01.249329069Z [2024-05-25T23:15:01.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:15:01.251930315Z [2024-05-25T23:15:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status queued for try_number 1 2024-05-25T23:15:01.251943901Z [2024-05-25T23:15:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status queued for try_number 1 2024-05-25T23:15:01.251947500Z [2024-05-25T23:15:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status queued for try_number 1 2024-05-25T23:15:01.264838755Z [2024-05-25T23:15:01.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37f57eda-8bdb-42ab-9042-d9a3c254ed47 2024-05-25T23:15:01.264858785Z [2024-05-25T23:15:01.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to faf435fc-2eb7-4992-9e1b-8b60aa6c0be8 2024-05-25T23:15:01.265006589Z [2024-05-25T23:15:01.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1ebfe58-623a-44fe-ae2b-2d4cac792fe6 2024-05-25T23:15:01.265184314Z [2024-05-25T23:15:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a91bd5b-52cc-496a-912f-6313b3e8f99f 2024-05-25T23:15:02.974869478Z [2024-05-25T23:15:02.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:15:02.975020742Z [2024-05-25T23:15:02.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:14:00+00:00, run_id=scheduled__2024-05-25T23:14:00+00:00, run_start_date=2024-05-25 23:15:00.627424+00:00, run_end_date=2024-05-25 23:15:02.974559+00:00, run_duration=2.347135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:14:00+00:00, data_interval_end=2024-05-25 23:15:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:15:02.984516089Z [2024-05-25T23:15:02.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:15:00+00:00, run_after=2024-05-25T23:16:00+00:00 2024-05-25T23:15:03.052645998Z [2024-05-25T23:15:03.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status success for try_number 1 2024-05-25T23:15:03.058903972Z [2024-05-25T23:15:03.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:14:00+00:00, map_index=-1, run_start_date=2024-05-25 23:15:02.475036+00:00, run_end_date=2024-05-25 23:15:02.828106+00:00, run_duration=0.35307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:15:00.723691+00:00, queued_by_job_id=1, pid=2447 2024-05-25T23:15:05.291651075Z [2024-05-25T23:15:05.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:15:05.292888459Z [2024-05-25T23:15:05.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:14:00+00:00, run_id=scheduled__2024-05-25T23:14:00+00:00, run_start_date=2024-05-25 23:15:00.628617+00:00, run_end_date=2024-05-25 23:15:05.291923+00:00, run_duration=4.663306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:14:00+00:00, data_interval_end=2024-05-25 23:15:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:15:05.313136272Z [2024-05-25T23:15:05.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:15:00+00:00, run_after=2024-05-25T23:16:00+00:00 2024-05-25T23:15:05.322593576Z [2024-05-25T23:15:05.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:15:05.323039500Z [2024-05-25T23:15:05.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:14:00+00:00, run_id=scheduled__2024-05-25T23:14:00+00:00, run_start_date=2024-05-25 23:15:00.629607+00:00, run_end_date=2024-05-25 23:15:05.322712+00:00, run_duration=4.693105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:14:00+00:00, data_interval_end=2024-05-25 23:15:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:15:05.333419335Z [2024-05-25T23:15:05.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:15:00+00:00, run_after=2024-05-25T23:16:00+00:00 2024-05-25T23:15:05.376850040Z [2024-05-25T23:15:05.376+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:15:05.376884031Z 2024-05-25T23:15:05.378683058Z [2024-05-25T23:15:05.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:15:05.380173400Z [2024-05-25T23:15:05.379+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:15:05.380190060Z 2024-05-25T23:15:05.392660617Z [2024-05-25T23:15:05.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:15:05.392793188Z [2024-05-25T23:15:05.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:15:05.457885501Z [2024-05-25T23:15:05.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:15:05.458094006Z [2024-05-25T23:15:05.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:15:05.458257924Z [2024-05-25T23:15:05.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status success for try_number 1 2024-05-25T23:15:05.458386569Z [2024-05-25T23:15:05.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status success for try_number 1 2024-05-25T23:15:05.466524138Z [2024-05-25T23:15:05.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=-1, run_start_date=2024-05-25 23:15:03.846041+00:00, run_end_date=2024-05-25 23:15:04.404390+00:00, run_duration=0.558349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:15:00.723691+00:00, queued_by_job_id=1, pid=2477 2024-05-25T23:15:05.466651213Z [2024-05-25T23:15:05.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:14:00+00:00, map_index=-1, run_start_date=2024-05-25 23:15:03.538255+00:00, run_end_date=2024-05-25 23:15:05.052960+00:00, run_duration=1.514705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:15:00.723691+00:00, queued_by_job_id=1, pid=2471 2024-05-25T23:15:05.466970658Z [2024-05-25T23:15:05.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:14:00+00:00, map_index=-1, run_start_date=2024-05-25 23:15:03.342702+00:00, run_end_date=2024-05-25 23:15:05.113539+00:00, run_duration=1.770837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:15:00.723691+00:00, queued_by_job_id=1, pid=2465 2024-05-25T23:15:05.467185123Z [2024-05-25T23:15:05.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c279a85-d330-4685-bc7e-f1f9caacaa5f 2024-05-25T23:15:08.588393503Z [2024-05-25T23:15:08.587+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:15:08.588452800Z 2024-05-25T23:15:08.591180838Z [2024-05-25T23:15:08.590+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:15:08.592324949Z [2024-05-25T23:15:08.591+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:15:08.592353430Z 2024-05-25T23:15:08.595181371Z [2024-05-25T23:15:08.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:15:08.595322382Z [2024-05-25T23:15:08.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:15:08.671432478Z [2024-05-25T23:15:08.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:15:08.671659060Z [2024-05-25T23:15:08.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:15:08.677784488Z [2024-05-25T23:15:08.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 590c6577-9023-47a8-a41a-5667e56518c0 2024-05-25T23:15:08.678049587Z [2024-05-25T23:15:08.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=-1, run_start_date=2024-05-25 23:15:07.323081+00:00, run_end_date=2024-05-25 23:15:07.726825+00:00, run_duration=0.403744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:15:05.380672+00:00, queued_by_job_id=1, pid=2495 2024-05-25T23:15:10.998308976Z [2024-05-25T23:15:10.997+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:15:10.998356095Z 2024-05-25T23:15:10.998668231Z [2024-05-25T23:15:10.998+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:15:10.999716923Z [2024-05-25T23:15:10.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:15:10.999730348Z 2024-05-25T23:15:11.003577241Z [2024-05-25T23:15:11.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:15:11.003911381Z [2024-05-25T23:15:11.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:15:11.066716632Z [2024-05-25T23:15:11.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status queued for try_number 1 2024-05-25T23:15:11.067132408Z [2024-05-25T23:15:11.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:15:11.077119361Z [2024-05-25T23:15:11.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e15137d-7506-40d3-bdae-01ca2b6d00ec 2024-05-25T23:15:11.077562784Z [2024-05-25T23:15:11.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=0, run_start_date=2024-05-25 23:15:10.303206+00:00, run_end_date=2024-05-25 23:15:10.710635+00:00, run_duration=0.407429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:15:08.592722+00:00, queued_by_job_id=1, pid=2503 2024-05-25T23:15:14.132988785Z [2024-05-25T23:15:14.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:15:14.133626512Z [2024-05-25T23:15:14.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:10:00+00:00, run_id=scheduled__2024-05-25T23:10:00+00:00, run_start_date=2024-05-25 23:15:00.626280+00:00, run_end_date=2024-05-25 23:15:14.132822+00:00, run_duration=13.506542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:10:00+00:00, data_interval_end=2024-05-25 23:15:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:15:14.143263291Z [2024-05-25T23:15:14.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:15:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:15:14.181459237Z [2024-05-25T23:15:14.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:10:00+00:00 exited with status success for try_number 1 2024-05-25T23:15:14.188549556Z [2024-05-25T23:15:14.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:10:00+00:00, map_index=-1, run_start_date=2024-05-25 23:15:12.675220+00:00, run_end_date=2024-05-25 23:15:13.065261+00:00, run_duration=0.390041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:15:11.000355+00:00, queued_by_job_id=1, pid=2511 2024-05-25T23:16:01.064374115Z [2024-05-25T23:16:01.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:16:00+00:00, run_after=2024-05-25T23:17:00+00:00 2024-05-25T23:16:01.074220618Z [2024-05-25T23:16:01.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:16:01.087622587Z [2024-05-25T23:16:01.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:16:00+00:00, run_after=2024-05-25T23:17:00+00:00 2024-05-25T23:16:01.095734045Z [2024-05-25T23:16:01.095+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:16:01.205858266Z [2024-05-25T23:16:01.205+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:16:01.205909409Z 2024-05-25T23:16:01.205921066Z 2024-05-25T23:16:01.205931096Z 2024-05-25T23:16:01.205940865Z 2024-05-25T23:16:01.206047466Z [2024-05-25T23:16:01.205+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:16:01.206249757Z [2024-05-25T23:16:01.205+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:16:01.206439276Z [2024-05-25T23:16:01.206+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:16:01.206693002Z [2024-05-25T23:16:01.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:16:01.207647963Z [2024-05-25T23:16:01.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:16:01.207673621Z 2024-05-25T23:16:01.207705868Z 2024-05-25T23:16:01.207709687Z 2024-05-25T23:16:01.207713163Z 2024-05-25T23:16:01.213823734Z [2024-05-25T23:16:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:16:01.214075086Z [2024-05-25T23:16:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:16:01.214445819Z [2024-05-25T23:16:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:16:01.214595524Z [2024-05-25T23:16:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:16:01.214925812Z [2024-05-25T23:16:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:16:01.215069276Z [2024-05-25T23:16:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:16:01.215373505Z [2024-05-25T23:16:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:16:01.215542721Z [2024-05-25T23:16:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:16:01.649678949Z [2024-05-25T23:16:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status queued for try_number 1 2024-05-25T23:16:01.649720368Z [2024-05-25T23:16:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status queued for try_number 1 2024-05-25T23:16:01.649867716Z [2024-05-25T23:16:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status queued for try_number 1 2024-05-25T23:16:01.650143380Z [2024-05-25T23:16:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status queued for try_number 1 2024-05-25T23:16:01.670033892Z [2024-05-25T23:16:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fa0ee8e-9405-45df-b2b0-7de7e685d067 2024-05-25T23:16:01.670299281Z [2024-05-25T23:16:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 795f01a5-b04a-4977-8d8f-6a83b6bcb111 2024-05-25T23:16:01.670988159Z [2024-05-25T23:16:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bdfd2e1-a87d-4279-8a5f-e17f36a9e2ca 2024-05-25T23:16:01.671196393Z [2024-05-25T23:16:01.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4b2f1b2-a6a0-4765-ac79-06bc0a3cd0f2 2024-05-25T23:16:02.690482648Z [2024-05-25T23:16:02.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:16:02.691060577Z [2024-05-25T23:16:02.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:14:00+00:00, run_id=scheduled__2024-05-25T23:14:00+00:00, run_start_date=2024-05-25 23:16:01.108964+00:00, run_end_date=2024-05-25 23:16:02.690647+00:00, run_duration=1.581683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:14:00+00:00, data_interval_end=2024-05-25 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:16:02.698994269Z [2024-05-25T23:16:02.698+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:16:00+00:00, run_after=2024-05-25T23:18:00+00:00 2024-05-25T23:16:02.780464611Z [2024-05-25T23:16:02.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:14:00+00:00 exited with status success for try_number 1 2024-05-25T23:16:02.789977571Z [2024-05-25T23:16:02.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:14:00+00:00, map_index=-1, run_start_date=2024-05-25 23:16:02.133904+00:00, run_end_date=2024-05-25 23:16:02.579557+00:00, run_duration=0.445653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:16:01.209160+00:00, queued_by_job_id=1, pid=2529 2024-05-25T23:16:03.881676223Z [2024-05-25T23:16:03.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:16:03.885867865Z [2024-05-25T23:16:03.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:15:00+00:00, run_id=scheduled__2024-05-25T23:15:00+00:00, run_start_date=2024-05-25 23:16:01.110424+00:00, run_end_date=2024-05-25 23:16:03.881588+00:00, run_duration=2.771164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:15:00+00:00, data_interval_end=2024-05-25 23:16:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:16:03.905761662Z [2024-05-25T23:16:03.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:16:00+00:00, run_after=2024-05-25T23:17:00+00:00 2024-05-25T23:16:03.983113852Z [2024-05-25T23:16:03.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status success for try_number 1 2024-05-25T23:16:03.987577945Z [2024-05-25T23:16:03.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:15:00+00:00, map_index=-1, run_start_date=2024-05-25 23:16:02.389183+00:00, run_end_date=2024-05-25 23:16:02.825085+00:00, run_duration=0.435902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:16:01.209160+00:00, queued_by_job_id=1, pid=2536 2024-05-25T23:16:06.166338529Z [2024-05-25T23:16:06.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:16:06.167726512Z [2024-05-25T23:16:06.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:15:00+00:00, run_id=scheduled__2024-05-25T23:15:00+00:00, run_start_date=2024-05-25 23:16:01.111595+00:00, run_end_date=2024-05-25 23:16:06.166218+00:00, run_duration=5.054623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:15:00+00:00, data_interval_end=2024-05-25 23:16:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:16:06.178150270Z [2024-05-25T23:16:06.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:16:00+00:00, run_after=2024-05-25T23:17:00+00:00 2024-05-25T23:16:06.187238242Z [2024-05-25T23:16:06.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:16:06.187581317Z [2024-05-25T23:16:06.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:15:00+00:00, run_id=scheduled__2024-05-25T23:15:00+00:00, run_start_date=2024-05-25 23:16:01.112675+00:00, run_end_date=2024-05-25 23:16:06.187173+00:00, run_duration=5.074498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:15:00+00:00, data_interval_end=2024-05-25 23:16:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:16:06.205219395Z [2024-05-25T23:16:06.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:16:00+00:00, run_after=2024-05-25T23:17:00+00:00 2024-05-25T23:16:06.253710993Z [2024-05-25T23:16:06.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status success for try_number 1 2024-05-25T23:16:06.253957043Z [2024-05-25T23:16:06.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status success for try_number 1 2024-05-25T23:16:06.264478062Z [2024-05-25T23:16:06.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:15:00+00:00, map_index=-1, run_start_date=2024-05-25 23:16:03.384333+00:00, run_end_date=2024-05-25 23:16:05.282826+00:00, run_duration=1.898493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:16:01.209160+00:00, queued_by_job_id=1, pid=2559 2024-05-25T23:16:06.264734824Z [2024-05-25T23:16:06.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:15:00+00:00, map_index=-1, run_start_date=2024-05-25 23:16:03.340380+00:00, run_end_date=2024-05-25 23:16:05.325941+00:00, run_duration=1.985561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:16:01.209160+00:00, queued_by_job_id=1, pid=2558 2024-05-25T23:17:00.709421400Z [2024-05-25T23:17:00.708+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:17:00+00:00, run_after=2024-05-25T23:18:00+00:00 2024-05-25T23:17:00.719715831Z [2024-05-25T23:17:00.719+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:17:00.743253800Z [2024-05-25T23:17:00.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:17:00+00:00, run_after=2024-05-25T23:18:00+00:00 2024-05-25T23:17:00.832043983Z [2024-05-25T23:17:00.831+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:17:00.832071071Z 2024-05-25T23:17:00.832075392Z 2024-05-25T23:17:00.832080055Z 2024-05-25T23:17:00.832095881Z [2024-05-25T23:17:00.831+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:17:00.832162409Z [2024-05-25T23:17:00.832+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:17:00.832276270Z [2024-05-25T23:17:00.832+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:17:00.832947165Z [2024-05-25T23:17:00.832+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:17:00.832967572Z 2024-05-25T23:17:00.832976177Z 2024-05-25T23:17:00.832979708Z 2024-05-25T23:17:00.836578485Z [2024-05-25T23:17:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:17:00.836832440Z [2024-05-25T23:17:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:17:00.837172807Z [2024-05-25T23:17:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:17:00.837346597Z [2024-05-25T23:17:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:17:00.837651184Z [2024-05-25T23:17:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:17:00.837830953Z [2024-05-25T23:17:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:17:01.065428691Z [2024-05-25T23:17:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status queued for try_number 1 2024-05-25T23:17:01.065492736Z [2024-05-25T23:17:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status queued for try_number 1 2024-05-25T23:17:01.065647738Z [2024-05-25T23:17:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status queued for try_number 1 2024-05-25T23:17:01.073505191Z [2024-05-25T23:17:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a46efd9-54e0-4ba7-8875-d675b988203e 2024-05-25T23:17:01.073717237Z [2024-05-25T23:17:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to bebb69a6-cc4b-405b-abae-fa78ab3da378 2024-05-25T23:17:01.073869954Z [2024-05-25T23:17:01.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea2c25c7-6dbb-4933-8f49-f58d724bfee1 2024-05-25T23:17:02.309317424Z [2024-05-25T23:17:02.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:17:02.309908667Z [2024-05-25T23:17:02.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:16:00+00:00, run_id=scheduled__2024-05-25T23:16:00+00:00, run_start_date=2024-05-25 23:17:00.772080+00:00, run_end_date=2024-05-25 23:17:02.309223+00:00, run_duration=1.537143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:16:00+00:00, data_interval_end=2024-05-25 23:17:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:17:02.319900910Z [2024-05-25T23:17:02.319+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:17:00+00:00, run_after=2024-05-25T23:18:00+00:00 2024-05-25T23:17:02.383241517Z [2024-05-25T23:17:02.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status success for try_number 1 2024-05-25T23:17:02.392808962Z [2024-05-25T23:17:02.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:16:00+00:00, map_index=-1, run_start_date=2024-05-25 23:17:01.643634+00:00, run_end_date=2024-05-25 23:17:02.014072+00:00, run_duration=0.370438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:17:00.833687+00:00, queued_by_job_id=1, pid=2591 2024-05-25T23:17:04.748081242Z [2024-05-25T23:17:04.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:17:04.748442352Z [2024-05-25T23:17:04.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:16:00+00:00, run_id=scheduled__2024-05-25T23:16:00+00:00, run_start_date=2024-05-25 23:17:00.777121+00:00, run_end_date=2024-05-25 23:17:04.747967+00:00, run_duration=3.970846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:16:00+00:00, data_interval_end=2024-05-25 23:17:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:17:04.763899951Z [2024-05-25T23:17:04.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:17:00+00:00, run_after=2024-05-25T23:18:00+00:00 2024-05-25T23:17:05.914273317Z [2024-05-25T23:17:05.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:17:05.915217253Z [2024-05-25T23:17:05.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:16:00+00:00, run_id=scheduled__2024-05-25T23:16:00+00:00, run_start_date=2024-05-25 23:17:00.778721+00:00, run_end_date=2024-05-25 23:17:05.914463+00:00, run_duration=5.135742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:16:00+00:00, data_interval_end=2024-05-25 23:17:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:17:05.933258886Z [2024-05-25T23:17:05.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:17:00+00:00, run_after=2024-05-25T23:18:00+00:00 2024-05-25T23:17:05.977638975Z [2024-05-25T23:17:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status success for try_number 1 2024-05-25T23:17:05.977887855Z [2024-05-25T23:17:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status success for try_number 1 2024-05-25T23:17:05.983783501Z [2024-05-25T23:17:05.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:16:00+00:00, map_index=-1, run_start_date=2024-05-25 23:17:02.954444+00:00, run_end_date=2024-05-25 23:17:04.692372+00:00, run_duration=1.737928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:17:00.833687+00:00, queued_by_job_id=1, pid=2610 2024-05-25T23:17:05.984100977Z [2024-05-25T23:17:05.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:16:00+00:00, map_index=-1, run_start_date=2024-05-25 23:17:02.799061+00:00, run_end_date=2024-05-25 23:17:04.839489+00:00, run_duration=2.040428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:17:00.833687+00:00, queued_by_job_id=1, pid=2609 2024-05-25T23:18:00.638227335Z [2024-05-25T23:18:00.637+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:18:00+00:00, run_after=2024-05-25T23:19:00+00:00 2024-05-25T23:18:00.651637463Z [2024-05-25T23:18:00.651+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:18:00.685162517Z [2024-05-25T23:18:00.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:18:00+00:00, run_after=2024-05-25T23:19:00+00:00 2024-05-25T23:18:00.697069124Z [2024-05-25T23:18:00.696+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:18:00.791689897Z [2024-05-25T23:18:00.788+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:18:00.791718601Z 2024-05-25T23:18:00.791728740Z 2024-05-25T23:18:00.791734433Z 2024-05-25T23:18:00.791739999Z 2024-05-25T23:18:00.791747014Z [2024-05-25T23:18:00.788+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:18:00.791752365Z [2024-05-25T23:18:00.788+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:18:00.791775034Z [2024-05-25T23:18:00.788+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:18:00.791781084Z [2024-05-25T23:18:00.788+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:18:00.791786506Z [2024-05-25T23:18:00.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:18:00.791791654Z 2024-05-25T23:18:00.791796806Z 2024-05-25T23:18:00.791801986Z 2024-05-25T23:18:00.791807160Z 2024-05-25T23:18:00.793064870Z [2024-05-25T23:18:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:18:00.793189266Z [2024-05-25T23:18:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:18:00.793380809Z [2024-05-25T23:18:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:18:00.793468747Z [2024-05-25T23:18:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:18:00.793652320Z [2024-05-25T23:18:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:18:00.793749087Z [2024-05-25T23:18:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:18:00.793914723Z [2024-05-25T23:18:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:18:00.794002034Z [2024-05-25T23:18:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:18:01.122661640Z [2024-05-25T23:18:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status queued for try_number 1 2024-05-25T23:18:01.124755623Z [2024-05-25T23:18:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:17:00+00:00 exited with status queued for try_number 1 2024-05-25T23:18:01.124960114Z [2024-05-25T23:18:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:17:00+00:00 exited with status queued for try_number 1 2024-05-25T23:18:01.125183992Z [2024-05-25T23:18:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:17:00+00:00 exited with status queued for try_number 1 2024-05-25T23:18:01.134852326Z [2024-05-25T23:18:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17925c85-f5bc-4c2e-897d-796cdaa5ab32 2024-05-25T23:18:01.135107091Z [2024-05-25T23:18:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15a90e3c-dbcd-4333-a19b-a949d0bc2cdb 2024-05-25T23:18:01.135376278Z [2024-05-25T23:18:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b571083-838c-4a43-9e1d-5c4f2458ee2f 2024-05-25T23:18:01.135685839Z [2024-05-25T23:18:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9992dc4-39c3-4651-814e-eab08b9b7dec 2024-05-25T23:18:02.348711068Z [2024-05-25T23:18:02.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:16:00+00:00 exited with status success for try_number 1 2024-05-25T23:18:02.355032613Z [2024-05-25T23:18:02.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:16:00+00:00, map_index=-1, run_start_date=2024-05-25 23:18:01.752874+00:00, run_end_date=2024-05-25 23:18:02.200056+00:00, run_duration=0.447182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:18:00.790198+00:00, queued_by_job_id=1, pid=2643 2024-05-25T23:18:03.411966331Z [2024-05-25T23:18:03.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:18:03.412497104Z [2024-05-25T23:18:03.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:16:00+00:00, run_id=scheduled__2024-05-25T23:16:00+00:00, run_start_date=2024-05-25 23:18:00.710524+00:00, run_end_date=2024-05-25 23:18:03.412129+00:00, run_duration=2.701605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:16:00+00:00, data_interval_end=2024-05-25 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:18:03.433203409Z [2024-05-25T23:18:03.432+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:18:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:18:03.441945434Z [2024-05-25T23:18:03.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:18:03.442026451Z [2024-05-25T23:18:03.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:17:00+00:00, run_id=scheduled__2024-05-25T23:17:00+00:00, run_start_date=2024-05-25 23:18:00.712210+00:00, run_end_date=2024-05-25 23:18:03.441367+00:00, run_duration=2.729157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:17:00+00:00, data_interval_end=2024-05-25 23:18:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:18:03.452126888Z [2024-05-25T23:18:03.451+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:18:00+00:00, run_after=2024-05-25T23:19:00+00:00 2024-05-25T23:18:03.520741300Z [2024-05-25T23:18:03.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:17:00+00:00 exited with status success for try_number 1 2024-05-25T23:18:03.525598083Z [2024-05-25T23:18:03.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:17:00+00:00, map_index=-1, run_start_date=2024-05-25 23:18:01.818970+00:00, run_end_date=2024-05-25 23:18:02.278268+00:00, run_duration=0.459298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:18:00.790198+00:00, queued_by_job_id=1, pid=2644 2024-05-25T23:18:04.574823368Z [2024-05-25T23:18:04.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:18:04.574986991Z [2024-05-25T23:18:04.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:17:00+00:00, run_id=scheduled__2024-05-25T23:17:00+00:00, run_start_date=2024-05-25 23:18:00.717750+00:00, run_end_date=2024-05-25 23:18:04.574749+00:00, run_duration=3.856999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:17:00+00:00, data_interval_end=2024-05-25 23:18:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:18:04.585464329Z [2024-05-25T23:18:04.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:18:00+00:00, run_after=2024-05-25T23:19:00+00:00 2024-05-25T23:18:05.714371785Z [2024-05-25T23:18:05.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:18:05.715119946Z [2024-05-25T23:18:05.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:17:00+00:00, run_id=scheduled__2024-05-25T23:17:00+00:00, run_start_date=2024-05-25 23:18:00.719761+00:00, run_end_date=2024-05-25 23:18:05.714419+00:00, run_duration=4.994658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:17:00+00:00, data_interval_end=2024-05-25 23:18:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:18:05.725279754Z [2024-05-25T23:18:05.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:18:00+00:00, run_after=2024-05-25T23:19:00+00:00 2024-05-25T23:18:05.751637989Z [2024-05-25T23:18:05.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:17:00+00:00 exited with status success for try_number 1 2024-05-25T23:18:05.751792100Z [2024-05-25T23:18:05.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:17:00+00:00 exited with status success for try_number 1 2024-05-25T23:18:05.757433163Z [2024-05-25T23:18:05.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:17:00+00:00, map_index=-1, run_start_date=2024-05-25 23:18:02.903744+00:00, run_end_date=2024-05-25 23:18:04.528724+00:00, run_duration=1.62498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:18:00.790198+00:00, queued_by_job_id=1, pid=2668 2024-05-25T23:18:05.757881060Z [2024-05-25T23:18:05.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:17:00+00:00, map_index=-1, run_start_date=2024-05-25 23:18:02.845315+00:00, run_end_date=2024-05-25 23:18:04.860688+00:00, run_duration=2.015373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:18:00.790198+00:00, queued_by_job_id=1, pid=2667 2024-05-25T23:18:30.432088893Z [2024-05-25T23:18:30.431+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:19:00.270273411Z [2024-05-25T23:19:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:19:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:19:00.282915538Z [2024-05-25T23:19:00.282+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:19:00.296725023Z [2024-05-25T23:19:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:19:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:19:00.373313229Z [2024-05-25T23:19:00.372+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:19:00.373398342Z 2024-05-25T23:19:00.373410123Z 2024-05-25T23:19:00.373419289Z 2024-05-25T23:19:00.373427634Z [2024-05-25T23:19:00.373+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:19:00.373436046Z [2024-05-25T23:19:00.373+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:19:00.373505309Z [2024-05-25T23:19:00.373+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:19:00.373926379Z [2024-05-25T23:19:00.373+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:19:00.373950374Z 2024-05-25T23:19:00.373954008Z 2024-05-25T23:19:00.373956921Z 2024-05-25T23:19:00.376992667Z [2024-05-25T23:19:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:19:00.377006748Z [2024-05-25T23:19:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:19:00.377406337Z [2024-05-25T23:19:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:19:00.377439155Z [2024-05-25T23:19:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:19:00.377699951Z [2024-05-25T23:19:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:19:00.377762484Z [2024-05-25T23:19:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:19:00.638747855Z [2024-05-25T23:19:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status queued for try_number 1 2024-05-25T23:19:00.638942390Z [2024-05-25T23:19:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status queued for try_number 1 2024-05-25T23:19:00.639247326Z [2024-05-25T23:19:00.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status queued for try_number 1 2024-05-25T23:19:00.646785608Z [2024-05-25T23:19:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7e7ed95-9d28-4d5b-a176-eb3d106a4016 2024-05-25T23:19:00.647086914Z [2024-05-25T23:19:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1012ecc-b4e9-4c8e-a84f-f1b3219a86f2 2024-05-25T23:19:00.647224446Z [2024-05-25T23:19:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61a00b67-d455-4496-8b2b-f2e4d6977342 2024-05-25T23:19:01.825983297Z [2024-05-25T23:19:01.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:19:01.826596323Z [2024-05-25T23:19:01.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:18:00+00:00, run_id=scheduled__2024-05-25T23:18:00+00:00, run_start_date=2024-05-25 23:19:00.310501+00:00, run_end_date=2024-05-25 23:19:01.826085+00:00, run_duration=1.515584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:18:00+00:00, data_interval_end=2024-05-25 23:19:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:19:01.837300740Z [2024-05-25T23:19:01.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:19:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:19:01.927167805Z [2024-05-25T23:19:01.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status success for try_number 1 2024-05-25T23:19:01.933419421Z [2024-05-25T23:19:01.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:18:00+00:00, map_index=-1, run_start_date=2024-05-25 23:19:01.169290+00:00, run_end_date=2024-05-25 23:19:01.629310+00:00, run_duration=0.46002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:19:00.374532+00:00, queued_by_job_id=1, pid=2701 2024-05-25T23:19:04.135345064Z [2024-05-25T23:19:04.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:19:04.137008390Z [2024-05-25T23:19:04.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:18:00+00:00, run_id=scheduled__2024-05-25T23:18:00+00:00, run_start_date=2024-05-25 23:19:00.312007+00:00, run_end_date=2024-05-25 23:19:04.135730+00:00, run_duration=3.823723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:18:00+00:00, data_interval_end=2024-05-25 23:19:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:19:04.148569805Z [2024-05-25T23:19:04.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:19:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:19:04.156489912Z [2024-05-25T23:19:04.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:19:04.157033020Z [2024-05-25T23:19:04.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:18:00+00:00, run_id=scheduled__2024-05-25T23:18:00+00:00, run_start_date=2024-05-25 23:19:00.313147+00:00, run_end_date=2024-05-25 23:19:04.156662+00:00, run_duration=3.843515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:18:00+00:00, data_interval_end=2024-05-25 23:19:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:19:04.165975010Z [2024-05-25T23:19:04.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:19:00+00:00, run_after=2024-05-25T23:20:00+00:00 2024-05-25T23:19:04.200458698Z [2024-05-25T23:19:04.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status success for try_number 1 2024-05-25T23:19:04.205644548Z [2024-05-25T23:19:04.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:18:00+00:00, map_index=-1, run_start_date=2024-05-25 23:19:02.206269+00:00, run_end_date=2024-05-25 23:19:03.962971+00:00, run_duration=1.756702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:19:00.374532+00:00, queued_by_job_id=1, pid=2719 2024-05-25T23:19:05.286062412Z [2024-05-25T23:19:05.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status success for try_number 1 2024-05-25T23:19:05.291925374Z [2024-05-25T23:19:05.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:18:00+00:00, map_index=-1, run_start_date=2024-05-25 23:19:02.280510+00:00, run_end_date=2024-05-25 23:19:04.001905+00:00, run_duration=1.721395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:19:00.374532+00:00, queued_by_job_id=1, pid=2720 2024-05-25T23:20:00.681434418Z [2024-05-25T23:20:00.680+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:21:00+00:00 2024-05-25T23:20:00.700506277Z [2024-05-25T23:20:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:25:00+00:00 2024-05-25T23:20:00.726602697Z [2024-05-25T23:20:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:21:00+00:00 2024-05-25T23:20:00.743707696Z [2024-05-25T23:20:00.737+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:20:00.753675138Z [2024-05-25T23:20:00.744+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:20:00.831916526Z [2024-05-25T23:20:00.831+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T23:20:00.831988741Z 2024-05-25T23:20:00.831999228Z 2024-05-25T23:20:00.832008691Z 2024-05-25T23:20:00.832017364Z 2024-05-25T23:20:00.832025853Z 2024-05-25T23:20:00.832261488Z [2024-05-25T23:20:00.831+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:20:00.832542845Z [2024-05-25T23:20:00.832+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:20:00.832848674Z [2024-05-25T23:20:00.832+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:20:00.833121597Z [2024-05-25T23:20:00.832+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:20:00.833410095Z [2024-05-25T23:20:00.833+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:20:00.834458754Z [2024-05-25T23:20:00.834+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:20:00.834468853Z 2024-05-25T23:20:00.834474944Z 2024-05-25T23:20:00.834480705Z 2024-05-25T23:20:00.834486188Z 2024-05-25T23:20:00.834491647Z 2024-05-25T23:20:00.841177360Z [2024-05-25T23:20:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:20:00.841465419Z [2024-05-25T23:20:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:20:00.841879795Z [2024-05-25T23:20:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:20:00.842105271Z [2024-05-25T23:20:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:20:00.842456070Z [2024-05-25T23:20:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:20:00.842919244Z [2024-05-25T23:20:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:20:00.843278386Z [2024-05-25T23:20:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:20:00.843559992Z [2024-05-25T23:20:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:20:00.843906358Z [2024-05-25T23:20:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:20:00.844110713Z [2024-05-25T23:20:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:20:01.340966232Z [2024-05-25T23:20:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:01.340994817Z [2024-05-25T23:20:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:01.341066902Z [2024-05-25T23:20:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:19:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:01.341129210Z [2024-05-25T23:20:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:19:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:01.341202670Z [2024-05-25T23:20:01.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:19:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:01.361883685Z [2024-05-25T23:20:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to d33ca46f-27ee-4c62-9f78-48fe8ab28d49 2024-05-25T23:20:01.362094638Z [2024-05-25T23:20:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 862329c1-1b57-4a45-8694-14f76535a88e 2024-05-25T23:20:01.362312169Z [2024-05-25T23:20:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cdbd033-5aca-4ee9-ab8b-f798e9b3bfe3 2024-05-25T23:20:01.362486186Z [2024-05-25T23:20:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9619a1d7-cac2-4aeb-a2be-e113abd3b5d4 2024-05-25T23:20:01.362670322Z [2024-05-25T23:20:01.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 813364c8-f34e-44b8-92d2-3c1aad21ea83 2024-05-25T23:20:03.902422785Z [2024-05-25T23:20:03.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:20:03.903067640Z [2024-05-25T23:20:03.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:18:00+00:00, run_id=scheduled__2024-05-25T23:18:00+00:00, run_start_date=2024-05-25 23:20:00.754108+00:00, run_end_date=2024-05-25 23:20:03.902333+00:00, run_duration=3.148225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:18:00+00:00, data_interval_end=2024-05-25 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:20:03.922882162Z [2024-05-25T23:20:03.922+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:22:00+00:00 2024-05-25T23:20:03.930575877Z [2024-05-25T23:20:03.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:20:03.930950080Z [2024-05-25T23:20:03.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:19:00+00:00, run_id=scheduled__2024-05-25T23:19:00+00:00, run_start_date=2024-05-25 23:20:00.755073+00:00, run_end_date=2024-05-25 23:20:03.930485+00:00, run_duration=3.175412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:19:00+00:00, data_interval_end=2024-05-25 23:20:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:20:03.941995988Z [2024-05-25T23:20:03.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:21:00+00:00 2024-05-25T23:20:04.016580010Z [2024-05-25T23:20:04.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:18:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:04.017169584Z [2024-05-25T23:20:04.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:19:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:04.024651537Z [2024-05-25T23:20:04.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:18:00+00:00, map_index=-1, run_start_date=2024-05-25 23:20:02.283714+00:00, run_end_date=2024-05-25 23:20:02.841827+00:00, run_duration=0.558113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:00.837174+00:00, queued_by_job_id=1, pid=2756 2024-05-25T23:20:04.025263608Z [2024-05-25T23:20:04.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:19:00+00:00, map_index=-1, run_start_date=2024-05-25 23:20:02.141632+00:00, run_end_date=2024-05-25 23:20:02.890075+00:00, run_duration=0.748443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:00.837174+00:00, queued_by_job_id=1, pid=2755 2024-05-25T23:20:05.095322259Z [2024-05-25T23:20:05.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:20:05.095382322Z [2024-05-25T23:20:05.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:19:00+00:00, run_id=scheduled__2024-05-25T23:19:00+00:00, run_start_date=2024-05-25 23:20:00.757110+00:00, run_end_date=2024-05-25 23:20:05.095112+00:00, run_duration=4.338002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:19:00+00:00, data_interval_end=2024-05-25 23:20:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:20:05.103869765Z [2024-05-25T23:20:05.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:21:00+00:00 2024-05-25T23:20:05.126549938Z [2024-05-25T23:20:05.126+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:20:05.126581118Z 2024-05-25T23:20:05.126597560Z [2024-05-25T23:20:05.126+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:20:05.127056519Z [2024-05-25T23:20:05.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:20:05.127084945Z 2024-05-25T23:20:05.129438066Z [2024-05-25T23:20:05.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:20:05.129471502Z [2024-05-25T23:20:05.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:20:05.197548710Z [2024-05-25T23:20:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:05.197749784Z [2024-05-25T23:20:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:05.205098188Z [2024-05-25T23:20:05.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a7df025-7a93-4138-8c5c-d6c68e8a7fdf 2024-05-25T23:20:05.205799263Z [2024-05-25T23:20:05.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:15:00+00:00, map_index=-1, run_start_date=2024-05-25 23:20:03.656999+00:00, run_end_date=2024-05-25 23:20:04.314584+00:00, run_duration=0.657585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:00.837174+00:00, queued_by_job_id=1, pid=2790 2024-05-25T23:20:05.332044627Z [2024-05-25T23:20:05.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:19:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:05.340060623Z [2024-05-25T23:20:05.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:19:00+00:00, map_index=-1, run_start_date=2024-05-25 23:20:03.262763+00:00, run_end_date=2024-05-25 23:20:05.019440+00:00, run_duration=1.756677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:00.837174+00:00, queued_by_job_id=1, pid=2779 2024-05-25T23:20:06.390798981Z [2024-05-25T23:20:06.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:20:06.391160840Z [2024-05-25T23:20:06.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:19:00+00:00, run_id=scheduled__2024-05-25T23:19:00+00:00, run_start_date=2024-05-25 23:20:00.756194+00:00, run_end_date=2024-05-25 23:20:06.390669+00:00, run_duration=5.634475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:19:00+00:00, data_interval_end=2024-05-25 23:20:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:20:06.400235262Z [2024-05-25T23:20:06.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:21:00+00:00 2024-05-25T23:20:06.443103833Z [2024-05-25T23:20:06.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:19:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:06.448474057Z [2024-05-25T23:20:06.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:19:00+00:00, map_index=-1, run_start_date=2024-05-25 23:20:03.755460+00:00, run_end_date=2024-05-25 23:20:05.409898+00:00, run_duration=1.654438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:00.837174+00:00, queued_by_job_id=1, pid=2791 2024-05-25T23:20:07.842285314Z [2024-05-25T23:20:07.841+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:20:07.842339551Z 2024-05-25T23:20:07.842692139Z [2024-05-25T23:20:07.842+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:20:07.843898103Z [2024-05-25T23:20:07.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:20:07.843936376Z 2024-05-25T23:20:07.847992391Z [2024-05-25T23:20:07.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:20:07.848308322Z [2024-05-25T23:20:07.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:20:07.914260311Z [2024-05-25T23:20:07.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:07.915898415Z [2024-05-25T23:20:07.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:07.925620978Z [2024-05-25T23:20:07.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7635cb2-967c-45a2-9bb6-e719eb83950e 2024-05-25T23:20:07.926052658Z [2024-05-25T23:20:07.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:15:00+00:00, map_index=-1, run_start_date=2024-05-25 23:20:07.082104+00:00, run_end_date=2024-05-25 23:20:07.417700+00:00, run_duration=0.335596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:05.127266+00:00, queued_by_job_id=1, pid=2809 2024-05-25T23:20:10.846272538Z [2024-05-25T23:20:10.845+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:20:10.846316553Z 2024-05-25T23:20:10.846721260Z [2024-05-25T23:20:10.846+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:20:10.848259188Z [2024-05-25T23:20:10.847+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:20:10.848287698Z 2024-05-25T23:20:10.851370961Z [2024-05-25T23:20:10.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:20:10.851805404Z [2024-05-25T23:20:10.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:20:10.913738205Z [2024-05-25T23:20:10.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status queued for try_number 1 2024-05-25T23:20:10.913947301Z [2024-05-25T23:20:10.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:10.921473665Z [2024-05-25T23:20:10.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf4bca11-fd1d-4443-a02f-848d2e83ac27 2024-05-25T23:20:10.921719764Z [2024-05-25T23:20:10.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:15:00+00:00, map_index=0, run_start_date=2024-05-25 23:20:09.531959+00:00, run_end_date=2024-05-25 23:20:09.869684+00:00, run_duration=0.337725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:07.844393+00:00, queued_by_job_id=1, pid=2817 2024-05-25T23:20:13.128147052Z [2024-05-25T23:20:13.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:20:13.128546076Z [2024-05-25T23:20:13.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:15:00+00:00, run_id=scheduled__2024-05-25T23:15:00+00:00, run_start_date=2024-05-25 23:20:00.752974+00:00, run_end_date=2024-05-25 23:20:13.128013+00:00, run_duration=12.375039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:15:00+00:00, data_interval_end=2024-05-25 23:20:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:20:13.148084574Z [2024-05-25T23:20:13.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:20:00+00:00, run_after=2024-05-25T23:25:00+00:00 2024-05-25T23:20:13.214962415Z [2024-05-25T23:20:13.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:15:00+00:00 exited with status success for try_number 1 2024-05-25T23:20:13.237903972Z [2024-05-25T23:20:13.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:15:00+00:00, map_index=-1, run_start_date=2024-05-25 23:20:12.581725+00:00, run_end_date=2024-05-25 23:20:12.990119+00:00, run_duration=0.408394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:20:10.848941+00:00, queued_by_job_id=1, pid=2825 2024-05-25T23:21:00.130570880Z [2024-05-25T23:21:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:21:00+00:00, run_after=2024-05-25T23:22:00+00:00 2024-05-25T23:21:00.140394417Z [2024-05-25T23:21:00.140+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:21:00.155628480Z [2024-05-25T23:21:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:21:00+00:00, run_after=2024-05-25T23:22:00+00:00 2024-05-25T23:21:00.229448004Z [2024-05-25T23:21:00.229+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:21:00.229478575Z 2024-05-25T23:21:00.229483377Z 2024-05-25T23:21:00.229486954Z 2024-05-25T23:21:00.229702592Z [2024-05-25T23:21:00.229+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:21:00.229761554Z [2024-05-25T23:21:00.229+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:21:00.229927461Z [2024-05-25T23:21:00.229+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:21:00.230542599Z [2024-05-25T23:21:00.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:21:00.230556871Z 2024-05-25T23:21:00.230560888Z 2024-05-25T23:21:00.230564257Z 2024-05-25T23:21:00.233801920Z [2024-05-25T23:21:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:21:00.234040491Z [2024-05-25T23:21:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:21:00.234365773Z [2024-05-25T23:21:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:21:00.234556934Z [2024-05-25T23:21:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:21:00.234877087Z [2024-05-25T23:21:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:21:00.235160938Z [2024-05-25T23:21:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:21:00.484515132Z [2024-05-25T23:21:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:21:00.487424167Z [2024-05-25T23:21:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:21:00.487636693Z [2024-05-25T23:21:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:21:00.499569650Z [2024-05-25T23:21:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0aa2c747-5748-48dd-b77d-f4c4a41dafbd 2024-05-25T23:21:00.499892011Z [2024-05-25T23:21:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to b00c172d-7046-4d09-adaa-708f132c7c2a 2024-05-25T23:21:00.500205066Z [2024-05-25T23:21:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 832f8112-fedb-477e-9c63-2d1ce0b89345 2024-05-25T23:21:01.675750735Z [2024-05-25T23:21:01.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:21:01.676385693Z [2024-05-25T23:21:01.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:20:00+00:00, run_id=scheduled__2024-05-25T23:20:00+00:00, run_start_date=2024-05-25 23:21:00.168436+00:00, run_end_date=2024-05-25 23:21:01.675728+00:00, run_duration=1.507292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:20:00+00:00, data_interval_end=2024-05-25 23:21:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:21:01.693249677Z [2024-05-25T23:21:01.692+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:21:00+00:00, run_after=2024-05-25T23:22:00+00:00 2024-05-25T23:21:01.746143982Z [2024-05-25T23:21:01.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:21:01.751349699Z [2024-05-25T23:21:01.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=-1, run_start_date=2024-05-25 23:21:01.035269+00:00, run_end_date=2024-05-25 23:21:01.449717+00:00, run_duration=0.414448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:21:00.231261+00:00, queued_by_job_id=1, pid=2847 2024-05-25T23:21:03.713995366Z [2024-05-25T23:21:03.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:21:03.714268728Z [2024-05-25T23:21:03.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:20:00+00:00, run_id=scheduled__2024-05-25T23:20:00+00:00, run_start_date=2024-05-25 23:21:00.170128+00:00, run_end_date=2024-05-25 23:21:03.713918+00:00, run_duration=3.54379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:20:00+00:00, data_interval_end=2024-05-25 23:21:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:21:03.725478221Z [2024-05-25T23:21:03.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:21:00+00:00, run_after=2024-05-25T23:22:00+00:00 2024-05-25T23:21:03.784005367Z [2024-05-25T23:21:03.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:21:03.791260254Z [2024-05-25T23:21:03.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=-1, run_start_date=2024-05-25 23:21:02.148871+00:00, run_end_date=2024-05-25 23:21:03.397265+00:00, run_duration=1.248394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:21:00.231261+00:00, queued_by_job_id=1, pid=2865 2024-05-25T23:21:04.835805160Z [2024-05-25T23:21:04.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:21:04.835948401Z [2024-05-25T23:21:04.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:20:00+00:00, run_id=scheduled__2024-05-25T23:20:00+00:00, run_start_date=2024-05-25 23:21:00.171199+00:00, run_end_date=2024-05-25 23:21:04.835722+00:00, run_duration=4.664523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:20:00+00:00, data_interval_end=2024-05-25 23:21:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:21:04.850883882Z [2024-05-25T23:21:04.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:21:00+00:00, run_after=2024-05-25T23:22:00+00:00 2024-05-25T23:21:04.893676421Z [2024-05-25T23:21:04.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:21:04.899073474Z [2024-05-25T23:21:04.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=-1, run_start_date=2024-05-25 23:21:02.334507+00:00, run_end_date=2024-05-25 23:21:03.920924+00:00, run_duration=1.586417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:21:00.231261+00:00, queued_by_job_id=1, pid=2866 2024-05-25T23:22:00.849242730Z [2024-05-25T23:22:00.848+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:22:00.875419255Z [2024-05-25T23:22:00.874+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:22:00.890413525Z [2024-05-25T23:22:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:22:00+00:00, run_after=2024-05-25T23:23:00+00:00 2024-05-25T23:22:00.910459982Z [2024-05-25T23:22:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:22:00+00:00, run_after=2024-05-25T23:23:00+00:00 2024-05-25T23:22:01.025288129Z [2024-05-25T23:22:01.024+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:22:01.025328536Z 2024-05-25T23:22:01.025337261Z 2024-05-25T23:22:01.025344654Z 2024-05-25T23:22:01.025352138Z 2024-05-25T23:22:01.025606527Z [2024-05-25T23:22:01.025+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:22:01.025917536Z [2024-05-25T23:22:01.025+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:22:01.026129715Z [2024-05-25T23:22:01.025+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:22:01.026358077Z [2024-05-25T23:22:01.026+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:22:01.027563284Z [2024-05-25T23:22:01.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:22:01.027580399Z 2024-05-25T23:22:01.027585437Z 2024-05-25T23:22:01.027589822Z 2024-05-25T23:22:01.027598272Z 2024-05-25T23:22:01.033281215Z [2024-05-25T23:22:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:22:01.033516915Z [2024-05-25T23:22:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:22:01.033923038Z [2024-05-25T23:22:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:22:01.034264721Z [2024-05-25T23:22:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:22:01.034652531Z [2024-05-25T23:22:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:22:01.034892852Z [2024-05-25T23:22:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:22:01.035266235Z [2024-05-25T23:22:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:22:01.035498575Z [2024-05-25T23:22:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:22:01.344922826Z [2024-05-25T23:22:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:22:01.345259490Z [2024-05-25T23:22:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:21:00+00:00 exited with status queued for try_number 1 2024-05-25T23:22:01.345377920Z [2024-05-25T23:22:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:21:00+00:00 exited with status queued for try_number 1 2024-05-25T23:22:01.345495899Z [2024-05-25T23:22:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:21:00+00:00 exited with status queued for try_number 1 2024-05-25T23:22:01.357200600Z [2024-05-25T23:22:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2261364-8a9b-469c-a2f0-fd6ce7e5ea51 2024-05-25T23:22:01.357356215Z [2024-05-25T23:22:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b43ae47-3bfa-47e1-a06c-a81f42b6a8e5 2024-05-25T23:22:01.357523966Z [2024-05-25T23:22:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4a0507c-4b9b-4c5f-bf33-b5f94f3c2dc0 2024-05-25T23:22:01.357672127Z [2024-05-25T23:22:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 438656e8-75eb-4515-9657-9df5f3bb664e 2024-05-25T23:22:02.688665469Z [2024-05-25T23:22:02.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:22:02.689099663Z [2024-05-25T23:22:02.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:20:00+00:00, run_id=scheduled__2024-05-25T23:20:00+00:00, run_start_date=2024-05-25 23:22:00.924545+00:00, run_end_date=2024-05-25 23:22:02.688566+00:00, run_duration=1.764021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:20:00+00:00, data_interval_end=2024-05-25 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:22:02.697038695Z [2024-05-25T23:22:02.696+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:22:00+00:00, run_after=2024-05-25T23:24:00+00:00 2024-05-25T23:22:02.704323363Z [2024-05-25T23:22:02.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:22:02.704644540Z [2024-05-25T23:22:02.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:21:00+00:00, run_id=scheduled__2024-05-25T23:21:00+00:00, run_start_date=2024-05-25 23:22:00.926516+00:00, run_end_date=2024-05-25 23:22:02.704237+00:00, run_duration=1.777721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:21:00+00:00, data_interval_end=2024-05-25 23:22:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:22:02.718451713Z [2024-05-25T23:22:02.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:22:00+00:00, run_after=2024-05-25T23:23:00+00:00 2024-05-25T23:22:02.783466753Z [2024-05-25T23:22:02.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:22:02.783758262Z [2024-05-25T23:22:02.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:21:00+00:00 exited with status success for try_number 1 2024-05-25T23:22:02.800345388Z [2024-05-25T23:22:02.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=-1, run_start_date=2024-05-25 23:22:01.963158+00:00, run_end_date=2024-05-25 23:22:02.334536+00:00, run_duration=0.371378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:22:01.029473+00:00, queued_by_job_id=1, pid=2899 2024-05-25T23:22:02.801176166Z [2024-05-25T23:22:02.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:21:00+00:00, map_index=-1, run_start_date=2024-05-25 23:22:02.054969+00:00, run_end_date=2024-05-25 23:22:02.534357+00:00, run_duration=0.479388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:22:01.029473+00:00, queued_by_job_id=1, pid=2900 2024-05-25T23:22:04.711503970Z [2024-05-25T23:22:04.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:22:04.711956786Z [2024-05-25T23:22:04.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:21:00+00:00, run_id=scheduled__2024-05-25T23:21:00+00:00, run_start_date=2024-05-25 23:22:00.928656+00:00, run_end_date=2024-05-25 23:22:04.711440+00:00, run_duration=3.782784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:21:00+00:00, data_interval_end=2024-05-25 23:22:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:22:04.727567194Z [2024-05-25T23:22:04.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:22:00+00:00, run_after=2024-05-25T23:23:00+00:00 2024-05-25T23:22:05.836799270Z [2024-05-25T23:22:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:22:05.837044695Z [2024-05-25T23:22:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:21:00+00:00, run_id=scheduled__2024-05-25T23:21:00+00:00, run_start_date=2024-05-25 23:22:00.930129+00:00, run_end_date=2024-05-25 23:22:05.836673+00:00, run_duration=4.906544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:21:00+00:00, data_interval_end=2024-05-25 23:22:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:22:05.858054674Z [2024-05-25T23:22:05.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:22:00+00:00, run_after=2024-05-25T23:23:00+00:00 2024-05-25T23:22:05.914699664Z [2024-05-25T23:22:05.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:21:00+00:00 exited with status success for try_number 1 2024-05-25T23:22:05.918439424Z [2024-05-25T23:22:05.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:21:00+00:00 exited with status success for try_number 1 2024-05-25T23:22:05.931430368Z [2024-05-25T23:22:05.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:21:00+00:00, map_index=-1, run_start_date=2024-05-25 23:22:03.142831+00:00, run_end_date=2024-05-25 23:22:04.666682+00:00, run_duration=1.523851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:22:01.029473+00:00, queued_by_job_id=1, pid=2924 2024-05-25T23:22:05.931841813Z [2024-05-25T23:22:05.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:21:00+00:00, map_index=-1, run_start_date=2024-05-25 23:22:03.138406+00:00, run_end_date=2024-05-25 23:22:05.123257+00:00, run_duration=1.984851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:22:01.029473+00:00, queued_by_job_id=1, pid=2923 2024-05-25T23:23:00.644517748Z [2024-05-25T23:23:00.643+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:23:00+00:00, run_after=2024-05-25T23:24:00+00:00 2024-05-25T23:23:00.678691871Z [2024-05-25T23:23:00.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:23:00+00:00, run_after=2024-05-25T23:24:00+00:00 2024-05-25T23:23:00.688553736Z [2024-05-25T23:23:00.688+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:23:00.778150468Z [2024-05-25T23:23:00.777+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:23:00.778187490Z 2024-05-25T23:23:00.778194461Z 2024-05-25T23:23:00.778199969Z 2024-05-25T23:23:00.778315899Z [2024-05-25T23:23:00.777+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:23:00.778324195Z [2024-05-25T23:23:00.778+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:23:00.778422263Z [2024-05-25T23:23:00.778+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:23:00.779216910Z [2024-05-25T23:23:00.778+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:23:00.779231519Z 2024-05-25T23:23:00.779237263Z 2024-05-25T23:23:00.779242817Z 2024-05-25T23:23:00.784310366Z [2024-05-25T23:23:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:23:00.784479621Z [2024-05-25T23:23:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:23:00.784767167Z [2024-05-25T23:23:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:23:00.784961226Z [2024-05-25T23:23:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:23:00.785050186Z [2024-05-25T23:23:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:23:00.785200529Z [2024-05-25T23:23:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:23:01.046620711Z [2024-05-25T23:23:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status queued for try_number 1 2024-05-25T23:23:01.046729868Z [2024-05-25T23:23:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status queued for try_number 1 2024-05-25T23:23:01.046765338Z [2024-05-25T23:23:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status queued for try_number 1 2024-05-25T23:23:01.054266177Z [2024-05-25T23:23:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35b352ae-271d-4890-ac3d-8ef4eb392728 2024-05-25T23:23:01.054434779Z [2024-05-25T23:23:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec7f832b-72aa-44b0-b10a-9aaabfa671de 2024-05-25T23:23:01.054663801Z [2024-05-25T23:23:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49ac412c-71c8-411d-9137-1b550dba59b7 2024-05-25T23:23:02.919999656Z [2024-05-25T23:23:02.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:23:02.920203304Z [2024-05-25T23:23:02.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:22:00+00:00, run_id=scheduled__2024-05-25T23:22:00+00:00, run_start_date=2024-05-25 23:23:00.701812+00:00, run_end_date=2024-05-25 23:23:02.919831+00:00, run_duration=2.218019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:22:00+00:00, data_interval_end=2024-05-25 23:23:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:23:02.931036937Z [2024-05-25T23:23:02.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:23:00+00:00, run_after=2024-05-25T23:24:00+00:00 2024-05-25T23:23:02.977491843Z [2024-05-25T23:23:02.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status success for try_number 1 2024-05-25T23:23:02.984848688Z [2024-05-25T23:23:02.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:22:00+00:00, map_index=-1, run_start_date=2024-05-25 23:23:01.656088+00:00, run_end_date=2024-05-25 23:23:02.018536+00:00, run_duration=0.362448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:23:00.780448+00:00, queued_by_job_id=1, pid=2957 2024-05-25T23:23:04.623240698Z [2024-05-25T23:23:04.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:23:04.623450920Z [2024-05-25T23:23:04.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:22:00+00:00, run_id=scheduled__2024-05-25T23:22:00+00:00, run_start_date=2024-05-25 23:23:00.703426+00:00, run_end_date=2024-05-25 23:23:04.623161+00:00, run_duration=3.919735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:22:00+00:00, data_interval_end=2024-05-25 23:23:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:23:04.659015104Z [2024-05-25T23:23:04.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:23:00+00:00, run_after=2024-05-25T23:24:00+00:00 2024-05-25T23:23:04.695582666Z [2024-05-25T23:23:04.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status success for try_number 1 2024-05-25T23:23:04.701098635Z [2024-05-25T23:23:04.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:22:00+00:00, map_index=-1, run_start_date=2024-05-25 23:23:02.769880+00:00, run_end_date=2024-05-25 23:23:04.459652+00:00, run_duration=1.689772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:23:00.780448+00:00, queued_by_job_id=1, pid=2976 2024-05-25T23:23:05.765929754Z [2024-05-25T23:23:05.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:23:05.766384094Z [2024-05-25T23:23:05.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:22:00+00:00, run_id=scheduled__2024-05-25T23:22:00+00:00, run_start_date=2024-05-25 23:23:00.704774+00:00, run_end_date=2024-05-25 23:23:05.765836+00:00, run_duration=5.061062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:22:00+00:00, data_interval_end=2024-05-25 23:23:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:23:05.780563181Z [2024-05-25T23:23:05.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:23:00+00:00, run_after=2024-05-25T23:24:00+00:00 2024-05-25T23:23:05.809070441Z [2024-05-25T23:23:05.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status success for try_number 1 2024-05-25T23:23:05.816949028Z [2024-05-25T23:23:05.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:22:00+00:00, map_index=-1, run_start_date=2024-05-25 23:23:02.701441+00:00, run_end_date=2024-05-25 23:23:04.970347+00:00, run_duration=2.268906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:23:00.780448+00:00, queued_by_job_id=1, pid=2975 2024-05-25T23:23:30.519981391Z [2024-05-25T23:23:30.519+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:24:00.332966129Z [2024-05-25T23:24:00.332+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:24:00.344684713Z [2024-05-25T23:24:00.344+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:24:00.375747974Z [2024-05-25T23:24:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:24:00+00:00, run_after=2024-05-25T23:25:00+00:00 2024-05-25T23:24:00.393257283Z [2024-05-25T23:24:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:24:00+00:00, run_after=2024-05-25T23:25:00+00:00 2024-05-25T23:24:00.492091595Z [2024-05-25T23:24:00.491+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:24:00.492115697Z 2024-05-25T23:24:00.492119562Z 2024-05-25T23:24:00.492122867Z 2024-05-25T23:24:00.492125914Z 2024-05-25T23:24:00.492184305Z [2024-05-25T23:24:00.491+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:24:00.492396053Z [2024-05-25T23:24:00.492+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:24:00.492562697Z [2024-05-25T23:24:00.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:24:00.492669020Z [2024-05-25T23:24:00.492+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:24:00.493436518Z [2024-05-25T23:24:00.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:24:00.493449411Z 2024-05-25T23:24:00.493453121Z 2024-05-25T23:24:00.493456535Z 2024-05-25T23:24:00.493495987Z 2024-05-25T23:24:00.498953057Z [2024-05-25T23:24:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:24:00.499122169Z [2024-05-25T23:24:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:24:00.499239596Z [2024-05-25T23:24:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:24:00.499351510Z [2024-05-25T23:24:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:24:00.499495516Z [2024-05-25T23:24:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:24:00.499706872Z [2024-05-25T23:24:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:24:00.499814732Z [2024-05-25T23:24:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:24:00.499969289Z [2024-05-25T23:24:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:24:00.877108192Z [2024-05-25T23:24:00.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status queued for try_number 1 2024-05-25T23:24:00.877147073Z [2024-05-25T23:24:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:23:00+00:00 exited with status queued for try_number 1 2024-05-25T23:24:00.877227688Z [2024-05-25T23:24:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:23:00+00:00 exited with status queued for try_number 1 2024-05-25T23:24:00.877290124Z [2024-05-25T23:24:00.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:23:00+00:00 exited with status queued for try_number 1 2024-05-25T23:24:00.900909682Z [2024-05-25T23:24:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0526536f-ed43-4c71-9f75-f504182a84e7 2024-05-25T23:24:00.900945593Z [2024-05-25T23:24:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b078291-8d1d-4a49-a97d-7cd1adc32c6e 2024-05-25T23:24:00.901075789Z [2024-05-25T23:24:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 503a4426-2aa2-4d73-ada6-3aacdb44b799 2024-05-25T23:24:00.901161992Z [2024-05-25T23:24:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3144e810-fbbb-4769-ad32-cfda1ae156aa 2024-05-25T23:24:02.230635078Z [2024-05-25T23:24:02.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:24:02.231009870Z [2024-05-25T23:24:02.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:22:00+00:00, run_id=scheduled__2024-05-25T23:22:00+00:00, run_start_date=2024-05-25 23:24:00.409079+00:00, run_end_date=2024-05-25 23:24:02.230466+00:00, run_duration=1.821387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:22:00+00:00, data_interval_end=2024-05-25 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:24:02.239468237Z [2024-05-25T23:24:02.239+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:24:00+00:00, run_after=2024-05-25T23:26:00+00:00 2024-05-25T23:24:02.246465385Z [2024-05-25T23:24:02.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:24:02.246751370Z [2024-05-25T23:24:02.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:23:00+00:00, run_id=scheduled__2024-05-25T23:23:00+00:00, run_start_date=2024-05-25 23:24:00.411148+00:00, run_end_date=2024-05-25 23:24:02.246298+00:00, run_duration=1.83515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:23:00+00:00, data_interval_end=2024-05-25 23:24:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:24:02.256894322Z [2024-05-25T23:24:02.256+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:24:00+00:00, run_after=2024-05-25T23:25:00+00:00 2024-05-25T23:24:02.350000223Z [2024-05-25T23:24:02.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:22:00+00:00 exited with status success for try_number 1 2024-05-25T23:24:02.350033271Z [2024-05-25T23:24:02.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:23:00+00:00 exited with status success for try_number 1 2024-05-25T23:24:02.358127817Z [2024-05-25T23:24:02.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:22:00+00:00, map_index=-1, run_start_date=2024-05-25 23:24:01.240458+00:00, run_end_date=2024-05-25 23:24:01.703872+00:00, run_duration=0.463414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:24:00.494451+00:00, queued_by_job_id=1, pid=3009 2024-05-25T23:24:02.358246731Z [2024-05-25T23:24:02.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:23:00+00:00, map_index=-1, run_start_date=2024-05-25 23:24:01.510468+00:00, run_end_date=2024-05-25 23:24:01.950315+00:00, run_duration=0.439847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:24:00.494451+00:00, queued_by_job_id=1, pid=3010 2024-05-25T23:24:04.576262914Z [2024-05-25T23:24:04.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:24:04.576678159Z [2024-05-25T23:24:04.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:23:00+00:00, run_id=scheduled__2024-05-25T23:23:00+00:00, run_start_date=2024-05-25 23:24:00.412655+00:00, run_end_date=2024-05-25 23:24:04.576363+00:00, run_duration=4.163708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:23:00+00:00, data_interval_end=2024-05-25 23:24:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:24:04.588807995Z [2024-05-25T23:24:04.588+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:24:00+00:00, run_after=2024-05-25T23:25:00+00:00 2024-05-25T23:24:04.599037275Z [2024-05-25T23:24:04.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:24:04.599988295Z [2024-05-25T23:24:04.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:23:00+00:00, run_id=scheduled__2024-05-25T23:23:00+00:00, run_start_date=2024-05-25 23:24:00.414033+00:00, run_end_date=2024-05-25 23:24:04.599264+00:00, run_duration=4.185231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:23:00+00:00, data_interval_end=2024-05-25 23:24:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:24:04.620402605Z [2024-05-25T23:24:04.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:24:00+00:00, run_after=2024-05-25T23:25:00+00:00 2024-05-25T23:24:04.677726618Z [2024-05-25T23:24:04.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:23:00+00:00 exited with status success for try_number 1 2024-05-25T23:24:04.678149203Z [2024-05-25T23:24:04.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:23:00+00:00 exited with status success for try_number 1 2024-05-25T23:24:04.687256028Z [2024-05-25T23:24:04.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:23:00+00:00, map_index=-1, run_start_date=2024-05-25 23:24:02.433510+00:00, run_end_date=2024-05-25 23:24:03.712032+00:00, run_duration=1.278522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:24:00.494451+00:00, queued_by_job_id=1, pid=3033 2024-05-25T23:24:04.687756194Z [2024-05-25T23:24:04.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:23:00+00:00, map_index=-1, run_start_date=2024-05-25 23:24:02.539959+00:00, run_end_date=2024-05-25 23:24:04.380516+00:00, run_duration=1.840557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:24:00.494451+00:00, queued_by_job_id=1, pid=3034 2024-05-25T23:25:00.597861914Z [2024-05-25T23:25:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:25:00+00:00, run_after=2024-05-25T23:26:00+00:00 2024-05-25T23:25:00.619958051Z [2024-05-25T23:25:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:25:00+00:00, run_after=2024-05-25T23:26:00+00:00 2024-05-25T23:25:00.639929165Z [2024-05-25T23:25:00.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:25:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:25:00.649066575Z [2024-05-25T23:25:00.648+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:25:00.765155103Z [2024-05-25T23:25:00.755+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:25:00.765176513Z 2024-05-25T23:25:00.765182656Z 2024-05-25T23:25:00.765187392Z 2024-05-25T23:25:00.765192870Z 2024-05-25T23:25:00.765197996Z [2024-05-25T23:25:00.756+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:25:00.765202994Z [2024-05-25T23:25:00.756+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:25:00.765208141Z [2024-05-25T23:25:00.756+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:25:00.765213100Z [2024-05-25T23:25:00.757+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:25:00.765220744Z [2024-05-25T23:25:00.757+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:25:00.765226001Z 2024-05-25T23:25:00.765231131Z 2024-05-25T23:25:00.765268339Z 2024-05-25T23:25:00.765274056Z 2024-05-25T23:25:00.765281254Z [2024-05-25T23:25:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:25:00.765286405Z [2024-05-25T23:25:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:25:00.765291040Z [2024-05-25T23:25:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:25:00.765329695Z [2024-05-25T23:25:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:25:00.765335372Z [2024-05-25T23:25:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:25:00.765340420Z [2024-05-25T23:25:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:25:00.765349384Z [2024-05-25T23:25:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:25:00.765354697Z [2024-05-25T23:25:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:25:01.021414412Z [2024-05-25T23:25:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:25:01.023513673Z [2024-05-25T23:25:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status queued for try_number 1 2024-05-25T23:25:01.023771790Z [2024-05-25T23:25:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status queued for try_number 1 2024-05-25T23:25:01.024004933Z [2024-05-25T23:25:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status queued for try_number 1 2024-05-25T23:25:01.031878111Z [2024-05-25T23:25:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 699d88b1-494d-4ad8-a47d-56eb332b9d90 2024-05-25T23:25:01.032291567Z [2024-05-25T23:25:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d06a23d-d070-4de1-9d68-a5f7a834e021 2024-05-25T23:25:01.032541872Z [2024-05-25T23:25:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44397030-f040-441f-be9f-d2c5015776a0 2024-05-25T23:25:01.032770404Z [2024-05-25T23:25:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac36e220-eae7-4545-8a9c-bd5cbb4f41eb 2024-05-25T23:25:02.764802515Z [2024-05-25T23:25:02.764+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:25:02.765331130Z [2024-05-25T23:25:02.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:24:00+00:00, run_id=scheduled__2024-05-25T23:24:00+00:00, run_start_date=2024-05-25 23:25:00.665168+00:00, run_end_date=2024-05-25 23:25:02.764891+00:00, run_duration=2.099723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:24:00+00:00, data_interval_end=2024-05-25 23:25:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:25:02.777955090Z [2024-05-25T23:25:02.777+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:25:00+00:00, run_after=2024-05-25T23:26:00+00:00 2024-05-25T23:25:02.830535091Z [2024-05-25T23:25:02.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status success for try_number 1 2024-05-25T23:25:02.835576643Z [2024-05-25T23:25:02.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:24:00+00:00, map_index=-1, run_start_date=2024-05-25 23:25:01.821579+00:00, run_end_date=2024-05-25 23:25:02.434347+00:00, run_duration=0.612768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:25:00.759148+00:00, queued_by_job_id=1, pid=3067 2024-05-25T23:25:03.955538593Z [2024-05-25T23:25:03.955+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:25:03.955565177Z 2024-05-25T23:25:03.955777679Z [2024-05-25T23:25:03.955+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:25:03.956687508Z [2024-05-25T23:25:03.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:25:03.956699682Z 2024-05-25T23:25:03.964558401Z [2024-05-25T23:25:03.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:25:03.964801418Z [2024-05-25T23:25:03.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:25:04.118466331Z [2024-05-25T23:25:04.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:25:04.118559821Z [2024-05-25T23:25:04.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:25:04.124318010Z [2024-05-25T23:25:04.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ce1dde9-60fc-409a-9731-149acd37b8e9 2024-05-25T23:25:04.124441210Z [2024-05-25T23:25:04.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=-1, run_start_date=2024-05-25 23:25:03.191765+00:00, run_end_date=2024-05-25 23:25:03.851650+00:00, run_duration=0.659885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:25:00.759148+00:00, queued_by_job_id=1, pid=3092 2024-05-25T23:25:05.309616104Z [2024-05-25T23:25:05.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:25:05.310038064Z [2024-05-25T23:25:05.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:24:00+00:00, run_id=scheduled__2024-05-25T23:24:00+00:00, run_start_date=2024-05-25 23:25:00.666516+00:00, run_end_date=2024-05-25 23:25:05.309705+00:00, run_duration=4.643189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:24:00+00:00, data_interval_end=2024-05-25 23:25:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:25:05.325384181Z [2024-05-25T23:25:05.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:25:00+00:00, run_after=2024-05-25T23:26:00+00:00 2024-05-25T23:25:05.332642211Z [2024-05-25T23:25:05.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:25:05.332958064Z [2024-05-25T23:25:05.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:24:00+00:00, run_id=scheduled__2024-05-25T23:24:00+00:00, run_start_date=2024-05-25 23:25:00.667814+00:00, run_end_date=2024-05-25 23:25:05.332599+00:00, run_duration=4.664785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:24:00+00:00, data_interval_end=2024-05-25 23:25:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:25:05.344867240Z [2024-05-25T23:25:05.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:25:00+00:00, run_after=2024-05-25T23:26:00+00:00 2024-05-25T23:25:05.408403947Z [2024-05-25T23:25:05.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status success for try_number 1 2024-05-25T23:25:05.408461760Z [2024-05-25T23:25:05.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status success for try_number 1 2024-05-25T23:25:05.441242401Z [2024-05-25T23:25:05.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:24:00+00:00, map_index=-1, run_start_date=2024-05-25 23:25:03.070658+00:00, run_end_date=2024-05-25 23:25:04.442032+00:00, run_duration=1.371374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:25:00.759148+00:00, queued_by_job_id=1, pid=3091 2024-05-25T23:25:05.441355485Z [2024-05-25T23:25:05.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:24:00+00:00, map_index=-1, run_start_date=2024-05-25 23:25:03.245282+00:00, run_end_date=2024-05-25 23:25:05.065656+00:00, run_duration=1.820374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:25:00.759148+00:00, queued_by_job_id=1, pid=3093 2024-05-25T23:25:06.522061109Z [2024-05-25T23:25:06.521+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:25:06.522115519Z 2024-05-25T23:25:06.522140331Z [2024-05-25T23:25:06.521+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:25:06.522796342Z [2024-05-25T23:25:06.522+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:25:06.522816998Z 2024-05-25T23:25:06.525401603Z [2024-05-25T23:25:06.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:25:06.525589371Z [2024-05-25T23:25:06.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:25:06.575684056Z [2024-05-25T23:25:06.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:25:06.575881023Z [2024-05-25T23:25:06.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:25:06.582923625Z [2024-05-25T23:25:06.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to a39281df-a9d4-4230-82c2-f7bd3d5be0f6 2024-05-25T23:25:06.583188299Z [2024-05-25T23:25:06.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=-1, run_start_date=2024-05-25 23:25:05.827161+00:00, run_end_date=2024-05-25 23:25:06.171293+00:00, run_duration=0.344132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:25:03.957394+00:00, queued_by_job_id=1, pid=3116 2024-05-25T23:25:09.312625174Z [2024-05-25T23:25:09.312+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:25:09.312664977Z 2024-05-25T23:25:09.312938805Z [2024-05-25T23:25:09.312+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:25:09.313733906Z [2024-05-25T23:25:09.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:25:09.313748162Z 2024-05-25T23:25:09.317103880Z [2024-05-25T23:25:09.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:25:09.317393790Z [2024-05-25T23:25:09.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:25:09.387782649Z [2024-05-25T23:25:09.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status queued for try_number 1 2024-05-25T23:25:09.387864846Z [2024-05-25T23:25:09.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:25:09.395686333Z [2024-05-25T23:25:09.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ec17539-abf1-4837-9eae-df96ead5e142 2024-05-25T23:25:09.396213981Z [2024-05-25T23:25:09.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=0, run_start_date=2024-05-25 23:25:08.135430+00:00, run_end_date=2024-05-25 23:25:08.486181+00:00, run_duration=0.350751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:25:06.523120+00:00, queued_by_job_id=1, pid=3124 2024-05-25T23:25:11.648341723Z [2024-05-25T23:25:11.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:25:11.648782741Z [2024-05-25T23:25:11.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:20:00+00:00, run_id=scheduled__2024-05-25T23:20:00+00:00, run_start_date=2024-05-25 23:25:00.663719+00:00, run_end_date=2024-05-25 23:25:11.648171+00:00, run_duration=10.984452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:20:00+00:00, data_interval_end=2024-05-25 23:25:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:25:11.656943369Z [2024-05-25T23:25:11.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:25:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:25:11.698728499Z [2024-05-25T23:25:11.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:20:00+00:00 exited with status success for try_number 1 2024-05-25T23:25:11.707208044Z [2024-05-25T23:25:11.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:20:00+00:00, map_index=-1, run_start_date=2024-05-25 23:25:10.912310+00:00, run_end_date=2024-05-25 23:25:11.328162+00:00, run_duration=0.415852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:25:09.314275+00:00, queued_by_job_id=1, pid=3132 2024-05-25T23:26:00.874446003Z [2024-05-25T23:26:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:26:00+00:00, run_after=2024-05-25T23:27:00+00:00 2024-05-25T23:26:00.888714071Z [2024-05-25T23:26:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:26:00+00:00, run_after=2024-05-25T23:27:00+00:00 2024-05-25T23:26:00.897068044Z [2024-05-25T23:26:00.896+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:26:00.905061627Z [2024-05-25T23:26:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:26:00.973739756Z [2024-05-25T23:26:00.973+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:26:00.973763871Z 2024-05-25T23:26:00.973768412Z 2024-05-25T23:26:00.973771969Z 2024-05-25T23:26:00.973791159Z 2024-05-25T23:26:00.973794914Z [2024-05-25T23:26:00.973+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:26:00.974120107Z [2024-05-25T23:26:00.973+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:26:00.974156240Z [2024-05-25T23:26:00.973+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:26:00.974279294Z [2024-05-25T23:26:00.974+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:26:00.974868237Z [2024-05-25T23:26:00.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:26:00.974897733Z 2024-05-25T23:26:00.974907200Z 2024-05-25T23:26:00.974915697Z 2024-05-25T23:26:00.974924422Z 2024-05-25T23:26:00.980623937Z [2024-05-25T23:26:00.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:26:00.980888604Z [2024-05-25T23:26:00.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:26:00.981203783Z [2024-05-25T23:26:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:26:00.981342660Z [2024-05-25T23:26:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:26:00.981652455Z [2024-05-25T23:26:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:26:00.981781592Z [2024-05-25T23:26:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:26:00.982041665Z [2024-05-25T23:26:00.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:26:00.982201825Z [2024-05-25T23:26:00.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:26:01.415822312Z [2024-05-25T23:26:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status queued for try_number 1 2024-05-25T23:26:01.415885285Z [2024-05-25T23:26:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status queued for try_number 1 2024-05-25T23:26:01.415889931Z [2024-05-25T23:26:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status queued for try_number 1 2024-05-25T23:26:01.415955814Z [2024-05-25T23:26:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status queued for try_number 1 2024-05-25T23:26:01.436885777Z [2024-05-25T23:26:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9ecb4c1-dcf8-4c88-9483-871b6b4cf7c2 2024-05-25T23:26:01.436983943Z [2024-05-25T23:26:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93a5d0a1-1961-4c40-aa47-5437c1244d5f 2024-05-25T23:26:01.437071603Z [2024-05-25T23:26:01.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0642acbe-e25b-4d7b-a174-50e1c7c264fa 2024-05-25T23:26:01.437168114Z [2024-05-25T23:26:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39b85a5e-5d7e-4fde-879e-49a4dde62516 2024-05-25T23:26:02.757622728Z [2024-05-25T23:26:02.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:26:02.757949004Z [2024-05-25T23:26:02.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:24:00+00:00, run_id=scheduled__2024-05-25T23:24:00+00:00, run_start_date=2024-05-25 23:26:00.917847+00:00, run_end_date=2024-05-25 23:26:02.757574+00:00, run_duration=1.839727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:24:00+00:00, data_interval_end=2024-05-25 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:26:02.765428657Z [2024-05-25T23:26:02.765+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:26:00+00:00, run_after=2024-05-25T23:28:00+00:00 2024-05-25T23:26:02.772800335Z [2024-05-25T23:26:02.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:26:02.773245000Z [2024-05-25T23:26:02.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:25:00+00:00, run_id=scheduled__2024-05-25T23:25:00+00:00, run_start_date=2024-05-25 23:26:00.919120+00:00, run_end_date=2024-05-25 23:26:02.772808+00:00, run_duration=1.853688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:25:00+00:00, data_interval_end=2024-05-25 23:26:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:26:02.785842212Z [2024-05-25T23:26:02.783+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:26:00+00:00, run_after=2024-05-25T23:27:00+00:00 2024-05-25T23:26:02.844091178Z [2024-05-25T23:26:02.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status success for try_number 1 2024-05-25T23:26:02.859405008Z [2024-05-25T23:26:02.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:25:00+00:00, map_index=-1, run_start_date=2024-05-25 23:26:01.872320+00:00, run_end_date=2024-05-25 23:26:02.399319+00:00, run_duration=0.526999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:26:00.975577+00:00, queued_by_job_id=1, pid=3155 2024-05-25T23:26:02.967317800Z [2024-05-25T23:26:02.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:24:00+00:00 exited with status success for try_number 1 2024-05-25T23:26:02.974240078Z [2024-05-25T23:26:02.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:24:00+00:00, map_index=-1, run_start_date=2024-05-25 23:26:02.122146+00:00, run_end_date=2024-05-25 23:26:02.680418+00:00, run_duration=0.558272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:26:00.975577+00:00, queued_by_job_id=1, pid=3157 2024-05-25T23:26:05.433942740Z [2024-05-25T23:26:05.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:26:05.434402969Z [2024-05-25T23:26:05.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:25:00+00:00, run_id=scheduled__2024-05-25T23:25:00+00:00, run_start_date=2024-05-25 23:26:00.920354+00:00, run_end_date=2024-05-25 23:26:05.433864+00:00, run_duration=4.51351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:25:00+00:00, data_interval_end=2024-05-25 23:26:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:26:05.444787942Z [2024-05-25T23:26:05.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:26:00+00:00, run_after=2024-05-25T23:27:00+00:00 2024-05-25T23:26:05.452862911Z [2024-05-25T23:26:05.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:26:05.453277788Z [2024-05-25T23:26:05.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:25:00+00:00, run_id=scheduled__2024-05-25T23:25:00+00:00, run_start_date=2024-05-25 23:26:00.921772+00:00, run_end_date=2024-05-25 23:26:05.452932+00:00, run_duration=4.53116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:25:00+00:00, data_interval_end=2024-05-25 23:26:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:26:05.463761090Z [2024-05-25T23:26:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:26:00+00:00, run_after=2024-05-25T23:27:00+00:00 2024-05-25T23:26:05.492217114Z [2024-05-25T23:26:05.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status success for try_number 1 2024-05-25T23:26:05.492440719Z [2024-05-25T23:26:05.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status success for try_number 1 2024-05-25T23:26:05.498441146Z [2024-05-25T23:26:05.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:25:00+00:00, map_index=-1, run_start_date=2024-05-25 23:26:02.931825+00:00, run_end_date=2024-05-25 23:26:04.331453+00:00, run_duration=1.399628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:26:00.975577+00:00, queued_by_job_id=1, pid=3174 2024-05-25T23:26:05.498702605Z [2024-05-25T23:26:05.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:25:00+00:00, map_index=-1, run_start_date=2024-05-25 23:26:03.516749+00:00, run_end_date=2024-05-25 23:26:05.076591+00:00, run_duration=1.559842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:26:00.975577+00:00, queued_by_job_id=1, pid=3185 2024-05-25T23:27:00.060177287Z [2024-05-25T23:27:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:27:00+00:00, run_after=2024-05-25T23:28:00+00:00 2024-05-25T23:27:00.066219689Z [2024-05-25T23:27:00.065+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:27:00.078062456Z [2024-05-25T23:27:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:27:00+00:00, run_after=2024-05-25T23:28:00+00:00 2024-05-25T23:27:00.154051794Z [2024-05-25T23:27:00.153+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:27:00.154077889Z 2024-05-25T23:27:00.154081955Z 2024-05-25T23:27:00.154085580Z 2024-05-25T23:27:00.154210080Z [2024-05-25T23:27:00.154+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:27:00.154371674Z [2024-05-25T23:27:00.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:27:00.154531546Z [2024-05-25T23:27:00.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:27:00.155284923Z [2024-05-25T23:27:00.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:27:00.155296208Z 2024-05-25T23:27:00.155302242Z 2024-05-25T23:27:00.155308762Z 2024-05-25T23:27:00.159280530Z [2024-05-25T23:27:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:27:00.159584894Z [2024-05-25T23:27:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:27:00.159805783Z [2024-05-25T23:27:00.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:27:00.159984484Z [2024-05-25T23:27:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:27:00.160294291Z [2024-05-25T23:27:00.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:27:00.160473893Z [2024-05-25T23:27:00.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:27:00.386330698Z [2024-05-25T23:27:00.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status queued for try_number 1 2024-05-25T23:27:00.386655915Z [2024-05-25T23:27:00.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status queued for try_number 1 2024-05-25T23:27:00.386805402Z [2024-05-25T23:27:00.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status queued for try_number 1 2024-05-25T23:27:00.396150976Z [2024-05-25T23:27:00.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to c355a1c5-977f-4dff-98db-43ee4209c544 2024-05-25T23:27:00.396302436Z [2024-05-25T23:27:00.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to c78bc61f-d162-4c7c-90a3-3ac992cf052f 2024-05-25T23:27:00.396485370Z [2024-05-25T23:27:00.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd3e1cc2-5789-460e-9faa-c7461f48e89c 2024-05-25T23:27:01.590489714Z [2024-05-25T23:27:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status success for try_number 1 2024-05-25T23:27:01.595558747Z [2024-05-25T23:27:01.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:26:00+00:00, map_index=-1, run_start_date=2024-05-25 23:27:01.083067+00:00, run_end_date=2024-05-25 23:27:01.462290+00:00, run_duration=0.379223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:27:00.156155+00:00, queued_by_job_id=1, pid=3212 2024-05-25T23:27:02.641134919Z [2024-05-25T23:27:02.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:27:02.641521994Z [2024-05-25T23:27:02.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:26:00+00:00, run_id=scheduled__2024-05-25T23:26:00+00:00, run_start_date=2024-05-25 23:27:00.087524+00:00, run_end_date=2024-05-25 23:27:02.640905+00:00, run_duration=2.553381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:26:00+00:00, data_interval_end=2024-05-25 23:27:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:27:02.658321312Z [2024-05-25T23:27:02.657+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:27:00+00:00, run_after=2024-05-25T23:28:00+00:00 2024-05-25T23:27:03.640799353Z [2024-05-25T23:27:03.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:27:03.641167072Z [2024-05-25T23:27:03.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:26:00+00:00, run_id=scheduled__2024-05-25T23:26:00+00:00, run_start_date=2024-05-25 23:27:00.088711+00:00, run_end_date=2024-05-25 23:27:03.640701+00:00, run_duration=3.55199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:26:00+00:00, data_interval_end=2024-05-25 23:27:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:27:03.650642170Z [2024-05-25T23:27:03.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:27:00+00:00, run_after=2024-05-25T23:28:00+00:00 2024-05-25T23:27:03.688689003Z [2024-05-25T23:27:03.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status success for try_number 1 2024-05-25T23:27:03.693567120Z [2024-05-25T23:27:03.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:26:00+00:00, map_index=-1, run_start_date=2024-05-25 23:27:02.052506+00:00, run_end_date=2024-05-25 23:27:03.288754+00:00, run_duration=1.236248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:27:00.156155+00:00, queued_by_job_id=1, pid=3230 2024-05-25T23:27:03.835424799Z [2024-05-25T23:27:03.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:27:03.835587680Z [2024-05-25T23:27:03.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:26:00+00:00, run_id=scheduled__2024-05-25T23:26:00+00:00, run_start_date=2024-05-25 23:27:00.090093+00:00, run_end_date=2024-05-25 23:27:03.835318+00:00, run_duration=3.745225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:26:00+00:00, data_interval_end=2024-05-25 23:27:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:27:03.846628613Z [2024-05-25T23:27:03.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:27:00+00:00, run_after=2024-05-25T23:28:00+00:00 2024-05-25T23:27:03.874095908Z [2024-05-25T23:27:03.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status success for try_number 1 2024-05-25T23:27:03.878637061Z [2024-05-25T23:27:03.878+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:26:00+00:00, map_index=-1, run_start_date=2024-05-25 23:27:02.059658+00:00, run_end_date=2024-05-25 23:27:03.628172+00:00, run_duration=1.568514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:27:00.156155+00:00, queued_by_job_id=1, pid=3231 2024-05-25T23:28:00.616869768Z [2024-05-25T23:28:00.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:28:00+00:00, run_after=2024-05-25T23:29:00+00:00 2024-05-25T23:28:00.631922033Z [2024-05-25T23:28:00.631+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:28:00.658046639Z [2024-05-25T23:28:00.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:28:00+00:00, run_after=2024-05-25T23:29:00+00:00 2024-05-25T23:28:00.671282614Z [2024-05-25T23:28:00.670+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:28:00.779647462Z [2024-05-25T23:28:00.778+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:28:00.779681654Z 2024-05-25T23:28:00.779692258Z 2024-05-25T23:28:00.779699243Z 2024-05-25T23:28:00.779705750Z 2024-05-25T23:28:00.779712851Z [2024-05-25T23:28:00.778+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:28:00.779720303Z [2024-05-25T23:28:00.779+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:28:00.779726807Z [2024-05-25T23:28:00.779+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:28:00.779904433Z [2024-05-25T23:28:00.779+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:28:00.780568882Z [2024-05-25T23:28:00.780+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:28:00.780577867Z 2024-05-25T23:28:00.780583249Z 2024-05-25T23:28:00.780588488Z 2024-05-25T23:28:00.780598323Z 2024-05-25T23:28:00.785018318Z [2024-05-25T23:28:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:28:00.785289713Z [2024-05-25T23:28:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:28:00.785567185Z [2024-05-25T23:28:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:28:00.785736913Z [2024-05-25T23:28:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:28:00.786171947Z [2024-05-25T23:28:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:28:00.786421634Z [2024-05-25T23:28:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:28:00.786693658Z [2024-05-25T23:28:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:28:00.786856432Z [2024-05-25T23:28:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:28:01.160663323Z [2024-05-25T23:28:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status queued for try_number 1 2024-05-25T23:28:01.160728554Z [2024-05-25T23:28:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:27:00+00:00 exited with status queued for try_number 1 2024-05-25T23:28:01.160840097Z [2024-05-25T23:28:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:27:00+00:00 exited with status queued for try_number 1 2024-05-25T23:28:01.160909313Z [2024-05-25T23:28:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:27:00+00:00 exited with status queued for try_number 1 2024-05-25T23:28:01.172753504Z [2024-05-25T23:28:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42970aa4-5912-4f19-a170-4a63e477bdb7 2024-05-25T23:28:01.172777527Z [2024-05-25T23:28:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3bfdc6b-8476-4846-9931-80db0c18f58a 2024-05-25T23:28:01.172928949Z [2024-05-25T23:28:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e82177e-e54a-4ea3-b53b-ad528d0fb1bb 2024-05-25T23:28:01.173017852Z [2024-05-25T23:28:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to d272b0b7-f860-41f4-babb-a81c420d1a74 2024-05-25T23:28:02.409040674Z [2024-05-25T23:28:02.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:28:02.409258496Z [2024-05-25T23:28:02.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:26:00+00:00, run_id=scheduled__2024-05-25T23:26:00+00:00, run_start_date=2024-05-25 23:28:00.686744+00:00, run_end_date=2024-05-25 23:28:02.408965+00:00, run_duration=1.722221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:26:00+00:00, data_interval_end=2024-05-25 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:28:02.431856129Z [2024-05-25T23:28:02.431+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:28:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:28:02.507583555Z [2024-05-25T23:28:02.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:26:00+00:00 exited with status success for try_number 1 2024-05-25T23:28:02.507989601Z [2024-05-25T23:28:02.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:27:00+00:00 exited with status success for try_number 1 2024-05-25T23:28:02.519455061Z [2024-05-25T23:28:02.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:26:00+00:00, map_index=-1, run_start_date=2024-05-25 23:28:01.494198+00:00, run_end_date=2024-05-25 23:28:01.907488+00:00, run_duration=0.41329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:28:00.781998+00:00, queued_by_job_id=1, pid=3259 2024-05-25T23:28:02.519896804Z [2024-05-25T23:28:02.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:27:00+00:00, map_index=-1, run_start_date=2024-05-25 23:28:01.837582+00:00, run_end_date=2024-05-25 23:28:02.289631+00:00, run_duration=0.452049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:28:00.781998+00:00, queued_by_job_id=1, pid=3270 2024-05-25T23:28:03.581192841Z [2024-05-25T23:28:03.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:28:03.581752147Z [2024-05-25T23:28:03.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:27:00+00:00, run_id=scheduled__2024-05-25T23:27:00+00:00, run_start_date=2024-05-25 23:28:00.688579+00:00, run_end_date=2024-05-25 23:28:03.581267+00:00, run_duration=2.892688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:27:00+00:00, data_interval_end=2024-05-25 23:28:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:28:03.594433575Z [2024-05-25T23:28:03.594+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:28:00+00:00, run_after=2024-05-25T23:29:00+00:00 2024-05-25T23:28:04.106095976Z [2024-05-25T23:28:04.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:28:04.106582930Z [2024-05-25T23:28:04.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:27:00+00:00, run_id=scheduled__2024-05-25T23:27:00+00:00, run_start_date=2024-05-25 23:28:00.690187+00:00, run_end_date=2024-05-25 23:28:04.106170+00:00, run_duration=3.415983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:27:00+00:00, data_interval_end=2024-05-25 23:28:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:28:04.125906024Z [2024-05-25T23:28:04.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:28:00+00:00, run_after=2024-05-25T23:29:00+00:00 2024-05-25T23:28:04.821861850Z [2024-05-25T23:28:04.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:28:04.823677263Z [2024-05-25T23:28:04.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:27:00+00:00, run_id=scheduled__2024-05-25T23:27:00+00:00, run_start_date=2024-05-25 23:28:00.691715+00:00, run_end_date=2024-05-25 23:28:04.823109+00:00, run_duration=4.131394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:27:00+00:00, data_interval_end=2024-05-25 23:28:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:28:04.838371545Z [2024-05-25T23:28:04.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:28:00+00:00, run_after=2024-05-25T23:29:00+00:00 2024-05-25T23:28:04.903778480Z [2024-05-25T23:28:04.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:27:00+00:00 exited with status success for try_number 1 2024-05-25T23:28:04.909040754Z [2024-05-25T23:28:04.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:27:00+00:00, map_index=-1, run_start_date=2024-05-25 23:28:02.783966+00:00, run_end_date=2024-05-25 23:28:04.031164+00:00, run_duration=1.247198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:28:00.781998+00:00, queued_by_job_id=1, pid=3283 2024-05-25T23:28:06.034034254Z [2024-05-25T23:28:06.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:27:00+00:00 exited with status success for try_number 1 2024-05-25T23:28:06.039858292Z [2024-05-25T23:28:06.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:27:00+00:00, map_index=-1, run_start_date=2024-05-25 23:28:03.078819+00:00, run_end_date=2024-05-25 23:28:04.728629+00:00, run_duration=1.64981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:28:00.781998+00:00, queued_by_job_id=1, pid=3294 2024-05-25T23:28:30.586320735Z [2024-05-25T23:28:30.585+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:29:00.758350257Z [2024-05-25T23:29:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:29:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:29:00.771245323Z [2024-05-25T23:29:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:29:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:29:00.777930114Z [2024-05-25T23:29:00.777+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:29:00.840716841Z [2024-05-25T23:29:00.840+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:29:00.840755455Z 2024-05-25T23:29:00.840760802Z 2024-05-25T23:29:00.840765475Z 2024-05-25T23:29:00.841145447Z [2024-05-25T23:29:00.840+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:29:00.841663425Z [2024-05-25T23:29:00.841+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:29:00.841765984Z [2024-05-25T23:29:00.841+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:29:00.842411654Z [2024-05-25T23:29:00.842+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:29:00.842423221Z 2024-05-25T23:29:00.842428232Z 2024-05-25T23:29:00.842432574Z 2024-05-25T23:29:00.846387329Z [2024-05-25T23:29:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:29:00.846634232Z [2024-05-25T23:29:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:29:00.846951050Z [2024-05-25T23:29:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:29:00.847055232Z [2024-05-25T23:29:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:29:00.847410973Z [2024-05-25T23:29:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:29:00.847635606Z [2024-05-25T23:29:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:29:01.098830377Z [2024-05-25T23:29:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status queued for try_number 1 2024-05-25T23:29:01.098904821Z [2024-05-25T23:29:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status queued for try_number 1 2024-05-25T23:29:01.099079778Z [2024-05-25T23:29:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status queued for try_number 1 2024-05-25T23:29:01.110471944Z [2024-05-25T23:29:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee231098-cbe1-46fe-aa29-8a2488f0ef46 2024-05-25T23:29:01.110643264Z [2024-05-25T23:29:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 339946d1-18f5-494b-b577-89325ec303bb 2024-05-25T23:29:01.110838767Z [2024-05-25T23:29:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78fa69ef-ca9d-4db6-bed2-899904add775 2024-05-25T23:29:02.561003291Z [2024-05-25T23:29:02.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:29:02.561418290Z [2024-05-25T23:29:02.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:28:00+00:00, run_id=scheduled__2024-05-25T23:28:00+00:00, run_start_date=2024-05-25 23:29:00.786749+00:00, run_end_date=2024-05-25 23:29:02.561054+00:00, run_duration=1.774305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:28:00+00:00, data_interval_end=2024-05-25 23:29:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:29:02.572326427Z [2024-05-25T23:29:02.572+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:29:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:29:02.624351276Z [2024-05-25T23:29:02.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status success for try_number 1 2024-05-25T23:29:02.630840718Z [2024-05-25T23:29:02.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:28:00+00:00, map_index=-1, run_start_date=2024-05-25 23:29:01.690911+00:00, run_end_date=2024-05-25 23:29:02.170664+00:00, run_duration=0.479753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:29:00.843529+00:00, queued_by_job_id=1, pid=3320 2024-05-25T23:29:05.674583133Z [2024-05-25T23:29:05.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:29:05.674646194Z [2024-05-25T23:29:05.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:28:00+00:00, run_id=scheduled__2024-05-25T23:28:00+00:00, run_start_date=2024-05-25 23:29:00.788749+00:00, run_end_date=2024-05-25 23:29:05.673663+00:00, run_duration=4.884914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:28:00+00:00, data_interval_end=2024-05-25 23:29:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:29:05.688734717Z [2024-05-25T23:29:05.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:29:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:29:05.697889105Z [2024-05-25T23:29:05.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:29:05.700541282Z [2024-05-25T23:29:05.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:28:00+00:00, run_id=scheduled__2024-05-25T23:28:00+00:00, run_start_date=2024-05-25 23:29:00.787844+00:00, run_end_date=2024-05-25 23:29:05.697992+00:00, run_duration=4.910148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:28:00+00:00, data_interval_end=2024-05-25 23:29:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:29:05.712768980Z [2024-05-25T23:29:05.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:29:00+00:00, run_after=2024-05-25T23:30:00+00:00 2024-05-25T23:29:05.747009333Z [2024-05-25T23:29:05.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status success for try_number 1 2024-05-25T23:29:05.747390703Z [2024-05-25T23:29:05.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status success for try_number 1 2024-05-25T23:29:05.756291405Z [2024-05-25T23:29:05.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:28:00+00:00, map_index=-1, run_start_date=2024-05-25 23:29:02.687848+00:00, run_end_date=2024-05-25 23:29:05.249077+00:00, run_duration=2.561229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:29:00.843529+00:00, queued_by_job_id=1, pid=3338 2024-05-25T23:29:05.756759228Z [2024-05-25T23:29:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:28:00+00:00, map_index=-1, run_start_date=2024-05-25 23:29:02.774220+00:00, run_end_date=2024-05-25 23:29:04.908758+00:00, run_duration=2.134538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:29:00.843529+00:00, queued_by_job_id=1, pid=3339 2024-05-25T23:30:00.198021880Z [2024-05-25T23:30:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:35:00+00:00 2024-05-25T23:30:00.209240021Z [2024-05-25T23:30:00.208+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:30:00.226349717Z [2024-05-25T23:30:00.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:31:00+00:00 2024-05-25T23:30:00.240188539Z [2024-05-25T23:30:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:31:00+00:00 2024-05-25T23:30:00.246723031Z [2024-05-25T23:30:00.246+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:30:00.333981150Z [2024-05-25T23:30:00.333+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T23:30:00.334002598Z 2024-05-25T23:30:00.334006200Z 2024-05-25T23:30:00.334027053Z 2024-05-25T23:30:00.334030833Z 2024-05-25T23:30:00.334033988Z 2024-05-25T23:30:00.334243928Z [2024-05-25T23:30:00.333+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:30:00.334500042Z [2024-05-25T23:30:00.334+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:30:00.334668731Z [2024-05-25T23:30:00.334+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:30:00.334881476Z [2024-05-25T23:30:00.334+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:30:00.335078944Z [2024-05-25T23:30:00.334+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:30:00.336204165Z [2024-05-25T23:30:00.335+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:30:00.336214637Z 2024-05-25T23:30:00.336218365Z 2024-05-25T23:30:00.336221643Z 2024-05-25T23:30:00.336224649Z 2024-05-25T23:30:00.336228106Z 2024-05-25T23:30:00.342351932Z [2024-05-25T23:30:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:30:00.342567235Z [2024-05-25T23:30:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:30:00.342851798Z [2024-05-25T23:30:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:30:00.343015866Z [2024-05-25T23:30:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:30:00.343298609Z [2024-05-25T23:30:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:30:00.343405783Z [2024-05-25T23:30:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:30:00.343797937Z [2024-05-25T23:30:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:30:00.343910307Z [2024-05-25T23:30:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:30:00.344175870Z [2024-05-25T23:30:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:30:00.344303261Z [2024-05-25T23:30:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:30:01.280491372Z [2024-05-25T23:30:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:01.280552361Z [2024-05-25T23:30:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:01.280595257Z [2024-05-25T23:30:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:29:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:01.280832549Z [2024-05-25T23:30:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:29:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:01.280939692Z [2024-05-25T23:30:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:29:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:01.296980184Z [2024-05-25T23:30:01.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3373fce6-f82a-4448-88da-74bbb16c2ebc 2024-05-25T23:30:01.297128668Z [2024-05-25T23:30:01.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16122c97-8f1d-4968-9696-203928f17524 2024-05-25T23:30:01.297231139Z [2024-05-25T23:30:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fb2a256-c436-4d67-9a65-8ce0be6e3265 2024-05-25T23:30:01.297335985Z [2024-05-25T23:30:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39ced4e4-e2c6-46b2-8125-9aa4437650a0 2024-05-25T23:30:01.297415260Z [2024-05-25T23:30:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2eb0a566-52e5-477b-aed4-a7fcb16051a7 2024-05-25T23:30:02.093819013Z [2024-05-25T23:30:02.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:30:02.094231844Z [2024-05-25T23:30:02.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:28:00+00:00, run_id=scheduled__2024-05-25T23:28:00+00:00, run_start_date=2024-05-25 23:30:00.258651+00:00, run_end_date=2024-05-25 23:30:02.093859+00:00, run_duration=1.835208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:28:00+00:00, data_interval_end=2024-05-25 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:30:02.107427407Z [2024-05-25T23:30:02.107+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:32:00+00:00 2024-05-25T23:30:02.122581612Z [2024-05-25T23:30:02.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:30:02.123819671Z [2024-05-25T23:30:02.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:29:00+00:00, run_id=scheduled__2024-05-25T23:29:00+00:00, run_start_date=2024-05-25 23:30:00.259760+00:00, run_end_date=2024-05-25 23:30:02.123446+00:00, run_duration=1.863686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:29:00+00:00, data_interval_end=2024-05-25 23:30:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:30:02.140908382Z [2024-05-25T23:30:02.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:31:00+00:00 2024-05-25T23:30:02.239083610Z [2024-05-25T23:30:02.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:28:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:02.247700217Z [2024-05-25T23:30:02.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:28:00+00:00, map_index=-1, run_start_date=2024-05-25 23:30:01.409985+00:00, run_end_date=2024-05-25 23:30:01.858832+00:00, run_duration=0.448847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:00.337782+00:00, queued_by_job_id=1, pid=3373 2024-05-25T23:30:03.359298433Z [2024-05-25T23:30:03.357+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:30:03.359322062Z 2024-05-25T23:30:03.359593031Z [2024-05-25T23:30:03.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:30:03.363368119Z [2024-05-25T23:30:03.363+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:30:03.363385217Z 2024-05-25T23:30:03.368850913Z [2024-05-25T23:30:03.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:30:03.369461526Z [2024-05-25T23:30:03.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:30:03.540676201Z [2024-05-25T23:30:03.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:03.541446750Z [2024-05-25T23:30:03.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:03.541685264Z [2024-05-25T23:30:03.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:29:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:03.577757092Z [2024-05-25T23:30:03.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:29:00+00:00, map_index=-1, run_start_date=2024-05-25 23:30:01.606945+00:00, run_end_date=2024-05-25 23:30:02.078685+00:00, run_duration=0.47174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:00.337782+00:00, queued_by_job_id=1, pid=3374 2024-05-25T23:30:03.578393313Z [2024-05-25T23:30:03.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:25:00+00:00, map_index=-1, run_start_date=2024-05-25 23:30:02.769744+00:00, run_end_date=2024-05-25 23:30:03.108006+00:00, run_duration=0.338262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:00.337782+00:00, queued_by_job_id=1, pid=3398 2024-05-25T23:30:03.578904411Z [2024-05-25T23:30:03.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea924f3a-21e6-4223-9e6e-01579edb4715 2024-05-25T23:30:04.778757761Z [2024-05-25T23:30:04.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:30:04.779160393Z [2024-05-25T23:30:04.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:29:00+00:00, run_id=scheduled__2024-05-25T23:29:00+00:00, run_start_date=2024-05-25 23:30:00.260882+00:00, run_end_date=2024-05-25 23:30:04.778684+00:00, run_duration=4.517802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:29:00+00:00, data_interval_end=2024-05-25 23:30:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:30:04.789218617Z [2024-05-25T23:30:04.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:31:00+00:00 2024-05-25T23:30:04.849867055Z [2024-05-25T23:30:04.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:29:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:04.859475583Z [2024-05-25T23:30:04.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:29:00+00:00, map_index=-1, run_start_date=2024-05-25 23:30:02.781577+00:00, run_end_date=2024-05-25 23:30:04.156626+00:00, run_duration=1.375049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:00.337782+00:00, queued_by_job_id=1, pid=3399 2024-05-25T23:30:06.167982754Z [2024-05-25T23:30:06.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:30:06.168285148Z [2024-05-25T23:30:06.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:29:00+00:00, run_id=scheduled__2024-05-25T23:29:00+00:00, run_start_date=2024-05-25 23:30:00.261940+00:00, run_end_date=2024-05-25 23:30:06.167975+00:00, run_duration=5.906035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:29:00+00:00, data_interval_end=2024-05-25 23:30:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:30:06.177747056Z [2024-05-25T23:30:06.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:31:00+00:00 2024-05-25T23:30:06.220169789Z [2024-05-25T23:30:06.219+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:30:06.220222430Z 2024-05-25T23:30:06.220267215Z [2024-05-25T23:30:06.220+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:30:06.221071351Z [2024-05-25T23:30:06.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:30:06.221084111Z 2024-05-25T23:30:06.224214493Z [2024-05-25T23:30:06.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:30:06.224445411Z [2024-05-25T23:30:06.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:30:06.275885112Z [2024-05-25T23:30:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:06.276205952Z [2024-05-25T23:30:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:29:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:06.276414203Z [2024-05-25T23:30:06.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:06.286167809Z [2024-05-25T23:30:06.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:29:00+00:00, map_index=-1, run_start_date=2024-05-25 23:30:03.362060+00:00, run_end_date=2024-05-25 23:30:05.066792+00:00, run_duration=1.704732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:00.337782+00:00, queued_by_job_id=1, pid=3415 2024-05-25T23:30:06.286473348Z [2024-05-25T23:30:06.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:25:00+00:00, map_index=-1, run_start_date=2024-05-25 23:30:05.491341+00:00, run_end_date=2024-05-25 23:30:05.949394+00:00, run_duration=0.458053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:03.364224+00:00, queued_by_job_id=1, pid=3428 2024-05-25T23:30:06.286793821Z [2024-05-25T23:30:06.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16353ef1-ce61-4a4c-8592-b7acac1b9995 2024-05-25T23:30:08.463714639Z [2024-05-25T23:30:08.463+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:30:08.463759917Z 2024-05-25T23:30:08.463851069Z [2024-05-25T23:30:08.463+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:30:08.464435502Z [2024-05-25T23:30:08.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:30:08.464445641Z 2024-05-25T23:30:08.466467314Z [2024-05-25T23:30:08.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:30:08.466575586Z [2024-05-25T23:30:08.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:30:08.543372473Z [2024-05-25T23:30:08.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status queued for try_number 1 2024-05-25T23:30:08.549083793Z [2024-05-25T23:30:08.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18e441cd-9863-4ca1-b753-39336f28142d 2024-05-25T23:30:08.628179100Z [2024-05-25T23:30:08.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:08.634249417Z [2024-05-25T23:30:08.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:25:00+00:00, map_index=0, run_start_date=2024-05-25 23:30:08.039404+00:00, run_end_date=2024-05-25 23:30:08.422967+00:00, run_duration=0.383563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:06.221617+00:00, queued_by_job_id=1, pid=3436 2024-05-25T23:30:10.780910617Z [2024-05-25T23:30:10.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:30:10.780943120Z [2024-05-25T23:30:10.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:25:00+00:00, run_id=scheduled__2024-05-25T23:25:00+00:00, run_start_date=2024-05-25 23:30:00.257330+00:00, run_end_date=2024-05-25 23:30:10.779960+00:00, run_duration=10.52263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:25:00+00:00, data_interval_end=2024-05-25 23:30:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:30:10.787635072Z [2024-05-25T23:30:10.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:30:00+00:00, run_after=2024-05-25T23:35:00+00:00 2024-05-25T23:30:10.819847472Z [2024-05-25T23:30:10.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:25:00+00:00 exited with status success for try_number 1 2024-05-25T23:30:10.825142782Z [2024-05-25T23:30:10.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:25:00+00:00, map_index=-1, run_start_date=2024-05-25 23:30:10.040795+00:00, run_end_date=2024-05-25 23:30:10.389492+00:00, run_duration=0.348697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:30:08.464754+00:00, queued_by_job_id=1, pid=3444 2024-05-25T23:31:00.248892273Z [2024-05-25T23:31:00.248+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:31:00.264424298Z [2024-05-25T23:31:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:31:00+00:00, run_after=2024-05-25T23:32:00+00:00 2024-05-25T23:31:00.276865965Z [2024-05-25T23:31:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:31:00+00:00, run_after=2024-05-25T23:32:00+00:00 2024-05-25T23:31:00.372046343Z [2024-05-25T23:31:00.371+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:31:00.372128402Z 2024-05-25T23:31:00.372137747Z 2024-05-25T23:31:00.372144412Z 2024-05-25T23:31:00.372226608Z [2024-05-25T23:31:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:31:00.372274513Z [2024-05-25T23:31:00.372+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:31:00.372748761Z [2024-05-25T23:31:00.372+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:31:00.373346742Z [2024-05-25T23:31:00.373+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:31:00.373359712Z 2024-05-25T23:31:00.373366719Z 2024-05-25T23:31:00.373373249Z 2024-05-25T23:31:00.377505664Z [2024-05-25T23:31:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:31:00.377625537Z [2024-05-25T23:31:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:31:00.377933680Z [2024-05-25T23:31:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:31:00.377989502Z [2024-05-25T23:31:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:31:00.378375868Z [2024-05-25T23:31:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:31:00.378414971Z [2024-05-25T23:31:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:31:00.616287964Z [2024-05-25T23:31:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:31:00.616362424Z [2024-05-25T23:31:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:31:00.616478130Z [2024-05-25T23:31:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:31:00.623981565Z [2024-05-25T23:31:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61438258-b9a9-4689-b9c1-c04e4552bf79 2024-05-25T23:31:00.624040454Z [2024-05-25T23:31:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to cec2fb26-bcf7-4f03-bf71-b760e7d42b6b 2024-05-25T23:31:00.624175449Z [2024-05-25T23:31:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f12a02b-8352-4fa1-876b-3aee52e6d694 2024-05-25T23:31:01.814013248Z [2024-05-25T23:31:01.813+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:31:01.815482898Z [2024-05-25T23:31:01.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:30:00+00:00, run_id=scheduled__2024-05-25T23:30:00+00:00, run_start_date=2024-05-25 23:31:00.286462+00:00, run_end_date=2024-05-25 23:31:01.813929+00:00, run_duration=1.527467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:30:00+00:00, data_interval_end=2024-05-25 23:31:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:31:01.836674839Z [2024-05-25T23:31:01.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:31:00+00:00, run_after=2024-05-25T23:32:00+00:00 2024-05-25T23:31:01.897026631Z [2024-05-25T23:31:01.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:31:01.906012562Z [2024-05-25T23:31:01.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=-1, run_start_date=2024-05-25 23:31:01.243756+00:00, run_end_date=2024-05-25 23:31:01.688640+00:00, run_duration=0.444884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:31:00.374066+00:00, queued_by_job_id=1, pid=3466 2024-05-25T23:31:05.386706633Z [2024-05-25T23:31:05.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:31:05.387066052Z [2024-05-25T23:31:05.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:30:00+00:00, run_id=scheduled__2024-05-25T23:30:00+00:00, run_start_date=2024-05-25 23:31:00.289431+00:00, run_end_date=2024-05-25 23:31:05.386595+00:00, run_duration=5.097164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:30:00+00:00, data_interval_end=2024-05-25 23:31:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:31:05.401550182Z [2024-05-25T23:31:05.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:31:00+00:00, run_after=2024-05-25T23:32:00+00:00 2024-05-25T23:31:05.410400509Z [2024-05-25T23:31:05.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:31:05.410431029Z [2024-05-25T23:31:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:30:00+00:00, run_id=scheduled__2024-05-25T23:30:00+00:00, run_start_date=2024-05-25 23:31:00.288263+00:00, run_end_date=2024-05-25 23:31:05.409436+00:00, run_duration=5.121173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:30:00+00:00, data_interval_end=2024-05-25 23:31:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:31:05.420868898Z [2024-05-25T23:31:05.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:31:00+00:00, run_after=2024-05-25T23:32:00+00:00 2024-05-25T23:31:05.450654715Z [2024-05-25T23:31:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:31:05.450751439Z [2024-05-25T23:31:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:31:05.459570368Z [2024-05-25T23:31:05.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=-1, run_start_date=2024-05-25 23:31:02.277496+00:00, run_end_date=2024-05-25 23:31:04.989436+00:00, run_duration=2.71194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:31:00.374066+00:00, queued_by_job_id=1, pid=3484 2024-05-25T23:31:05.459751372Z [2024-05-25T23:31:05.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=-1, run_start_date=2024-05-25 23:31:02.406289+00:00, run_end_date=2024-05-25 23:31:04.962467+00:00, run_duration=2.556178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:31:00.374066+00:00, queued_by_job_id=1, pid=3485 2024-05-25T23:32:00.115795578Z [2024-05-25T23:32:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:32:00+00:00, run_after=2024-05-25T23:33:00+00:00 2024-05-25T23:32:00.135100790Z [2024-05-25T23:32:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:32:00+00:00, run_after=2024-05-25T23:33:00+00:00 2024-05-25T23:32:00.147984663Z [2024-05-25T23:32:00.147+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:32:00.159143382Z [2024-05-25T23:32:00.158+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:32:00.269728342Z [2024-05-25T23:32:00.268+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:32:00.269752509Z 2024-05-25T23:32:00.269756732Z 2024-05-25T23:32:00.269760026Z 2024-05-25T23:32:00.269763282Z 2024-05-25T23:32:00.270114609Z [2024-05-25T23:32:00.269+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:32:00.270448178Z [2024-05-25T23:32:00.270+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:32:00.270805932Z [2024-05-25T23:32:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:32:00.271132964Z [2024-05-25T23:32:00.270+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:32:00.272958639Z [2024-05-25T23:32:00.272+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:32:00.272977267Z 2024-05-25T23:32:00.273006696Z 2024-05-25T23:32:00.273013301Z 2024-05-25T23:32:00.273019629Z 2024-05-25T23:32:00.278022438Z [2024-05-25T23:32:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:32:00.278350082Z [2024-05-25T23:32:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:32:00.278734933Z [2024-05-25T23:32:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:32:00.278939250Z [2024-05-25T23:32:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:32:00.279304120Z [2024-05-25T23:32:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:32:00.279573657Z [2024-05-25T23:32:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:32:00.279983680Z [2024-05-25T23:32:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:32:00.280239204Z [2024-05-25T23:32:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:32:00.600114149Z [2024-05-25T23:32:00.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:32:00.600294460Z [2024-05-25T23:32:00.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:31:00+00:00 exited with status queued for try_number 1 2024-05-25T23:32:00.600440759Z [2024-05-25T23:32:00.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:31:00+00:00 exited with status queued for try_number 1 2024-05-25T23:32:00.600581727Z [2024-05-25T23:32:00.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:31:00+00:00 exited with status queued for try_number 1 2024-05-25T23:32:00.620902879Z [2024-05-25T23:32:00.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e5726ea-6144-43ea-95c7-7e6d602e8aff 2024-05-25T23:32:00.623877830Z [2024-05-25T23:32:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8439643a-58be-44d2-97dd-67ccbc163d6f 2024-05-25T23:32:00.624054255Z [2024-05-25T23:32:00.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to a786ea06-4ea4-4919-af29-129ce2434ab8 2024-05-25T23:32:00.624186591Z [2024-05-25T23:32:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7388df55-a535-4e24-a215-eb0da69547bc 2024-05-25T23:32:01.839350066Z [2024-05-25T23:32:01.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:32:01.842555861Z [2024-05-25T23:32:01.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:30:00+00:00, run_id=scheduled__2024-05-25T23:30:00+00:00, run_start_date=2024-05-25 23:32:00.175996+00:00, run_end_date=2024-05-25 23:32:01.841948+00:00, run_duration=1.665952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:30:00+00:00, data_interval_end=2024-05-25 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:32:01.856421533Z [2024-05-25T23:32:01.855+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:32:00+00:00, run_after=2024-05-25T23:34:00+00:00 2024-05-25T23:32:01.865229046Z [2024-05-25T23:32:01.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:32:01.865248888Z [2024-05-25T23:32:01.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:31:00+00:00, run_id=scheduled__2024-05-25T23:31:00+00:00, run_start_date=2024-05-25 23:32:00.177373+00:00, run_end_date=2024-05-25 23:32:01.863992+00:00, run_duration=1.686619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:31:00+00:00, data_interval_end=2024-05-25 23:32:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:32:01.875424334Z [2024-05-25T23:32:01.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:32:00+00:00, run_after=2024-05-25T23:33:00+00:00 2024-05-25T23:32:01.918400376Z [2024-05-25T23:32:01.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:31:00+00:00 exited with status success for try_number 1 2024-05-25T23:32:01.926448459Z [2024-05-25T23:32:01.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:31:00+00:00, map_index=-1, run_start_date=2024-05-25 23:32:01.190349+00:00, run_end_date=2024-05-25 23:32:01.731690+00:00, run_duration=0.541341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:32:00.274354+00:00, queued_by_job_id=1, pid=3519 2024-05-25T23:32:02.539224541Z [2024-05-25T23:32:02.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:32:02.549008722Z [2024-05-25T23:32:02.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=-1, run_start_date=2024-05-25 23:32:01.254639+00:00, run_end_date=2024-05-25 23:32:01.773307+00:00, run_duration=0.518668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:32:00.274354+00:00, queued_by_job_id=1, pid=3520 2024-05-25T23:32:04.104457015Z [2024-05-25T23:32:04.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:32:04.104482533Z [2024-05-25T23:32:04.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:31:00+00:00, run_id=scheduled__2024-05-25T23:31:00+00:00, run_start_date=2024-05-25 23:32:00.178435+00:00, run_end_date=2024-05-25 23:32:04.104110+00:00, run_duration=3.925675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:31:00+00:00, data_interval_end=2024-05-25 23:32:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:32:04.116528995Z [2024-05-25T23:32:04.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:32:00+00:00, run_after=2024-05-25T23:33:00+00:00 2024-05-25T23:32:04.126352152Z [2024-05-25T23:32:04.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:32:04.126717049Z [2024-05-25T23:32:04.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:31:00+00:00, run_id=scheduled__2024-05-25T23:31:00+00:00, run_start_date=2024-05-25 23:32:00.179302+00:00, run_end_date=2024-05-25 23:32:04.126386+00:00, run_duration=3.947084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:31:00+00:00, data_interval_end=2024-05-25 23:32:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:32:04.135456948Z [2024-05-25T23:32:04.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:32:00+00:00, run_after=2024-05-25T23:33:00+00:00 2024-05-25T23:32:04.202646680Z [2024-05-25T23:32:04.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:31:00+00:00 exited with status success for try_number 1 2024-05-25T23:32:04.208289286Z [2024-05-25T23:32:04.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:31:00+00:00, map_index=-1, run_start_date=2024-05-25 23:32:02.460636+00:00, run_end_date=2024-05-25 23:32:03.777193+00:00, run_duration=1.316557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:32:00.274354+00:00, queued_by_job_id=1, pid=3544 2024-05-25T23:32:05.285390357Z [2024-05-25T23:32:05.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:31:00+00:00 exited with status success for try_number 1 2024-05-25T23:32:05.293045387Z [2024-05-25T23:32:05.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:31:00+00:00, map_index=-1, run_start_date=2024-05-25 23:32:02.387285+00:00, run_end_date=2024-05-25 23:32:04.069406+00:00, run_duration=1.682121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:32:00.274354+00:00, queued_by_job_id=1, pid=3543 2024-05-25T23:33:00.071036175Z [2024-05-25T23:33:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:33:00+00:00, run_after=2024-05-25T23:34:00+00:00 2024-05-25T23:33:00.079021111Z [2024-05-25T23:33:00.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:33:00.093022685Z [2024-05-25T23:33:00.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:33:00+00:00, run_after=2024-05-25T23:34:00+00:00 2024-05-25T23:33:00.177865282Z [2024-05-25T23:33:00.177+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:33:00.177898976Z 2024-05-25T23:33:00.177904425Z 2024-05-25T23:33:00.177909281Z 2024-05-25T23:33:00.178137978Z [2024-05-25T23:33:00.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:33:00.178365999Z [2024-05-25T23:33:00.178+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:33:00.178610087Z [2024-05-25T23:33:00.178+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:33:00.179450191Z [2024-05-25T23:33:00.179+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:33:00.179466412Z 2024-05-25T23:33:00.179474632Z 2024-05-25T23:33:00.179481865Z 2024-05-25T23:33:00.186152075Z [2024-05-25T23:33:00.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:33:00.186558733Z [2024-05-25T23:33:00.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:33:00.187110276Z [2024-05-25T23:33:00.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:33:00.187478502Z [2024-05-25T23:33:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:33:00.187860337Z [2024-05-25T23:33:00.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:33:00.188105155Z [2024-05-25T23:33:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:33:00.418243425Z [2024-05-25T23:33:00.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status queued for try_number 1 2024-05-25T23:33:00.418382747Z [2024-05-25T23:33:00.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status queued for try_number 1 2024-05-25T23:33:00.418492507Z [2024-05-25T23:33:00.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status queued for try_number 1 2024-05-25T23:33:00.425875089Z [2024-05-25T23:33:00.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cb48c1b-2427-4a47-9863-b4db3135dbcb 2024-05-25T23:33:00.426103510Z [2024-05-25T23:33:00.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ab0aa07-f943-45c1-893a-115998af9b63 2024-05-25T23:33:00.426270747Z [2024-05-25T23:33:00.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to d794eb14-0109-44d1-9d4b-d83544472a0a 2024-05-25T23:33:01.665617530Z [2024-05-25T23:33:01.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status success for try_number 1 2024-05-25T23:33:01.671655671Z [2024-05-25T23:33:01.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:32:00+00:00, map_index=-1, run_start_date=2024-05-25 23:33:01.032579+00:00, run_end_date=2024-05-25 23:33:01.508523+00:00, run_duration=0.475944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:33:00.180548+00:00, queued_by_job_id=1, pid=3576 2024-05-25T23:33:02.736663277Z [2024-05-25T23:33:02.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:33:02.737832521Z [2024-05-25T23:33:02.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:32:00+00:00, run_id=scheduled__2024-05-25T23:32:00+00:00, run_start_date=2024-05-25 23:33:00.102548+00:00, run_end_date=2024-05-25 23:33:02.736461+00:00, run_duration=2.633913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:32:00+00:00, data_interval_end=2024-05-25 23:33:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:33:02.753238800Z [2024-05-25T23:33:02.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:33:00+00:00, run_after=2024-05-25T23:34:00+00:00 2024-05-25T23:33:03.859390536Z [2024-05-25T23:33:03.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:33:03.859565926Z [2024-05-25T23:33:03.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:32:00+00:00, run_id=scheduled__2024-05-25T23:32:00+00:00, run_start_date=2024-05-25 23:33:00.103678+00:00, run_end_date=2024-05-25 23:33:03.859305+00:00, run_duration=3.755627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:32:00+00:00, data_interval_end=2024-05-25 23:33:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:33:03.867482330Z [2024-05-25T23:33:03.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:33:00+00:00, run_after=2024-05-25T23:34:00+00:00 2024-05-25T23:33:03.873363374Z [2024-05-25T23:33:03.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:33:03.873535694Z [2024-05-25T23:33:03.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:32:00+00:00, run_id=scheduled__2024-05-25T23:32:00+00:00, run_start_date=2024-05-25 23:33:00.104695+00:00, run_end_date=2024-05-25 23:33:03.873305+00:00, run_duration=3.76861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:32:00+00:00, data_interval_end=2024-05-25 23:33:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:33:03.881742907Z [2024-05-25T23:33:03.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:33:00+00:00, run_after=2024-05-25T23:34:00+00:00 2024-05-25T23:33:03.915152217Z [2024-05-25T23:33:03.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status success for try_number 1 2024-05-25T23:33:03.915227708Z [2024-05-25T23:33:03.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status success for try_number 1 2024-05-25T23:33:03.920730484Z [2024-05-25T23:33:03.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:32:00+00:00, map_index=-1, run_start_date=2024-05-25 23:33:02.054784+00:00, run_end_date=2024-05-25 23:33:03.406814+00:00, run_duration=1.35203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:33:00.180548+00:00, queued_by_job_id=1, pid=3594 2024-05-25T23:33:03.920829993Z [2024-05-25T23:33:03.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:32:00+00:00, map_index=-1, run_start_date=2024-05-25 23:33:02.119081+00:00, run_end_date=2024-05-25 23:33:03.700182+00:00, run_duration=1.581101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:33:00.180548+00:00, queued_by_job_id=1, pid=3595 2024-05-25T23:33:30.661552701Z [2024-05-25T23:33:30.660+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:34:00.936468874Z [2024-05-25T23:34:00.935+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:34:00.949211387Z [2024-05-25T23:34:00.948+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:34:00.968719475Z [2024-05-25T23:34:00.968+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:34:00+00:00, run_after=2024-05-25T23:35:00+00:00 2024-05-25T23:34:01.062251659Z [2024-05-25T23:34:01.061+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:34:01.062288122Z 2024-05-25T23:34:01.062296545Z 2024-05-25T23:34:01.062302832Z 2024-05-25T23:34:01.062704749Z [2024-05-25T23:34:01.062+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:34:01.063058496Z [2024-05-25T23:34:01.062+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:34:01.063381589Z [2024-05-25T23:34:01.063+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:34:01.065094500Z [2024-05-25T23:34:01.064+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:34:01.065122308Z 2024-05-25T23:34:01.065132145Z 2024-05-25T23:34:01.065140781Z 2024-05-25T23:34:01.071389893Z [2024-05-25T23:34:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:34:01.071439912Z [2024-05-25T23:34:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:34:01.071786968Z [2024-05-25T23:34:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:34:01.071978268Z [2024-05-25T23:34:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:34:01.072095227Z [2024-05-25T23:34:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:34:01.072331214Z [2024-05-25T23:34:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:34:01.316959235Z [2024-05-25T23:34:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status queued for try_number 1 2024-05-25T23:34:01.317062034Z [2024-05-25T23:34:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:33:00+00:00 exited with status queued for try_number 1 2024-05-25T23:34:01.317241542Z [2024-05-25T23:34:01.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:33:00+00:00 exited with status queued for try_number 1 2024-05-25T23:34:01.341382108Z [2024-05-25T23:34:01.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to d914674e-e2ba-4a8e-b25e-fed3d7950921 2024-05-25T23:34:01.341598827Z [2024-05-25T23:34:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to e70ae476-d043-4a2a-a15a-68f0925d2596 2024-05-25T23:34:01.341903569Z [2024-05-25T23:34:01.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21175c6b-314a-4186-97b0-0080df0f5a07 2024-05-25T23:34:01.396055644Z [2024-05-25T23:34:01.395+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:34:00+00:00, run_after=2024-05-25T23:35:00+00:00 2024-05-25T23:34:01.482035202Z [2024-05-25T23:34:01.481+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:34:01.482060942Z 2024-05-25T23:34:01.482280177Z [2024-05-25T23:34:01.481+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:34:01.482918547Z [2024-05-25T23:34:01.482+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:34:01.482929452Z 2024-05-25T23:34:01.485390513Z [2024-05-25T23:34:01.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:34:01.485663866Z [2024-05-25T23:34:01.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:34:01.598759680Z [2024-05-25T23:34:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:33:00+00:00 exited with status queued for try_number 1 2024-05-25T23:34:01.609375047Z [2024-05-25T23:34:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to 554ee183-2d5a-45f9-a2c9-2ed549590288 2024-05-25T23:34:02.794293183Z [2024-05-25T23:34:02.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:34:02.794344635Z [2024-05-25T23:34:02.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:32:00+00:00, run_id=scheduled__2024-05-25T23:32:00+00:00, run_start_date=2024-05-25 23:34:00.993018+00:00, run_end_date=2024-05-25 23:34:02.793424+00:00, run_duration=1.800406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:32:00+00:00, data_interval_end=2024-05-25 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:34:02.803113362Z [2024-05-25T23:34:02.802+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:34:00+00:00, run_after=2024-05-25T23:36:00+00:00 2024-05-25T23:34:02.810384350Z [2024-05-25T23:34:02.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:34:02.810603488Z [2024-05-25T23:34:02.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:33:00+00:00, run_id=scheduled__2024-05-25T23:33:00+00:00, run_start_date=2024-05-25 23:34:00.994468+00:00, run_end_date=2024-05-25 23:34:02.810295+00:00, run_duration=1.815827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:33:00+00:00, data_interval_end=2024-05-25 23:34:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:34:02.820852349Z [2024-05-25T23:34:02.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:34:00+00:00, run_after=2024-05-25T23:35:00+00:00 2024-05-25T23:34:02.868757225Z [2024-05-25T23:34:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:32:00+00:00 exited with status success for try_number 1 2024-05-25T23:34:02.868952087Z [2024-05-25T23:34:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:33:00+00:00 exited with status success for try_number 1 2024-05-25T23:34:02.875116342Z [2024-05-25T23:34:02.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:33:00+00:00, map_index=-1, run_start_date=2024-05-25 23:34:02.008967+00:00, run_end_date=2024-05-25 23:34:02.628530+00:00, run_duration=0.619563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:34:01.066669+00:00, queued_by_job_id=1, pid=3629 2024-05-25T23:34:02.875446747Z [2024-05-25T23:34:02.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:32:00+00:00, map_index=-1, run_start_date=2024-05-25 23:34:01.965153+00:00, run_end_date=2024-05-25 23:34:02.371285+00:00, run_duration=0.406132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:34:01.066669+00:00, queued_by_job_id=1, pid=3628 2024-05-25T23:34:06.410847634Z [2024-05-25T23:34:06.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:34:06.411569623Z [2024-05-25T23:34:06.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:33:00+00:00, run_id=scheduled__2024-05-25T23:33:00+00:00, run_start_date=2024-05-25 23:34:00.995411+00:00, run_end_date=2024-05-25 23:34:06.411164+00:00, run_duration=5.415753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:33:00+00:00, data_interval_end=2024-05-25 23:34:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:34:06.424893409Z [2024-05-25T23:34:06.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:34:00+00:00, run_after=2024-05-25T23:35:00+00:00 2024-05-25T23:34:06.433283580Z [2024-05-25T23:34:06.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:34:06.433760828Z [2024-05-25T23:34:06.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:33:00+00:00, run_id=scheduled__2024-05-25T23:33:00+00:00, run_start_date=2024-05-25 23:34:01.409939+00:00, run_end_date=2024-05-25 23:34:06.433461+00:00, run_duration=5.023522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:33:00+00:00, data_interval_end=2024-05-25 23:34:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:34:06.446188080Z [2024-05-25T23:34:06.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:34:00+00:00, run_after=2024-05-25T23:35:00+00:00 2024-05-25T23:34:06.499216680Z [2024-05-25T23:34:06.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:33:00+00:00 exited with status success for try_number 1 2024-05-25T23:34:06.499620823Z [2024-05-25T23:34:06.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:33:00+00:00 exited with status success for try_number 1 2024-05-25T23:34:06.508329922Z [2024-05-25T23:34:06.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:33:00+00:00, map_index=-1, run_start_date=2024-05-25 23:34:03.265236+00:00, run_end_date=2024-05-25 23:34:05.382960+00:00, run_duration=2.117724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:34:01.066669+00:00, queued_by_job_id=1, pid=3646 2024-05-25T23:34:06.508970249Z [2024-05-25T23:34:06.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:33:00+00:00, map_index=-1, run_start_date=2024-05-25 23:34:04.393327+00:00, run_end_date=2024-05-25 23:34:05.746228+00:00, run_duration=1.352901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:34:01.483273+00:00, queued_by_job_id=1, pid=3658 2024-05-25T23:35:00.536550396Z [2024-05-25T23:35:00.535+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:35:00.560771647Z [2024-05-25T23:35:00.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:35:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:35:00.577465593Z [2024-05-25T23:35:00.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:35:00+00:00, run_after=2024-05-25T23:36:00+00:00 2024-05-25T23:35:00.596418360Z [2024-05-25T23:35:00.596+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:35:00+00:00, run_after=2024-05-25T23:36:00+00:00 2024-05-25T23:35:00.699606605Z [2024-05-25T23:35:00.699+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:35:00.699683130Z 2024-05-25T23:35:00.699699001Z 2024-05-25T23:35:00.699708012Z 2024-05-25T23:35:00.699742523Z 2024-05-25T23:35:00.699751406Z [2024-05-25T23:35:00.699+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:35:00.699830829Z [2024-05-25T23:35:00.699+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:35:00.699986397Z [2024-05-25T23:35:00.699+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:35:00.700042197Z [2024-05-25T23:35:00.699+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:35:00.701019597Z [2024-05-25T23:35:00.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:35:00.701041758Z 2024-05-25T23:35:00.701051917Z 2024-05-25T23:35:00.701060786Z 2024-05-25T23:35:00.701069422Z 2024-05-25T23:35:00.706379281Z [2024-05-25T23:35:00.705+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:35:00.706459717Z [2024-05-25T23:35:00.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:35:00.706692256Z [2024-05-25T23:35:00.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:35:00.706752634Z [2024-05-25T23:35:00.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:35:00.707013317Z [2024-05-25T23:35:00.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:35:00.707076434Z [2024-05-25T23:35:00.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:35:00.707254996Z [2024-05-25T23:35:00.707+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:35:00.707336485Z [2024-05-25T23:35:00.707+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:35:01.059039096Z [2024-05-25T23:35:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:35:01.059202807Z [2024-05-25T23:35:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status queued for try_number 1 2024-05-25T23:35:01.059302775Z [2024-05-25T23:35:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status queued for try_number 1 2024-05-25T23:35:01.059344503Z [2024-05-25T23:35:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status queued for try_number 1 2024-05-25T23:35:01.066661053Z [2024-05-25T23:35:01.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdf745cc-c398-454e-b571-0c1b30c48c09 2024-05-25T23:35:01.066787757Z [2024-05-25T23:35:01.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1416f619-df9c-4b0c-8144-9f8816e8c708 2024-05-25T23:35:01.066993878Z [2024-05-25T23:35:01.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0787f9d8-dcc3-4831-a369-1acf8c2a3d1c 2024-05-25T23:35:01.067173875Z [2024-05-25T23:35:01.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to 583eca5e-d2ac-45c3-995b-dc198391c021 2024-05-25T23:35:02.283980164Z [2024-05-25T23:35:02.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:35:02.284297111Z [2024-05-25T23:35:02.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:34:00+00:00, run_id=scheduled__2024-05-25T23:34:00+00:00, run_start_date=2024-05-25 23:35:00.611200+00:00, run_end_date=2024-05-25 23:35:02.283936+00:00, run_duration=1.672736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:34:00+00:00, data_interval_end=2024-05-25 23:35:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:35:02.304410926Z [2024-05-25T23:35:02.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:35:00+00:00, run_after=2024-05-25T23:36:00+00:00 2024-05-25T23:35:02.379951563Z [2024-05-25T23:35:02.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status success for try_number 1 2024-05-25T23:35:02.384911038Z [2024-05-25T23:35:02.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:34:00+00:00, map_index=-1, run_start_date=2024-05-25 23:35:01.658430+00:00, run_end_date=2024-05-25 23:35:02.103556+00:00, run_duration=0.445126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:35:00.702102+00:00, queued_by_job_id=1, pid=3686 2024-05-25T23:35:04.448537776Z [2024-05-25T23:35:04.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:35:04.449193188Z [2024-05-25T23:35:04.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:34:00+00:00, run_id=scheduled__2024-05-25T23:34:00+00:00, run_start_date=2024-05-25 23:35:00.612305+00:00, run_end_date=2024-05-25 23:35:04.448439+00:00, run_duration=3.836134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:34:00+00:00, data_interval_end=2024-05-25 23:35:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:35:04.458809973Z [2024-05-25T23:35:04.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:35:00+00:00, run_after=2024-05-25T23:36:00+00:00 2024-05-25T23:35:04.467701674Z [2024-05-25T23:35:04.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:35:04.467731658Z [2024-05-25T23:35:04.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:34:00+00:00, run_id=scheduled__2024-05-25T23:34:00+00:00, run_start_date=2024-05-25 23:35:00.613414+00:00, run_end_date=2024-05-25 23:35:04.465693+00:00, run_duration=3.852279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:34:00+00:00, data_interval_end=2024-05-25 23:35:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:35:04.475698356Z [2024-05-25T23:35:04.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:35:00+00:00, run_after=2024-05-25T23:36:00+00:00 2024-05-25T23:35:04.499656035Z [2024-05-25T23:35:04.498+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:35:04.499677058Z 2024-05-25T23:35:04.499681332Z [2024-05-25T23:35:04.499+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:35:04.499689815Z [2024-05-25T23:35:04.499+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:35:04.499692952Z 2024-05-25T23:35:04.509538481Z [2024-05-25T23:35:04.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:35:04.509691754Z [2024-05-25T23:35:04.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:35:04.573838028Z [2024-05-25T23:35:04.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:35:04.575865482Z [2024-05-25T23:35:04.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:35:04.576002091Z [2024-05-25T23:35:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status success for try_number 1 2024-05-25T23:35:04.576056058Z [2024-05-25T23:35:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status success for try_number 1 2024-05-25T23:35:04.583836772Z [2024-05-25T23:35:04.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:34:00+00:00, map_index=-1, run_start_date=2024-05-25 23:35:02.682260+00:00, run_end_date=2024-05-25 23:35:04.010366+00:00, run_duration=1.328106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:35:00.702102+00:00, queued_by_job_id=1, pid=3710 2024-05-25T23:35:04.584035677Z [2024-05-25T23:35:04.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:34:00+00:00, map_index=-1, run_start_date=2024-05-25 23:35:02.710423+00:00, run_end_date=2024-05-25 23:35:04.310030+00:00, run_duration=1.599607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:35:00.702102+00:00, queued_by_job_id=1, pid=3711 2024-05-25T23:35:04.584226359Z [2024-05-25T23:35:04.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=-1, run_start_date=2024-05-25 23:35:02.821504+00:00, run_end_date=2024-05-25 23:35:03.247620+00:00, run_duration=0.426116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:35:00.702102+00:00, queued_by_job_id=1, pid=3712 2024-05-25T23:35:04.584370787Z [2024-05-25T23:35:04.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4eea35b0-020c-4787-960a-7a51206fbfeb 2024-05-25T23:35:07.092876106Z [2024-05-25T23:35:07.092+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:35:07.092921204Z 2024-05-25T23:35:07.093388633Z [2024-05-25T23:35:07.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:35:07.094296010Z [2024-05-25T23:35:07.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:35:07.094307489Z 2024-05-25T23:35:07.097667704Z [2024-05-25T23:35:07.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:35:07.098001605Z [2024-05-25T23:35:07.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:35:07.148337864Z [2024-05-25T23:35:07.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:35:07.148378573Z [2024-05-25T23:35:07.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:35:07.154681922Z [2024-05-25T23:35:07.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to f377d390-80fc-4ce0-9585-83edf42b2085 2024-05-25T23:35:07.154806808Z [2024-05-25T23:35:07.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=-1, run_start_date=2024-05-25 23:35:06.312388+00:00, run_end_date=2024-05-25 23:35:06.635639+00:00, run_duration=0.323251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:35:04.501927+00:00, queued_by_job_id=1, pid=3735 2024-05-25T23:35:09.719270843Z [2024-05-25T23:35:09.718+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:35:09.719320993Z 2024-05-25T23:35:09.719448045Z [2024-05-25T23:35:09.719+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:35:09.720361297Z [2024-05-25T23:35:09.720+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:35:09.720381592Z 2024-05-25T23:35:09.723804762Z [2024-05-25T23:35:09.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:35:09.724009147Z [2024-05-25T23:35:09.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:35:09.799568125Z [2024-05-25T23:35:09.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status queued for try_number 1 2024-05-25T23:35:09.800113574Z [2024-05-25T23:35:09.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:35:09.815310561Z [2024-05-25T23:35:09.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3239fa92-4220-45c2-b204-5fdfdb6352f0 2024-05-25T23:35:09.816054536Z [2024-05-25T23:35:09.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=0, run_start_date=2024-05-25 23:35:09.061085+00:00, run_end_date=2024-05-25 23:35:09.420442+00:00, run_duration=0.359357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:35:07.094927+00:00, queued_by_job_id=1, pid=3743 2024-05-25T23:35:12.057242209Z [2024-05-25T23:35:12.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:35:12.057862881Z [2024-05-25T23:35:12.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:30:00+00:00, run_id=scheduled__2024-05-25T23:30:00+00:00, run_start_date=2024-05-25 23:35:00.609528+00:00, run_end_date=2024-05-25 23:35:12.057403+00:00, run_duration=11.447875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:30:00+00:00, data_interval_end=2024-05-25 23:35:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:35:12.066688809Z [2024-05-25T23:35:12.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:35:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:35:12.109075151Z [2024-05-25T23:35:12.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:30:00+00:00 exited with status success for try_number 1 2024-05-25T23:35:12.115931600Z [2024-05-25T23:35:12.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:30:00+00:00, map_index=-1, run_start_date=2024-05-25 23:35:11.355630+00:00, run_end_date=2024-05-25 23:35:11.739904+00:00, run_duration=0.384274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:35:09.720857+00:00, queued_by_job_id=1, pid=3751 2024-05-25T23:36:00.391741759Z [2024-05-25T23:36:00.391+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:36:00+00:00, run_after=2024-05-25T23:37:00+00:00 2024-05-25T23:36:00.398982104Z [2024-05-25T23:36:00.398+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:36:00.409897611Z [2024-05-25T23:36:00.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:36:00+00:00, run_after=2024-05-25T23:37:00+00:00 2024-05-25T23:36:00.416105310Z [2024-05-25T23:36:00.415+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:36:00.544887842Z [2024-05-25T23:36:00.544+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:36:00.545001201Z 2024-05-25T23:36:00.545081349Z 2024-05-25T23:36:00.545096974Z 2024-05-25T23:36:00.545107565Z 2024-05-25T23:36:00.545118368Z [2024-05-25T23:36:00.544+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:36:00.545168681Z [2024-05-25T23:36:00.544+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:36:00.545181887Z [2024-05-25T23:36:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:36:00.545201672Z [2024-05-25T23:36:00.544+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:36:00.547019878Z [2024-05-25T23:36:00.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:36:00.547108828Z 2024-05-25T23:36:00.547128630Z 2024-05-25T23:36:00.547142779Z 2024-05-25T23:36:00.547198607Z 2024-05-25T23:36:00.553086840Z [2024-05-25T23:36:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:36:00.553394943Z [2024-05-25T23:36:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:36:00.553517995Z [2024-05-25T23:36:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:36:00.553690438Z [2024-05-25T23:36:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:36:00.553932771Z [2024-05-25T23:36:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:36:00.554081366Z [2024-05-25T23:36:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:36:00.554388941Z [2024-05-25T23:36:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:36:00.554469301Z [2024-05-25T23:36:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:36:01.107976447Z [2024-05-25T23:36:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status queued for try_number 1 2024-05-25T23:36:01.108404513Z [2024-05-25T23:36:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status queued for try_number 1 2024-05-25T23:36:01.108593183Z [2024-05-25T23:36:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status queued for try_number 1 2024-05-25T23:36:01.108781846Z [2024-05-25T23:36:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status queued for try_number 1 2024-05-25T23:36:01.124879568Z [2024-05-25T23:36:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8a87ad4-ceb1-4dfe-9722-f3691bd2400d 2024-05-25T23:36:01.125231946Z [2024-05-25T23:36:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33e45b47-33a7-4495-acd1-08bf9bdf4e02 2024-05-25T23:36:01.125466372Z [2024-05-25T23:36:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4318962d-211e-437e-998e-67a710ebdcdc 2024-05-25T23:36:01.125702371Z [2024-05-25T23:36:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8106de8f-c8f4-4ffc-b776-ee0814026172 2024-05-25T23:36:02.317450032Z [2024-05-25T23:36:02.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:36:02.318780374Z [2024-05-25T23:36:02.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:34:00+00:00, run_id=scheduled__2024-05-25T23:34:00+00:00, run_start_date=2024-05-25 23:36:00.428932+00:00, run_end_date=2024-05-25 23:36:02.317322+00:00, run_duration=1.88839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:34:00+00:00, data_interval_end=2024-05-25 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:36:02.328468066Z [2024-05-25T23:36:02.328+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:36:00+00:00, run_after=2024-05-25T23:38:00+00:00 2024-05-25T23:36:02.335312459Z [2024-05-25T23:36:02.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:36:02.335715449Z [2024-05-25T23:36:02.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:35:00+00:00, run_id=scheduled__2024-05-25T23:35:00+00:00, run_start_date=2024-05-25 23:36:00.433601+00:00, run_end_date=2024-05-25 23:36:02.335283+00:00, run_duration=1.901682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:35:00+00:00, data_interval_end=2024-05-25 23:36:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:36:02.345372289Z [2024-05-25T23:36:02.345+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:36:00+00:00, run_after=2024-05-25T23:37:00+00:00 2024-05-25T23:36:02.391237975Z [2024-05-25T23:36:02.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:34:00+00:00 exited with status success for try_number 1 2024-05-25T23:36:02.391817606Z [2024-05-25T23:36:02.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status success for try_number 1 2024-05-25T23:36:02.399824723Z [2024-05-25T23:36:02.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:35:00+00:00, map_index=-1, run_start_date=2024-05-25 23:36:01.444786+00:00, run_end_date=2024-05-25 23:36:01.818500+00:00, run_duration=0.373714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:36:00.548275+00:00, queued_by_job_id=1, pid=3775 2024-05-25T23:36:02.400229792Z [2024-05-25T23:36:02.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:34:00+00:00, map_index=-1, run_start_date=2024-05-25 23:36:01.297331+00:00, run_end_date=2024-05-25 23:36:01.654644+00:00, run_duration=0.357313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:36:00.548275+00:00, queued_by_job_id=1, pid=3774 2024-05-25T23:36:04.713860101Z [2024-05-25T23:36:04.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:36:04.714163921Z [2024-05-25T23:36:04.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:35:00+00:00, run_id=scheduled__2024-05-25T23:35:00+00:00, run_start_date=2024-05-25 23:36:00.437571+00:00, run_end_date=2024-05-25 23:36:04.713770+00:00, run_duration=4.276199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:35:00+00:00, data_interval_end=2024-05-25 23:36:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:36:04.726679590Z [2024-05-25T23:36:04.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:36:00+00:00, run_after=2024-05-25T23:37:00+00:00 2024-05-25T23:36:04.736310361Z [2024-05-25T23:36:04.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:36:04.736794909Z [2024-05-25T23:36:04.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:35:00+00:00, run_id=scheduled__2024-05-25T23:35:00+00:00, run_start_date=2024-05-25 23:36:00.441284+00:00, run_end_date=2024-05-25 23:36:04.736268+00:00, run_duration=4.294984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:35:00+00:00, data_interval_end=2024-05-25 23:36:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:36:04.748253655Z [2024-05-25T23:36:04.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:36:00+00:00, run_after=2024-05-25T23:37:00+00:00 2024-05-25T23:36:04.806832754Z [2024-05-25T23:36:04.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status success for try_number 1 2024-05-25T23:36:04.806948838Z [2024-05-25T23:36:04.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status success for try_number 1 2024-05-25T23:36:04.819018219Z [2024-05-25T23:36:04.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:35:00+00:00, map_index=-1, run_start_date=2024-05-25 23:36:02.431914+00:00, run_end_date=2024-05-25 23:36:03.660966+00:00, run_duration=1.229052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:36:00.548275+00:00, queued_by_job_id=1, pid=3798 2024-05-25T23:36:04.819206127Z [2024-05-25T23:36:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:35:00+00:00, map_index=-1, run_start_date=2024-05-25 23:36:02.610287+00:00, run_end_date=2024-05-25 23:36:04.338627+00:00, run_duration=1.72834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:36:00.548275+00:00, queued_by_job_id=1, pid=3799 2024-05-25T23:37:00.420592355Z [2024-05-25T23:37:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:37:00+00:00, run_after=2024-05-25T23:38:00+00:00 2024-05-25T23:37:00.432174736Z [2024-05-25T23:37:00.431+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:37:00.448778311Z [2024-05-25T23:37:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:37:00+00:00, run_after=2024-05-25T23:38:00+00:00 2024-05-25T23:37:00.527627506Z [2024-05-25T23:37:00.527+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:37:00.527664797Z 2024-05-25T23:37:00.527673154Z 2024-05-25T23:37:00.527680394Z 2024-05-25T23:37:00.527776704Z [2024-05-25T23:37:00.527+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:37:00.527958815Z [2024-05-25T23:37:00.527+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:37:00.528134669Z [2024-05-25T23:37:00.527+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:37:00.530608453Z [2024-05-25T23:37:00.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:37:00.530633820Z 2024-05-25T23:37:00.530642046Z 2024-05-25T23:37:00.530649049Z 2024-05-25T23:37:00.533120347Z [2024-05-25T23:37:00.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:37:00.533338731Z [2024-05-25T23:37:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:37:00.533676159Z [2024-05-25T23:37:00.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:37:00.533874533Z [2024-05-25T23:37:00.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:37:00.534307356Z [2024-05-25T23:37:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:37:00.534602603Z [2024-05-25T23:37:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:37:00.798726156Z [2024-05-25T23:37:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status queued for try_number 1 2024-05-25T23:37:00.798959399Z [2024-05-25T23:37:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status queued for try_number 1 2024-05-25T23:37:00.799116763Z [2024-05-25T23:37:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status queued for try_number 1 2024-05-25T23:37:00.809559653Z [2024-05-25T23:37:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 988ca659-4cec-4ec0-b2db-2b78bf9594c3 2024-05-25T23:37:00.809821832Z [2024-05-25T23:37:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb482857-df49-4be4-b2cb-dac097680418 2024-05-25T23:37:00.810003105Z [2024-05-25T23:37:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to c77cbb44-90cd-4dba-9ac5-0cb677854625 2024-05-25T23:37:01.949697725Z [2024-05-25T23:37:01.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:37:01.950190242Z [2024-05-25T23:37:01.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:36:00+00:00, run_id=scheduled__2024-05-25T23:36:00+00:00, run_start_date=2024-05-25 23:37:00.461412+00:00, run_end_date=2024-05-25 23:37:01.949717+00:00, run_duration=1.488305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:36:00+00:00, data_interval_end=2024-05-25 23:37:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:37:01.964907570Z [2024-05-25T23:37:01.963+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:37:00+00:00, run_after=2024-05-25T23:38:00+00:00 2024-05-25T23:37:02.013399095Z [2024-05-25T23:37:02.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status success for try_number 1 2024-05-25T23:37:02.020061502Z [2024-05-25T23:37:02.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:36:00+00:00, map_index=-1, run_start_date=2024-05-25 23:37:01.378842+00:00, run_end_date=2024-05-25 23:37:01.790573+00:00, run_duration=0.411731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:37:00.530093+00:00, queued_by_job_id=1, pid=3831 2024-05-25T23:37:03.885203711Z [2024-05-25T23:37:03.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:37:03.885724347Z [2024-05-25T23:37:03.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:36:00+00:00, run_id=scheduled__2024-05-25T23:36:00+00:00, run_start_date=2024-05-25 23:37:00.463453+00:00, run_end_date=2024-05-25 23:37:03.885080+00:00, run_duration=3.421627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:36:00+00:00, data_interval_end=2024-05-25 23:37:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:37:03.909535751Z [2024-05-25T23:37:03.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:37:00+00:00, run_after=2024-05-25T23:38:00+00:00 2024-05-25T23:37:04.006405927Z [2024-05-25T23:37:04.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status success for try_number 1 2024-05-25T23:37:04.012570817Z [2024-05-25T23:37:04.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:36:00+00:00, map_index=-1, run_start_date=2024-05-25 23:37:02.321490+00:00, run_end_date=2024-05-25 23:37:03.627253+00:00, run_duration=1.305763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:37:00.530093+00:00, queued_by_job_id=1, pid=3849 2024-05-25T23:37:04.428321805Z [2024-05-25T23:37:04.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:37:04.429053927Z [2024-05-25T23:37:04.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:36:00+00:00, run_id=scheduled__2024-05-25T23:36:00+00:00, run_start_date=2024-05-25 23:37:00.466981+00:00, run_end_date=2024-05-25 23:37:04.428604+00:00, run_duration=3.961623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:36:00+00:00, data_interval_end=2024-05-25 23:37:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:37:04.442141461Z [2024-05-25T23:37:04.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:37:00+00:00, run_after=2024-05-25T23:38:00+00:00 2024-05-25T23:37:04.473968453Z [2024-05-25T23:37:04.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status success for try_number 1 2024-05-25T23:37:04.478884720Z [2024-05-25T23:37:04.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:36:00+00:00, map_index=-1, run_start_date=2024-05-25 23:37:02.348392+00:00, run_end_date=2024-05-25 23:37:03.952865+00:00, run_duration=1.604473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:37:00.530093+00:00, queued_by_job_id=1, pid=3850 2024-05-25T23:38:00.283857730Z [2024-05-25T23:38:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:38:00+00:00, run_after=2024-05-25T23:39:00+00:00 2024-05-25T23:38:00.297104525Z [2024-05-25T23:38:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:38:00+00:00, run_after=2024-05-25T23:39:00+00:00 2024-05-25T23:38:00.303986556Z [2024-05-25T23:38:00.303+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:38:00.310098773Z [2024-05-25T23:38:00.309+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:38:00.384258333Z [2024-05-25T23:38:00.383+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:38:00.384284291Z 2024-05-25T23:38:00.384288751Z 2024-05-25T23:38:00.384292329Z 2024-05-25T23:38:00.384296067Z 2024-05-25T23:38:00.384511253Z [2024-05-25T23:38:00.384+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:38:00.384719662Z [2024-05-25T23:38:00.384+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:38:00.384906005Z [2024-05-25T23:38:00.384+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:38:00.385100113Z [2024-05-25T23:38:00.384+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:38:00.385817659Z [2024-05-25T23:38:00.385+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:38:00.385831534Z 2024-05-25T23:38:00.385835866Z 2024-05-25T23:38:00.385839304Z 2024-05-25T23:38:00.385843001Z 2024-05-25T23:38:00.392436316Z [2024-05-25T23:38:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:38:00.392851951Z [2024-05-25T23:38:00.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:38:00.393243267Z [2024-05-25T23:38:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:38:00.393469149Z [2024-05-25T23:38:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:38:00.393820582Z [2024-05-25T23:38:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:38:00.394235051Z [2024-05-25T23:38:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:38:00.394561331Z [2024-05-25T23:38:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:38:00.394771744Z [2024-05-25T23:38:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:38:00.669158823Z [2024-05-25T23:38:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status queued for try_number 1 2024-05-25T23:38:00.671458760Z [2024-05-25T23:38:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:37:00+00:00 exited with status queued for try_number 1 2024-05-25T23:38:00.671616345Z [2024-05-25T23:38:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:37:00+00:00 exited with status queued for try_number 1 2024-05-25T23:38:00.671757272Z [2024-05-25T23:38:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:37:00+00:00 exited with status queued for try_number 1 2024-05-25T23:38:00.686352616Z [2024-05-25T23:38:00.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 441e927e-6726-445c-afd3-3d7ab2e88664 2024-05-25T23:38:00.686759594Z [2024-05-25T23:38:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3cde220-184f-41c9-93d2-59a769350f08 2024-05-25T23:38:00.686995373Z [2024-05-25T23:38:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0c051d4-6eb8-460a-9443-7ec5bfffc179 2024-05-25T23:38:00.687147476Z [2024-05-25T23:38:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51a81449-490c-4373-a6bd-f0df9195b3fa 2024-05-25T23:38:02.039624542Z [2024-05-25T23:38:02.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:38:02.040390171Z [2024-05-25T23:38:02.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:36:00+00:00, run_id=scheduled__2024-05-25T23:36:00+00:00, run_start_date=2024-05-25 23:38:00.319017+00:00, run_end_date=2024-05-25 23:38:02.039431+00:00, run_duration=1.720414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:36:00+00:00, data_interval_end=2024-05-25 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:38:02.051567569Z [2024-05-25T23:38:02.051+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:38:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:38:02.182035884Z [2024-05-25T23:38:02.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:36:00+00:00 exited with status success for try_number 1 2024-05-25T23:38:02.189769536Z [2024-05-25T23:38:02.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:36:00+00:00, map_index=-1, run_start_date=2024-05-25 23:38:01.425693+00:00, run_end_date=2024-05-25 23:38:02.013007+00:00, run_duration=0.587314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:38:00.386721+00:00, queued_by_job_id=1, pid=3883 2024-05-25T23:38:03.259399340Z [2024-05-25T23:38:03.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:38:03.263966466Z [2024-05-25T23:38:03.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:37:00+00:00, run_id=scheduled__2024-05-25T23:37:00+00:00, run_start_date=2024-05-25 23:38:00.320242+00:00, run_end_date=2024-05-25 23:38:03.259339+00:00, run_duration=2.939097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:37:00+00:00, data_interval_end=2024-05-25 23:38:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:38:03.275068148Z [2024-05-25T23:38:03.274+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:38:00+00:00, run_after=2024-05-25T23:39:00+00:00 2024-05-25T23:38:03.376536904Z [2024-05-25T23:38:03.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:37:00+00:00 exited with status success for try_number 1 2024-05-25T23:38:03.394067684Z [2024-05-25T23:38:03.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:37:00+00:00, map_index=-1, run_start_date=2024-05-25 23:38:01.565237+00:00, run_end_date=2024-05-25 23:38:02.223153+00:00, run_duration=0.657916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:38:00.386721+00:00, queued_by_job_id=1, pid=3884 2024-05-25T23:38:05.408174975Z [2024-05-25T23:38:05.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:38:05.408773036Z [2024-05-25T23:38:05.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:37:00+00:00, run_id=scheduled__2024-05-25T23:37:00+00:00, run_start_date=2024-05-25 23:38:00.321275+00:00, run_end_date=2024-05-25 23:38:05.408061+00:00, run_duration=5.086786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:37:00+00:00, data_interval_end=2024-05-25 23:38:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:38:05.420559220Z [2024-05-25T23:38:05.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:38:00+00:00, run_after=2024-05-25T23:39:00+00:00 2024-05-25T23:38:05.427246400Z [2024-05-25T23:38:05.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:38:05.427391977Z [2024-05-25T23:38:05.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:37:00+00:00, run_id=scheduled__2024-05-25T23:37:00+00:00, run_start_date=2024-05-25 23:38:00.322209+00:00, run_end_date=2024-05-25 23:38:05.427148+00:00, run_duration=5.104939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:37:00+00:00, data_interval_end=2024-05-25 23:38:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:38:05.440815796Z [2024-05-25T23:38:05.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:38:00+00:00, run_after=2024-05-25T23:39:00+00:00 2024-05-25T23:38:05.491651164Z [2024-05-25T23:38:05.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:37:00+00:00 exited with status success for try_number 1 2024-05-25T23:38:05.491898244Z [2024-05-25T23:38:05.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:37:00+00:00 exited with status success for try_number 1 2024-05-25T23:38:05.500531344Z [2024-05-25T23:38:05.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:37:00+00:00, map_index=-1, run_start_date=2024-05-25 23:38:02.990752+00:00, run_end_date=2024-05-25 23:38:04.516032+00:00, run_duration=1.52528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:38:00.386721+00:00, queued_by_job_id=1, pid=3908 2024-05-25T23:38:05.500761825Z [2024-05-25T23:38:05.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:37:00+00:00, map_index=-1, run_start_date=2024-05-25 23:38:02.894211+00:00, run_end_date=2024-05-25 23:38:04.653523+00:00, run_duration=1.759312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:38:00.386721+00:00, queued_by_job_id=1, pid=3907 2024-05-25T23:38:30.699064021Z [2024-05-25T23:38:30.696+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:39:00.893309907Z [2024-05-25T23:39:00.892+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:39:00.910227753Z [2024-05-25T23:39:00.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:39:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:39:00.925238555Z [2024-05-25T23:39:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:39:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:39:01.009467760Z [2024-05-25T23:39:01.008+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:39:01.009504176Z 2024-05-25T23:39:01.009511853Z 2024-05-25T23:39:01.009517352Z 2024-05-25T23:39:01.009969310Z [2024-05-25T23:39:01.009+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:39:01.010365867Z [2024-05-25T23:39:01.010+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:39:01.010690166Z [2024-05-25T23:39:01.010+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:39:01.011849534Z [2024-05-25T23:39:01.011+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:39:01.011908866Z 2024-05-25T23:39:01.011916010Z 2024-05-25T23:39:01.011921694Z 2024-05-25T23:39:01.016455091Z [2024-05-25T23:39:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:39:01.017036871Z [2024-05-25T23:39:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:39:01.017704780Z [2024-05-25T23:39:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:39:01.018095701Z [2024-05-25T23:39:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:39:01.018474882Z [2024-05-25T23:39:01.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:39:01.018897477Z [2024-05-25T23:39:01.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:39:01.251380124Z [2024-05-25T23:39:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status queued for try_number 1 2024-05-25T23:39:01.251465538Z [2024-05-25T23:39:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status queued for try_number 1 2024-05-25T23:39:01.251643053Z [2024-05-25T23:39:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status queued for try_number 1 2024-05-25T23:39:01.261874336Z [2024-05-25T23:39:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0461ba9b-a5bf-4646-8c9a-992071dff3d6 2024-05-25T23:39:01.261964736Z [2024-05-25T23:39:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to b562854a-5239-4b55-b6a4-e954cab93cad 2024-05-25T23:39:01.262132526Z [2024-05-25T23:39:01.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d1261b0-f6e5-41d0-8b1a-af511faad0a2 2024-05-25T23:39:02.881987208Z [2024-05-25T23:39:02.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:39:02.882766703Z [2024-05-25T23:39:02.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:38:00+00:00, run_id=scheduled__2024-05-25T23:38:00+00:00, run_start_date=2024-05-25 23:39:00.937808+00:00, run_end_date=2024-05-25 23:39:02.881898+00:00, run_duration=1.94409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:38:00+00:00, data_interval_end=2024-05-25 23:39:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:39:02.895709714Z [2024-05-25T23:39:02.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:39:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:39:02.975990861Z [2024-05-25T23:39:02.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status success for try_number 1 2024-05-25T23:39:02.986634681Z [2024-05-25T23:39:02.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:38:00+00:00, map_index=-1, run_start_date=2024-05-25 23:39:01.789736+00:00, run_end_date=2024-05-25 23:39:02.217607+00:00, run_duration=0.427871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:39:01.013360+00:00, queued_by_job_id=1, pid=3941 2024-05-25T23:39:04.611314628Z [2024-05-25T23:39:04.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:39:04.611610541Z [2024-05-25T23:39:04.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:38:00+00:00, run_id=scheduled__2024-05-25T23:38:00+00:00, run_start_date=2024-05-25 23:39:00.939489+00:00, run_end_date=2024-05-25 23:39:04.611185+00:00, run_duration=3.671696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:38:00+00:00, data_interval_end=2024-05-25 23:39:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:39:04.621969944Z [2024-05-25T23:39:04.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:39:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:39:04.677025212Z [2024-05-25T23:39:04.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status success for try_number 1 2024-05-25T23:39:04.685736595Z [2024-05-25T23:39:04.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:38:00+00:00, map_index=-1, run_start_date=2024-05-25 23:39:02.904295+00:00, run_end_date=2024-05-25 23:39:04.309090+00:00, run_duration=1.404795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:39:01.013360+00:00, queued_by_job_id=1, pid=3960 2024-05-25T23:39:05.747142658Z [2024-05-25T23:39:05.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:39:05.748227792Z [2024-05-25T23:39:05.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:38:00+00:00, run_id=scheduled__2024-05-25T23:38:00+00:00, run_start_date=2024-05-25 23:39:00.940670+00:00, run_end_date=2024-05-25 23:39:05.746989+00:00, run_duration=4.806319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:38:00+00:00, data_interval_end=2024-05-25 23:39:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:39:05.758797803Z [2024-05-25T23:39:05.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:39:00+00:00, run_after=2024-05-25T23:40:00+00:00 2024-05-25T23:39:05.796849760Z [2024-05-25T23:39:05.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status success for try_number 1 2024-05-25T23:39:05.805097578Z [2024-05-25T23:39:05.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:38:00+00:00, map_index=-1, run_start_date=2024-05-25 23:39:02.800802+00:00, run_end_date=2024-05-25 23:39:04.825460+00:00, run_duration=2.024658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:39:01.013360+00:00, queued_by_job_id=1, pid=3959 2024-05-25T23:40:00.173393157Z [2024-05-25T23:40:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:45:00+00:00 2024-05-25T23:40:00.184746474Z [2024-05-25T23:40:00.184+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:41:00+00:00 2024-05-25T23:40:00.191574110Z [2024-05-25T23:40:00.191+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:40:00.198580302Z [2024-05-25T23:40:00.198+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:40:00.209633080Z [2024-05-25T23:40:00.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:41:00+00:00 2024-05-25T23:40:00.293566589Z [2024-05-25T23:40:00.293+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T23:40:00.293590956Z 2024-05-25T23:40:00.293594573Z 2024-05-25T23:40:00.293598086Z 2024-05-25T23:40:00.293600940Z 2024-05-25T23:40:00.293603816Z 2024-05-25T23:40:00.293618383Z [2024-05-25T23:40:00.293+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:40:00.293815747Z [2024-05-25T23:40:00.293+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:40:00.294006003Z [2024-05-25T23:40:00.293+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:40:00.294017217Z [2024-05-25T23:40:00.293+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:40:00.294225046Z [2024-05-25T23:40:00.294+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:40:00.294789519Z [2024-05-25T23:40:00.294+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:40:00.294829285Z 2024-05-25T23:40:00.294837948Z 2024-05-25T23:40:00.294843436Z 2024-05-25T23:40:00.294848387Z 2024-05-25T23:40:00.294853563Z 2024-05-25T23:40:00.298453309Z [2024-05-25T23:40:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:40:00.298682736Z [2024-05-25T23:40:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:40:00.298971305Z [2024-05-25T23:40:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:40:00.299146822Z [2024-05-25T23:40:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:40:00.299468870Z [2024-05-25T23:40:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:40:00.299684498Z [2024-05-25T23:40:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:40:00.299981682Z [2024-05-25T23:40:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:40:00.300192624Z [2024-05-25T23:40:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:40:00.300467417Z [2024-05-25T23:40:00.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:40:00.300654255Z [2024-05-25T23:40:00.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:40:00.916680376Z [2024-05-25T23:40:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:00.916717459Z [2024-05-25T23:40:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:00.916777960Z [2024-05-25T23:40:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:39:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:00.916844614Z [2024-05-25T23:40:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:39:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:00.916891172Z [2024-05-25T23:40:00.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:39:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:00.941310473Z [2024-05-25T23:40:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a300a1b-19e3-454a-85db-ad44336ab52e 2024-05-25T23:40:00.941338726Z [2024-05-25T23:40:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6daef123-9982-4bf4-83ba-64ccbc20f4d9 2024-05-25T23:40:00.941459828Z [2024-05-25T23:40:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to f984dd7d-d4e1-4b6b-8c23-cec7b8468164 2024-05-25T23:40:00.941538838Z [2024-05-25T23:40:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24bfe0ea-83d2-4881-95ae-ca0b63b12530 2024-05-25T23:40:00.941640353Z [2024-05-25T23:40:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 721371da-b2f2-4f12-bb2a-51e94cf60f64 2024-05-25T23:40:02.292160457Z [2024-05-25T23:40:02.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:40:02.292518624Z [2024-05-25T23:40:02.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:38:00+00:00, run_id=scheduled__2024-05-25T23:38:00+00:00, run_start_date=2024-05-25 23:40:00.221081+00:00, run_end_date=2024-05-25 23:40:02.292135+00:00, run_duration=2.071054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:38:00+00:00, data_interval_end=2024-05-25 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:40:02.302624608Z [2024-05-25T23:40:02.302+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:42:00+00:00 2024-05-25T23:40:02.310718650Z [2024-05-25T23:40:02.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:40:02.311036235Z [2024-05-25T23:40:02.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:39:00+00:00, run_id=scheduled__2024-05-25T23:39:00+00:00, run_start_date=2024-05-25 23:40:00.222150+00:00, run_end_date=2024-05-25 23:40:02.310696+00:00, run_duration=2.088546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:39:00+00:00, data_interval_end=2024-05-25 23:40:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:40:02.324022453Z [2024-05-25T23:40:02.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:41:00+00:00 2024-05-25T23:40:02.382388450Z [2024-05-25T23:40:02.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:38:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:02.382595388Z [2024-05-25T23:40:02.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:39:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:02.392821618Z [2024-05-25T23:40:02.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:38:00+00:00, map_index=-1, run_start_date=2024-05-25 23:40:01.505443+00:00, run_end_date=2024-05-25 23:40:01.934656+00:00, run_duration=0.429213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:00.295581+00:00, queued_by_job_id=1, pid=3994 2024-05-25T23:40:02.393313318Z [2024-05-25T23:40:02.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:39:00+00:00, map_index=-1, run_start_date=2024-05-25 23:40:01.604450+00:00, run_end_date=2024-05-25 23:40:02.040689+00:00, run_duration=0.436239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:00.295581+00:00, queued_by_job_id=1, pid=3998 2024-05-25T23:40:03.841610894Z [2024-05-25T23:40:03.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:40:03.842091226Z [2024-05-25T23:40:03.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:39:00+00:00, run_id=scheduled__2024-05-25T23:39:00+00:00, run_start_date=2024-05-25 23:40:00.223056+00:00, run_end_date=2024-05-25 23:40:03.841519+00:00, run_duration=3.618463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:39:00+00:00, data_interval_end=2024-05-25 23:40:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:40:03.850607159Z [2024-05-25T23:40:03.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:41:00+00:00 2024-05-25T23:40:03.903662879Z [2024-05-25T23:40:03.903+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:40:03.903688223Z 2024-05-25T23:40:03.904154958Z [2024-05-25T23:40:03.903+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:40:03.905185494Z [2024-05-25T23:40:03.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:40:03.905210345Z 2024-05-25T23:40:03.910901268Z [2024-05-25T23:40:03.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:40:03.912294483Z [2024-05-25T23:40:03.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:40:04.128577834Z [2024-05-25T23:40:04.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:04.128683981Z [2024-05-25T23:40:04.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:04.128691329Z [2024-05-25T23:40:04.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:39:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:04.163978102Z [2024-05-25T23:40:04.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:35:00+00:00, map_index=-1, run_start_date=2024-05-25 23:40:02.474770+00:00, run_end_date=2024-05-25 23:40:02.877342+00:00, run_duration=0.402572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:00.295581+00:00, queued_by_job_id=1, pid=4024 2024-05-25T23:40:04.164001229Z [2024-05-25T23:40:04.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fea20f8-9892-4750-a1b8-765e67392e8c 2024-05-25T23:40:04.164004968Z [2024-05-25T23:40:04.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:39:00+00:00, map_index=-1, run_start_date=2024-05-25 23:40:02.490782+00:00, run_end_date=2024-05-25 23:40:03.753863+00:00, run_duration=1.263081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:00.295581+00:00, queued_by_job_id=1, pid=4025 2024-05-25T23:40:04.209155657Z [2024-05-25T23:40:04.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:40:04.209585187Z [2024-05-25T23:40:04.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:39:00+00:00, run_id=scheduled__2024-05-25T23:39:00+00:00, run_start_date=2024-05-25 23:40:00.224000+00:00, run_end_date=2024-05-25 23:40:04.209084+00:00, run_duration=3.985084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:39:00+00:00, data_interval_end=2024-05-25 23:40:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:40:04.218162589Z [2024-05-25T23:40:04.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:41:00+00:00 2024-05-25T23:40:04.958326018Z [2024-05-25T23:40:04.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:39:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:04.963631323Z [2024-05-25T23:40:04.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:39:00+00:00, map_index=-1, run_start_date=2024-05-25 23:40:02.599966+00:00, run_end_date=2024-05-25 23:40:04.121394+00:00, run_duration=1.521428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:00.295581+00:00, queued_by_job_id=1, pid=4026 2024-05-25T23:40:07.202860538Z [2024-05-25T23:40:07.202+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:40:07.202927196Z 2024-05-25T23:40:07.202937496Z [2024-05-25T23:40:07.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:40:07.203829341Z [2024-05-25T23:40:07.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:40:07.203894656Z 2024-05-25T23:40:07.207720419Z [2024-05-25T23:40:07.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:40:07.207890208Z [2024-05-25T23:40:07.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:40:07.268094237Z [2024-05-25T23:40:07.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:07.268150105Z [2024-05-25T23:40:07.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:07.274763535Z [2024-05-25T23:40:07.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f832f45-eaa9-4a84-9cd0-9a920ae6d401 2024-05-25T23:40:07.274943015Z [2024-05-25T23:40:07.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:35:00+00:00, map_index=-1, run_start_date=2024-05-25 23:40:05.892940+00:00, run_end_date=2024-05-25 23:40:06.233511+00:00, run_duration=0.340571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:03.905858+00:00, queued_by_job_id=1, pid=4049 2024-05-25T23:40:10.291737077Z [2024-05-25T23:40:10.291+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:40:10.291776126Z 2024-05-25T23:40:10.292447405Z [2024-05-25T23:40:10.291+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:40:10.293324068Z [2024-05-25T23:40:10.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:40:10.293348941Z 2024-05-25T23:40:10.296419703Z [2024-05-25T23:40:10.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:40:10.296707060Z [2024-05-25T23:40:10.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:40:10.361667017Z [2024-05-25T23:40:10.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status queued for try_number 1 2024-05-25T23:40:10.363111460Z [2024-05-25T23:40:10.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:10.371678324Z [2024-05-25T23:40:10.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ac0d56f-0c95-4433-9bf5-ecd2bda4adb5 2024-05-25T23:40:10.373700094Z [2024-05-25T23:40:10.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:35:00+00:00, map_index=0, run_start_date=2024-05-25 23:40:08.885304+00:00, run_end_date=2024-05-25 23:40:09.254878+00:00, run_duration=0.369574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:07.204374+00:00, queued_by_job_id=1, pid=4057 2024-05-25T23:40:12.623443098Z [2024-05-25T23:40:12.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:40:12.623495307Z [2024-05-25T23:40:12.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:35:00+00:00, run_id=scheduled__2024-05-25T23:35:00+00:00, run_start_date=2024-05-25 23:40:00.219858+00:00, run_end_date=2024-05-25 23:40:12.622993+00:00, run_duration=12.403135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:35:00+00:00, data_interval_end=2024-05-25 23:40:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:40:12.630405236Z [2024-05-25T23:40:12.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:40:00+00:00, run_after=2024-05-25T23:45:00+00:00 2024-05-25T23:40:12.691076718Z [2024-05-25T23:40:12.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:35:00+00:00 exited with status success for try_number 1 2024-05-25T23:40:12.698875833Z [2024-05-25T23:40:12.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:35:00+00:00, map_index=-1, run_start_date=2024-05-25 23:40:11.889040+00:00, run_end_date=2024-05-25 23:40:12.279672+00:00, run_duration=0.390632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:40:10.293892+00:00, queued_by_job_id=1, pid=4065 2024-05-25T23:41:00.665507178Z [2024-05-25T23:41:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:41:00+00:00, run_after=2024-05-25T23:42:00+00:00 2024-05-25T23:41:00.679074352Z [2024-05-25T23:41:00.678+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:41:00.696456009Z [2024-05-25T23:41:00.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:41:00+00:00, run_after=2024-05-25T23:42:00+00:00 2024-05-25T23:41:00.763716838Z [2024-05-25T23:41:00.759+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:41:00.763747102Z 2024-05-25T23:41:00.763750814Z 2024-05-25T23:41:00.763754026Z 2024-05-25T23:41:00.763757145Z [2024-05-25T23:41:00.760+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:41:00.763760435Z [2024-05-25T23:41:00.760+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:41:00.763763501Z [2024-05-25T23:41:00.761+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:41:00.763779811Z [2024-05-25T23:41:00.761+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:41:00.763782898Z 2024-05-25T23:41:00.763785861Z 2024-05-25T23:41:00.763788830Z 2024-05-25T23:41:00.767982746Z [2024-05-25T23:41:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:41:00.768037943Z [2024-05-25T23:41:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:41:00.768046409Z [2024-05-25T23:41:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:41:00.768063784Z [2024-05-25T23:41:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:41:00.768077062Z [2024-05-25T23:41:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:41:00.768090486Z [2024-05-25T23:41:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:41:00.965728167Z [2024-05-25T23:41:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:41:00.965816083Z [2024-05-25T23:41:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:41:00.965979579Z [2024-05-25T23:41:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:41:00.972724508Z [2024-05-25T23:41:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f498e3d-3c63-4c94-ad0e-7a3c27f30097 2024-05-25T23:41:00.972762521Z [2024-05-25T23:41:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbbfa8b8-fed7-4c3b-bdcd-ad90014a8c22 2024-05-25T23:41:00.972875655Z [2024-05-25T23:41:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72d37830-812d-4573-8ae6-c5eaf95e32bd 2024-05-25T23:41:02.104664502Z [2024-05-25T23:41:02.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:41:02.104841682Z [2024-05-25T23:41:02.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:40:00+00:00, run_id=scheduled__2024-05-25T23:40:00+00:00, run_start_date=2024-05-25 23:41:00.709855+00:00, run_end_date=2024-05-25 23:41:02.104525+00:00, run_duration=1.39467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:40:00+00:00, data_interval_end=2024-05-25 23:41:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:41:02.114711776Z [2024-05-25T23:41:02.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:41:00+00:00, run_after=2024-05-25T23:42:00+00:00 2024-05-25T23:41:02.167381917Z [2024-05-25T23:41:02.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:41:02.175605190Z [2024-05-25T23:41:02.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=-1, run_start_date=2024-05-25 23:41:01.445497+00:00, run_end_date=2024-05-25 23:41:01.802663+00:00, run_duration=0.357166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:41:00.762375+00:00, queued_by_job_id=1, pid=4088 2024-05-25T23:41:04.790905952Z [2024-05-25T23:41:04.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:41:04.791027061Z [2024-05-25T23:41:04.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:40:00+00:00, run_id=scheduled__2024-05-25T23:40:00+00:00, run_start_date=2024-05-25 23:41:00.711252+00:00, run_end_date=2024-05-25 23:41:04.790808+00:00, run_duration=4.079556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:40:00+00:00, data_interval_end=2024-05-25 23:41:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:41:04.799881133Z [2024-05-25T23:41:04.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:41:00+00:00, run_after=2024-05-25T23:42:00+00:00 2024-05-25T23:41:04.806541388Z [2024-05-25T23:41:04.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:41:04.806923545Z [2024-05-25T23:41:04.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:40:00+00:00, run_id=scheduled__2024-05-25T23:40:00+00:00, run_start_date=2024-05-25 23:41:00.712481+00:00, run_end_date=2024-05-25 23:41:04.806446+00:00, run_duration=4.093965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:40:00+00:00, data_interval_end=2024-05-25 23:41:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:41:04.817943209Z [2024-05-25T23:41:04.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:41:00+00:00, run_after=2024-05-25T23:42:00+00:00 2024-05-25T23:41:04.862848414Z [2024-05-25T23:41:04.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:41:04.863249470Z [2024-05-25T23:41:04.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:41:04.872148991Z [2024-05-25T23:41:04.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=-1, run_start_date=2024-05-25 23:41:02.457001+00:00, run_end_date=2024-05-25 23:41:04.318696+00:00, run_duration=1.861695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:41:00.762375+00:00, queued_by_job_id=1, pid=4106 2024-05-25T23:41:04.872581996Z [2024-05-25T23:41:04.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=-1, run_start_date=2024-05-25 23:41:02.631923+00:00, run_end_date=2024-05-25 23:41:03.922711+00:00, run_duration=1.290788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:41:00.762375+00:00, queued_by_job_id=1, pid=4107 2024-05-25T23:42:01.103876275Z [2024-05-25T23:42:01.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:42:00+00:00, run_after=2024-05-25T23:43:00+00:00 2024-05-25T23:42:01.125487175Z [2024-05-25T23:42:01.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:42:00+00:00, run_after=2024-05-25T23:43:00+00:00 2024-05-25T23:42:01.135026036Z [2024-05-25T23:42:01.134+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:42:01.143654367Z [2024-05-25T23:42:01.143+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:42:01.231990189Z [2024-05-25T23:42:01.231+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:42:01.232066245Z 2024-05-25T23:42:01.232078631Z 2024-05-25T23:42:01.232111697Z 2024-05-25T23:42:01.232120515Z 2024-05-25T23:42:01.232148801Z [2024-05-25T23:42:01.231+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:42:01.232198654Z [2024-05-25T23:42:01.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:42:01.232395767Z [2024-05-25T23:42:01.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:42:01.232455082Z [2024-05-25T23:42:01.232+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:42:01.233526640Z [2024-05-25T23:42:01.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:42:01.233548967Z 2024-05-25T23:42:01.233558897Z 2024-05-25T23:42:01.233567332Z 2024-05-25T23:42:01.233576189Z 2024-05-25T23:42:01.239404966Z [2024-05-25T23:42:01.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:42:01.239446714Z [2024-05-25T23:42:01.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:42:01.239615542Z [2024-05-25T23:42:01.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:42:01.239690648Z [2024-05-25T23:42:01.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:42:01.240006891Z [2024-05-25T23:42:01.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:42:01.240066633Z [2024-05-25T23:42:01.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:42:01.240432475Z [2024-05-25T23:42:01.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:42:01.240615497Z [2024-05-25T23:42:01.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:42:01.561259020Z [2024-05-25T23:42:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:42:01.561566118Z [2024-05-25T23:42:01.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:41:00+00:00 exited with status queued for try_number 1 2024-05-25T23:42:01.561713004Z [2024-05-25T23:42:01.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:41:00+00:00 exited with status queued for try_number 1 2024-05-25T23:42:01.561887312Z [2024-05-25T23:42:01.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:41:00+00:00 exited with status queued for try_number 1 2024-05-25T23:42:01.580919926Z [2024-05-25T23:42:01.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbbb722c-5411-413a-af9f-c53bca390405 2024-05-25T23:42:01.581205288Z [2024-05-25T23:42:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8e62370-aae4-4e77-bdc3-73d584e8af83 2024-05-25T23:42:01.581491317Z [2024-05-25T23:42:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 707d0f2f-6a12-4808-b598-3d7c3ab9c1dd 2024-05-25T23:42:01.581731261Z [2024-05-25T23:42:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to c75f9462-c997-4091-970f-fe88f378fbed 2024-05-25T23:42:02.884820234Z [2024-05-25T23:42:02.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:42:02.885316843Z [2024-05-25T23:42:02.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:40:00+00:00, run_id=scheduled__2024-05-25T23:40:00+00:00, run_start_date=2024-05-25 23:42:01.157075+00:00, run_end_date=2024-05-25 23:42:02.884716+00:00, run_duration=1.727641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:40:00+00:00, data_interval_end=2024-05-25 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:42:02.892655427Z [2024-05-25T23:42:02.892+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:42:00+00:00, run_after=2024-05-25T23:44:00+00:00 2024-05-25T23:42:02.899763524Z [2024-05-25T23:42:02.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:42:02.900331684Z [2024-05-25T23:42:02.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:41:00+00:00, run_id=scheduled__2024-05-25T23:41:00+00:00, run_start_date=2024-05-25 23:42:01.158514+00:00, run_end_date=2024-05-25 23:42:02.899871+00:00, run_duration=1.741357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:41:00+00:00, data_interval_end=2024-05-25 23:42:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:42:02.918237211Z [2024-05-25T23:42:02.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:42:00+00:00, run_after=2024-05-25T23:43:00+00:00 2024-05-25T23:42:02.977717462Z [2024-05-25T23:42:02.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:42:02.978122068Z [2024-05-25T23:42:02.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:41:00+00:00 exited with status success for try_number 1 2024-05-25T23:42:02.988750726Z [2024-05-25T23:42:02.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:41:00+00:00, map_index=-1, run_start_date=2024-05-25 23:42:02.121249+00:00, run_end_date=2024-05-25 23:42:02.538063+00:00, run_duration=0.416814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:42:01.234835+00:00, queued_by_job_id=1, pid=4140 2024-05-25T23:42:02.989265269Z [2024-05-25T23:42:02.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=-1, run_start_date=2024-05-25 23:42:02.198523+00:00, run_end_date=2024-05-25 23:42:02.580929+00:00, run_duration=0.382406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:42:01.234835+00:00, queued_by_job_id=1, pid=4141 2024-05-25T23:42:05.499655964Z [2024-05-25T23:42:05.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:42:05.500086977Z [2024-05-25T23:42:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:41:00+00:00, run_id=scheduled__2024-05-25T23:41:00+00:00, run_start_date=2024-05-25 23:42:01.161123+00:00, run_end_date=2024-05-25 23:42:05.499565+00:00, run_duration=4.338442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:41:00+00:00, data_interval_end=2024-05-25 23:42:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:42:05.512155012Z [2024-05-25T23:42:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:42:00+00:00, run_after=2024-05-25T23:43:00+00:00 2024-05-25T23:42:05.518837323Z [2024-05-25T23:42:05.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:42:05.519155767Z [2024-05-25T23:42:05.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:41:00+00:00, run_id=scheduled__2024-05-25T23:41:00+00:00, run_start_date=2024-05-25 23:42:01.162522+00:00, run_end_date=2024-05-25 23:42:05.518774+00:00, run_duration=4.356252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:41:00+00:00, data_interval_end=2024-05-25 23:42:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:42:05.528510062Z [2024-05-25T23:42:05.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:42:00+00:00, run_after=2024-05-25T23:43:00+00:00 2024-05-25T23:42:05.557987450Z [2024-05-25T23:42:05.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:41:00+00:00 exited with status success for try_number 1 2024-05-25T23:42:05.558168448Z [2024-05-25T23:42:05.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:41:00+00:00 exited with status success for try_number 1 2024-05-25T23:42:05.564313338Z [2024-05-25T23:42:05.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:41:00+00:00, map_index=-1, run_start_date=2024-05-25 23:42:03.301076+00:00, run_end_date=2024-05-25 23:42:04.796072+00:00, run_duration=1.494996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:42:01.234835+00:00, queued_by_job_id=1, pid=4165 2024-05-25T23:42:05.564635733Z [2024-05-25T23:42:05.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:41:00+00:00, map_index=-1, run_start_date=2024-05-25 23:42:03.271920+00:00, run_end_date=2024-05-25 23:42:05.300477+00:00, run_duration=2.028557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:42:01.234835+00:00, queued_by_job_id=1, pid=4164 2024-05-25T23:43:00.435011659Z [2024-05-25T23:43:00.434+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:43:00.452145243Z [2024-05-25T23:43:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:43:00+00:00, run_after=2024-05-25T23:44:00+00:00 2024-05-25T23:43:00.465742805Z [2024-05-25T23:43:00.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:43:00+00:00, run_after=2024-05-25T23:44:00+00:00 2024-05-25T23:43:00.533248957Z [2024-05-25T23:43:00.532+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:43:00.533291133Z 2024-05-25T23:43:00.533296579Z 2024-05-25T23:43:00.533317205Z 2024-05-25T23:43:00.533666302Z [2024-05-25T23:43:00.533+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:43:00.533958066Z [2024-05-25T23:43:00.533+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:43:00.534225306Z [2024-05-25T23:43:00.534+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:43:00.535083244Z [2024-05-25T23:43:00.534+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:43:00.535097783Z 2024-05-25T23:43:00.535102325Z 2024-05-25T23:43:00.535106520Z 2024-05-25T23:43:00.540268694Z [2024-05-25T23:43:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:43:00.541321245Z [2024-05-25T23:43:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:43:00.541689655Z [2024-05-25T23:43:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:43:00.541961893Z [2024-05-25T23:43:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:43:00.542293195Z [2024-05-25T23:43:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:43:00.542525009Z [2024-05-25T23:43:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:43:01.052252568Z [2024-05-25T23:43:01.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status queued for try_number 1 2024-05-25T23:43:01.052438204Z [2024-05-25T23:43:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status queued for try_number 1 2024-05-25T23:43:01.052613394Z [2024-05-25T23:43:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status queued for try_number 1 2024-05-25T23:43:01.072439838Z [2024-05-25T23:43:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef8f613a-c3a8-4559-ad62-8bbc7e429abf 2024-05-25T23:43:01.072674201Z [2024-05-25T23:43:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b1dad64-c960-47ec-9a9f-d23e9c155e89 2024-05-25T23:43:01.072893365Z [2024-05-25T23:43:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to d09088e4-9545-4fff-8640-bd98f6512ad8 2024-05-25T23:43:02.389088447Z [2024-05-25T23:43:02.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:43:02.389535596Z [2024-05-25T23:43:02.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:42:00+00:00, run_id=scheduled__2024-05-25T23:42:00+00:00, run_start_date=2024-05-25 23:43:00.479359+00:00, run_end_date=2024-05-25 23:43:02.389003+00:00, run_duration=1.909644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:42:00+00:00, data_interval_end=2024-05-25 23:43:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:43:02.399198970Z [2024-05-25T23:43:02.398+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:43:00+00:00, run_after=2024-05-25T23:44:00+00:00 2024-05-25T23:43:02.453416568Z [2024-05-25T23:43:02.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status success for try_number 1 2024-05-25T23:43:02.468554066Z [2024-05-25T23:43:02.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:42:00+00:00, map_index=-1, run_start_date=2024-05-25 23:43:01.616356+00:00, run_end_date=2024-05-25 23:43:02.172398+00:00, run_duration=0.556042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:43:00.536454+00:00, queued_by_job_id=1, pid=4197 2024-05-25T23:43:04.587923204Z [2024-05-25T23:43:04.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:43:04.588261877Z [2024-05-25T23:43:04.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:42:00+00:00, run_id=scheduled__2024-05-25T23:42:00+00:00, run_start_date=2024-05-25 23:43:00.480774+00:00, run_end_date=2024-05-25 23:43:04.587804+00:00, run_duration=4.10703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:42:00+00:00, data_interval_end=2024-05-25 23:43:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:43:04.597558277Z [2024-05-25T23:43:04.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:43:00+00:00, run_after=2024-05-25T23:44:00+00:00 2024-05-25T23:43:04.630756956Z [2024-05-25T23:43:04.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status success for try_number 1 2024-05-25T23:43:04.635181336Z [2024-05-25T23:43:04.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:42:00+00:00, map_index=-1, run_start_date=2024-05-25 23:43:02.641554+00:00, run_end_date=2024-05-25 23:43:03.958870+00:00, run_duration=1.317316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:43:00.536454+00:00, queued_by_job_id=1, pid=4210 2024-05-25T23:43:05.694206905Z [2024-05-25T23:43:05.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:43:05.694604503Z [2024-05-25T23:43:05.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:42:00+00:00, run_id=scheduled__2024-05-25T23:42:00+00:00, run_start_date=2024-05-25 23:43:00.481944+00:00, run_end_date=2024-05-25 23:43:05.694302+00:00, run_duration=5.212358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:42:00+00:00, data_interval_end=2024-05-25 23:43:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:43:05.709222145Z [2024-05-25T23:43:05.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:43:00+00:00, run_after=2024-05-25T23:44:00+00:00 2024-05-25T23:43:05.743718813Z [2024-05-25T23:43:05.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status success for try_number 1 2024-05-25T23:43:05.750571196Z [2024-05-25T23:43:05.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:42:00+00:00, map_index=-1, run_start_date=2024-05-25 23:43:03.000550+00:00, run_end_date=2024-05-25 23:43:04.769838+00:00, run_duration=1.769288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:43:00.536454+00:00, queued_by_job_id=1, pid=4221 2024-05-25T23:43:30.785196317Z [2024-05-25T23:43:30.784+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:44:00.225958193Z [2024-05-25T23:44:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:44:00+00:00, run_after=2024-05-25T23:45:00+00:00 2024-05-25T23:44:00.236193020Z [2024-05-25T23:44:00.235+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:44:00.244972386Z [2024-05-25T23:44:00.244+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:44:00.258817859Z [2024-05-25T23:44:00.258+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:44:00+00:00, run_after=2024-05-25T23:45:00+00:00 2024-05-25T23:44:00.357593792Z [2024-05-25T23:44:00.357+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:44:00.357631386Z 2024-05-25T23:44:00.357637339Z 2024-05-25T23:44:00.357641966Z 2024-05-25T23:44:00.357646684Z 2024-05-25T23:44:00.358001125Z [2024-05-25T23:44:00.357+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:44:00.358313928Z [2024-05-25T23:44:00.357+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:44:00.358586737Z [2024-05-25T23:44:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:44:00.358855507Z [2024-05-25T23:44:00.358+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:44:00.359760950Z [2024-05-25T23:44:00.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:44:00.359784130Z 2024-05-25T23:44:00.359792516Z 2024-05-25T23:44:00.359799220Z 2024-05-25T23:44:00.359806157Z 2024-05-25T23:44:00.365608519Z [2024-05-25T23:44:00.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:44:00.366087473Z [2024-05-25T23:44:00.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:44:00.366629825Z [2024-05-25T23:44:00.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:44:00.366954189Z [2024-05-25T23:44:00.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:44:00.367472685Z [2024-05-25T23:44:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:44:00.367678558Z [2024-05-25T23:44:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:44:00.368106735Z [2024-05-25T23:44:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:44:00.368364782Z [2024-05-25T23:44:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:44:00.712688890Z [2024-05-25T23:44:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status queued for try_number 1 2024-05-25T23:44:00.712872902Z [2024-05-25T23:44:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:43:00+00:00 exited with status queued for try_number 1 2024-05-25T23:44:00.713068613Z [2024-05-25T23:44:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:43:00+00:00 exited with status queued for try_number 1 2024-05-25T23:44:00.713640493Z [2024-05-25T23:44:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:43:00+00:00 exited with status queued for try_number 1 2024-05-25T23:44:00.746959293Z [2024-05-25T23:44:00.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9386782e-11e7-43d4-aacb-a5f0d6952ef6 2024-05-25T23:44:00.747033301Z [2024-05-25T23:44:00.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to de47c035-1129-4e78-b460-ba714c1651f8 2024-05-25T23:44:00.747038874Z [2024-05-25T23:44:00.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57365688-1b3b-4ce7-9957-a354f8458fb1 2024-05-25T23:44:00.747042680Z [2024-05-25T23:44:00.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6ec9bb3-9329-49d2-b5ea-8c3bcd032e67 2024-05-25T23:44:02.088802526Z [2024-05-25T23:44:02.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:44:02.089314286Z [2024-05-25T23:44:02.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:42:00+00:00, run_id=scheduled__2024-05-25T23:42:00+00:00, run_start_date=2024-05-25 23:44:00.272005+00:00, run_end_date=2024-05-25 23:44:02.088617+00:00, run_duration=1.816612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:42:00+00:00, data_interval_end=2024-05-25 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:44:02.098239875Z [2024-05-25T23:44:02.097+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:44:00+00:00, run_after=2024-05-25T23:46:00+00:00 2024-05-25T23:44:02.105197345Z [2024-05-25T23:44:02.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:44:02.105422450Z [2024-05-25T23:44:02.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:43:00+00:00, run_id=scheduled__2024-05-25T23:43:00+00:00, run_start_date=2024-05-25 23:44:00.273606+00:00, run_end_date=2024-05-25 23:44:02.104994+00:00, run_duration=1.831388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:43:00+00:00, data_interval_end=2024-05-25 23:44:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:44:02.126365697Z [2024-05-25T23:44:02.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:44:00+00:00, run_after=2024-05-25T23:45:00+00:00 2024-05-25T23:44:02.190236815Z [2024-05-25T23:44:02.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:42:00+00:00 exited with status success for try_number 1 2024-05-25T23:44:02.190468064Z [2024-05-25T23:44:02.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:43:00+00:00 exited with status success for try_number 1 2024-05-25T23:44:02.199487735Z [2024-05-25T23:44:02.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:42:00+00:00, map_index=-1, run_start_date=2024-05-25 23:44:01.261688+00:00, run_end_date=2024-05-25 23:44:01.791319+00:00, run_duration=0.529631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:44:00.360926+00:00, queued_by_job_id=1, pid=4249 2024-05-25T23:44:02.199815346Z [2024-05-25T23:44:02.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:43:00+00:00, map_index=-1, run_start_date=2024-05-25 23:44:01.320895+00:00, run_end_date=2024-05-25 23:44:01.833791+00:00, run_duration=0.512896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:44:00.360926+00:00, queued_by_job_id=1, pid=4250 2024-05-25T23:44:04.377348156Z [2024-05-25T23:44:04.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:44:04.378038275Z [2024-05-25T23:44:04.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:43:00+00:00, run_id=scheduled__2024-05-25T23:43:00+00:00, run_start_date=2024-05-25 23:44:00.274832+00:00, run_end_date=2024-05-25 23:44:04.377482+00:00, run_duration=4.10265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:43:00+00:00, data_interval_end=2024-05-25 23:44:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:44:04.398408164Z [2024-05-25T23:44:04.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:44:00+00:00, run_after=2024-05-25T23:45:00+00:00 2024-05-25T23:44:04.411096806Z [2024-05-25T23:44:04.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:44:04.411120442Z [2024-05-25T23:44:04.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:43:00+00:00, run_id=scheduled__2024-05-25T23:43:00+00:00, run_start_date=2024-05-25 23:44:00.276681+00:00, run_end_date=2024-05-25 23:44:04.410453+00:00, run_duration=4.133772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:43:00+00:00, data_interval_end=2024-05-25 23:44:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:44:04.429705920Z [2024-05-25T23:44:04.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:44:00+00:00, run_after=2024-05-25T23:45:00+00:00 2024-05-25T23:44:04.482358536Z [2024-05-25T23:44:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:43:00+00:00 exited with status success for try_number 1 2024-05-25T23:44:04.482375136Z [2024-05-25T23:44:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:43:00+00:00 exited with status success for try_number 1 2024-05-25T23:44:04.487431105Z [2024-05-25T23:44:04.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:43:00+00:00, map_index=-1, run_start_date=2024-05-25 23:44:02.334097+00:00, run_end_date=2024-05-25 23:44:03.845051+00:00, run_duration=1.510954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:44:00.360926+00:00, queued_by_job_id=1, pid=4273 2024-05-25T23:44:04.487488748Z [2024-05-25T23:44:04.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:43:00+00:00, map_index=-1, run_start_date=2024-05-25 23:44:02.400912+00:00, run_end_date=2024-05-25 23:44:04.264704+00:00, run_duration=1.863792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:44:00.360926+00:00, queued_by_job_id=1, pid=4274 2024-05-25T23:45:00.222262075Z [2024-05-25T23:45:00.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:45:00+00:00, run_after=2024-05-25T23:46:00+00:00 2024-05-25T23:45:00.234427631Z [2024-05-25T23:45:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:45:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:45:00.245994296Z [2024-05-25T23:45:00.245+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:45:00+00:00, run_after=2024-05-25T23:46:00+00:00 2024-05-25T23:45:00.252821815Z [2024-05-25T23:45:00.252+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:45:00.326327379Z [2024-05-25T23:45:00.325+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:45:00.326350379Z 2024-05-25T23:45:00.326354183Z 2024-05-25T23:45:00.326357357Z 2024-05-25T23:45:00.326360436Z 2024-05-25T23:45:00.326598872Z [2024-05-25T23:45:00.326+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:45:00.326783902Z [2024-05-25T23:45:00.326+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:45:00.326970365Z [2024-05-25T23:45:00.326+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:45:00.327133923Z [2024-05-25T23:45:00.327+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:45:00.327768545Z [2024-05-25T23:45:00.327+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:45:00.327780376Z 2024-05-25T23:45:00.327783784Z 2024-05-25T23:45:00.327787224Z 2024-05-25T23:45:00.327790280Z 2024-05-25T23:45:00.331084699Z [2024-05-25T23:45:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:45:00.331450897Z [2024-05-25T23:45:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:45:00.331803416Z [2024-05-25T23:45:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:45:00.332127399Z [2024-05-25T23:45:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:45:00.332339747Z [2024-05-25T23:45:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:45:00.332444675Z [2024-05-25T23:45:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:45:00.332705947Z [2024-05-25T23:45:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:45:00.332778587Z [2024-05-25T23:45:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:45:00.745581209Z [2024-05-25T23:45:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:45:00.747984479Z [2024-05-25T23:45:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status queued for try_number 1 2024-05-25T23:45:00.748048942Z [2024-05-25T23:45:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status queued for try_number 1 2024-05-25T23:45:00.748108933Z [2024-05-25T23:45:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status queued for try_number 1 2024-05-25T23:45:00.762875892Z [2024-05-25T23:45:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f972a58-011f-44f0-aa0c-766df7d92e21 2024-05-25T23:45:00.762896600Z [2024-05-25T23:45:00.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7788b2a-5625-4f87-a6b5-f2105be02096 2024-05-25T23:45:00.762906752Z [2024-05-25T23:45:00.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to edb9c72a-e8f2-430d-b96e-4f86e70b2a31 2024-05-25T23:45:00.762910760Z [2024-05-25T23:45:00.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44a16a34-6e6b-4caa-99d7-1d29566e022c 2024-05-25T23:45:01.946747603Z [2024-05-25T23:45:01.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:45:01.947505510Z [2024-05-25T23:45:01.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:44:00+00:00, run_id=scheduled__2024-05-25T23:44:00+00:00, run_start_date=2024-05-25 23:45:00.264402+00:00, run_end_date=2024-05-25 23:45:01.946697+00:00, run_duration=1.682295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:44:00+00:00, data_interval_end=2024-05-25 23:45:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:45:01.960759101Z [2024-05-25T23:45:01.960+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:45:00+00:00, run_after=2024-05-25T23:46:00+00:00 2024-05-25T23:45:02.060620684Z [2024-05-25T23:45:02.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status success for try_number 1 2024-05-25T23:45:02.083649932Z [2024-05-25T23:45:02.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:44:00+00:00, map_index=-1, run_start_date=2024-05-25 23:45:01.207263+00:00, run_end_date=2024-05-25 23:45:01.521505+00:00, run_duration=0.314242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:45:00.328565+00:00, queued_by_job_id=1, pid=4307 2024-05-25T23:45:03.221908801Z [2024-05-25T23:45:03.221+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:45:03.221940213Z 2024-05-25T23:45:03.221958214Z [2024-05-25T23:45:03.221+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:45:03.222716828Z [2024-05-25T23:45:03.222+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:45:03.222747418Z 2024-05-25T23:45:03.225553769Z [2024-05-25T23:45:03.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:45:03.225815203Z [2024-05-25T23:45:03.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:45:03.322994375Z [2024-05-25T23:45:03.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:45:03.323219129Z [2024-05-25T23:45:03.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:45:03.332136658Z [2024-05-25T23:45:03.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06319338-68b2-4ca4-996f-25fe522f419e 2024-05-25T23:45:03.332306460Z [2024-05-25T23:45:03.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=-1, run_start_date=2024-05-25 23:45:02.586319+00:00, run_end_date=2024-05-25 23:45:02.953404+00:00, run_duration=0.367085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:45:00.328565+00:00, queued_by_job_id=1, pid=4333 2024-05-25T23:45:04.584842476Z [2024-05-25T23:45:04.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:45:04.585072082Z [2024-05-25T23:45:04.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:44:00+00:00, run_id=scheduled__2024-05-25T23:44:00+00:00, run_start_date=2024-05-25 23:45:00.266430+00:00, run_end_date=2024-05-25 23:45:04.584737+00:00, run_duration=4.318307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:44:00+00:00, data_interval_end=2024-05-25 23:45:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:45:04.595200829Z [2024-05-25T23:45:04.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:45:00+00:00, run_after=2024-05-25T23:46:00+00:00 2024-05-25T23:45:04.602648079Z [2024-05-25T23:45:04.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:45:04.602810449Z [2024-05-25T23:45:04.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:44:00+00:00, run_id=scheduled__2024-05-25T23:44:00+00:00, run_start_date=2024-05-25 23:45:00.265391+00:00, run_end_date=2024-05-25 23:45:04.602571+00:00, run_duration=4.33718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:44:00+00:00, data_interval_end=2024-05-25 23:45:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:45:04.611984874Z [2024-05-25T23:45:04.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:45:00+00:00, run_after=2024-05-25T23:46:00+00:00 2024-05-25T23:45:04.654691298Z [2024-05-25T23:45:04.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status success for try_number 1 2024-05-25T23:45:04.654712943Z [2024-05-25T23:45:04.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status success for try_number 1 2024-05-25T23:45:04.671033223Z [2024-05-25T23:45:04.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:44:00+00:00, map_index=-1, run_start_date=2024-05-25 23:45:02.326031+00:00, run_end_date=2024-05-25 23:45:04.044602+00:00, run_duration=1.718571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:45:00.328565+00:00, queued_by_job_id=1, pid=4326 2024-05-25T23:45:04.671289155Z [2024-05-25T23:45:04.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:44:00+00:00, map_index=-1, run_start_date=2024-05-25 23:45:02.482781+00:00, run_end_date=2024-05-25 23:45:03.736745+00:00, run_duration=1.253964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:45:00.328565+00:00, queued_by_job_id=1, pid=4332 2024-05-25T23:45:05.759776802Z [2024-05-25T23:45:05.759+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:45:05.759815627Z 2024-05-25T23:45:05.759971632Z [2024-05-25T23:45:05.759+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:45:05.760745964Z [2024-05-25T23:45:05.760+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:45:05.760781895Z 2024-05-25T23:45:05.764035204Z [2024-05-25T23:45:05.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:45:05.764211758Z [2024-05-25T23:45:05.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:45:05.865583052Z [2024-05-25T23:45:05.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:45:05.865981209Z [2024-05-25T23:45:05.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:45:05.872837030Z [2024-05-25T23:45:05.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74aae252-fbea-4f0c-b05a-28aa293b15e8 2024-05-25T23:45:05.873302941Z [2024-05-25T23:45:05.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=-1, run_start_date=2024-05-25 23:45:04.906513+00:00, run_end_date=2024-05-25 23:45:05.247379+00:00, run_duration=0.340866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:45:03.223113+00:00, queued_by_job_id=1, pid=4356 2024-05-25T23:45:08.403239526Z [2024-05-25T23:45:08.402+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:45:08.403268560Z 2024-05-25T23:45:08.404733406Z [2024-05-25T23:45:08.403+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:45:08.404746762Z [2024-05-25T23:45:08.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:45:08.404751118Z 2024-05-25T23:45:08.435757134Z [2024-05-25T23:45:08.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:45:08.435796844Z [2024-05-25T23:45:08.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:45:08.488355047Z [2024-05-25T23:45:08.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status queued for try_number 1 2024-05-25T23:45:08.488383811Z [2024-05-25T23:45:08.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:45:08.499103290Z [2024-05-25T23:45:08.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to e137e712-c9d9-456d-8ba2-06df3ac10eae 2024-05-25T23:45:08.499477931Z [2024-05-25T23:45:08.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=0, run_start_date=2024-05-25 23:45:07.633727+00:00, run_end_date=2024-05-25 23:45:08.005518+00:00, run_duration=0.371791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:45:05.761238+00:00, queued_by_job_id=1, pid=4364 2024-05-25T23:45:10.704342190Z [2024-05-25T23:45:10.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:45:10.704728222Z [2024-05-25T23:45:10.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:40:00+00:00, run_id=scheduled__2024-05-25T23:40:00+00:00, run_start_date=2024-05-25 23:45:00.263160+00:00, run_end_date=2024-05-25 23:45:10.704240+00:00, run_duration=10.44108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:40:00+00:00, data_interval_end=2024-05-25 23:45:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:45:10.712961930Z [2024-05-25T23:45:10.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:45:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:45:10.757986719Z [2024-05-25T23:45:10.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:40:00+00:00 exited with status success for try_number 1 2024-05-25T23:45:10.763101909Z [2024-05-25T23:45:10.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:40:00+00:00, map_index=-1, run_start_date=2024-05-25 23:45:10.126477+00:00, run_end_date=2024-05-25 23:45:10.529217+00:00, run_duration=0.40274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:45:08.404506+00:00, queued_by_job_id=1, pid=4372 2024-05-25T23:46:00.308542974Z [2024-05-25T23:46:00.307+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:46:00.323697651Z [2024-05-25T23:46:00.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:46:00+00:00, run_after=2024-05-25T23:47:00+00:00 2024-05-25T23:46:00.339027368Z [2024-05-25T23:46:00.338+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:46:00+00:00, run_after=2024-05-25T23:47:00+00:00 2024-05-25T23:46:00.347234452Z [2024-05-25T23:46:00.346+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:46:00.435339857Z [2024-05-25T23:46:00.434+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:46:00.435397622Z 2024-05-25T23:46:00.435413722Z 2024-05-25T23:46:00.435427646Z 2024-05-25T23:46:00.435441730Z 2024-05-25T23:46:00.435773677Z [2024-05-25T23:46:00.435+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:46:00.436172070Z [2024-05-25T23:46:00.435+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:46:00.436516303Z [2024-05-25T23:46:00.436+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:46:00.436843178Z [2024-05-25T23:46:00.436+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:46:00.437798774Z [2024-05-25T23:46:00.437+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:46:00.437814505Z 2024-05-25T23:46:00.437820106Z 2024-05-25T23:46:00.437825022Z 2024-05-25T23:46:00.437858634Z 2024-05-25T23:46:00.443318604Z [2024-05-25T23:46:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:46:00.444835681Z [2024-05-25T23:46:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:46:00.445423696Z [2024-05-25T23:46:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:46:00.445801391Z [2024-05-25T23:46:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:46:00.446497733Z [2024-05-25T23:46:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:46:00.446870999Z [2024-05-25T23:46:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:46:00.447319874Z [2024-05-25T23:46:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:46:00.447692952Z [2024-05-25T23:46:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:46:00.714540124Z [2024-05-25T23:46:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status queued for try_number 1 2024-05-25T23:46:00.714558438Z [2024-05-25T23:46:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status queued for try_number 1 2024-05-25T23:46:00.714561953Z [2024-05-25T23:46:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status queued for try_number 1 2024-05-25T23:46:00.714564823Z [2024-05-25T23:46:00.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status queued for try_number 1 2024-05-25T23:46:00.735665900Z [2024-05-25T23:46:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 888fb615-f635-41ff-aaa2-d7cd4cd2a960 2024-05-25T23:46:00.735691324Z [2024-05-25T23:46:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1383a821-a459-493c-8433-89b75d73b947 2024-05-25T23:46:00.735695135Z [2024-05-25T23:46:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c8b80a0-2195-4ebf-bfcc-eb43440c8b13 2024-05-25T23:46:00.735698828Z [2024-05-25T23:46:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6608570d-fec8-4803-b882-20cb426a6c4b 2024-05-25T23:46:01.894043055Z [2024-05-25T23:46:01.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:46:01.894155215Z [2024-05-25T23:46:01.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:44:00+00:00, run_id=scheduled__2024-05-25T23:44:00+00:00, run_start_date=2024-05-25 23:46:00.357471+00:00, run_end_date=2024-05-25 23:46:01.893555+00:00, run_duration=1.536084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:44:00+00:00, data_interval_end=2024-05-25 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:46:01.902056732Z [2024-05-25T23:46:01.901+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:46:00+00:00, run_after=2024-05-25T23:48:00+00:00 2024-05-25T23:46:01.908744771Z [2024-05-25T23:46:01.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:46:01.908833610Z [2024-05-25T23:46:01.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:45:00+00:00, run_id=scheduled__2024-05-25T23:45:00+00:00, run_start_date=2024-05-25 23:46:00.358711+00:00, run_end_date=2024-05-25 23:46:01.908499+00:00, run_duration=1.549788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:45:00+00:00, data_interval_end=2024-05-25 23:46:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:46:01.918500766Z [2024-05-25T23:46:01.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:46:00+00:00, run_after=2024-05-25T23:47:00+00:00 2024-05-25T23:46:01.972976069Z [2024-05-25T23:46:01.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:44:00+00:00 exited with status success for try_number 1 2024-05-25T23:46:01.973016809Z [2024-05-25T23:46:01.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status success for try_number 1 2024-05-25T23:46:01.980441479Z [2024-05-25T23:46:01.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:45:00+00:00, map_index=-1, run_start_date=2024-05-25 23:46:01.330389+00:00, run_end_date=2024-05-25 23:46:01.730621+00:00, run_duration=0.400232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:46:00.439138+00:00, queued_by_job_id=1, pid=4396 2024-05-25T23:46:01.980642051Z [2024-05-25T23:46:01.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:44:00+00:00, map_index=-1, run_start_date=2024-05-25 23:46:01.288866+00:00, run_end_date=2024-05-25 23:46:01.743303+00:00, run_duration=0.454437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:46:00.439138+00:00, queued_by_job_id=1, pid=4395 2024-05-25T23:46:04.311509660Z [2024-05-25T23:46:04.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:46:04.311805084Z [2024-05-25T23:46:04.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:45:00+00:00, run_id=scheduled__2024-05-25T23:45:00+00:00, run_start_date=2024-05-25 23:46:00.360033+00:00, run_end_date=2024-05-25 23:46:04.311345+00:00, run_duration=3.951312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:45:00+00:00, data_interval_end=2024-05-25 23:46:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:46:04.324472445Z [2024-05-25T23:46:04.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:46:00+00:00, run_after=2024-05-25T23:47:00+00:00 2024-05-25T23:46:04.331585599Z [2024-05-25T23:46:04.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:46:04.331659909Z [2024-05-25T23:46:04.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:45:00+00:00, run_id=scheduled__2024-05-25T23:45:00+00:00, run_start_date=2024-05-25 23:46:00.361305+00:00, run_end_date=2024-05-25 23:46:04.331403+00:00, run_duration=3.970098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:45:00+00:00, data_interval_end=2024-05-25 23:46:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:46:04.341355077Z [2024-05-25T23:46:04.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:46:00+00:00, run_after=2024-05-25T23:47:00+00:00 2024-05-25T23:46:04.373018754Z [2024-05-25T23:46:04.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status success for try_number 1 2024-05-25T23:46:04.378552891Z [2024-05-25T23:46:04.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:45:00+00:00, map_index=-1, run_start_date=2024-05-25 23:46:02.462222+00:00, run_end_date=2024-05-25 23:46:03.847207+00:00, run_duration=1.384985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:46:00.439138+00:00, queued_by_job_id=1, pid=4419 2024-05-25T23:46:05.476426047Z [2024-05-25T23:46:05.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status success for try_number 1 2024-05-25T23:46:05.488627873Z [2024-05-25T23:46:05.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:45:00+00:00, map_index=-1, run_start_date=2024-05-25 23:46:02.473448+00:00, run_end_date=2024-05-25 23:46:04.243351+00:00, run_duration=1.769903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:46:00.439138+00:00, queued_by_job_id=1, pid=4420 2024-05-25T23:47:00.160912403Z [2024-05-25T23:47:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:47:00.181445669Z [2024-05-25T23:47:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:47:00+00:00, run_after=2024-05-25T23:48:00+00:00 2024-05-25T23:47:00.202430466Z [2024-05-25T23:47:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:47:00+00:00, run_after=2024-05-25T23:48:00+00:00 2024-05-25T23:47:00.275621408Z [2024-05-25T23:47:00.275+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:47:00.275644043Z 2024-05-25T23:47:00.275649190Z 2024-05-25T23:47:00.275654001Z 2024-05-25T23:47:00.276306442Z [2024-05-25T23:47:00.275+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:47:00.276633327Z [2024-05-25T23:47:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:47:00.277465196Z [2024-05-25T23:47:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:47:00.278279370Z [2024-05-25T23:47:00.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:47:00.278293660Z 2024-05-25T23:47:00.278298413Z 2024-05-25T23:47:00.278302932Z 2024-05-25T23:47:00.282563646Z [2024-05-25T23:47:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:47:00.282940952Z [2024-05-25T23:47:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:47:00.283350338Z [2024-05-25T23:47:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:47:00.283583757Z [2024-05-25T23:47:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:47:00.283915010Z [2024-05-25T23:47:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:47:00.284100441Z [2024-05-25T23:47:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:47:00.791599324Z [2024-05-25T23:47:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status queued for try_number 1 2024-05-25T23:47:00.791621160Z [2024-05-25T23:47:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status queued for try_number 1 2024-05-25T23:47:00.791624703Z [2024-05-25T23:47:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status queued for try_number 1 2024-05-25T23:47:00.862586094Z [2024-05-25T23:47:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dc4f665-cd2b-47d1-97ba-ad663e852d6b 2024-05-25T23:47:00.862691913Z [2024-05-25T23:47:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to 421653fe-8ec7-428e-bb60-699f9547de54 2024-05-25T23:47:00.862787863Z [2024-05-25T23:47:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to a134e27f-d915-4a99-bd81-044edc023c19 2024-05-25T23:47:02.596517908Z [2024-05-25T23:47:02.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:47:02.596976189Z [2024-05-25T23:47:02.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:46:00+00:00, run_id=scheduled__2024-05-25T23:46:00+00:00, run_start_date=2024-05-25 23:47:00.211276+00:00, run_end_date=2024-05-25 23:47:02.596425+00:00, run_duration=2.385149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:46:00+00:00, data_interval_end=2024-05-25 23:47:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:47:02.611624701Z [2024-05-25T23:47:02.610+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:47:00+00:00, run_after=2024-05-25T23:48:00+00:00 2024-05-25T23:47:02.714623426Z [2024-05-25T23:47:02.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status success for try_number 1 2024-05-25T23:47:02.729654909Z [2024-05-25T23:47:02.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:46:00+00:00, map_index=-1, run_start_date=2024-05-25 23:47:01.770800+00:00, run_end_date=2024-05-25 23:47:02.394871+00:00, run_duration=0.624071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:47:00.279397+00:00, queued_by_job_id=1, pid=4453 2024-05-25T23:47:06.856690943Z [2024-05-25T23:47:06.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:47:06.857097197Z [2024-05-25T23:47:06.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:46:00+00:00, run_id=scheduled__2024-05-25T23:46:00+00:00, run_start_date=2024-05-25 23:47:00.212583+00:00, run_end_date=2024-05-25 23:47:06.856609+00:00, run_duration=6.644026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:46:00+00:00, data_interval_end=2024-05-25 23:47:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:47:06.875619052Z [2024-05-25T23:47:06.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:47:00+00:00, run_after=2024-05-25T23:48:00+00:00 2024-05-25T23:47:06.989181482Z [2024-05-25T23:47:06.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status success for try_number 1 2024-05-25T23:47:06.994583762Z [2024-05-25T23:47:06.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:46:00+00:00, map_index=-1, run_start_date=2024-05-25 23:47:04.406604+00:00, run_end_date=2024-05-25 23:47:06.208799+00:00, run_duration=1.802195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:47:00.279397+00:00, queued_by_job_id=1, pid=4471 2024-05-25T23:47:09.177839308Z [2024-05-25T23:47:09.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:47:09.178479721Z [2024-05-25T23:47:09.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:46:00+00:00, run_id=scheduled__2024-05-25T23:46:00+00:00, run_start_date=2024-05-25 23:47:00.213776+00:00, run_end_date=2024-05-25 23:47:09.177942+00:00, run_duration=8.964166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:46:00+00:00, data_interval_end=2024-05-25 23:47:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:47:09.187272777Z [2024-05-25T23:47:09.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:47:00+00:00, run_after=2024-05-25T23:48:00+00:00 2024-05-25T23:47:09.220716346Z [2024-05-25T23:47:09.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status success for try_number 1 2024-05-25T23:47:09.227070438Z [2024-05-25T23:47:09.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:46:00+00:00, map_index=-1, run_start_date=2024-05-25 23:47:04.763213+00:00, run_end_date=2024-05-25 23:47:08.365491+00:00, run_duration=3.602278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:47:00.279397+00:00, queued_by_job_id=1, pid=4472 2024-05-25T23:48:00.283405229Z [2024-05-25T23:48:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:48:00+00:00, run_after=2024-05-25T23:49:00+00:00 2024-05-25T23:48:00.316707723Z [2024-05-25T23:48:00.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:48:00+00:00, run_after=2024-05-25T23:49:00+00:00 2024-05-25T23:48:00.325769819Z [2024-05-25T23:48:00.325+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:48:00.332061190Z [2024-05-25T23:48:00.331+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:48:00.422999933Z [2024-05-25T23:48:00.422+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:48:00.423043074Z 2024-05-25T23:48:00.423053916Z 2024-05-25T23:48:00.423062809Z 2024-05-25T23:48:00.423071143Z 2024-05-25T23:48:00.423080221Z [2024-05-25T23:48:00.422+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:48:00.423397929Z [2024-05-25T23:48:00.422+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:48:00.424049042Z [2024-05-25T23:48:00.423+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:48:00.424563946Z [2024-05-25T23:48:00.424+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:48:00.426091637Z [2024-05-25T23:48:00.425+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:48:00.426105890Z 2024-05-25T23:48:00.426110818Z 2024-05-25T23:48:00.426114745Z 2024-05-25T23:48:00.426118487Z 2024-05-25T23:48:00.431658994Z [2024-05-25T23:48:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:48:00.431921096Z [2024-05-25T23:48:00.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:48:00.432301792Z [2024-05-25T23:48:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:48:00.432488587Z [2024-05-25T23:48:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:48:00.432817506Z [2024-05-25T23:48:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:48:00.433018604Z [2024-05-25T23:48:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:48:00.433450079Z [2024-05-25T23:48:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:48:00.433704588Z [2024-05-25T23:48:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:48:00.715037931Z [2024-05-25T23:48:00.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status queued for try_number 1 2024-05-25T23:48:00.715061248Z [2024-05-25T23:48:00.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:47:00+00:00 exited with status queued for try_number 1 2024-05-25T23:48:00.715233970Z [2024-05-25T23:48:00.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:47:00+00:00 exited with status queued for try_number 1 2024-05-25T23:48:00.715935217Z [2024-05-25T23:48:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:47:00+00:00 exited with status queued for try_number 1 2024-05-25T23:48:00.731607330Z [2024-05-25T23:48:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 572d56fb-89f6-4acc-a943-f5a5867c99a1 2024-05-25T23:48:00.731637018Z [2024-05-25T23:48:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccb440fb-8f34-4990-9d31-e371c00368d9 2024-05-25T23:48:00.731640556Z [2024-05-25T23:48:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9cbeee9-0048-4cb6-9d2d-551276f535bd 2024-05-25T23:48:00.731643690Z [2024-05-25T23:48:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b537be9-6064-4f22-bb31-75e2807b7d1c 2024-05-25T23:48:02.043784320Z [2024-05-25T23:48:02.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:48:02.044034525Z [2024-05-25T23:48:02.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:46:00+00:00, run_id=scheduled__2024-05-25T23:46:00+00:00, run_start_date=2024-05-25 23:48:00.341299+00:00, run_end_date=2024-05-25 23:48:02.043714+00:00, run_duration=1.702415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:46:00+00:00, data_interval_end=2024-05-25 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:48:02.059194240Z [2024-05-25T23:48:02.058+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:48:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:48:02.087739553Z [2024-05-25T23:48:02.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:48:02.087974897Z [2024-05-25T23:48:02.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:47:00+00:00, run_id=scheduled__2024-05-25T23:47:00+00:00, run_start_date=2024-05-25 23:48:00.342477+00:00, run_end_date=2024-05-25 23:48:02.087669+00:00, run_duration=1.745192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:47:00+00:00, data_interval_end=2024-05-25 23:48:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:48:02.100262315Z [2024-05-25T23:48:02.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:48:00+00:00, run_after=2024-05-25T23:49:00+00:00 2024-05-25T23:48:02.269590851Z [2024-05-25T23:48:02.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:46:00+00:00 exited with status success for try_number 1 2024-05-25T23:48:02.269893410Z [2024-05-25T23:48:02.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:47:00+00:00 exited with status success for try_number 1 2024-05-25T23:48:02.284036224Z [2024-05-25T23:48:02.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:46:00+00:00, map_index=-1, run_start_date=2024-05-25 23:48:01.243808+00:00, run_end_date=2024-05-25 23:48:01.716496+00:00, run_duration=0.472688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:48:00.427191+00:00, queued_by_job_id=1, pid=4505 2024-05-25T23:48:02.284393445Z [2024-05-25T23:48:02.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:47:00+00:00, map_index=-1, run_start_date=2024-05-25 23:48:01.340397+00:00, run_end_date=2024-05-25 23:48:01.884576+00:00, run_duration=0.544179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:48:00.427191+00:00, queued_by_job_id=1, pid=4506 2024-05-25T23:48:04.794252843Z [2024-05-25T23:48:04.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:48:04.794801970Z [2024-05-25T23:48:04.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:47:00+00:00, run_id=scheduled__2024-05-25T23:47:00+00:00, run_start_date=2024-05-25 23:48:00.343554+00:00, run_end_date=2024-05-25 23:48:04.794174+00:00, run_duration=4.45062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:47:00+00:00, data_interval_end=2024-05-25 23:48:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:48:04.806736656Z [2024-05-25T23:48:04.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:48:00+00:00, run_after=2024-05-25T23:49:00+00:00 2024-05-25T23:48:04.825790025Z [2024-05-25T23:48:04.825+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:48:04.826235346Z [2024-05-25T23:48:04.826+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:47:00+00:00, run_id=scheduled__2024-05-25T23:47:00+00:00, run_start_date=2024-05-25 23:48:00.344613+00:00, run_end_date=2024-05-25 23:48:04.825709+00:00, run_duration=4.481096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:47:00+00:00, data_interval_end=2024-05-25 23:48:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:48:04.838370793Z [2024-05-25T23:48:04.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:48:00+00:00, run_after=2024-05-25T23:49:00+00:00 2024-05-25T23:48:04.922706143Z [2024-05-25T23:48:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:47:00+00:00 exited with status success for try_number 1 2024-05-25T23:48:04.930639530Z [2024-05-25T23:48:04.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:47:00+00:00, map_index=-1, run_start_date=2024-05-25 23:48:02.780626+00:00, run_end_date=2024-05-25 23:48:04.356464+00:00, run_duration=1.575838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:48:00.427191+00:00, queued_by_job_id=1, pid=4529 2024-05-25T23:48:06.022899368Z [2024-05-25T23:48:06.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:47:00+00:00 exited with status success for try_number 1 2024-05-25T23:48:06.030156435Z [2024-05-25T23:48:06.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:47:00+00:00, map_index=-1, run_start_date=2024-05-25 23:48:02.814142+00:00, run_end_date=2024-05-25 23:48:04.720995+00:00, run_duration=1.906853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:48:00.427191+00:00, queued_by_job_id=1, pid=4530 2024-05-25T23:48:30.850967105Z [2024-05-25T23:48:30.850+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:49:00.237888339Z [2024-05-25T23:49:00.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:49:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:49:00.256968070Z [2024-05-25T23:49:00.256+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:49:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:49:00.265659027Z [2024-05-25T23:49:00.265+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:49:00.351261614Z [2024-05-25T23:49:00.350+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:49:00.351301006Z 2024-05-25T23:49:00.351308995Z 2024-05-25T23:49:00.351316302Z 2024-05-25T23:49:00.351375042Z [2024-05-25T23:49:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:49:00.351677656Z [2024-05-25T23:49:00.351+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:49:00.351721322Z [2024-05-25T23:49:00.351+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:49:00.352349718Z [2024-05-25T23:49:00.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:49:00.352379218Z 2024-05-25T23:49:00.352452464Z 2024-05-25T23:49:00.352462170Z 2024-05-25T23:49:00.356448985Z [2024-05-25T23:49:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:49:00.356716300Z [2024-05-25T23:49:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:49:00.356856006Z [2024-05-25T23:49:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:49:00.356961675Z [2024-05-25T23:49:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:49:00.357268361Z [2024-05-25T23:49:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:49:00.357343671Z [2024-05-25T23:49:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:49:00.611895120Z [2024-05-25T23:49:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status queued for try_number 1 2024-05-25T23:49:00.612014419Z [2024-05-25T23:49:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status queued for try_number 1 2024-05-25T23:49:00.612162310Z [2024-05-25T23:49:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status queued for try_number 1 2024-05-25T23:49:00.626390530Z [2024-05-25T23:49:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac9a83b2-286a-4e6f-bf5f-ae4f92dc2110 2024-05-25T23:49:00.626447907Z [2024-05-25T23:49:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 805ae796-f992-4879-b979-6f2211edc8cb 2024-05-25T23:49:00.626645010Z [2024-05-25T23:49:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f61f21d-0f45-4293-9046-f4dee3efc6b8 2024-05-25T23:49:01.801362082Z [2024-05-25T23:49:01.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:49:01.801620153Z [2024-05-25T23:49:01.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:48:00+00:00, run_id=scheduled__2024-05-25T23:48:00+00:00, run_start_date=2024-05-25 23:49:00.277367+00:00, run_end_date=2024-05-25 23:49:01.801229+00:00, run_duration=1.523862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:48:00+00:00, data_interval_end=2024-05-25 23:49:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:49:01.812181135Z [2024-05-25T23:49:01.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:49:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:49:01.880767905Z [2024-05-25T23:49:01.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status success for try_number 1 2024-05-25T23:49:01.890115644Z [2024-05-25T23:49:01.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:48:00+00:00, map_index=-1, run_start_date=2024-05-25 23:49:01.202300+00:00, run_end_date=2024-05-25 23:49:01.579861+00:00, run_duration=0.377561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:49:00.353033+00:00, queued_by_job_id=1, pid=4562 2024-05-25T23:49:05.205981789Z [2024-05-25T23:49:05.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:49:05.206411786Z [2024-05-25T23:49:05.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:48:00+00:00, run_id=scheduled__2024-05-25T23:48:00+00:00, run_start_date=2024-05-25 23:49:00.278808+00:00, run_end_date=2024-05-25 23:49:05.205852+00:00, run_duration=4.927044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:48:00+00:00, data_interval_end=2024-05-25 23:49:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:49:05.216886720Z [2024-05-25T23:49:05.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:49:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:49:05.226328725Z [2024-05-25T23:49:05.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:49:05.226546644Z [2024-05-25T23:49:05.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:48:00+00:00, run_id=scheduled__2024-05-25T23:48:00+00:00, run_start_date=2024-05-25 23:49:00.280255+00:00, run_end_date=2024-05-25 23:49:05.226176+00:00, run_duration=4.945921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:48:00+00:00, data_interval_end=2024-05-25 23:49:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:49:05.236836927Z [2024-05-25T23:49:05.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:49:00+00:00, run_after=2024-05-25T23:50:00+00:00 2024-05-25T23:49:05.280865795Z [2024-05-25T23:49:05.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status success for try_number 1 2024-05-25T23:49:05.281571787Z [2024-05-25T23:49:05.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status success for try_number 1 2024-05-25T23:49:05.294670483Z [2024-05-25T23:49:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:48:00+00:00, map_index=-1, run_start_date=2024-05-25 23:49:02.557578+00:00, run_end_date=2024-05-25 23:49:03.963041+00:00, run_duration=1.405463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:49:00.353033+00:00, queued_by_job_id=1, pid=4581 2024-05-25T23:49:05.295161466Z [2024-05-25T23:49:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:48:00+00:00, map_index=-1, run_start_date=2024-05-25 23:49:02.337183+00:00, run_end_date=2024-05-25 23:49:04.291121+00:00, run_duration=1.953938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:49:00.353033+00:00, queued_by_job_id=1, pid=4580 2024-05-25T23:50:00.123828427Z [2024-05-25T23:50:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:55:00+00:00 2024-05-25T23:50:00.132428388Z [2024-05-25T23:50:00.132+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:50:00.145215640Z [2024-05-25T23:50:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:51:00+00:00 2024-05-25T23:50:00.152585137Z [2024-05-25T23:50:00.152+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:50:00.165182209Z [2024-05-25T23:50:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:51:00+00:00 2024-05-25T23:50:00.249585484Z [2024-05-25T23:50:00.249+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-25T23:50:00.249629984Z 2024-05-25T23:50:00.249639668Z 2024-05-25T23:50:00.249676968Z 2024-05-25T23:50:00.249685899Z 2024-05-25T23:50:00.249694199Z 2024-05-25T23:50:00.249716491Z [2024-05-25T23:50:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:50:00.249810662Z [2024-05-25T23:50:00.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:50:00.249950691Z [2024-05-25T23:50:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:50:00.250080516Z [2024-05-25T23:50:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:50:00.250215871Z [2024-05-25T23:50:00.250+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:50:00.250925907Z [2024-05-25T23:50:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:50:00.250947059Z 2024-05-25T23:50:00.250957205Z 2024-05-25T23:50:00.250966157Z 2024-05-25T23:50:00.250974470Z 2024-05-25T23:50:00.250982964Z 2024-05-25T23:50:00.255342100Z [2024-05-25T23:50:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:50:00.255476119Z [2024-05-25T23:50:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:50:00.255841633Z [2024-05-25T23:50:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:50:00.255951060Z [2024-05-25T23:50:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:50:00.256242174Z [2024-05-25T23:50:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:50:00.256363213Z [2024-05-25T23:50:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:50:00.256687109Z [2024-05-25T23:50:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:50:00.256828608Z [2024-05-25T23:50:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:50:00.257085041Z [2024-05-25T23:50:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:50:00.257196854Z [2024-05-25T23:50:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:50:00.658070765Z [2024-05-25T23:50:00.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:00.658210098Z [2024-05-25T23:50:00.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:00.658309974Z [2024-05-25T23:50:00.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:49:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:00.658482777Z [2024-05-25T23:50:00.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:49:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:00.658676738Z [2024-05-25T23:50:00.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:49:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:00.673097359Z [2024-05-25T23:50:00.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e024349-7a23-464c-a19f-3443f723e737 2024-05-25T23:50:00.680134323Z [2024-05-25T23:50:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to e08ef8a2-7fa3-4a99-90f3-64a8df897c19 2024-05-25T23:50:00.680359418Z [2024-05-25T23:50:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f28692d-7896-4b2c-a0d4-eec2576c5ffe 2024-05-25T23:50:00.680581219Z [2024-05-25T23:50:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09128312-7e24-4cc4-8dbe-0ea58ae8d9d8 2024-05-25T23:50:00.680794924Z [2024-05-25T23:50:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99c78b83-9f2b-4211-b4d5-802986633cb1 2024-05-25T23:50:01.984807387Z [2024-05-25T23:50:01.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:50:01.985128111Z [2024-05-25T23:50:01.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:48:00+00:00, run_id=scheduled__2024-05-25T23:48:00+00:00, run_start_date=2024-05-25 23:50:00.176051+00:00, run_end_date=2024-05-25 23:50:01.984793+00:00, run_duration=1.808742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:48:00+00:00, data_interval_end=2024-05-25 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:50:02.000036312Z [2024-05-25T23:50:01.999+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:52:00+00:00 2024-05-25T23:50:02.101458699Z [2024-05-25T23:50:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:48:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:02.113006490Z [2024-05-25T23:50:02.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:48:00+00:00, map_index=-1, run_start_date=2024-05-25 23:50:01.190877+00:00, run_end_date=2024-05-25 23:50:01.670911+00:00, run_duration=0.480034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:00.252009+00:00, queued_by_job_id=1, pid=4610 2024-05-25T23:50:03.175015043Z [2024-05-25T23:50:03.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:50:03.175040159Z [2024-05-25T23:50:03.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:49:00+00:00, run_id=scheduled__2024-05-25T23:49:00+00:00, run_start_date=2024-05-25 23:50:00.176994+00:00, run_end_date=2024-05-25 23:50:03.172153+00:00, run_duration=2.995159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:49:00+00:00, data_interval_end=2024-05-25 23:50:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:50:03.191080065Z [2024-05-25T23:50:03.183+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:51:00+00:00 2024-05-25T23:50:03.259613971Z [2024-05-25T23:50:03.258+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:50:03.259640769Z 2024-05-25T23:50:03.259645400Z [2024-05-25T23:50:03.258+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:50:03.259659558Z [2024-05-25T23:50:03.259+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:50:03.259662721Z 2024-05-25T23:50:03.262565323Z [2024-05-25T23:50:03.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:50:03.264181811Z [2024-05-25T23:50:03.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:50:03.322654436Z [2024-05-25T23:50:03.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:03.322805207Z [2024-05-25T23:50:03.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:49:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:03.334821148Z [2024-05-25T23:50:03.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05d652e8-8601-4158-8870-90fb0c5ad6fe 2024-05-25T23:50:03.335135897Z [2024-05-25T23:50:03.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:49:00+00:00, map_index=-1, run_start_date=2024-05-25 23:50:01.790332+00:00, run_end_date=2024-05-25 23:50:02.485366+00:00, run_duration=0.695034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:00.252009+00:00, queued_by_job_id=1, pid=4624 2024-05-25T23:50:03.516410180Z [2024-05-25T23:50:03.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:03.538343943Z [2024-05-25T23:50:03.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:45:00+00:00, map_index=-1, run_start_date=2024-05-25 23:50:02.647741+00:00, run_end_date=2024-05-25 23:50:03.112784+00:00, run_duration=0.465043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:00.252009+00:00, queued_by_job_id=1, pid=4640 2024-05-25T23:50:05.719106307Z [2024-05-25T23:50:05.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:50:05.719394920Z [2024-05-25T23:50:05.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:49:00+00:00, run_id=scheduled__2024-05-25T23:49:00+00:00, run_start_date=2024-05-25 23:50:00.178831+00:00, run_end_date=2024-05-25 23:50:05.719031+00:00, run_duration=5.5402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:49:00+00:00, data_interval_end=2024-05-25 23:50:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:50:05.728252437Z [2024-05-25T23:50:05.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:51:00+00:00 2024-05-25T23:50:05.735644424Z [2024-05-25T23:50:05.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:50:05.735673058Z [2024-05-25T23:50:05.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:49:00+00:00, run_id=scheduled__2024-05-25T23:49:00+00:00, run_start_date=2024-05-25 23:50:00.177920+00:00, run_end_date=2024-05-25 23:50:05.734794+00:00, run_duration=5.556874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:49:00+00:00, data_interval_end=2024-05-25 23:50:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:50:05.746108571Z [2024-05-25T23:50:05.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:51:00+00:00 2024-05-25T23:50:05.786978327Z [2024-05-25T23:50:05.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:49:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:05.787352606Z [2024-05-25T23:50:05.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:49:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:05.793268476Z [2024-05-25T23:50:05.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:49:00+00:00, map_index=-1, run_start_date=2024-05-25 23:50:02.899022+00:00, run_end_date=2024-05-25 23:50:05.090287+00:00, run_duration=2.191265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:00.252009+00:00, queued_by_job_id=1, pid=4641 2024-05-25T23:50:05.793686741Z [2024-05-25T23:50:05.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:49:00+00:00, map_index=-1, run_start_date=2024-05-25 23:50:03.264671+00:00, run_end_date=2024-05-25 23:50:05.044303+00:00, run_duration=1.779632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:00.252009+00:00, queued_by_job_id=1, pid=4657 2024-05-25T23:50:06.878136385Z [2024-05-25T23:50:06.877+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:50:06.878171928Z 2024-05-25T23:50:06.878560476Z [2024-05-25T23:50:06.878+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:50:06.879661585Z [2024-05-25T23:50:06.879+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:50:06.879742034Z 2024-05-25T23:50:06.882260416Z [2024-05-25T23:50:06.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:50:06.882509268Z [2024-05-25T23:50:06.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:50:06.947123448Z [2024-05-25T23:50:06.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:06.947438709Z [2024-05-25T23:50:06.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:06.958411305Z [2024-05-25T23:50:06.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81186120-e8b7-481d-8c19-8113e0b79e35 2024-05-25T23:50:06.958791353Z [2024-05-25T23:50:06.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:45:00+00:00, map_index=-1, run_start_date=2024-05-25 23:50:05.535955+00:00, run_end_date=2024-05-25 23:50:05.912356+00:00, run_duration=0.376401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:03.260164+00:00, queued_by_job_id=1, pid=4670 2024-05-25T23:50:09.024553991Z [2024-05-25T23:50:09.024+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:50:09.024577840Z 2024-05-25T23:50:09.024630024Z [2024-05-25T23:50:09.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:50:09.025236887Z [2024-05-25T23:50:09.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:50:09.025242645Z 2024-05-25T23:50:09.029018741Z [2024-05-25T23:50:09.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:50:09.029063778Z [2024-05-25T23:50:09.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:50:09.076895657Z [2024-05-25T23:50:09.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status queued for try_number 1 2024-05-25T23:50:09.076933129Z [2024-05-25T23:50:09.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:09.084244078Z [2024-05-25T23:50:09.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to a990a36a-a9d6-4764-a1e3-8a4fca09f40e 2024-05-25T23:50:09.084340963Z [2024-05-25T23:50:09.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:45:00+00:00, map_index=0, run_start_date=2024-05-25 23:50:08.550945+00:00, run_end_date=2024-05-25 23:50:08.844321+00:00, run_duration=0.293376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:06.880120+00:00, queued_by_job_id=1, pid=4678 2024-05-25T23:50:11.337156135Z [2024-05-25T23:50:11.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:50:11.337578611Z [2024-05-25T23:50:11.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:45:00+00:00, run_id=scheduled__2024-05-25T23:45:00+00:00, run_start_date=2024-05-25 23:50:00.174798+00:00, run_end_date=2024-05-25 23:50:11.337185+00:00, run_duration=11.162387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:45:00+00:00, data_interval_end=2024-05-25 23:50:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:50:11.344794982Z [2024-05-25T23:50:11.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:50:00+00:00, run_after=2024-05-25T23:55:00+00:00 2024-05-25T23:50:11.385549347Z [2024-05-25T23:50:11.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:45:00+00:00 exited with status success for try_number 1 2024-05-25T23:50:11.392764713Z [2024-05-25T23:50:11.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:45:00+00:00, map_index=-1, run_start_date=2024-05-25 23:50:10.627957+00:00, run_end_date=2024-05-25 23:50:10.979121+00:00, run_duration=0.351164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:50:09.026528+00:00, queued_by_job_id=1, pid=4686 2024-05-25T23:51:00.065351170Z [2024-05-25T23:51:00.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:51:00+00:00, run_after=2024-05-25T23:52:00+00:00 2024-05-25T23:51:00.078617727Z [2024-05-25T23:51:00.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:51:00+00:00, run_after=2024-05-25T23:52:00+00:00 2024-05-25T23:51:00.087796589Z [2024-05-25T23:51:00.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:51:00.165208930Z [2024-05-25T23:51:00.164+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:51:00.165255313Z 2024-05-25T23:51:00.165265439Z 2024-05-25T23:51:00.165274021Z 2024-05-25T23:51:00.165282380Z [2024-05-25T23:51:00.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:51:00.165304701Z [2024-05-25T23:51:00.165+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:51:00.165419572Z [2024-05-25T23:51:00.165+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:51:00.166320965Z [2024-05-25T23:51:00.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:51:00.166349897Z 2024-05-25T23:51:00.166363814Z 2024-05-25T23:51:00.166379739Z 2024-05-25T23:51:00.171182681Z [2024-05-25T23:51:00.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:51:00.171313762Z [2024-05-25T23:51:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:51:00.171605140Z [2024-05-25T23:51:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:51:00.171812638Z [2024-05-25T23:51:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:51:00.172050208Z [2024-05-25T23:51:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:51:00.172114562Z [2024-05-25T23:51:00.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:51:00.562844810Z [2024-05-25T23:51:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:51:00.562869996Z [2024-05-25T23:51:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:51:00.562950837Z [2024-05-25T23:51:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:51:00.577175852Z [2024-05-25T23:51:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc9b5e45-54d9-4e54-bdd4-be843749f62e 2024-05-25T23:51:00.577267152Z [2024-05-25T23:51:00.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3787febd-74bf-4687-8912-3025347fbfcc 2024-05-25T23:51:00.577380693Z [2024-05-25T23:51:00.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c1902a4-a0ee-4e3e-990d-b93847f50a9b 2024-05-25T23:51:01.790770716Z [2024-05-25T23:51:01.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:51:01.790974684Z [2024-05-25T23:51:01.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:50:00+00:00, run_id=scheduled__2024-05-25T23:50:00+00:00, run_start_date=2024-05-25 23:51:00.100969+00:00, run_end_date=2024-05-25 23:51:01.790675+00:00, run_duration=1.689706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:50:00+00:00, data_interval_end=2024-05-25 23:51:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:51:01.805688622Z [2024-05-25T23:51:01.805+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:51:00+00:00, run_after=2024-05-25T23:52:00+00:00 2024-05-25T23:51:01.886531411Z [2024-05-25T23:51:01.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:51:01.895865612Z [2024-05-25T23:51:01.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=-1, run_start_date=2024-05-25 23:51:01.089021+00:00, run_end_date=2024-05-25 23:51:01.619105+00:00, run_duration=0.530084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:51:00.166950+00:00, queued_by_job_id=1, pid=4709 2024-05-25T23:51:04.057875570Z [2024-05-25T23:51:04.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:51:04.059002769Z [2024-05-25T23:51:04.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:50:00+00:00, run_id=scheduled__2024-05-25T23:50:00+00:00, run_start_date=2024-05-25 23:51:00.102261+00:00, run_end_date=2024-05-25 23:51:04.058452+00:00, run_duration=3.956191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:50:00+00:00, data_interval_end=2024-05-25 23:51:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:51:04.070101467Z [2024-05-25T23:51:04.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:51:00+00:00, run_after=2024-05-25T23:52:00+00:00 2024-05-25T23:51:04.076911361Z [2024-05-25T23:51:04.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:51:04.077414661Z [2024-05-25T23:51:04.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:50:00+00:00, run_id=scheduled__2024-05-25T23:50:00+00:00, run_start_date=2024-05-25 23:51:00.103306+00:00, run_end_date=2024-05-25 23:51:04.076822+00:00, run_duration=3.973516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:50:00+00:00, data_interval_end=2024-05-25 23:51:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:51:04.086953800Z [2024-05-25T23:51:04.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:51:00+00:00, run_after=2024-05-25T23:52:00+00:00 2024-05-25T23:51:04.134638533Z [2024-05-25T23:51:04.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:51:04.135092134Z [2024-05-25T23:51:04.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:51:04.146888326Z [2024-05-25T23:51:04.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=-1, run_start_date=2024-05-25 23:51:02.193001+00:00, run_end_date=2024-05-25 23:51:03.718400+00:00, run_duration=1.525399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:51:00.166950+00:00, queued_by_job_id=1, pid=4728 2024-05-25T23:51:04.148115001Z [2024-05-25T23:51:04.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=-1, run_start_date=2024-05-25 23:51:01.972639+00:00, run_end_date=2024-05-25 23:51:03.347918+00:00, run_duration=1.375279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:51:00.166950+00:00, queued_by_job_id=1, pid=4722 2024-05-25T23:52:00.749575378Z [2024-05-25T23:52:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:52:00+00:00, run_after=2024-05-25T23:53:00+00:00 2024-05-25T23:52:00.767614381Z [2024-05-25T23:52:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:52:00+00:00, run_after=2024-05-25T23:53:00+00:00 2024-05-25T23:52:00.769928499Z [2024-05-25T23:52:00.769+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:52:00.776864423Z [2024-05-25T23:52:00.776+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:52:00.852856166Z [2024-05-25T23:52:00.852+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:52:00.852919766Z 2024-05-25T23:52:00.852930811Z 2024-05-25T23:52:00.852939316Z 2024-05-25T23:52:00.852948268Z 2024-05-25T23:52:00.852957815Z [2024-05-25T23:52:00.852+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:52:00.852981289Z [2024-05-25T23:52:00.852+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:52:00.852989965Z [2024-05-25T23:52:00.852+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:52:00.852998113Z [2024-05-25T23:52:00.852+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:52:00.853602070Z [2024-05-25T23:52:00.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:52:00.853636569Z 2024-05-25T23:52:00.853646805Z 2024-05-25T23:52:00.853655235Z 2024-05-25T23:52:00.853663762Z 2024-05-25T23:52:00.859870227Z [2024-05-25T23:52:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:52:00.859915152Z [2024-05-25T23:52:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:52:00.859926310Z [2024-05-25T23:52:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:52:00.859962389Z [2024-05-25T23:52:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:52:00.859971155Z [2024-05-25T23:52:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:52:00.859979619Z [2024-05-25T23:52:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:52:00.859987848Z [2024-05-25T23:52:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:52:00.859996162Z [2024-05-25T23:52:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:52:01.336481242Z [2024-05-25T23:52:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:52:01.336530813Z [2024-05-25T23:52:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:51:00+00:00 exited with status queued for try_number 1 2024-05-25T23:52:01.336631894Z [2024-05-25T23:52:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:51:00+00:00 exited with status queued for try_number 1 2024-05-25T23:52:01.336768143Z [2024-05-25T23:52:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:51:00+00:00 exited with status queued for try_number 1 2024-05-25T23:52:01.359716548Z [2024-05-25T23:52:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd782761-a64b-4d55-9aad-f701912a99cb 2024-05-25T23:52:01.359945462Z [2024-05-25T23:52:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to a659c950-4fb8-42bb-80cc-a2e132daa2dd 2024-05-25T23:52:01.360096928Z [2024-05-25T23:52:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80a2967a-053b-4406-bf73-2cafd6dc93d9 2024-05-25T23:52:01.360271363Z [2024-05-25T23:52:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22dff4d4-f04a-40cc-b71c-df492d16970d 2024-05-25T23:52:02.625292044Z [2024-05-25T23:52:02.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:52:02.625617422Z [2024-05-25T23:52:02.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:50:00+00:00, run_id=scheduled__2024-05-25T23:50:00+00:00, run_start_date=2024-05-25 23:52:00.790286+00:00, run_end_date=2024-05-25 23:52:02.625208+00:00, run_duration=1.834922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:50:00+00:00, data_interval_end=2024-05-25 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:52:02.652614461Z [2024-05-25T23:52:02.652+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:52:00+00:00, run_after=2024-05-25T23:54:00+00:00 2024-05-25T23:52:02.686378359Z [2024-05-25T23:52:02.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:52:02.691940902Z [2024-05-25T23:52:02.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:51:00+00:00, run_id=scheduled__2024-05-25T23:51:00+00:00, run_start_date=2024-05-25 23:52:00.791639+00:00, run_end_date=2024-05-25 23:52:02.686301+00:00, run_duration=1.894662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:51:00+00:00, data_interval_end=2024-05-25 23:52:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:52:02.730205008Z [2024-05-25T23:52:02.729+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:52:00+00:00, run_after=2024-05-25T23:53:00+00:00 2024-05-25T23:52:02.868326840Z [2024-05-25T23:52:02.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:52:02.868473842Z [2024-05-25T23:52:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:51:00+00:00 exited with status success for try_number 1 2024-05-25T23:52:02.880066428Z [2024-05-25T23:52:02.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=-1, run_start_date=2024-05-25 23:52:01.765238+00:00, run_end_date=2024-05-25 23:52:02.214563+00:00, run_duration=0.449325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:52:00.854249+00:00, queued_by_job_id=1, pid=4760 2024-05-25T23:52:02.880399350Z [2024-05-25T23:52:02.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:51:00+00:00, map_index=-1, run_start_date=2024-05-25 23:52:01.945310+00:00, run_end_date=2024-05-25 23:52:02.446586+00:00, run_duration=0.501276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:52:00.854249+00:00, queued_by_job_id=1, pid=4761 2024-05-25T23:52:05.498423254Z [2024-05-25T23:52:05.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:52:05.502465277Z [2024-05-25T23:52:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:51:00+00:00, run_id=scheduled__2024-05-25T23:51:00+00:00, run_start_date=2024-05-25 23:52:00.792670+00:00, run_end_date=2024-05-25 23:52:05.498344+00:00, run_duration=4.705674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:51:00+00:00, data_interval_end=2024-05-25 23:52:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:52:05.585763828Z [2024-05-25T23:52:05.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:52:00+00:00, run_after=2024-05-25T23:53:00+00:00 2024-05-25T23:52:06.697414298Z [2024-05-25T23:52:06.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:52:06.697668072Z [2024-05-25T23:52:06.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:51:00+00:00, run_id=scheduled__2024-05-25T23:51:00+00:00, run_start_date=2024-05-25 23:52:00.793702+00:00, run_end_date=2024-05-25 23:52:06.697324+00:00, run_duration=5.903622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:51:00+00:00, data_interval_end=2024-05-25 23:52:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:52:06.791305910Z [2024-05-25T23:52:06.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:52:00+00:00, run_after=2024-05-25T23:53:00+00:00 2024-05-25T23:52:06.962586475Z [2024-05-25T23:52:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:51:00+00:00 exited with status success for try_number 1 2024-05-25T23:52:06.964948070Z [2024-05-25T23:52:06.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:51:00+00:00 exited with status success for try_number 1 2024-05-25T23:52:06.993164725Z [2024-05-25T23:52:06.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:51:00+00:00, map_index=-1, run_start_date=2024-05-25 23:52:03.339351+00:00, run_end_date=2024-05-25 23:52:05.396104+00:00, run_duration=2.056753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:52:00.854249+00:00, queued_by_job_id=1, pid=4779 2024-05-25T23:52:06.999335534Z [2024-05-25T23:52:06.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:51:00+00:00, map_index=-1, run_start_date=2024-05-25 23:52:04.057211+00:00, run_end_date=2024-05-25 23:52:06.257807+00:00, run_duration=2.200596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:52:00.854249+00:00, queued_by_job_id=1, pid=4790 2024-05-25T23:53:01.041152646Z [2024-05-25T23:53:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:53:00+00:00, run_after=2024-05-25T23:54:00+00:00 2024-05-25T23:53:01.058979614Z [2024-05-25T23:53:01.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:53:01.094634008Z [2024-05-25T23:53:01.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:53:00+00:00, run_after=2024-05-25T23:54:00+00:00 2024-05-25T23:53:01.161580855Z [2024-05-25T23:53:01.161+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:53:01.161608250Z 2024-05-25T23:53:01.161611853Z 2024-05-25T23:53:01.161615016Z 2024-05-25T23:53:01.161618897Z [2024-05-25T23:53:01.161+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:53:01.161806522Z [2024-05-25T23:53:01.161+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:53:01.161967790Z [2024-05-25T23:53:01.161+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:53:01.162586249Z [2024-05-25T23:53:01.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:53:01.162597851Z 2024-05-25T23:53:01.162600952Z 2024-05-25T23:53:01.162603886Z 2024-05-25T23:53:01.165517086Z [2024-05-25T23:53:01.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:53:01.165766169Z [2024-05-25T23:53:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:53:01.166038578Z [2024-05-25T23:53:01.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:53:01.166202013Z [2024-05-25T23:53:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:53:01.166455411Z [2024-05-25T23:53:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:53:01.166635330Z [2024-05-25T23:53:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:53:01.390990926Z [2024-05-25T23:53:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status queued for try_number 1 2024-05-25T23:53:01.391170601Z [2024-05-25T23:53:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status queued for try_number 1 2024-05-25T23:53:01.391341444Z [2024-05-25T23:53:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status queued for try_number 1 2024-05-25T23:53:01.398587415Z [2024-05-25T23:53:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b47f3c8-a4ec-4c71-81d9-0399a744b961 2024-05-25T23:53:01.398797604Z [2024-05-25T23:53:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93359b35-4722-49ba-9354-ccca9532bdef 2024-05-25T23:53:01.398972091Z [2024-05-25T23:53:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 841be48a-c540-454d-9f7c-a1ffb5a6d184 2024-05-25T23:53:02.587014232Z [2024-05-25T23:53:02.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:53:02.587628992Z [2024-05-25T23:53:02.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:52:00+00:00, run_id=scheduled__2024-05-25T23:52:00+00:00, run_start_date=2024-05-25 23:53:01.111316+00:00, run_end_date=2024-05-25 23:53:02.586926+00:00, run_duration=1.47561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:52:00+00:00, data_interval_end=2024-05-25 23:53:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:53:02.600266753Z [2024-05-25T23:53:02.599+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:53:00+00:00, run_after=2024-05-25T23:54:00+00:00 2024-05-25T23:53:02.644554746Z [2024-05-25T23:53:02.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status success for try_number 1 2024-05-25T23:53:02.651944250Z [2024-05-25T23:53:02.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:52:00+00:00, map_index=-1, run_start_date=2024-05-25 23:53:02.065929+00:00, run_end_date=2024-05-25 23:53:02.463288+00:00, run_duration=0.397359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:53:01.163173+00:00, queued_by_job_id=1, pid=4817 2024-05-25T23:53:06.132412190Z [2024-05-25T23:53:06.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:53:06.132539120Z [2024-05-25T23:53:06.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:52:00+00:00, run_id=scheduled__2024-05-25T23:52:00+00:00, run_start_date=2024-05-25 23:53:01.112929+00:00, run_end_date=2024-05-25 23:53:06.132171+00:00, run_duration=5.019242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:52:00+00:00, data_interval_end=2024-05-25 23:53:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:53:06.143641753Z [2024-05-25T23:53:06.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:53:00+00:00, run_after=2024-05-25T23:54:00+00:00 2024-05-25T23:53:06.158170159Z [2024-05-25T23:53:06.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:53:06.158658768Z [2024-05-25T23:53:06.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:52:00+00:00, run_id=scheduled__2024-05-25T23:52:00+00:00, run_start_date=2024-05-25 23:53:01.114157+00:00, run_end_date=2024-05-25 23:53:06.158129+00:00, run_duration=5.043972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:52:00+00:00, data_interval_end=2024-05-25 23:53:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:53:06.171169562Z [2024-05-25T23:53:06.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:53:00+00:00, run_after=2024-05-25T23:54:00+00:00 2024-05-25T23:53:06.213744214Z [2024-05-25T23:53:06.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status success for try_number 1 2024-05-25T23:53:06.213915236Z [2024-05-25T23:53:06.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status success for try_number 1 2024-05-25T23:53:06.222901006Z [2024-05-25T23:53:06.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:52:00+00:00, map_index=-1, run_start_date=2024-05-25 23:53:02.997929+00:00, run_end_date=2024-05-25 23:53:05.024540+00:00, run_duration=2.026611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:53:01.163173+00:00, queued_by_job_id=1, pid=4836 2024-05-25T23:53:06.223154025Z [2024-05-25T23:53:06.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:52:00+00:00, map_index=-1, run_start_date=2024-05-25 23:53:02.899790+00:00, run_end_date=2024-05-25 23:53:05.247578+00:00, run_duration=2.347788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:53:01.163173+00:00, queued_by_job_id=1, pid=4835 2024-05-25T23:53:30.931650560Z [2024-05-25T23:53:30.930+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:54:00.845568211Z [2024-05-25T23:54:00.844+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:54:00.852652884Z [2024-05-25T23:54:00.852+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:54:00.867777315Z [2024-05-25T23:54:00.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:54:00+00:00, run_after=2024-05-25T23:55:00+00:00 2024-05-25T23:54:00.881562384Z [2024-05-25T23:54:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:54:00+00:00, run_after=2024-05-25T23:55:00+00:00 2024-05-25T23:54:00.986726151Z [2024-05-25T23:54:00.986+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:54:00.986796215Z 2024-05-25T23:54:00.986812461Z 2024-05-25T23:54:00.986824927Z 2024-05-25T23:54:00.986837533Z 2024-05-25T23:54:00.986871736Z [2024-05-25T23:54:00.986+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:54:00.987169871Z [2024-05-25T23:54:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:54:00.987370915Z [2024-05-25T23:54:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:54:00.987823783Z [2024-05-25T23:54:00.987+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:54:00.988954946Z [2024-05-25T23:54:00.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:54:00.989007543Z 2024-05-25T23:54:00.989018719Z 2024-05-25T23:54:00.989027382Z 2024-05-25T23:54:00.989035936Z 2024-05-25T23:54:00.995999226Z [2024-05-25T23:54:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:54:00.996314479Z [2024-05-25T23:54:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:54:00.996849014Z [2024-05-25T23:54:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:54:00.997154792Z [2024-05-25T23:54:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:54:00.997998346Z [2024-05-25T23:54:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:54:00.998124077Z [2024-05-25T23:54:00.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:54:00.998615089Z [2024-05-25T23:54:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:54:00.998995410Z [2024-05-25T23:54:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:54:01.237767977Z [2024-05-25T23:54:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status queued for try_number 1 2024-05-25T23:54:01.238003929Z [2024-05-25T23:54:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:53:00+00:00 exited with status queued for try_number 1 2024-05-25T23:54:01.238156707Z [2024-05-25T23:54:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:53:00+00:00 exited with status queued for try_number 1 2024-05-25T23:54:01.238318231Z [2024-05-25T23:54:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:53:00+00:00 exited with status queued for try_number 1 2024-05-25T23:54:01.253136785Z [2024-05-25T23:54:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 798ee358-0479-414b-98de-8885c385acfa 2024-05-25T23:54:01.253560375Z [2024-05-25T23:54:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f1fbb35-5140-439a-9899-360b28df0f44 2024-05-25T23:54:01.253895145Z [2024-05-25T23:54:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b7c3dc0-f609-4c8b-bf05-5c0df25ea18c 2024-05-25T23:54:01.254272649Z [2024-05-25T23:54:01.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 312807a3-d395-4d38-82c1-07670a14486e 2024-05-25T23:54:02.507084871Z [2024-05-25T23:54:02.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:54:02.507780968Z [2024-05-25T23:54:02.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:52:00+00:00, run_id=scheduled__2024-05-25T23:52:00+00:00, run_start_date=2024-05-25 23:54:00.897310+00:00, run_end_date=2024-05-25 23:54:02.507353+00:00, run_duration=1.610043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:52:00+00:00, data_interval_end=2024-05-25 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:54:02.514710142Z [2024-05-25T23:54:02.514+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:54:00+00:00, run_after=2024-05-25T23:56:00+00:00 2024-05-25T23:54:02.521081923Z [2024-05-25T23:54:02.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:54:02.521280169Z [2024-05-25T23:54:02.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:53:00+00:00, run_id=scheduled__2024-05-25T23:53:00+00:00, run_start_date=2024-05-25 23:54:00.899892+00:00, run_end_date=2024-05-25 23:54:02.521001+00:00, run_duration=1.621109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:53:00+00:00, data_interval_end=2024-05-25 23:54:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:54:02.530745143Z [2024-05-25T23:54:02.530+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:54:00+00:00, run_after=2024-05-25T23:55:00+00:00 2024-05-25T23:54:02.574325227Z [2024-05-25T23:54:02.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:52:00+00:00 exited with status success for try_number 1 2024-05-25T23:54:02.574362085Z [2024-05-25T23:54:02.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:53:00+00:00 exited with status success for try_number 1 2024-05-25T23:54:02.580885917Z [2024-05-25T23:54:02.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:52:00+00:00, map_index=-1, run_start_date=2024-05-25 23:54:01.794151+00:00, run_end_date=2024-05-25 23:54:02.196768+00:00, run_duration=0.402617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:54:00.990900+00:00, queued_by_job_id=1, pid=4869 2024-05-25T23:54:02.581077846Z [2024-05-25T23:54:02.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:53:00+00:00, map_index=-1, run_start_date=2024-05-25 23:54:01.966694+00:00, run_end_date=2024-05-25 23:54:02.362987+00:00, run_duration=0.396293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:54:00.990900+00:00, queued_by_job_id=1, pid=4871 2024-05-25T23:54:04.946541947Z [2024-05-25T23:54:04.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:54:04.946937627Z [2024-05-25T23:54:04.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:53:00+00:00, run_id=scheduled__2024-05-25T23:53:00+00:00, run_start_date=2024-05-25 23:54:00.902182+00:00, run_end_date=2024-05-25 23:54:04.946353+00:00, run_duration=4.044171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:53:00+00:00, data_interval_end=2024-05-25 23:54:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:54:04.958017910Z [2024-05-25T23:54:04.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:54:00+00:00, run_after=2024-05-25T23:55:00+00:00 2024-05-25T23:54:06.058494820Z [2024-05-25T23:54:06.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:54:06.058969272Z [2024-05-25T23:54:06.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:53:00+00:00, run_id=scheduled__2024-05-25T23:53:00+00:00, run_start_date=2024-05-25 23:54:00.904452+00:00, run_end_date=2024-05-25 23:54:06.058508+00:00, run_duration=5.154056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:53:00+00:00, data_interval_end=2024-05-25 23:54:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:54:06.073137327Z [2024-05-25T23:54:06.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:54:00+00:00, run_after=2024-05-25T23:55:00+00:00 2024-05-25T23:54:06.130493649Z [2024-05-25T23:54:06.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:53:00+00:00 exited with status success for try_number 1 2024-05-25T23:54:06.131115313Z [2024-05-25T23:54:06.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:53:00+00:00 exited with status success for try_number 1 2024-05-25T23:54:06.144063559Z [2024-05-25T23:54:06.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:53:00+00:00, map_index=-1, run_start_date=2024-05-25 23:54:03.008518+00:00, run_end_date=2024-05-25 23:54:04.898774+00:00, run_duration=1.890256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:54:00.990900+00:00, queued_by_job_id=1, pid=4894 2024-05-25T23:54:06.144657642Z [2024-05-25T23:54:06.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:53:00+00:00, map_index=-1, run_start_date=2024-05-25 23:54:02.787973+00:00, run_end_date=2024-05-25 23:54:05.879733+00:00, run_duration=3.09176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:54:00.990900+00:00, queued_by_job_id=1, pid=4893 2024-05-25T23:55:00.730664472Z [2024-05-25T23:55:00.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:55:00+00:00, run_after=2024-05-25T23:56:00+00:00 2024-05-25T23:55:00.737183993Z [2024-05-25T23:55:00.736+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:55:00.753690092Z [2024-05-25T23:55:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:55:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:55:00.766048796Z [2024-05-25T23:55:00.765+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:55:00+00:00, run_after=2024-05-25T23:56:00+00:00 2024-05-25T23:55:00.854008781Z [2024-05-25T23:55:00.853+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:55:00.854052593Z 2024-05-25T23:55:00.854061087Z 2024-05-25T23:55:00.854068108Z 2024-05-25T23:55:00.854075281Z 2024-05-25T23:55:00.854209284Z [2024-05-25T23:55:00.853+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:55:00.854237416Z [2024-05-25T23:55:00.854+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:55:00.854354192Z [2024-05-25T23:55:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:55:00.854519961Z [2024-05-25T23:55:00.854+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:55:00.855479057Z [2024-05-25T23:55:00.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:55:00.855509906Z 2024-05-25T23:55:00.855553128Z 2024-05-25T23:55:00.855562107Z 2024-05-25T23:55:00.855568742Z 2024-05-25T23:55:00.861454342Z [2024-05-25T23:55:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-25T23:55:00.861704028Z [2024-05-25T23:55:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:55:00.862104201Z [2024-05-25T23:55:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:55:00.862391619Z [2024-05-25T23:55:00.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:55:00.862921535Z [2024-05-25T23:55:00.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:55:00.864512788Z [2024-05-25T23:55:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:55:00.865465574Z [2024-05-25T23:55:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:55:00.865794221Z [2024-05-25T23:55:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:55:01.435748831Z [2024-05-25T23:55:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:55:01.435772233Z [2024-05-25T23:55:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status queued for try_number 1 2024-05-25T23:55:01.435776243Z [2024-05-25T23:55:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status queued for try_number 1 2024-05-25T23:55:01.435779446Z [2024-05-25T23:55:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status queued for try_number 1 2024-05-25T23:55:01.446143941Z [2024-05-25T23:55:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf703148-cd89-4405-a92d-c02a515f461a 2024-05-25T23:55:01.446299994Z [2024-05-25T23:55:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32ceae66-9aac-4fdc-b591-649761ec49a9 2024-05-25T23:55:01.446451925Z [2024-05-25T23:55:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 355b2c53-3d08-4ea7-94a8-b79b6bd956ab 2024-05-25T23:55:01.446584619Z [2024-05-25T23:55:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57e017dd-1be6-4ab0-ac7c-a19f5a2a68c3 2024-05-25T23:55:02.626524961Z [2024-05-25T23:55:02.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:55:02.626989423Z [2024-05-25T23:55:02.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:54:00+00:00, run_id=scheduled__2024-05-25T23:54:00+00:00, run_start_date=2024-05-25 23:55:00.780722+00:00, run_end_date=2024-05-25 23:55:02.626600+00:00, run_duration=1.845878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:54:00+00:00, data_interval_end=2024-05-25 23:55:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:55:02.645276091Z [2024-05-25T23:55:02.644+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:55:00+00:00, run_after=2024-05-25T23:56:00+00:00 2024-05-25T23:55:02.705023012Z [2024-05-25T23:55:02.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status success for try_number 1 2024-05-25T23:55:02.717502210Z [2024-05-25T23:55:02.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:54:00+00:00, map_index=-1, run_start_date=2024-05-25 23:55:01.892396+00:00, run_end_date=2024-05-25 23:55:02.325196+00:00, run_duration=0.4328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:55:00.857025+00:00, queued_by_job_id=1, pid=4926 2024-05-25T23:55:03.826213198Z [2024-05-25T23:55:03.825+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:55:03.826252108Z 2024-05-25T23:55:03.826606992Z [2024-05-25T23:55:03.826+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:55:03.827687005Z [2024-05-25T23:55:03.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:55:03.827702520Z 2024-05-25T23:55:03.831411336Z [2024-05-25T23:55:03.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-25T23:55:03.831880522Z [2024-05-25T23:55:03.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:55:03.915331687Z [2024-05-25T23:55:03.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:55:03.917670401Z [2024-05-25T23:55:03.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:55:03.922964429Z [2024-05-25T23:55:03.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ef0c02-7540-46d2-a6d4-649bcfacc529 2024-05-25T23:55:03.925093432Z [2024-05-25T23:55:03.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=-1, run_start_date=2024-05-25 23:55:02.910175+00:00, run_end_date=2024-05-25 23:55:03.294214+00:00, run_duration=0.384039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:55:00.857025+00:00, queued_by_job_id=1, pid=4952 2024-05-25T23:55:04.728059260Z [2024-05-25T23:55:04.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:55:04.728200784Z [2024-05-25T23:55:04.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:54:00+00:00, run_id=scheduled__2024-05-25T23:54:00+00:00, run_start_date=2024-05-25 23:55:00.784752+00:00, run_end_date=2024-05-25 23:55:04.727975+00:00, run_duration=3.943223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:54:00+00:00, data_interval_end=2024-05-25 23:55:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:55:04.742889585Z [2024-05-25T23:55:04.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:55:00+00:00, run_after=2024-05-25T23:56:00+00:00 2024-05-25T23:55:04.762087382Z [2024-05-25T23:55:04.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:55:04.762508449Z [2024-05-25T23:55:04.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:54:00+00:00, run_id=scheduled__2024-05-25T23:54:00+00:00, run_start_date=2024-05-25 23:55:00.782062+00:00, run_end_date=2024-05-25 23:55:04.761996+00:00, run_duration=3.979934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:54:00+00:00, data_interval_end=2024-05-25 23:55:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:55:04.772423905Z [2024-05-25T23:55:04.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:55:00+00:00, run_after=2024-05-25T23:56:00+00:00 2024-05-25T23:55:04.812936985Z [2024-05-25T23:55:04.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status success for try_number 1 2024-05-25T23:55:04.813213805Z [2024-05-25T23:55:04.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status success for try_number 1 2024-05-25T23:55:04.819433288Z [2024-05-25T23:55:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:54:00+00:00, map_index=-1, run_start_date=2024-05-25 23:55:02.670039+00:00, run_end_date=2024-05-25 23:55:04.244559+00:00, run_duration=1.57452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:55:00.857025+00:00, queued_by_job_id=1, pid=4945 2024-05-25T23:55:04.819822935Z [2024-05-25T23:55:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:54:00+00:00, map_index=-1, run_start_date=2024-05-25 23:55:02.823332+00:00, run_end_date=2024-05-25 23:55:04.135234+00:00, run_duration=1.311902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:55:00.857025+00:00, queued_by_job_id=1, pid=4951 2024-05-25T23:55:07.027211931Z [2024-05-25T23:55:07.025+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:55:07.027242567Z 2024-05-25T23:55:07.028252032Z [2024-05-25T23:55:07.027+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:55:07.029235830Z [2024-05-25T23:55:07.028+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:55:07.029250101Z 2024-05-25T23:55:07.033511365Z [2024-05-25T23:55:07.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-25T23:55:07.034886171Z [2024-05-25T23:55:07.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T23:55:07.100480927Z [2024-05-25T23:55:07.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:55:07.100878479Z [2024-05-25T23:55:07.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:55:07.107410367Z [2024-05-25T23:55:07.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to e05706aa-3a9f-40c4-8630-d7088b40d937 2024-05-25T23:55:07.107753463Z [2024-05-25T23:55:07.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=-1, run_start_date=2024-05-25 23:55:05.689986+00:00, run_end_date=2024-05-25 23:55:06.017856+00:00, run_duration=0.32787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:55:03.828399+00:00, queued_by_job_id=1, pid=4975 2024-05-25T23:55:09.146272476Z [2024-05-25T23:55:09.145+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-25T23:55:09.146322168Z 2024-05-25T23:55:09.146389595Z [2024-05-25T23:55:09.146+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:55:09.147254733Z [2024-05-25T23:55:09.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:55:09.147272763Z 2024-05-25T23:55:09.150899140Z [2024-05-25T23:55:09.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:55:09.151013945Z [2024-05-25T23:55:09.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T23:55:09.221929420Z [2024-05-25T23:55:09.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status queued for try_number 1 2024-05-25T23:55:09.229322987Z [2024-05-25T23:55:09.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04063b6a-9359-4201-956d-7937557d61ec 2024-05-25T23:55:09.318159625Z [2024-05-25T23:55:09.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:55:09.326047618Z [2024-05-25T23:55:09.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=0, run_start_date=2024-05-25 23:55:08.695623+00:00, run_end_date=2024-05-25 23:55:09.047687+00:00, run_duration=0.352064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:55:07.029796+00:00, queued_by_job_id=1, pid=4983 2024-05-25T23:55:12.111495297Z [2024-05-25T23:55:12.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:55:12.112496209Z [2024-05-25T23:55:12.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:50:00+00:00, run_id=scheduled__2024-05-25T23:50:00+00:00, run_start_date=2024-05-25 23:55:00.779455+00:00, run_end_date=2024-05-25 23:55:12.111608+00:00, run_duration=11.332153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:50:00+00:00, data_interval_end=2024-05-25 23:55:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-25T23:55:12.125692785Z [2024-05-25T23:55:12.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:55:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:55:12.170315645Z [2024-05-25T23:55:12.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:50:00+00:00 exited with status success for try_number 1 2024-05-25T23:55:12.176775153Z [2024-05-25T23:55:12.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:50:00+00:00, map_index=-1, run_start_date=2024-05-25 23:55:10.685553+00:00, run_end_date=2024-05-25 23:55:11.074920+00:00, run_duration=0.389367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:55:09.147910+00:00, queued_by_job_id=1, pid=4991 2024-05-25T23:56:00.635091184Z [2024-05-25T23:56:00.633+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:56:00.654663183Z [2024-05-25T23:56:00.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:56:00+00:00, run_after=2024-05-25T23:57:00+00:00 2024-05-25T23:56:00.682113204Z [2024-05-25T23:56:00.681+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:56:00+00:00, run_after=2024-05-25T23:57:00+00:00 2024-05-25T23:56:00.696097294Z [2024-05-25T23:56:00.695+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:56:00.799213663Z [2024-05-25T23:56:00.798+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:56:00.799265732Z 2024-05-25T23:56:00.799271829Z 2024-05-25T23:56:00.799276197Z 2024-05-25T23:56:00.799280705Z 2024-05-25T23:56:00.799295798Z [2024-05-25T23:56:00.799+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:56:00.799440169Z [2024-05-25T23:56:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:56:00.799615608Z [2024-05-25T23:56:00.799+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:56:00.800191766Z [2024-05-25T23:56:00.799+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:56:00.800863564Z [2024-05-25T23:56:00.800+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:56:00.800877693Z 2024-05-25T23:56:00.800887102Z 2024-05-25T23:56:00.800891933Z 2024-05-25T23:56:00.800896397Z 2024-05-25T23:56:00.804436144Z [2024-05-25T23:56:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:56:00.804700023Z [2024-05-25T23:56:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:56:00.805086122Z [2024-05-25T23:56:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:56:00.805263021Z [2024-05-25T23:56:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:56:00.805621826Z [2024-05-25T23:56:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:56:00.805782920Z [2024-05-25T23:56:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:56:00.806251528Z [2024-05-25T23:56:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:56:00.806413518Z [2024-05-25T23:56:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:56:01.073846731Z [2024-05-25T23:56:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status queued for try_number 1 2024-05-25T23:56:01.073995682Z [2024-05-25T23:56:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:56:01.074100807Z [2024-05-25T23:56:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:56:01.074198522Z [2024-05-25T23:56:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status queued for try_number 1 2024-05-25T23:56:01.082805463Z [2024-05-25T23:56:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2ef9813-ba6d-4dc1-9196-aed6407d976e 2024-05-25T23:56:01.082974375Z [2024-05-25T23:56:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a20c021-3576-45a7-81db-636570560d02 2024-05-25T23:56:01.083134439Z [2024-05-25T23:56:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40e04986-713a-495c-bc83-5194063401a8 2024-05-25T23:56:01.083278469Z [2024-05-25T23:56:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44196658-6440-4c83-ba4b-f0bcd266ce13 2024-05-25T23:56:02.250803274Z [2024-05-25T23:56:02.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:56:02.251127799Z [2024-05-25T23:56:02.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:54:00+00:00, run_id=scheduled__2024-05-25T23:54:00+00:00, run_start_date=2024-05-25 23:56:00.713153+00:00, run_end_date=2024-05-25 23:56:02.250659+00:00, run_duration=1.537506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:54:00+00:00, data_interval_end=2024-05-25 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:56:02.262180723Z [2024-05-25T23:56:02.261+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:56:00+00:00, run_after=2024-05-25T23:58:00+00:00 2024-05-25T23:56:02.269794520Z [2024-05-25T23:56:02.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:56:02.270308463Z [2024-05-25T23:56:02.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:55:00+00:00, run_id=scheduled__2024-05-25T23:55:00+00:00, run_start_date=2024-05-25 23:56:00.715049+00:00, run_end_date=2024-05-25 23:56:02.269839+00:00, run_duration=1.55479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:55:00+00:00, data_interval_end=2024-05-25 23:56:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:56:02.281907329Z [2024-05-25T23:56:02.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:56:00+00:00, run_after=2024-05-25T23:57:00+00:00 2024-05-25T23:56:02.332149309Z [2024-05-25T23:56:02.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:54:00+00:00 exited with status success for try_number 1 2024-05-25T23:56:02.332318502Z [2024-05-25T23:56:02.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:56:02.341298778Z [2024-05-25T23:56:02.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:54:00+00:00, map_index=-1, run_start_date=2024-05-25 23:56:01.531469+00:00, run_end_date=2024-05-25 23:56:01.928913+00:00, run_duration=0.397444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:56:00.801677+00:00, queued_by_job_id=1, pid=5014 2024-05-25T23:56:02.341806783Z [2024-05-25T23:56:02.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:56:01.728331+00:00, run_end_date=2024-05-25 23:56:02.129470+00:00, run_duration=0.401139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:56:00.801677+00:00, queued_by_job_id=1, pid=5015 2024-05-25T23:56:04.547658776Z [2024-05-25T23:56:04.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:56:04.551943611Z [2024-05-25T23:56:04.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:55:00+00:00, run_id=scheduled__2024-05-25T23:55:00+00:00, run_start_date=2024-05-25 23:56:00.719575+00:00, run_end_date=2024-05-25 23:56:04.548085+00:00, run_duration=3.82851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:55:00+00:00, data_interval_end=2024-05-25 23:56:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:56:04.577275631Z [2024-05-25T23:56:04.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:56:00+00:00, run_after=2024-05-25T23:57:00+00:00 2024-05-25T23:56:04.620893437Z [2024-05-25T23:56:04.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:56:04.628191302Z [2024-05-25T23:56:04.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:56:02.639897+00:00, run_end_date=2024-05-25 23:56:04.271363+00:00, run_duration=1.631466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:56:00.801677+00:00, queued_by_job_id=1, pid=5033 2024-05-25T23:56:05.710247340Z [2024-05-25T23:56:05.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:56:05.710284552Z [2024-05-25T23:56:05.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:55:00+00:00, run_id=scheduled__2024-05-25T23:55:00+00:00, run_start_date=2024-05-25 23:56:00.718479+00:00, run_end_date=2024-05-25 23:56:05.707716+00:00, run_duration=4.989237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:55:00+00:00, data_interval_end=2024-05-25 23:56:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:56:05.751670785Z [2024-05-25T23:56:05.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:56:00+00:00, run_after=2024-05-25T23:57:00+00:00 2024-05-25T23:56:05.801049484Z [2024-05-25T23:56:05.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status success for try_number 1 2024-05-25T23:56:05.810672721Z [2024-05-25T23:56:05.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:55:00+00:00, map_index=-1, run_start_date=2024-05-25 23:56:02.987979+00:00, run_end_date=2024-05-25 23:56:04.580067+00:00, run_duration=1.592088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:56:00.801677+00:00, queued_by_job_id=1, pid=5044 2024-05-25T23:57:00.067575721Z [2024-05-25T23:57:00.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:57:00+00:00, run_after=2024-05-25T23:58:00+00:00 2024-05-25T23:57:00.087513541Z [2024-05-25T23:57:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:57:00+00:00, run_after=2024-05-25T23:58:00+00:00 2024-05-25T23:57:00.094784156Z [2024-05-25T23:57:00.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:57:00.181675195Z [2024-05-25T23:57:00.181+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:57:00.181718846Z 2024-05-25T23:57:00.181729251Z 2024-05-25T23:57:00.181737461Z 2024-05-25T23:57:00.181992933Z [2024-05-25T23:57:00.181+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:57:00.182481531Z [2024-05-25T23:57:00.182+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:57:00.182701287Z [2024-05-25T23:57:00.182+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:57:00.183602006Z [2024-05-25T23:57:00.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:57:00.183628905Z 2024-05-25T23:57:00.183643659Z 2024-05-25T23:57:00.183656238Z 2024-05-25T23:57:00.198866533Z [2024-05-25T23:57:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:57:00.199065014Z [2024-05-25T23:57:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:57:00.199378934Z [2024-05-25T23:57:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:57:00.199560755Z [2024-05-25T23:57:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:57:00.199880944Z [2024-05-25T23:57:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:57:00.200158051Z [2024-05-25T23:57:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:57:00.469764017Z [2024-05-25T23:57:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status queued for try_number 1 2024-05-25T23:57:00.470540292Z [2024-05-25T23:57:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status queued for try_number 1 2024-05-25T23:57:00.470664858Z [2024-05-25T23:57:00.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status queued for try_number 1 2024-05-25T23:57:00.482564822Z [2024-05-25T23:57:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74e3b23a-9f97-40a9-8d3a-74f760b428de 2024-05-25T23:57:00.482717586Z [2024-05-25T23:57:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to dadf5b96-8f45-417d-b4a0-afe60573d5b6 2024-05-25T23:57:00.482820315Z [2024-05-25T23:57:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2a26bb4-b2e0-47e0-aa59-01d0f65c9fb0 2024-05-25T23:57:01.983702354Z [2024-05-25T23:57:01.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:57:01.983942966Z [2024-05-25T23:57:01.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:56:00+00:00, run_id=scheduled__2024-05-25T23:56:00+00:00, run_start_date=2024-05-25 23:57:00.107954+00:00, run_end_date=2024-05-25 23:57:01.983497+00:00, run_duration=1.875543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:56:00+00:00, data_interval_end=2024-05-25 23:57:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:57:01.994205465Z [2024-05-25T23:57:01.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:57:00+00:00, run_after=2024-05-25T23:58:00+00:00 2024-05-25T23:57:02.050890934Z [2024-05-25T23:57:02.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status success for try_number 1 2024-05-25T23:57:02.057233214Z [2024-05-25T23:57:02.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:56:00+00:00, map_index=-1, run_start_date=2024-05-25 23:57:01.245811+00:00, run_end_date=2024-05-25 23:57:01.718545+00:00, run_duration=0.472734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:57:00.195800+00:00, queued_by_job_id=1, pid=5071 2024-05-25T23:57:04.297129266Z [2024-05-25T23:57:04.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:57:04.297299954Z [2024-05-25T23:57:04.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:56:00+00:00, run_id=scheduled__2024-05-25T23:56:00+00:00, run_start_date=2024-05-25 23:57:00.109564+00:00, run_end_date=2024-05-25 23:57:04.297027+00:00, run_duration=4.187463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:56:00+00:00, data_interval_end=2024-05-25 23:57:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:57:04.329763254Z [2024-05-25T23:57:04.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:57:00+00:00, run_after=2024-05-25T23:58:00+00:00 2024-05-25T23:57:04.353047379Z [2024-05-25T23:57:04.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:57:04.353207161Z [2024-05-25T23:57:04.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:56:00+00:00, run_id=scheduled__2024-05-25T23:56:00+00:00, run_start_date=2024-05-25 23:57:00.110896+00:00, run_end_date=2024-05-25 23:57:04.352966+00:00, run_duration=4.24207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:56:00+00:00, data_interval_end=2024-05-25 23:57:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:57:04.377869309Z [2024-05-25T23:57:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:57:00+00:00, run_after=2024-05-25T23:58:00+00:00 2024-05-25T23:57:04.454386674Z [2024-05-25T23:57:04.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status success for try_number 1 2024-05-25T23:57:04.467413117Z [2024-05-25T23:57:04.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:56:00+00:00, map_index=-1, run_start_date=2024-05-25 23:57:02.340403+00:00, run_end_date=2024-05-25 23:57:03.539495+00:00, run_duration=1.199092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:57:00.195800+00:00, queued_by_job_id=1, pid=5089 2024-05-25T23:57:05.561719002Z [2024-05-25T23:57:05.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status success for try_number 1 2024-05-25T23:57:05.574874400Z [2024-05-25T23:57:05.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:56:00+00:00, map_index=-1, run_start_date=2024-05-25 23:57:02.400075+00:00, run_end_date=2024-05-25 23:57:04.201119+00:00, run_duration=1.801044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:57:00.195800+00:00, queued_by_job_id=1, pid=5090 2024-05-25T23:58:00.455145556Z [2024-05-25T23:58:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:58:00+00:00, run_after=2024-05-25T23:59:00+00:00 2024-05-25T23:58:00.469419648Z [2024-05-25T23:58:00.469+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:58:00.479266510Z [2024-05-25T23:58:00.478+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:58:00.493461756Z [2024-05-25T23:58:00.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:58:00+00:00, run_after=2024-05-25T23:59:00+00:00 2024-05-25T23:58:00.580757616Z [2024-05-25T23:58:00.580+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-25T23:58:00.580779192Z 2024-05-25T23:58:00.580797486Z 2024-05-25T23:58:00.580825211Z 2024-05-25T23:58:00.580828820Z 2024-05-25T23:58:00.580899868Z [2024-05-25T23:58:00.580+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-25T23:58:00.581082271Z [2024-05-25T23:58:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:58:00.581301631Z [2024-05-25T23:58:00.581+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:58:00.581354508Z [2024-05-25T23:58:00.581+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:58:00.582431265Z [2024-05-25T23:58:00.582+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:58:00.582450626Z 2024-05-25T23:58:00.582460016Z 2024-05-25T23:58:00.582468480Z 2024-05-25T23:58:00.582477063Z 2024-05-25T23:58:00.588599817Z [2024-05-25T23:58:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:58:00.588862093Z [2024-05-25T23:58:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T23:58:00.589126420Z [2024-05-25T23:58:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:58:00.589249221Z [2024-05-25T23:58:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:58:00.589438545Z [2024-05-25T23:58:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:58:00.589631657Z [2024-05-25T23:58:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:58:00.589969239Z [2024-05-25T23:58:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:58:00.590202093Z [2024-05-25T23:58:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:58:01.004765775Z [2024-05-25T23:58:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status queued for try_number 1 2024-05-25T23:58:01.004989967Z [2024-05-25T23:58:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:57:00+00:00 exited with status queued for try_number 1 2024-05-25T23:58:01.005197989Z [2024-05-25T23:58:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:57:00+00:00 exited with status queued for try_number 1 2024-05-25T23:58:01.005360455Z [2024-05-25T23:58:01.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:57:00+00:00 exited with status queued for try_number 1 2024-05-25T23:58:01.025322535Z [2024-05-25T23:58:01.024+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec77c098-a821-4358-9ad1-fd89d8e5e5cb 2024-05-25T23:58:01.026774796Z [2024-05-25T23:58:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5ec4e80-182c-4014-9817-634d613fa4bf 2024-05-25T23:58:01.027021854Z [2024-05-25T23:58:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85268064-54da-46a5-a804-9e5ce6c1d2af 2024-05-25T23:58:01.027287588Z [2024-05-25T23:58:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19340123-13c9-4758-ab76-7153de6abfda 2024-05-25T23:58:02.235470706Z [2024-05-25T23:58:02.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:58:02.235845141Z [2024-05-25T23:58:02.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:56:00+00:00, run_id=scheduled__2024-05-25T23:56:00+00:00, run_start_date=2024-05-25 23:58:00.511275+00:00, run_end_date=2024-05-25 23:58:02.235381+00:00, run_duration=1.724106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:56:00+00:00, data_interval_end=2024-05-25 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-25T23:58:02.244837144Z [2024-05-25T23:58:02.243+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-25T23:58:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:58:02.251160074Z [2024-05-25T23:58:02.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:58:02.251559281Z [2024-05-25T23:58:02.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:57:00+00:00, run_id=scheduled__2024-05-25T23:57:00+00:00, run_start_date=2024-05-25 23:58:00.513001+00:00, run_end_date=2024-05-25 23:58:02.251079+00:00, run_duration=1.738078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:57:00+00:00, data_interval_end=2024-05-25 23:58:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:58:02.261909956Z [2024-05-25T23:58:02.261+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:58:00+00:00, run_after=2024-05-25T23:59:00+00:00 2024-05-25T23:58:02.310445444Z [2024-05-25T23:58:02.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:56:00+00:00 exited with status success for try_number 1 2024-05-25T23:58:02.310554923Z [2024-05-25T23:58:02.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:57:00+00:00 exited with status success for try_number 1 2024-05-25T23:58:02.317360029Z [2024-05-25T23:58:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:57:00+00:00, map_index=-1, run_start_date=2024-05-25 23:58:01.493517+00:00, run_end_date=2024-05-25 23:58:02.052514+00:00, run_duration=0.558997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:58:00.584040+00:00, queued_by_job_id=1, pid=5124 2024-05-25T23:58:02.317616777Z [2024-05-25T23:58:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:56:00+00:00, map_index=-1, run_start_date=2024-05-25 23:58:01.448322+00:00, run_end_date=2024-05-25 23:58:02.044730+00:00, run_duration=0.596408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:58:00.584040+00:00, queued_by_job_id=1, pid=5123 2024-05-25T23:58:05.261017741Z [2024-05-25T23:58:05.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:58:05.261548090Z [2024-05-25T23:58:05.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:57:00+00:00, run_id=scheduled__2024-05-25T23:57:00+00:00, run_start_date=2024-05-25 23:58:00.514775+00:00, run_end_date=2024-05-25 23:58:05.261056+00:00, run_duration=4.746281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:57:00+00:00, data_interval_end=2024-05-25 23:58:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:58:05.271802036Z [2024-05-25T23:58:05.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:58:00+00:00, run_after=2024-05-25T23:59:00+00:00 2024-05-25T23:58:05.321654188Z [2024-05-25T23:58:05.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:57:00+00:00 exited with status success for try_number 1 2024-05-25T23:58:05.328856450Z [2024-05-25T23:58:05.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:57:00+00:00, map_index=-1, run_start_date=2024-05-25 23:58:02.732920+00:00, run_end_date=2024-05-25 23:58:04.114947+00:00, run_duration=1.382027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:58:00.584040+00:00, queued_by_job_id=1, pid=5142 2024-05-25T23:58:06.373011311Z [2024-05-25T23:58:06.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:58:06.373556072Z [2024-05-25T23:58:06.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:57:00+00:00, run_id=scheduled__2024-05-25T23:57:00+00:00, run_start_date=2024-05-25 23:58:00.516175+00:00, run_end_date=2024-05-25 23:58:06.372912+00:00, run_duration=5.856737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:57:00+00:00, data_interval_end=2024-05-25 23:58:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:58:06.381759236Z [2024-05-25T23:58:06.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:58:00+00:00, run_after=2024-05-25T23:59:00+00:00 2024-05-25T23:58:06.407962581Z [2024-05-25T23:58:06.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:57:00+00:00 exited with status success for try_number 1 2024-05-25T23:58:06.412727370Z [2024-05-25T23:58:06.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:57:00+00:00, map_index=-1, run_start_date=2024-05-25 23:58:03.041500+00:00, run_end_date=2024-05-25 23:58:05.247171+00:00, run_duration=2.205671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:58:00.584040+00:00, queued_by_job_id=1, pid=5153 2024-05-25T23:58:30.993049183Z [2024-05-25T23:58:30.992+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-25T23:59:01.045223142Z [2024-05-25T23:59:01.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:59:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:59:01.063033034Z [2024-05-25T23:59:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:59:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:59:01.073344250Z [2024-05-25T23:59:01.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-25T23:59:01.137097192Z [2024-05-25T23:59:01.136+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-25T23:59:01.137121707Z 2024-05-25T23:59:01.137125629Z 2024-05-25T23:59:01.137143380Z 2024-05-25T23:59:01.137433414Z [2024-05-25T23:59:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:59:01.137644370Z [2024-05-25T23:59:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-25T23:59:01.137841228Z [2024-05-25T23:59:01.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-25T23:59:01.138514784Z [2024-05-25T23:59:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-25T23:59:01.138526592Z 2024-05-25T23:59:01.138537862Z 2024-05-25T23:59:01.138541486Z 2024-05-25T23:59:01.142760381Z [2024-05-25T23:59:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:59:01.143167278Z [2024-05-25T23:59:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T23:59:01.143562644Z [2024-05-25T23:59:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:59:01.143835887Z [2024-05-25T23:59:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T23:59:01.144143889Z [2024-05-25T23:59:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-25T23:59:01.144356399Z [2024-05-25T23:59:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T23:59:01.572760564Z [2024-05-25T23:59:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status queued for try_number 1 2024-05-25T23:59:01.573151860Z [2024-05-25T23:59:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status queued for try_number 1 2024-05-25T23:59:01.573315957Z [2024-05-25T23:59:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status queued for try_number 1 2024-05-25T23:59:01.589070811Z [2024-05-25T23:59:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f5ac2ce-3fa4-4038-ae38-9bce8edbad5e 2024-05-25T23:59:01.589359112Z [2024-05-25T23:59:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 789d7c9e-0cbf-4a64-99e4-de6f3863ddfc 2024-05-25T23:59:01.591695448Z [2024-05-25T23:59:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65539ad2-36a6-4016-ad0b-d5c7df54e8a5 2024-05-25T23:59:02.809877502Z [2024-05-25T23:59:02.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:59:02.810024667Z [2024-05-25T23:59:02.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:58:00+00:00, run_id=scheduled__2024-05-25T23:58:00+00:00, run_start_date=2024-05-25 23:59:01.085631+00:00, run_end_date=2024-05-25 23:59:02.809744+00:00, run_duration=1.724113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:58:00+00:00, data_interval_end=2024-05-25 23:59:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-25T23:59:02.820984389Z [2024-05-25T23:59:02.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-25T23:59:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:59:02.879017175Z [2024-05-25T23:59:02.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status success for try_number 1 2024-05-25T23:59:02.885177030Z [2024-05-25T23:59:02.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:58:00+00:00, map_index=-1, run_start_date=2024-05-25 23:59:02.337150+00:00, run_end_date=2024-05-25 23:59:02.714647+00:00, run_duration=0.377497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:59:01.139266+00:00, queued_by_job_id=1, pid=5180 2024-05-25T23:59:06.369750712Z [2024-05-25T23:59:06.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:59:06.370106900Z [2024-05-25T23:59:06.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:58:00+00:00, run_id=scheduled__2024-05-25T23:58:00+00:00, run_start_date=2024-05-25 23:59:01.086919+00:00, run_end_date=2024-05-25 23:59:06.369681+00:00, run_duration=5.282762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:58:00+00:00, data_interval_end=2024-05-25 23:59:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-25T23:59:06.379560267Z [2024-05-25T23:59:06.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:59:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:59:06.386403544Z [2024-05-25T23:59:06.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-25T23:59:06.386819449Z [2024-05-25T23:59:06.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:58:00+00:00, run_id=scheduled__2024-05-25T23:58:00+00:00, run_start_date=2024-05-25 23:59:01.088000+00:00, run_end_date=2024-05-25 23:59:06.386317+00:00, run_duration=5.298317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:58:00+00:00, data_interval_end=2024-05-25 23:59:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-25T23:59:06.396705964Z [2024-05-25T23:59:06.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-25T23:59:00+00:00, run_after=2024-05-26T00:00:00+00:00 2024-05-25T23:59:06.428224041Z [2024-05-25T23:59:06.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status success for try_number 1 2024-05-25T23:59:06.428415029Z [2024-05-25T23:59:06.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status success for try_number 1 2024-05-25T23:59:06.434549574Z [2024-05-25T23:59:06.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:58:00+00:00, map_index=-1, run_start_date=2024-05-25 23:59:03.571858+00:00, run_end_date=2024-05-25 23:59:05.381571+00:00, run_duration=1.809713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:59:01.139266+00:00, queued_by_job_id=1, pid=5199 2024-05-25T23:59:06.434794236Z [2024-05-25T23:59:06.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:58:00+00:00, map_index=-1, run_start_date=2024-05-25 23:59:03.432469+00:00, run_end_date=2024-05-25 23:59:05.622831+00:00, run_duration=2.190362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-25 23:59:01.139266+00:00, queued_by_job_id=1, pid=5198 2024-05-26T00:00:00.154125150Z [2024-05-26T00:00:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:01:00+00:00 2024-05-26T00:00:00.168808248Z [2024-05-26T00:00:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:01:00+00:00 2024-05-26T00:00:00.187719480Z [2024-05-26T00:00:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:05:00+00:00 2024-05-26T00:00:00.202943270Z [2024-05-26T00:00:00.202+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:00:00.216026133Z [2024-05-26T00:00:00.215+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:00:00.325721354Z [2024-05-26T00:00:00.325+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T00:00:00.325746246Z 2024-05-26T00:00:00.325749909Z 2024-05-26T00:00:00.325753690Z 2024-05-26T00:00:00.325795555Z 2024-05-26T00:00:00.325799209Z 2024-05-26T00:00:00.326140978Z [2024-05-26T00:00:00.325+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:00:00.326615825Z [2024-05-26T00:00:00.326+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:00:00.327374013Z [2024-05-26T00:00:00.326+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:00:00.327993813Z [2024-05-26T00:00:00.327+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:00:00.328591657Z [2024-05-26T00:00:00.328+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:00:00.330222902Z [2024-05-26T00:00:00.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:00:00.330234913Z 2024-05-26T00:00:00.330239904Z 2024-05-26T00:00:00.330243405Z 2024-05-26T00:00:00.330246441Z 2024-05-26T00:00:00.330249536Z 2024-05-26T00:00:00.337662318Z [2024-05-26T00:00:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-25T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:00:00.338062474Z [2024-05-26T00:00:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:00:00.338590875Z [2024-05-26T00:00:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-25T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:00:00.338864115Z [2024-05-26T00:00:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:00:00.339355898Z [2024-05-26T00:00:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:00:00.339657830Z [2024-05-26T00:00:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:00:00.340102252Z [2024-05-26T00:00:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:00:00.340332957Z [2024-05-26T00:00:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:00:00.340695550Z [2024-05-26T00:00:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-25T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:00:00.340937012Z [2024-05-26T00:00:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:00:00.942075824Z [2024-05-26T00:00:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:00.942101195Z [2024-05-26T00:00:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:00.942105876Z [2024-05-26T00:00:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:59:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:00.942109317Z [2024-05-26T00:00:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:59:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:00.942125902Z [2024-05-26T00:00:00.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:59:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:00.954362931Z [2024-05-26T00:00:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d4970d-af1e-4d9b-b1a3-6d2d5065ab98 2024-05-26T00:00:00.954510906Z [2024-05-26T00:00:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to f04cbff2-367e-4211-ac58-4e786f7a5b0c 2024-05-26T00:00:00.954691138Z [2024-05-26T00:00:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50709644-12f5-44e9-b0b7-5686506ad800 2024-05-26T00:00:00.954839248Z [2024-05-26T00:00:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76f33aac-426f-4c96-baf9-7fd71c66a889 2024-05-26T00:00:00.954971814Z [2024-05-26T00:00:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32e242bc-f048-4bd5-aacd-513355121da6 2024-05-26T00:00:02.387567827Z [2024-05-26T00:00:02.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:00:02.387819732Z [2024-05-26T00:00:02.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-25 23:59:00+00:00, run_id=scheduled__2024-05-25T23:59:00+00:00, run_start_date=2024-05-26 00:00:00.235994+00:00, run_end_date=2024-05-26 00:00:02.387456+00:00, run_duration=2.151462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:59:00+00:00, data_interval_end=2024-05-26 00:00:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:00:02.419642864Z [2024-05-26T00:00:02.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:01:00+00:00 2024-05-26T00:00:02.526898372Z [2024-05-26T00:00:02.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:59:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:02.532264138Z [2024-05-26T00:00:02.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:59:00+00:00, map_index=-1, run_start_date=2024-05-26 00:00:01.590518+00:00, run_end_date=2024-05-26 00:00:02.041871+00:00, run_duration=0.451353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:00.333343+00:00, queued_by_job_id=1, pid=5234 2024-05-26T00:00:03.580866056Z [2024-05-26T00:00:03.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:00:03.581163452Z [2024-05-26T00:00:03.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-25 23:58:00+00:00, run_id=scheduled__2024-05-25T23:58:00+00:00, run_start_date=2024-05-26 00:00:00.232623+00:00, run_end_date=2024-05-26 00:00:03.580777+00:00, run_duration=3.348154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:58:00+00:00, data_interval_end=2024-05-26 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:00:03.595694114Z [2024-05-26T00:00:03.595+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:02:00+00:00 2024-05-26T00:00:03.659563060Z [2024-05-26T00:00:03.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-25T23:58:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:03.665413092Z [2024-05-26T00:00:03.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-25T23:58:00+00:00, map_index=-1, run_start_date=2024-05-26 00:00:01.792869+00:00, run_end_date=2024-05-26 00:00:02.464768+00:00, run_duration=0.671899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:00.333343+00:00, queued_by_job_id=1, pid=5236 2024-05-26T00:00:04.847018895Z [2024-05-26T00:00:04.844+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:00:04.847042522Z 2024-05-26T00:00:04.847046883Z [2024-05-26T00:00:04.844+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:00:04.847057434Z [2024-05-26T00:00:04.845+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:00:04.847061299Z 2024-05-26T00:00:04.849801199Z [2024-05-26T00:00:04.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-25T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:00:04.850032639Z [2024-05-26T00:00:04.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:00:04.957903970Z [2024-05-26T00:00:04.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:04.957943121Z [2024-05-26T00:00:04.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:04.967124428Z [2024-05-26T00:00:04.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0a924d8-bc4c-4c21-aee4-aac7e55b79b9 2024-05-26T00:00:04.967217967Z [2024-05-26T00:00:04.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-25T23:55:00+00:00, map_index=-1, run_start_date=2024-05-26 00:00:03.396153+00:00, run_end_date=2024-05-26 00:00:04.235259+00:00, run_duration=0.839106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:00.333343+00:00, queued_by_job_id=1, pid=5265 2024-05-26T00:00:05.052414668Z [2024-05-26T00:00:05.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:00:05.052837694Z [2024-05-26T00:00:05.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:59:00+00:00, run_id=scheduled__2024-05-25T23:59:00+00:00, run_start_date=2024-05-26 00:00:00.237400+00:00, run_end_date=2024-05-26 00:00:05.052449+00:00, run_duration=4.815049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:59:00+00:00, data_interval_end=2024-05-26 00:00:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:00:05.063608487Z [2024-05-26T00:00:05.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:01:00+00:00 2024-05-26T00:00:05.134084948Z [2024-05-26T00:00:05.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:59:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:05.153536552Z [2024-05-26T00:00:05.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:59:00+00:00, map_index=-1, run_start_date=2024-05-26 00:00:03.036257+00:00, run_end_date=2024-05-26 00:00:04.713880+00:00, run_duration=1.677623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:00.333343+00:00, queued_by_job_id=1, pid=5259 2024-05-26T00:00:07.170253274Z [2024-05-26T00:00:07.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:00:07.170614808Z [2024-05-26T00:00:07.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:59:00+00:00, run_id=scheduled__2024-05-25T23:59:00+00:00, run_start_date=2024-05-26 00:00:00.238746+00:00, run_end_date=2024-05-26 00:00:07.170259+00:00, run_duration=6.931513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:59:00+00:00, data_interval_end=2024-05-26 00:00:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:00:07.186817045Z [2024-05-26T00:00:07.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:01:00+00:00 2024-05-26T00:00:07.291032872Z [2024-05-26T00:00:07.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-25T23:59:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:07.296567878Z [2024-05-26T00:00:07.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-25T23:59:00+00:00, map_index=-1, run_start_date=2024-05-26 00:00:03.989033+00:00, run_end_date=2024-05-26 00:00:06.301099+00:00, run_duration=2.312066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:00.333343+00:00, queued_by_job_id=1, pid=5271 2024-05-26T00:00:08.377067849Z [2024-05-26T00:00:08.373+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:00:08.377092486Z 2024-05-26T00:00:08.377095844Z [2024-05-26T00:00:08.373+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:00:08.377100705Z [2024-05-26T00:00:08.374+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:00:08.377103797Z 2024-05-26T00:00:08.377108144Z [2024-05-26T00:00:08.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-25T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:00:08.377111379Z [2024-05-26T00:00:08.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:00:08.504542669Z [2024-05-26T00:00:08.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:08.504714456Z [2024-05-26T00:00:08.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:08.513023039Z [2024-05-26T00:00:08.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dc04f9a-a887-4c9d-83bc-94a887419b8e 2024-05-26T00:00:08.513240271Z [2024-05-26T00:00:08.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-25T23:55:00+00:00, map_index=-1, run_start_date=2024-05-26 00:00:06.901768+00:00, run_end_date=2024-05-26 00:00:07.313964+00:00, run_duration=0.412196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:04.845741+00:00, queued_by_job_id=1, pid=5289 2024-05-26T00:00:11.183013437Z [2024-05-26T00:00:11.182+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:00:11.183052930Z 2024-05-26T00:00:11.183467942Z [2024-05-26T00:00:11.183+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:00:11.184371382Z [2024-05-26T00:00:11.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:00:11.184385037Z 2024-05-26T00:00:11.186542928Z [2024-05-26T00:00:11.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-25T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:00:11.186887287Z [2024-05-26T00:00:11.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-25T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:00:11.255141485Z [2024-05-26T00:00:11.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status queued for try_number 1 2024-05-26T00:00:11.255584088Z [2024-05-26T00:00:11.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:11.262928021Z [2024-05-26T00:00:11.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73152e7d-a2ae-4303-ad64-234f7ccc630e 2024-05-26T00:00:11.263948138Z [2024-05-26T00:00:11.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-25T23:55:00+00:00, map_index=0, run_start_date=2024-05-26 00:00:10.107189+00:00, run_end_date=2024-05-26 00:00:10.467196+00:00, run_duration=0.360007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:08.374704+00:00, queued_by_job_id=1, pid=5297 2024-05-26T00:00:13.514981022Z [2024-05-26T00:00:13.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:00:13.515348561Z [2024-05-26T00:00:13.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-25 23:55:00+00:00, run_id=scheduled__2024-05-25T23:55:00+00:00, run_start_date=2024-05-26 00:00:00.230806+00:00, run_end_date=2024-05-26 00:00:13.514476+00:00, run_duration=13.28367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-25 23:55:00+00:00, data_interval_end=2024-05-26 00:00:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:00:13.526179595Z [2024-05-26T00:00:13.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:00:00+00:00, run_after=2024-05-26T00:05:00+00:00 2024-05-26T00:00:13.576240253Z [2024-05-26T00:00:13.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-25T23:55:00+00:00 exited with status success for try_number 1 2024-05-26T00:00:13.584711131Z [2024-05-26T00:00:13.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-25T23:55:00+00:00, map_index=-1, run_start_date=2024-05-26 00:00:12.811883+00:00, run_end_date=2024-05-26 00:00:13.204986+00:00, run_duration=0.393103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:00:11.184783+00:00, queued_by_job_id=1, pid=5305 2024-05-26T00:01:00.744094159Z [2024-05-26T00:01:00.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:01:00+00:00, run_after=2024-05-26T00:02:00+00:00 2024-05-26T00:01:00.755608029Z [2024-05-26T00:01:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:01:00+00:00, run_after=2024-05-26T00:02:00+00:00 2024-05-26T00:01:00.764919858Z [2024-05-26T00:01:00.764+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:01:00.828924916Z [2024-05-26T00:01:00.828+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:01:00.828949334Z 2024-05-26T00:01:00.828952609Z 2024-05-26T00:01:00.828955630Z 2024-05-26T00:01:00.829315452Z [2024-05-26T00:01:00.828+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:01:00.829390559Z [2024-05-26T00:01:00.829+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:01:00.829464907Z [2024-05-26T00:01:00.829+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:01:00.829990815Z [2024-05-26T00:01:00.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:01:00.829998613Z 2024-05-26T00:01:00.830001845Z 2024-05-26T00:01:00.830004743Z 2024-05-26T00:01:00.834855527Z [2024-05-26T00:01:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:01:00.834908134Z [2024-05-26T00:01:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:01:00.835013466Z [2024-05-26T00:01:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:01:00.835066348Z [2024-05-26T00:01:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:01:00.835279072Z [2024-05-26T00:01:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:01:00.835309695Z [2024-05-26T00:01:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:01:01.066622038Z [2024-05-26T00:01:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:01:01.067211367Z [2024-05-26T00:01:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:01:01.067345732Z [2024-05-26T00:01:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:01:01.077078337Z [2024-05-26T00:01:01.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to 337cf232-ac1b-4691-8599-59189a14649e 2024-05-26T00:01:01.077243364Z [2024-05-26T00:01:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5f261cf-5496-4b02-98c2-c20f67d49822 2024-05-26T00:01:01.077394455Z [2024-05-26T00:01:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6de2f70b-5231-4d51-9bb0-5e3211feaf11 2024-05-26T00:01:02.073749313Z [2024-05-26T00:01:02.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:01:02.074115007Z [2024-05-26T00:01:02.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:00:00+00:00, run_id=scheduled__2024-05-26T00:00:00+00:00, run_start_date=2024-05-26 00:01:00.774214+00:00, run_end_date=2024-05-26 00:01:02.073787+00:00, run_duration=1.299573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:00:00+00:00, data_interval_end=2024-05-26 00:01:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:01:02.084139636Z [2024-05-26T00:01:02.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:01:00+00:00, run_after=2024-05-26T00:02:00+00:00 2024-05-26T00:01:03.290371971Z [2024-05-26T00:01:03.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:01:03.296498163Z [2024-05-26T00:01:03.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=-1, run_start_date=2024-05-26 00:01:01.624914+00:00, run_end_date=2024-05-26 00:01:01.980392+00:00, run_duration=0.355478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:01:00.831774+00:00, queued_by_job_id=1, pid=5327 2024-05-26T00:01:04.351691212Z [2024-05-26T00:01:04.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:01:04.352545197Z [2024-05-26T00:01:04.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:00:00+00:00, run_id=scheduled__2024-05-26T00:00:00+00:00, run_start_date=2024-05-26 00:01:00.775373+00:00, run_end_date=2024-05-26 00:01:04.351923+00:00, run_duration=3.57655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:00:00+00:00, data_interval_end=2024-05-26 00:01:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:01:04.377148367Z [2024-05-26T00:01:04.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:01:00+00:00, run_after=2024-05-26T00:02:00+00:00 2024-05-26T00:01:04.437379307Z [2024-05-26T00:01:04.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:01:04.441706227Z [2024-05-26T00:01:04.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=-1, run_start_date=2024-05-26 00:01:02.531181+00:00, run_end_date=2024-05-26 00:01:04.074840+00:00, run_duration=1.543659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:01:00.831774+00:00, queued_by_job_id=1, pid=5345 2024-05-26T00:01:06.621531370Z [2024-05-26T00:01:06.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:01:06.621952190Z [2024-05-26T00:01:06.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:00:00+00:00, run_id=scheduled__2024-05-26T00:00:00+00:00, run_start_date=2024-05-26 00:01:00.776442+00:00, run_end_date=2024-05-26 00:01:06.621494+00:00, run_duration=5.845052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:00:00+00:00, data_interval_end=2024-05-26 00:01:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:01:06.634546894Z [2024-05-26T00:01:06.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:01:00+00:00, run_after=2024-05-26T00:02:00+00:00 2024-05-26T00:01:06.671076545Z [2024-05-26T00:01:06.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:01:06.678666777Z [2024-05-26T00:01:06.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=-1, run_start_date=2024-05-26 00:01:02.660738+00:00, run_end_date=2024-05-26 00:01:06.362083+00:00, run_duration=3.701345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:01:00.831774+00:00, queued_by_job_id=1, pid=5346 2024-05-26T00:02:00.034499260Z [2024-05-26T00:02:00.033+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:02:00.041791990Z [2024-05-26T00:02:00.041+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:02:00.054464353Z [2024-05-26T00:02:00.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:02:00+00:00, run_after=2024-05-26T00:03:00+00:00 2024-05-26T00:02:00.065872841Z [2024-05-26T00:02:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:02:00+00:00, run_after=2024-05-26T00:03:00+00:00 2024-05-26T00:02:00.172981271Z [2024-05-26T00:02:00.172+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:02:00.173010749Z 2024-05-26T00:02:00.173017609Z 2024-05-26T00:02:00.173022245Z 2024-05-26T00:02:00.173026475Z 2024-05-26T00:02:00.173275054Z [2024-05-26T00:02:00.173+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:02:00.173441547Z [2024-05-26T00:02:00.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:02:00.173542392Z [2024-05-26T00:02:00.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:02:00.173691386Z [2024-05-26T00:02:00.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:02:00.174544517Z [2024-05-26T00:02:00.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:02:00.174556194Z 2024-05-26T00:02:00.174560278Z 2024-05-26T00:02:00.174563564Z 2024-05-26T00:02:00.174598217Z 2024-05-26T00:02:00.180611142Z [2024-05-26T00:02:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:02:00.180813143Z [2024-05-26T00:02:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:02:00.181226462Z [2024-05-26T00:02:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:02:00.181379310Z [2024-05-26T00:02:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:02:00.181801750Z [2024-05-26T00:02:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:02:00.181988774Z [2024-05-26T00:02:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:02:00.182293234Z [2024-05-26T00:02:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:02:00.182426760Z [2024-05-26T00:02:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:02:00.491318802Z [2024-05-26T00:02:00.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:02:00.492710882Z [2024-05-26T00:02:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:01:00+00:00 exited with status queued for try_number 1 2024-05-26T00:02:00.492937689Z [2024-05-26T00:02:00.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:01:00+00:00 exited with status queued for try_number 1 2024-05-26T00:02:00.493062371Z [2024-05-26T00:02:00.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:01:00+00:00 exited with status queued for try_number 1 2024-05-26T00:02:00.502487142Z [2024-05-26T00:02:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd3a9175-7d97-4206-b66a-27295983064c 2024-05-26T00:02:00.502771522Z [2024-05-26T00:02:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c2000f2-6ab4-41c5-b2bc-fb12a24f8165 2024-05-26T00:02:00.502950902Z [2024-05-26T00:02:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f35a24b-61a0-4cf0-b80b-bafc1d99609f 2024-05-26T00:02:00.503126375Z [2024-05-26T00:02:00.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9ddb565-9617-44c2-bdfc-a4fd216123ac 2024-05-26T00:02:01.677378654Z [2024-05-26T00:02:01.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:02:01.677698082Z [2024-05-26T00:02:01.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:00:00+00:00, run_id=scheduled__2024-05-26T00:00:00+00:00, run_start_date=2024-05-26 00:02:00.078594+00:00, run_end_date=2024-05-26 00:02:01.677386+00:00, run_duration=1.598792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:00:00+00:00, data_interval_end=2024-05-26 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:02:01.687070962Z [2024-05-26T00:02:01.686+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:02:00+00:00, run_after=2024-05-26T00:04:00+00:00 2024-05-26T00:02:01.694982678Z [2024-05-26T00:02:01.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:02:01.695260814Z [2024-05-26T00:02:01.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:01:00+00:00, run_id=scheduled__2024-05-26T00:01:00+00:00, run_start_date=2024-05-26 00:02:00.079965+00:00, run_end_date=2024-05-26 00:02:01.694992+00:00, run_duration=1.615027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:01:00+00:00, data_interval_end=2024-05-26 00:02:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:02:01.706578823Z [2024-05-26T00:02:01.706+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:02:00+00:00, run_after=2024-05-26T00:03:00+00:00 2024-05-26T00:02:01.763888774Z [2024-05-26T00:02:01.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:02:01.768936596Z [2024-05-26T00:02:01.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=-1, run_start_date=2024-05-26 00:02:00.997705+00:00, run_end_date=2024-05-26 00:02:01.404661+00:00, run_duration=0.406956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:02:00.176619+00:00, queued_by_job_id=1, pid=5379 2024-05-26T00:02:02.903711082Z [2024-05-26T00:02:02.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:01:00+00:00 exited with status success for try_number 1 2024-05-26T00:02:02.913426357Z [2024-05-26T00:02:02.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:01:00+00:00, map_index=-1, run_start_date=2024-05-26 00:02:01.081157+00:00, run_end_date=2024-05-26 00:02:01.661733+00:00, run_duration=0.580576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:02:00.176619+00:00, queued_by_job_id=1, pid=5380 2024-05-26T00:02:04.290433412Z [2024-05-26T00:02:04.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:02:04.290750105Z [2024-05-26T00:02:04.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:01:00+00:00, run_id=scheduled__2024-05-26T00:01:00+00:00, run_start_date=2024-05-26 00:02:00.081158+00:00, run_end_date=2024-05-26 00:02:04.290309+00:00, run_duration=4.209151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:01:00+00:00, data_interval_end=2024-05-26 00:02:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:02:04.302673675Z [2024-05-26T00:02:04.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:02:00+00:00, run_after=2024-05-26T00:03:00+00:00 2024-05-26T00:02:04.311184017Z [2024-05-26T00:02:04.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:02:04.311492163Z [2024-05-26T00:02:04.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:01:00+00:00, run_id=scheduled__2024-05-26T00:01:00+00:00, run_start_date=2024-05-26 00:02:00.082334+00:00, run_end_date=2024-05-26 00:02:04.311064+00:00, run_duration=4.22873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:01:00+00:00, data_interval_end=2024-05-26 00:02:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:02:04.328016794Z [2024-05-26T00:02:04.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:02:00+00:00, run_after=2024-05-26T00:03:00+00:00 2024-05-26T00:02:04.361947560Z [2024-05-26T00:02:04.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:01:00+00:00 exited with status success for try_number 1 2024-05-26T00:02:04.361986666Z [2024-05-26T00:02:04.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:01:00+00:00 exited with status success for try_number 1 2024-05-26T00:02:04.370208560Z [2024-05-26T00:02:04.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:01:00+00:00, map_index=-1, run_start_date=2024-05-26 00:02:02.266971+00:00, run_end_date=2024-05-26 00:02:03.492650+00:00, run_duration=1.225679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:02:00.176619+00:00, queued_by_job_id=1, pid=5404 2024-05-26T00:02:04.370404572Z [2024-05-26T00:02:04.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:01:00+00:00, map_index=-1, run_start_date=2024-05-26 00:02:02.130196+00:00, run_end_date=2024-05-26 00:02:03.768236+00:00, run_duration=1.63804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:02:00.176619+00:00, queued_by_job_id=1, pid=5403 2024-05-26T00:03:00.096268515Z [2024-05-26T00:03:00.095+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:03:00.109373764Z [2024-05-26T00:03:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:03:00+00:00, run_after=2024-05-26T00:04:00+00:00 2024-05-26T00:03:00.121884860Z [2024-05-26T00:03:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:03:00+00:00, run_after=2024-05-26T00:04:00+00:00 2024-05-26T00:03:00.187266685Z [2024-05-26T00:03:00.185+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:03:00.187281050Z 2024-05-26T00:03:00.187300116Z 2024-05-26T00:03:00.187303435Z 2024-05-26T00:03:00.187306565Z [2024-05-26T00:03:00.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:03:00.187309417Z [2024-05-26T00:03:00.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:03:00.187312139Z [2024-05-26T00:03:00.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:03:00.187315397Z [2024-05-26T00:03:00.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:03:00.187318171Z 2024-05-26T00:03:00.187320917Z 2024-05-26T00:03:00.187323590Z 2024-05-26T00:03:00.192510729Z [2024-05-26T00:03:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:03:00.192735491Z [2024-05-26T00:03:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:03:00.193072922Z [2024-05-26T00:03:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:03:00.193258102Z [2024-05-26T00:03:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:03:00.193575037Z [2024-05-26T00:03:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:03:00.193693288Z [2024-05-26T00:03:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:03:00.451229262Z [2024-05-26T00:03:00.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status queued for try_number 1 2024-05-26T00:03:00.459645405Z [2024-05-26T00:03:00.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status queued for try_number 1 2024-05-26T00:03:00.459666199Z [2024-05-26T00:03:00.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status queued for try_number 1 2024-05-26T00:03:00.459669695Z [2024-05-26T00:03:00.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a2c24d5-4734-4dc3-b5c9-17e66f3a1721 2024-05-26T00:03:00.459672722Z [2024-05-26T00:03:00.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d98828d-2b27-4fbc-8f5c-979c501da006 2024-05-26T00:03:00.459675755Z [2024-05-26T00:03:00.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb461bf0-1f4c-4c14-807d-3836568a11d2 2024-05-26T00:03:02.019659663Z [2024-05-26T00:03:02.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:03:02.019685754Z [2024-05-26T00:03:02.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:02:00+00:00, run_id=scheduled__2024-05-26T00:02:00+00:00, run_start_date=2024-05-26 00:03:00.133202+00:00, run_end_date=2024-05-26 00:03:02.016202+00:00, run_duration=1.883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:02:00+00:00, data_interval_end=2024-05-26 00:03:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:03:02.029476480Z [2024-05-26T00:03:02.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:03:00+00:00, run_after=2024-05-26T00:04:00+00:00 2024-05-26T00:03:02.071618270Z [2024-05-26T00:03:02.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status success for try_number 1 2024-05-26T00:03:02.071874699Z [2024-05-26T00:03:02.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:02:00+00:00, map_index=-1, run_start_date=2024-05-26 00:03:01.223306+00:00, run_end_date=2024-05-26 00:03:01.747508+00:00, run_duration=0.524202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:03:00.187853+00:00, queued_by_job_id=1, pid=5436 2024-05-26T00:03:04.186047815Z [2024-05-26T00:03:04.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:03:04.186082049Z [2024-05-26T00:03:04.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:02:00+00:00, run_id=scheduled__2024-05-26T00:02:00+00:00, run_start_date=2024-05-26 00:03:00.134838+00:00, run_end_date=2024-05-26 00:03:04.182801+00:00, run_duration=4.047963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:02:00+00:00, data_interval_end=2024-05-26 00:03:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:03:04.199920536Z [2024-05-26T00:03:04.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:03:00+00:00, run_after=2024-05-26T00:04:00+00:00 2024-05-26T00:03:04.294184147Z [2024-05-26T00:03:04.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status success for try_number 1 2024-05-26T00:03:04.305731629Z [2024-05-26T00:03:04.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:02:00+00:00, map_index=-1, run_start_date=2024-05-26 00:03:02.380157+00:00, run_end_date=2024-05-26 00:03:03.636231+00:00, run_duration=1.256074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:03:00.187853+00:00, queued_by_job_id=1, pid=5454 2024-05-26T00:03:05.361004689Z [2024-05-26T00:03:05.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:03:05.361174910Z [2024-05-26T00:03:05.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:02:00+00:00, run_id=scheduled__2024-05-26T00:02:00+00:00, run_start_date=2024-05-26 00:03:00.137245+00:00, run_end_date=2024-05-26 00:03:05.360934+00:00, run_duration=5.223689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:02:00+00:00, data_interval_end=2024-05-26 00:03:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:03:05.374535917Z [2024-05-26T00:03:05.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:03:00+00:00, run_after=2024-05-26T00:04:00+00:00 2024-05-26T00:03:05.414202046Z [2024-05-26T00:03:05.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status success for try_number 1 2024-05-26T00:03:05.423356936Z [2024-05-26T00:03:05.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:02:00+00:00, map_index=-1, run_start_date=2024-05-26 00:03:02.507384+00:00, run_end_date=2024-05-26 00:03:04.141808+00:00, run_duration=1.634424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:03:00.187853+00:00, queued_by_job_id=1, pid=5455 2024-05-26T00:03:31.077691387Z [2024-05-26T00:03:31.076+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:04:00.228733000Z [2024-05-26T00:04:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:04:00+00:00, run_after=2024-05-26T00:05:00+00:00 2024-05-26T00:04:00.236394150Z [2024-05-26T00:04:00.236+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:04:00.248978968Z [2024-05-26T00:04:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:04:00+00:00, run_after=2024-05-26T00:05:00+00:00 2024-05-26T00:04:00.257530513Z [2024-05-26T00:04:00.257+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:04:00.360368665Z [2024-05-26T00:04:00.359+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:04:00.360403636Z 2024-05-26T00:04:00.360412853Z 2024-05-26T00:04:00.360419573Z 2024-05-26T00:04:00.360426385Z 2024-05-26T00:04:00.360823957Z [2024-05-26T00:04:00.360+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:04:00.361217728Z [2024-05-26T00:04:00.360+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:04:00.361418410Z [2024-05-26T00:04:00.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:04:00.361723956Z [2024-05-26T00:04:00.361+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:04:00.362905904Z [2024-05-26T00:04:00.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:04:00.362957412Z 2024-05-26T00:04:00.362965418Z 2024-05-26T00:04:00.362972386Z 2024-05-26T00:04:00.362978965Z 2024-05-26T00:04:00.368954130Z [2024-05-26T00:04:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:04:00.369221118Z [2024-05-26T00:04:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:04:00.369617832Z [2024-05-26T00:04:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:04:00.369836632Z [2024-05-26T00:04:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:04:00.370607138Z [2024-05-26T00:04:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:04:00.370614761Z [2024-05-26T00:04:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:04:00.370981737Z [2024-05-26T00:04:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:04:00.371206415Z [2024-05-26T00:04:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:04:00.812524392Z [2024-05-26T00:04:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status queued for try_number 1 2024-05-26T00:04:00.812778995Z [2024-05-26T00:04:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:03:00+00:00 exited with status queued for try_number 1 2024-05-26T00:04:00.812949808Z [2024-05-26T00:04:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:03:00+00:00 exited with status queued for try_number 1 2024-05-26T00:04:00.813100522Z [2024-05-26T00:04:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:03:00+00:00 exited with status queued for try_number 1 2024-05-26T00:04:00.822445866Z [2024-05-26T00:04:00.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6c1b0c6-fee3-4547-b23d-eb5276bc9e42 2024-05-26T00:04:00.822670822Z [2024-05-26T00:04:00.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 147b683a-0efc-4a8f-87b1-3e717bae6519 2024-05-26T00:04:00.822862501Z [2024-05-26T00:04:00.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to d514db84-9898-42d7-8c64-362b53784a8b 2024-05-26T00:04:00.823043089Z [2024-05-26T00:04:00.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8442353d-eea0-4f43-ac41-c63dd38fd25a 2024-05-26T00:04:02.624692122Z [2024-05-26T00:04:02.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:04:02.625059615Z [2024-05-26T00:04:02.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:02:00+00:00, run_id=scheduled__2024-05-26T00:02:00+00:00, run_start_date=2024-05-26 00:04:00.269230+00:00, run_end_date=2024-05-26 00:04:02.624682+00:00, run_duration=2.355452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:02:00+00:00, data_interval_end=2024-05-26 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:04:02.632660363Z [2024-05-26T00:04:02.632+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:04:00+00:00, run_after=2024-05-26T00:06:00+00:00 2024-05-26T00:04:02.640797250Z [2024-05-26T00:04:02.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:04:02.641160155Z [2024-05-26T00:04:02.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:03:00+00:00, run_id=scheduled__2024-05-26T00:03:00+00:00, run_start_date=2024-05-26 00:04:00.270580+00:00, run_end_date=2024-05-26 00:04:02.640829+00:00, run_duration=2.370249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:03:00+00:00, data_interval_end=2024-05-26 00:04:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:04:02.651324335Z [2024-05-26T00:04:02.651+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:04:00+00:00, run_after=2024-05-26T00:05:00+00:00 2024-05-26T00:04:02.721564491Z [2024-05-26T00:04:02.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:02:00+00:00 exited with status success for try_number 1 2024-05-26T00:04:02.721747219Z [2024-05-26T00:04:02.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:03:00+00:00 exited with status success for try_number 1 2024-05-26T00:04:02.728865533Z [2024-05-26T00:04:02.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:03:00+00:00, map_index=-1, run_start_date=2024-05-26 00:04:01.371602+00:00, run_end_date=2024-05-26 00:04:01.867478+00:00, run_duration=0.495876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:04:00.364482+00:00, queued_by_job_id=1, pid=5488 2024-05-26T00:04:02.729238138Z [2024-05-26T00:04:02.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:02:00+00:00, map_index=-1, run_start_date=2024-05-26 00:04:01.410808+00:00, run_end_date=2024-05-26 00:04:01.829425+00:00, run_duration=0.418617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:04:00.364482+00:00, queued_by_job_id=1, pid=5489 2024-05-26T00:04:04.951205540Z [2024-05-26T00:04:04.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:04:04.951854280Z [2024-05-26T00:04:04.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:03:00+00:00, run_id=scheduled__2024-05-26T00:03:00+00:00, run_start_date=2024-05-26 00:04:00.271723+00:00, run_end_date=2024-05-26 00:04:04.951324+00:00, run_duration=4.679601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:03:00+00:00, data_interval_end=2024-05-26 00:04:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:04:04.964590203Z [2024-05-26T00:04:04.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:04:00+00:00, run_after=2024-05-26T00:05:00+00:00 2024-05-26T00:04:04.972506247Z [2024-05-26T00:04:04.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:04:04.972724671Z [2024-05-26T00:04:04.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:03:00+00:00, run_id=scheduled__2024-05-26T00:03:00+00:00, run_start_date=2024-05-26 00:04:00.272873+00:00, run_end_date=2024-05-26 00:04:04.972375+00:00, run_duration=4.699502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:03:00+00:00, data_interval_end=2024-05-26 00:04:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:04:04.981683334Z [2024-05-26T00:04:04.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:04:00+00:00, run_after=2024-05-26T00:05:00+00:00 2024-05-26T00:04:05.011122460Z [2024-05-26T00:04:05.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:03:00+00:00 exited with status success for try_number 1 2024-05-26T00:04:05.011369070Z [2024-05-26T00:04:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:03:00+00:00 exited with status success for try_number 1 2024-05-26T00:04:05.017604606Z [2024-05-26T00:04:05.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:03:00+00:00, map_index=-1, run_start_date=2024-05-26 00:04:02.433778+00:00, run_end_date=2024-05-26 00:04:03.794594+00:00, run_duration=1.360816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:04:00.364482+00:00, queued_by_job_id=1, pid=5512 2024-05-26T00:04:05.017971178Z [2024-05-26T00:04:05.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:03:00+00:00, map_index=-1, run_start_date=2024-05-26 00:04:02.488091+00:00, run_end_date=2024-05-26 00:04:04.120786+00:00, run_duration=1.632695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:04:00.364482+00:00, queued_by_job_id=1, pid=5513 2024-05-26T00:05:01.032503844Z [2024-05-26T00:05:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:05:00+00:00, run_after=2024-05-26T00:06:00+00:00 2024-05-26T00:05:01.046378239Z [2024-05-26T00:05:01.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:05:01.065105824Z [2024-05-26T00:05:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:05:00+00:00, run_after=2024-05-26T00:06:00+00:00 2024-05-26T00:05:01.081857095Z [2024-05-26T00:05:01.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:05:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:05:01.231746228Z [2024-05-26T00:05:01.231+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:05:01.231809907Z 2024-05-26T00:05:01.231819059Z 2024-05-26T00:05:01.231826761Z 2024-05-26T00:05:01.231834503Z 2024-05-26T00:05:01.232388518Z [2024-05-26T00:05:01.232+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:05:01.232745186Z [2024-05-26T00:05:01.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:05:01.233106809Z [2024-05-26T00:05:01.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:05:01.233466298Z [2024-05-26T00:05:01.233+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:05:01.234477586Z [2024-05-26T00:05:01.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:05:01.234493781Z 2024-05-26T00:05:01.234499495Z 2024-05-26T00:05:01.234504265Z 2024-05-26T00:05:01.234508993Z 2024-05-26T00:05:01.243331876Z [2024-05-26T00:05:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:05:01.244124020Z [2024-05-26T00:05:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:05:01.244841213Z [2024-05-26T00:05:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:05:01.245170103Z [2024-05-26T00:05:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:05:01.245696381Z [2024-05-26T00:05:01.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:05:01.246044854Z [2024-05-26T00:05:01.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:05:01.246598042Z [2024-05-26T00:05:01.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:05:01.246933007Z [2024-05-26T00:05:01.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:05:01.902604641Z [2024-05-26T00:05:01.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:05:01.902688045Z [2024-05-26T00:05:01.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status queued for try_number 1 2024-05-26T00:05:01.902818054Z [2024-05-26T00:05:01.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status queued for try_number 1 2024-05-26T00:05:01.902920693Z [2024-05-26T00:05:01.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status queued for try_number 1 2024-05-26T00:05:01.911505442Z [2024-05-26T00:05:01.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to a69d8f4a-5682-4788-a7de-b97a47f5b21f 2024-05-26T00:05:01.911679274Z [2024-05-26T00:05:01.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to b87d0e75-a134-4051-9b6a-9ad0a9c690eb 2024-05-26T00:05:01.911903878Z [2024-05-26T00:05:01.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56b73b42-fd92-4fbd-97f8-58f79a61aae3 2024-05-26T00:05:01.912058930Z [2024-05-26T00:05:01.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8500503-10ad-45e9-8be5-94ebcb7b7d50 2024-05-26T00:05:03.088998069Z [2024-05-26T00:05:03.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:05:03.089358884Z [2024-05-26T00:05:03.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:04:00+00:00, run_id=scheduled__2024-05-26T00:04:00+00:00, run_start_date=2024-05-26 00:05:01.096822+00:00, run_end_date=2024-05-26 00:05:03.088904+00:00, run_duration=1.992082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:04:00+00:00, data_interval_end=2024-05-26 00:05:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:05:03.099492613Z [2024-05-26T00:05:03.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:05:00+00:00, run_after=2024-05-26T00:06:00+00:00 2024-05-26T00:05:03.184479551Z [2024-05-26T00:05:03.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status success for try_number 1 2024-05-26T00:05:03.194369088Z [2024-05-26T00:05:03.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:04:00+00:00, map_index=-1, run_start_date=2024-05-26 00:05:02.185346+00:00, run_end_date=2024-05-26 00:05:02.583197+00:00, run_duration=0.397851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:05:01.236609+00:00, queued_by_job_id=1, pid=5546 2024-05-26T00:05:05.416986475Z [2024-05-26T00:05:05.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:05:05.417332083Z [2024-05-26T00:05:05.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:04:00+00:00, run_id=scheduled__2024-05-26T00:04:00+00:00, run_start_date=2024-05-26 00:05:01.098080+00:00, run_end_date=2024-05-26 00:05:05.416868+00:00, run_duration=4.318788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:04:00+00:00, data_interval_end=2024-05-26 00:05:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:05:05.428013729Z [2024-05-26T00:05:05.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:05:00+00:00, run_after=2024-05-26T00:06:00+00:00 2024-05-26T00:05:05.464313135Z [2024-05-26T00:05:05.463+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:05:05.464354779Z 2024-05-26T00:05:05.466323885Z [2024-05-26T00:05:05.464+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:05:05.466920767Z [2024-05-26T00:05:05.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:05:05.466931676Z 2024-05-26T00:05:05.469727961Z [2024-05-26T00:05:05.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:05:05.469953624Z [2024-05-26T00:05:05.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:05:05.556680991Z [2024-05-26T00:05:05.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:05:05.556712554Z [2024-05-26T00:05:05.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:05:05.556717181Z [2024-05-26T00:05:05.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status success for try_number 1 2024-05-26T00:05:05.560932524Z [2024-05-26T00:05:05.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44e9183e-cd8e-499a-b7aa-6dfa856d505a 2024-05-26T00:05:05.563949903Z [2024-05-26T00:05:05.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:04:00+00:00, map_index=-1, run_start_date=2024-05-26 00:05:03.389097+00:00, run_end_date=2024-05-26 00:05:04.888363+00:00, run_duration=1.499266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:05:01.236609+00:00, queued_by_job_id=1, pid=5561 2024-05-26T00:05:05.564111124Z [2024-05-26T00:05:05.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=-1, run_start_date=2024-05-26 00:05:04.094938+00:00, run_end_date=2024-05-26 00:05:04.646018+00:00, run_duration=0.55108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:05:01.236609+00:00, queued_by_job_id=1, pid=5577 2024-05-26T00:05:05.623792778Z [2024-05-26T00:05:05.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:05:05.623848752Z [2024-05-26T00:05:05.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:04:00+00:00, run_id=scheduled__2024-05-26T00:04:00+00:00, run_start_date=2024-05-26 00:05:01.099185+00:00, run_end_date=2024-05-26 00:05:05.622300+00:00, run_duration=4.523115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:04:00+00:00, data_interval_end=2024-05-26 00:05:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:05:05.631757368Z [2024-05-26T00:05:05.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:05:00+00:00, run_after=2024-05-26T00:06:00+00:00 2024-05-26T00:05:06.910378922Z [2024-05-26T00:05:06.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status success for try_number 1 2024-05-26T00:05:06.918212106Z [2024-05-26T00:05:06.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:04:00+00:00, map_index=-1, run_start_date=2024-05-26 00:05:03.645193+00:00, run_end_date=2024-05-26 00:05:05.562234+00:00, run_duration=1.917041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:05:01.236609+00:00, queued_by_job_id=1, pid=5566 2024-05-26T00:05:08.144871849Z [2024-05-26T00:05:08.144+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:05:08.144917634Z 2024-05-26T00:05:08.145083175Z [2024-05-26T00:05:08.144+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:05:08.146061252Z [2024-05-26T00:05:08.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:05:08.146100923Z 2024-05-26T00:05:08.149662894Z [2024-05-26T00:05:08.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:05:08.149889811Z [2024-05-26T00:05:08.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:05:08.212721347Z [2024-05-26T00:05:08.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:05:08.213001787Z [2024-05-26T00:05:08.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:05:08.219700652Z [2024-05-26T00:05:08.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to b08771d5-9244-4aa3-81ce-0b7047a68eab 2024-05-26T00:05:08.220004281Z [2024-05-26T00:05:08.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=-1, run_start_date=2024-05-26 00:05:07.266397+00:00, run_end_date=2024-05-26 00:05:07.613047+00:00, run_duration=0.34665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:05:05.467416+00:00, queued_by_job_id=1, pid=5595 2024-05-26T00:05:10.522800190Z [2024-05-26T00:05:10.522+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:05:10.522850744Z 2024-05-26T00:05:10.522861043Z [2024-05-26T00:05:10.522+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:05:10.523440185Z [2024-05-26T00:05:10.523+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:05:10.523455443Z 2024-05-26T00:05:10.525536801Z [2024-05-26T00:05:10.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:05:10.525563329Z [2024-05-26T00:05:10.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:05:10.590618909Z [2024-05-26T00:05:10.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status queued for try_number 1 2024-05-26T00:05:10.590867285Z [2024-05-26T00:05:10.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:05:10.599912200Z [2024-05-26T00:05:10.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 256edc25-9260-4d20-b80a-703bc39f860f 2024-05-26T00:05:10.600283848Z [2024-05-26T00:05:10.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=0, run_start_date=2024-05-26 00:05:09.727923+00:00, run_end_date=2024-05-26 00:05:10.112205+00:00, run_duration=0.384282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:05:08.146743+00:00, queued_by_job_id=1, pid=5603 2024-05-26T00:05:13.246237950Z [2024-05-26T00:05:13.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:05:13.246732552Z [2024-05-26T00:05:13.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:00:00+00:00, run_id=scheduled__2024-05-26T00:00:00+00:00, run_start_date=2024-05-26 00:05:01.095304+00:00, run_end_date=2024-05-26 00:05:13.246345+00:00, run_duration=12.151041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:00:00+00:00, data_interval_end=2024-05-26 00:05:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:05:13.253426196Z [2024-05-26T00:05:13.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:05:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:05:13.285699225Z [2024-05-26T00:05:13.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:00:00+00:00 exited with status success for try_number 1 2024-05-26T00:05:13.291343344Z [2024-05-26T00:05:13.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:00:00+00:00, map_index=-1, run_start_date=2024-05-26 00:05:12.247277+00:00, run_end_date=2024-05-26 00:05:12.624216+00:00, run_duration=0.376939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:05:10.523666+00:00, queued_by_job_id=1, pid=5611 2024-05-26T00:06:01.089933362Z [2024-05-26T00:06:01.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:06:01.133565996Z [2024-05-26T00:06:01.132+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:06:00+00:00, run_after=2024-05-26T00:07:00+00:00 2024-05-26T00:06:01.141309505Z [2024-05-26T00:06:01.140+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:06:01.164869886Z [2024-05-26T00:06:01.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:06:00+00:00, run_after=2024-05-26T00:07:00+00:00 2024-05-26T00:06:01.263187703Z [2024-05-26T00:06:01.262+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:06:01.263233959Z 2024-05-26T00:06:01.263242663Z 2024-05-26T00:06:01.263248996Z 2024-05-26T00:06:01.263255321Z 2024-05-26T00:06:01.263659357Z [2024-05-26T00:06:01.263+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:06:01.263925858Z [2024-05-26T00:06:01.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:06:01.264112437Z [2024-05-26T00:06:01.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:06:01.264314171Z [2024-05-26T00:06:01.264+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:06:01.265084185Z [2024-05-26T00:06:01.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:06:01.265102439Z 2024-05-26T00:06:01.265107247Z 2024-05-26T00:06:01.265111212Z 2024-05-26T00:06:01.265115160Z 2024-05-26T00:06:01.270340084Z [2024-05-26T00:06:01.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:06:01.270749427Z [2024-05-26T00:06:01.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:06:01.271130631Z [2024-05-26T00:06:01.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:06:01.271317703Z [2024-05-26T00:06:01.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:06:01.271663701Z [2024-05-26T00:06:01.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:06:01.271906770Z [2024-05-26T00:06:01.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:06:01.272331773Z [2024-05-26T00:06:01.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:06:01.272615771Z [2024-05-26T00:06:01.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:06:01.709710582Z [2024-05-26T00:06:01.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status queued for try_number 1 2024-05-26T00:06:01.710028908Z [2024-05-26T00:06:01.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status queued for try_number 1 2024-05-26T00:06:01.710239067Z [2024-05-26T00:06:01.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status queued for try_number 1 2024-05-26T00:06:01.710416398Z [2024-05-26T00:06:01.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status queued for try_number 1 2024-05-26T00:06:01.724767275Z [2024-05-26T00:06:01.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9b03edf-4902-48ca-ae2a-d206581451e9 2024-05-26T00:06:01.725117189Z [2024-05-26T00:06:01.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cc29e49-2d1e-4239-8f26-f0c1ff8faba2 2024-05-26T00:06:01.725350362Z [2024-05-26T00:06:01.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf601ea1-d965-4d23-b39d-61fac0c94029 2024-05-26T00:06:01.725579098Z [2024-05-26T00:06:01.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30604d7d-0045-46fe-b164-15843ae5bb0f 2024-05-26T00:06:02.959593628Z [2024-05-26T00:06:02.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:06:02.959972628Z [2024-05-26T00:06:02.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:04:00+00:00, run_id=scheduled__2024-05-26T00:04:00+00:00, run_start_date=2024-05-26 00:06:01.182208+00:00, run_end_date=2024-05-26 00:06:02.959485+00:00, run_duration=1.777277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:04:00+00:00, data_interval_end=2024-05-26 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:06:02.971336322Z [2024-05-26T00:06:02.971+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:06:00+00:00, run_after=2024-05-26T00:08:00+00:00 2024-05-26T00:06:02.980360578Z [2024-05-26T00:06:02.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:06:02.980529899Z [2024-05-26T00:06:02.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:05:00+00:00, run_id=scheduled__2024-05-26T00:05:00+00:00, run_start_date=2024-05-26 00:06:01.183676+00:00, run_end_date=2024-05-26 00:06:02.980282+00:00, run_duration=1.796606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:05:00+00:00, data_interval_end=2024-05-26 00:06:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:06:02.991211393Z [2024-05-26T00:06:02.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:06:00+00:00, run_after=2024-05-26T00:07:00+00:00 2024-05-26T00:06:03.042830051Z [2024-05-26T00:06:03.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:04:00+00:00 exited with status success for try_number 1 2024-05-26T00:06:03.042869669Z [2024-05-26T00:06:03.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status success for try_number 1 2024-05-26T00:06:03.051965565Z [2024-05-26T00:06:03.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:04:00+00:00, map_index=-1, run_start_date=2024-05-26 00:06:02.150321+00:00, run_end_date=2024-05-26 00:06:02.531682+00:00, run_duration=0.381361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:06:01.266333+00:00, queued_by_job_id=1, pid=5634 2024-05-26T00:06:03.052076949Z [2024-05-26T00:06:03.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:05:00+00:00, map_index=-1, run_start_date=2024-05-26 00:06:02.152103+00:00, run_end_date=2024-05-26 00:06:02.510400+00:00, run_duration=0.358297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:06:01.266333+00:00, queued_by_job_id=1, pid=5635 2024-05-26T00:06:05.211067973Z [2024-05-26T00:06:05.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:06:05.211592164Z [2024-05-26T00:06:05.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:05:00+00:00, run_id=scheduled__2024-05-26T00:05:00+00:00, run_start_date=2024-05-26 00:06:01.185393+00:00, run_end_date=2024-05-26 00:06:05.210986+00:00, run_duration=4.025593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:05:00+00:00, data_interval_end=2024-05-26 00:06:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:06:05.228377973Z [2024-05-26T00:06:05.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:06:00+00:00, run_after=2024-05-26T00:07:00+00:00 2024-05-26T00:06:05.239060955Z [2024-05-26T00:06:05.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:06:05.239425750Z [2024-05-26T00:06:05.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:05:00+00:00, run_id=scheduled__2024-05-26T00:05:00+00:00, run_start_date=2024-05-26 00:06:01.186867+00:00, run_end_date=2024-05-26 00:06:05.238989+00:00, run_duration=4.052122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:05:00+00:00, data_interval_end=2024-05-26 00:06:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:06:05.248373452Z [2024-05-26T00:06:05.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:06:00+00:00, run_after=2024-05-26T00:07:00+00:00 2024-05-26T00:06:05.284272459Z [2024-05-26T00:06:05.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status success for try_number 1 2024-05-26T00:06:05.292492465Z [2024-05-26T00:06:05.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:05:00+00:00, map_index=-1, run_start_date=2024-05-26 00:06:03.287477+00:00, run_end_date=2024-05-26 00:06:04.753986+00:00, run_duration=1.466509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:06:01.266333+00:00, queued_by_job_id=1, pid=5659 2024-05-26T00:06:06.359396069Z [2024-05-26T00:06:06.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status success for try_number 1 2024-05-26T00:06:06.368921249Z [2024-05-26T00:06:06.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:05:00+00:00, map_index=-1, run_start_date=2024-05-26 00:06:03.202789+00:00, run_end_date=2024-05-26 00:06:05.137371+00:00, run_duration=1.934582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:06:01.266333+00:00, queued_by_job_id=1, pid=5658 2024-05-26T00:07:01.038443381Z [2024-05-26T00:07:01.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:07:01.052460351Z [2024-05-26T00:07:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:07:00+00:00, run_after=2024-05-26T00:08:00+00:00 2024-05-26T00:07:01.066872661Z [2024-05-26T00:07:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:07:00+00:00, run_after=2024-05-26T00:08:00+00:00 2024-05-26T00:07:01.156633327Z [2024-05-26T00:07:01.156+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:07:01.156669360Z 2024-05-26T00:07:01.156675927Z 2024-05-26T00:07:01.156681690Z 2024-05-26T00:07:01.156698124Z [2024-05-26T00:07:01.156+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:07:01.156936551Z [2024-05-26T00:07:01.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:07:01.157042662Z [2024-05-26T00:07:01.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:07:01.157673478Z [2024-05-26T00:07:01.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:07:01.157681621Z 2024-05-26T00:07:01.157687411Z 2024-05-26T00:07:01.157692888Z 2024-05-26T00:07:01.161531172Z [2024-05-26T00:07:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:07:01.161879062Z [2024-05-26T00:07:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:07:01.162299428Z [2024-05-26T00:07:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:07:01.162466037Z [2024-05-26T00:07:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:07:01.162737546Z [2024-05-26T00:07:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:07:01.162802363Z [2024-05-26T00:07:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:07:01.436967866Z [2024-05-26T00:07:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status queued for try_number 1 2024-05-26T00:07:01.437147282Z [2024-05-26T00:07:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status queued for try_number 1 2024-05-26T00:07:01.437303813Z [2024-05-26T00:07:01.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status queued for try_number 1 2024-05-26T00:07:01.455715119Z [2024-05-26T00:07:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63087593-5ea1-4783-a82c-6a0cc83daddb 2024-05-26T00:07:01.455965634Z [2024-05-26T00:07:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99ab1328-7f07-479e-8a9e-57d9caceb833 2024-05-26T00:07:01.456210238Z [2024-05-26T00:07:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20071108-2c9c-4d48-9e34-3405e46fd6eb 2024-05-26T00:07:02.616383910Z [2024-05-26T00:07:02.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:07:02.616564274Z [2024-05-26T00:07:02.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:06:00+00:00, run_id=scheduled__2024-05-26T00:06:00+00:00, run_start_date=2024-05-26 00:07:01.080317+00:00, run_end_date=2024-05-26 00:07:02.616229+00:00, run_duration=1.535912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:06:00+00:00, data_interval_end=2024-05-26 00:07:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:07:02.625825751Z [2024-05-26T00:07:02.625+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:07:00+00:00, run_after=2024-05-26T00:08:00+00:00 2024-05-26T00:07:02.680979588Z [2024-05-26T00:07:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status success for try_number 1 2024-05-26T00:07:02.694609269Z [2024-05-26T00:07:02.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:06:00+00:00, map_index=-1, run_start_date=2024-05-26 00:07:01.959784+00:00, run_end_date=2024-05-26 00:07:02.443410+00:00, run_duration=0.483626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:07:01.158367+00:00, queued_by_job_id=1, pid=5691 2024-05-26T00:07:05.204830833Z [2024-05-26T00:07:05.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:07:05.208224256Z [2024-05-26T00:07:05.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:06:00+00:00, run_id=scheduled__2024-05-26T00:06:00+00:00, run_start_date=2024-05-26 00:07:01.081958+00:00, run_end_date=2024-05-26 00:07:05.204731+00:00, run_duration=4.122773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:06:00+00:00, data_interval_end=2024-05-26 00:07:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:07:05.223487359Z [2024-05-26T00:07:05.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:07:00+00:00, run_after=2024-05-26T00:08:00+00:00 2024-05-26T00:07:05.266270225Z [2024-05-26T00:07:05.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status success for try_number 1 2024-05-26T00:07:05.271667204Z [2024-05-26T00:07:05.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:06:00+00:00, map_index=-1, run_start_date=2024-05-26 00:07:03.083858+00:00, run_end_date=2024-05-26 00:07:04.743904+00:00, run_duration=1.660046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:07:01.158367+00:00, queued_by_job_id=1, pid=5710 2024-05-26T00:07:06.326784557Z [2024-05-26T00:07:06.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:07:06.326863099Z [2024-05-26T00:07:06.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:06:00+00:00, run_id=scheduled__2024-05-26T00:06:00+00:00, run_start_date=2024-05-26 00:07:01.083224+00:00, run_end_date=2024-05-26 00:07:06.326599+00:00, run_duration=5.243375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:06:00+00:00, data_interval_end=2024-05-26 00:07:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:07:06.338934219Z [2024-05-26T00:07:06.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:07:00+00:00, run_after=2024-05-26T00:08:00+00:00 2024-05-26T00:07:06.382509437Z [2024-05-26T00:07:06.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status success for try_number 1 2024-05-26T00:07:06.390550840Z [2024-05-26T00:07:06.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:06:00+00:00, map_index=-1, run_start_date=2024-05-26 00:07:03.007115+00:00, run_end_date=2024-05-26 00:07:05.312963+00:00, run_duration=2.305848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:07:01.158367+00:00, queued_by_job_id=1, pid=5709 2024-05-26T00:08:00.976415302Z [2024-05-26T00:08:00.975+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:08:00.991258581Z [2024-05-26T00:08:00.990+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:08:01.022276616Z [2024-05-26T00:08:01.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:08:00+00:00, run_after=2024-05-26T00:09:00+00:00 2024-05-26T00:08:01.038737014Z [2024-05-26T00:08:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:08:00+00:00, run_after=2024-05-26T00:09:00+00:00 2024-05-26T00:08:01.110466035Z [2024-05-26T00:08:01.109+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:08:01.110499821Z 2024-05-26T00:08:01.110503811Z 2024-05-26T00:08:01.110506802Z 2024-05-26T00:08:01.110509817Z 2024-05-26T00:08:01.110785414Z [2024-05-26T00:08:01.110+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:08:01.111206051Z [2024-05-26T00:08:01.110+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:08:01.111733620Z [2024-05-26T00:08:01.111+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:08:01.112518963Z [2024-05-26T00:08:01.112+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:08:01.114575650Z [2024-05-26T00:08:01.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:08:01.114587533Z 2024-05-26T00:08:01.114602178Z 2024-05-26T00:08:01.114606498Z 2024-05-26T00:08:01.114610736Z 2024-05-26T00:08:01.121456243Z [2024-05-26T00:08:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:08:01.122415274Z [2024-05-26T00:08:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:08:01.123008594Z [2024-05-26T00:08:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:08:01.123338220Z [2024-05-26T00:08:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:08:01.123749902Z [2024-05-26T00:08:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:08:01.124015128Z [2024-05-26T00:08:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:08:01.124368866Z [2024-05-26T00:08:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:08:01.124985434Z [2024-05-26T00:08:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:08:01.684741432Z [2024-05-26T00:08:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status queued for try_number 1 2024-05-26T00:08:01.684813868Z [2024-05-26T00:08:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:07:00+00:00 exited with status queued for try_number 1 2024-05-26T00:08:01.685018753Z [2024-05-26T00:08:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:07:00+00:00 exited with status queued for try_number 1 2024-05-26T00:08:01.685164494Z [2024-05-26T00:08:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:07:00+00:00 exited with status queued for try_number 1 2024-05-26T00:08:01.694830224Z [2024-05-26T00:08:01.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cbdc08c-e7d5-4b70-8935-805a1a6a116f 2024-05-26T00:08:01.694969445Z [2024-05-26T00:08:01.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to f39fadeb-e360-44f7-acb7-c637e69e5853 2024-05-26T00:08:01.695103297Z [2024-05-26T00:08:01.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to f71dd429-78a4-4bb0-9285-c1ce7b96785d 2024-05-26T00:08:01.695197988Z [2024-05-26T00:08:01.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 221b4571-0459-42f6-8327-da6d56747d68 2024-05-26T00:08:02.881795895Z [2024-05-26T00:08:02.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:08:02.882011245Z [2024-05-26T00:08:02.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:06:00+00:00, run_id=scheduled__2024-05-26T00:06:00+00:00, run_start_date=2024-05-26 00:08:01.049497+00:00, run_end_date=2024-05-26 00:08:02.881677+00:00, run_duration=1.83218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:06:00+00:00, data_interval_end=2024-05-26 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:08:02.902694518Z [2024-05-26T00:08:02.902+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:08:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:08:02.920964119Z [2024-05-26T00:08:02.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:08:02.921142261Z [2024-05-26T00:08:02.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:07:00+00:00, run_id=scheduled__2024-05-26T00:07:00+00:00, run_start_date=2024-05-26 00:08:01.051067+00:00, run_end_date=2024-05-26 00:08:02.920882+00:00, run_duration=1.869815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:07:00+00:00, data_interval_end=2024-05-26 00:08:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:08:02.932049821Z [2024-05-26T00:08:02.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:08:00+00:00, run_after=2024-05-26T00:09:00+00:00 2024-05-26T00:08:02.977265857Z [2024-05-26T00:08:02.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:06:00+00:00 exited with status success for try_number 1 2024-05-26T00:08:02.977328917Z [2024-05-26T00:08:02.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:07:00+00:00 exited with status success for try_number 1 2024-05-26T00:08:02.987468654Z [2024-05-26T00:08:02.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:06:00+00:00, map_index=-1, run_start_date=2024-05-26 00:08:02.161734+00:00, run_end_date=2024-05-26 00:08:02.596548+00:00, run_duration=0.434814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:08:01.116193+00:00, queued_by_job_id=1, pid=5745 2024-05-26T00:08:02.987631052Z [2024-05-26T00:08:02.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:07:00+00:00, map_index=-1, run_start_date=2024-05-26 00:08:02.007954+00:00, run_end_date=2024-05-26 00:08:02.424890+00:00, run_duration=0.416936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:08:01.116193+00:00, queued_by_job_id=1, pid=5743 2024-05-26T00:08:06.082721635Z [2024-05-26T00:08:06.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:08:06.083050028Z [2024-05-26T00:08:06.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:07:00+00:00, run_id=scheduled__2024-05-26T00:07:00+00:00, run_start_date=2024-05-26 00:08:01.052114+00:00, run_end_date=2024-05-26 00:08:06.082627+00:00, run_duration=5.030513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:07:00+00:00, data_interval_end=2024-05-26 00:08:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:08:06.100972721Z [2024-05-26T00:08:06.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:08:00+00:00, run_after=2024-05-26T00:09:00+00:00 2024-05-26T00:08:06.116922817Z [2024-05-26T00:08:06.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:08:06.117530736Z [2024-05-26T00:08:06.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:07:00+00:00, run_id=scheduled__2024-05-26T00:07:00+00:00, run_start_date=2024-05-26 00:08:01.053115+00:00, run_end_date=2024-05-26 00:08:06.116825+00:00, run_duration=5.06371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:07:00+00:00, data_interval_end=2024-05-26 00:08:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:08:06.133418533Z [2024-05-26T00:08:06.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:08:00+00:00, run_after=2024-05-26T00:09:00+00:00 2024-05-26T00:08:06.177803549Z [2024-05-26T00:08:06.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:07:00+00:00 exited with status success for try_number 1 2024-05-26T00:08:06.177986700Z [2024-05-26T00:08:06.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:07:00+00:00 exited with status success for try_number 1 2024-05-26T00:08:06.185274677Z [2024-05-26T00:08:06.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:07:00+00:00, map_index=-1, run_start_date=2024-05-26 00:08:03.335113+00:00, run_end_date=2024-05-26 00:08:05.043917+00:00, run_duration=1.708804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:08:01.116193+00:00, queued_by_job_id=1, pid=5767 2024-05-26T00:08:06.185552764Z [2024-05-26T00:08:06.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:07:00+00:00, map_index=-1, run_start_date=2024-05-26 00:08:03.302134+00:00, run_end_date=2024-05-26 00:08:05.525998+00:00, run_duration=2.223864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:08:01.116193+00:00, queued_by_job_id=1, pid=5768 2024-05-26T00:08:31.128938663Z [2024-05-26T00:08:31.128+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:09:00.834618318Z [2024-05-26T00:09:00.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:09:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:09:00.843042986Z [2024-05-26T00:09:00.842+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:09:00.855272467Z [2024-05-26T00:09:00.854+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:09:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:09:00.956022168Z [2024-05-26T00:09:00.955+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:09:00.956053124Z 2024-05-26T00:09:00.956058549Z 2024-05-26T00:09:00.956063428Z 2024-05-26T00:09:00.956431670Z [2024-05-26T00:09:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:09:00.956800382Z [2024-05-26T00:09:00.956+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:09:00.956996667Z [2024-05-26T00:09:00.956+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:09:00.957922463Z [2024-05-26T00:09:00.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:09:00.957936848Z 2024-05-26T00:09:00.957941756Z 2024-05-26T00:09:00.957946122Z 2024-05-26T00:09:00.962853565Z [2024-05-26T00:09:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:09:00.963249226Z [2024-05-26T00:09:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:09:00.963907259Z [2024-05-26T00:09:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:09:00.964056999Z [2024-05-26T00:09:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:09:00.964532911Z [2024-05-26T00:09:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:09:00.964858433Z [2024-05-26T00:09:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:09:01.223027756Z [2024-05-26T00:09:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status queued for try_number 1 2024-05-26T00:09:01.223302051Z [2024-05-26T00:09:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status queued for try_number 1 2024-05-26T00:09:01.223458297Z [2024-05-26T00:09:01.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status queued for try_number 1 2024-05-26T00:09:01.235194358Z [2024-05-26T00:09:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fa2e973-8218-4147-afa4-8c46f8837d04 2024-05-26T00:09:01.235506582Z [2024-05-26T00:09:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9321be0-d7a5-49cc-a7fd-72095997ab8c 2024-05-26T00:09:01.235858108Z [2024-05-26T00:09:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b300906-50a5-4406-99ed-40817c39ed40 2024-05-26T00:09:03.498882962Z [2024-05-26T00:09:03.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:09:03.499238467Z [2024-05-26T00:09:03.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:08:00+00:00, run_id=scheduled__2024-05-26T00:08:00+00:00, run_start_date=2024-05-26 00:09:00.870705+00:00, run_end_date=2024-05-26 00:09:03.498775+00:00, run_duration=2.62807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:08:00+00:00, data_interval_end=2024-05-26 00:09:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:09:03.508363843Z [2024-05-26T00:09:03.508+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:09:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:09:03.556422229Z [2024-05-26T00:09:03.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status success for try_number 1 2024-05-26T00:09:03.564492965Z [2024-05-26T00:09:03.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:08:00+00:00, map_index=-1, run_start_date=2024-05-26 00:09:01.891769+00:00, run_end_date=2024-05-26 00:09:02.407083+00:00, run_duration=0.515314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:09:00.959084+00:00, queued_by_job_id=1, pid=5799 2024-05-26T00:09:05.014269529Z [2024-05-26T00:09:05.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:09:05.014877202Z [2024-05-26T00:09:05.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:08:00+00:00, run_id=scheduled__2024-05-26T00:08:00+00:00, run_start_date=2024-05-26 00:09:00.873260+00:00, run_end_date=2024-05-26 00:09:05.014149+00:00, run_duration=4.140889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:08:00+00:00, data_interval_end=2024-05-26 00:09:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:09:05.024413857Z [2024-05-26T00:09:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:09:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:09:05.057702013Z [2024-05-26T00:09:05.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status success for try_number 1 2024-05-26T00:09:05.062360344Z [2024-05-26T00:09:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:08:00+00:00, map_index=-1, run_start_date=2024-05-26 00:09:03.292148+00:00, run_end_date=2024-05-26 00:09:04.853644+00:00, run_duration=1.561496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:09:00.959084+00:00, queued_by_job_id=1, pid=5817 2024-05-26T00:09:06.113204427Z [2024-05-26T00:09:06.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:09:06.113379073Z [2024-05-26T00:09:06.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:08:00+00:00, run_id=scheduled__2024-05-26T00:08:00+00:00, run_start_date=2024-05-26 00:09:00.876207+00:00, run_end_date=2024-05-26 00:09:06.113108+00:00, run_duration=5.236901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:08:00+00:00, data_interval_end=2024-05-26 00:09:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:09:06.123136520Z [2024-05-26T00:09:06.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:09:00+00:00, run_after=2024-05-26T00:10:00+00:00 2024-05-26T00:09:06.158005991Z [2024-05-26T00:09:06.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status success for try_number 1 2024-05-26T00:09:06.165703159Z [2024-05-26T00:09:06.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:08:00+00:00, map_index=-1, run_start_date=2024-05-26 00:09:03.297653+00:00, run_end_date=2024-05-26 00:09:05.269335+00:00, run_duration=1.971682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:09:00.959084+00:00, queued_by_job_id=1, pid=5818 2024-05-26T00:10:00.071798645Z [2024-05-26T00:10:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:15:00+00:00 2024-05-26T00:10:00.078942634Z [2024-05-26T00:10:00.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:10:00.090717336Z [2024-05-26T00:10:00.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:11:00+00:00 2024-05-26T00:10:00.104270781Z [2024-05-26T00:10:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:11:00+00:00 2024-05-26T00:10:00.112221061Z [2024-05-26T00:10:00.111+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:10:00.266583889Z [2024-05-26T00:10:00.265+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T00:10:00.266624720Z 2024-05-26T00:10:00.266634494Z 2024-05-26T00:10:00.266643927Z 2024-05-26T00:10:00.266652801Z 2024-05-26T00:10:00.266661402Z 2024-05-26T00:10:00.266986593Z [2024-05-26T00:10:00.266+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:10:00.267413443Z [2024-05-26T00:10:00.267+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:10:00.267790737Z [2024-05-26T00:10:00.267+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:10:00.268172939Z [2024-05-26T00:10:00.267+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:10:00.268572514Z [2024-05-26T00:10:00.268+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:10:00.270176890Z [2024-05-26T00:10:00.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:10:00.270228982Z 2024-05-26T00:10:00.270264040Z 2024-05-26T00:10:00.270272648Z 2024-05-26T00:10:00.270280433Z 2024-05-26T00:10:00.270287960Z 2024-05-26T00:10:00.278595770Z [2024-05-26T00:10:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:10:00.279012931Z [2024-05-26T00:10:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:10:00.279489933Z [2024-05-26T00:10:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:10:00.279804415Z [2024-05-26T00:10:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:10:00.280159958Z [2024-05-26T00:10:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:10:00.280300017Z [2024-05-26T00:10:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:10:00.280732020Z [2024-05-26T00:10:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:10:00.280930194Z [2024-05-26T00:10:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:10:00.281307894Z [2024-05-26T00:10:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:10:00.281718076Z [2024-05-26T00:10:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:10:00.959512013Z [2024-05-26T00:10:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:00.959804994Z [2024-05-26T00:10:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:00.959998593Z [2024-05-26T00:10:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:09:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:00.960162683Z [2024-05-26T00:10:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:09:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:00.960297523Z [2024-05-26T00:10:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:09:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:00.976884101Z [2024-05-26T00:10:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to a280272b-20f6-49f6-878e-c783427a689c 2024-05-26T00:10:00.977183730Z [2024-05-26T00:10:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee669c3f-9928-4f5d-8831-5b862ed87e6c 2024-05-26T00:10:00.977353003Z [2024-05-26T00:10:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2b1519c-82fd-4de5-8c68-e65a3370d729 2024-05-26T00:10:00.977488227Z [2024-05-26T00:10:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11105724-459c-410a-97b3-a6c13780a558 2024-05-26T00:10:00.977658379Z [2024-05-26T00:10:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d7b32ed-d368-40f7-9b57-a0c7dfcf25c3 2024-05-26T00:10:02.225379268Z [2024-05-26T00:10:02.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:10:02.225884205Z [2024-05-26T00:10:02.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:09:00+00:00, run_id=scheduled__2024-05-26T00:09:00+00:00, run_start_date=2024-05-26 00:10:00.129700+00:00, run_end_date=2024-05-26 00:10:02.225298+00:00, run_duration=2.095598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:09:00+00:00, data_interval_end=2024-05-26 00:10:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:10:02.237259702Z [2024-05-26T00:10:02.236+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:11:00+00:00 2024-05-26T00:10:02.259594373Z [2024-05-26T00:10:02.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:10:02.260036891Z [2024-05-26T00:10:02.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:08:00+00:00, run_id=scheduled__2024-05-26T00:08:00+00:00, run_start_date=2024-05-26 00:10:00.128214+00:00, run_end_date=2024-05-26 00:10:02.259470+00:00, run_duration=2.131256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:08:00+00:00, data_interval_end=2024-05-26 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:10:02.270142547Z [2024-05-26T00:10:02.269+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:12:00+00:00 2024-05-26T00:10:02.326191447Z [2024-05-26T00:10:02.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:08:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:02.326227623Z [2024-05-26T00:10:02.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:09:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:02.332479430Z [2024-05-26T00:10:02.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:08:00+00:00, map_index=-1, run_start_date=2024-05-26 00:10:01.128052+00:00, run_end_date=2024-05-26 00:10:01.575623+00:00, run_duration=0.447571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:00.272361+00:00, queued_by_job_id=1, pid=5852 2024-05-26T00:10:02.332597584Z [2024-05-26T00:10:02.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:09:00+00:00, map_index=-1, run_start_date=2024-05-26 00:10:01.185765+00:00, run_end_date=2024-05-26 00:10:01.584023+00:00, run_duration=0.398258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:00.272361+00:00, queued_by_job_id=1, pid=5853 2024-05-26T00:10:03.440691429Z [2024-05-26T00:10:03.440+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:10:03.440731639Z 2024-05-26T00:10:03.441121623Z [2024-05-26T00:10:03.440+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:10:03.446366355Z [2024-05-26T00:10:03.441+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:10:03.446386195Z 2024-05-26T00:10:03.450757578Z [2024-05-26T00:10:03.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:10:03.451058318Z [2024-05-26T00:10:03.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:10:03.495735098Z [2024-05-26T00:10:03.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:03.495977999Z [2024-05-26T00:10:03.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:03.507338877Z [2024-05-26T00:10:03.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8febe860-420c-42f1-a509-fb875d4ab828 2024-05-26T00:10:03.508030357Z [2024-05-26T00:10:03.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:05:00+00:00, map_index=-1, run_start_date=2024-05-26 00:10:02.815918+00:00, run_end_date=2024-05-26 00:10:03.181320+00:00, run_duration=0.365402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:00.272361+00:00, queued_by_job_id=1, pid=5889 2024-05-26T00:10:04.365819246Z [2024-05-26T00:10:04.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:10:04.366191400Z [2024-05-26T00:10:04.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:09:00+00:00, run_id=scheduled__2024-05-26T00:09:00+00:00, run_start_date=2024-05-26 00:10:00.132647+00:00, run_end_date=2024-05-26 00:10:04.365727+00:00, run_duration=4.23308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:09:00+00:00, data_interval_end=2024-05-26 00:10:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:10:04.381419532Z [2024-05-26T00:10:04.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:11:00+00:00 2024-05-26T00:10:04.389067478Z [2024-05-26T00:10:04.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:10:04.389359774Z [2024-05-26T00:10:04.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:09:00+00:00, run_id=scheduled__2024-05-26T00:09:00+00:00, run_start_date=2024-05-26 00:10:00.131231+00:00, run_end_date=2024-05-26 00:10:04.388984+00:00, run_duration=4.257753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:09:00+00:00, data_interval_end=2024-05-26 00:10:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:10:04.399710635Z [2024-05-26T00:10:04.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:11:00+00:00 2024-05-26T00:10:04.468870008Z [2024-05-26T00:10:04.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:09:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:04.470081958Z [2024-05-26T00:10:04.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:09:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:04.476708389Z [2024-05-26T00:10:04.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:09:00+00:00, map_index=-1, run_start_date=2024-05-26 00:10:02.410704+00:00, run_end_date=2024-05-26 00:10:04.131013+00:00, run_duration=1.720309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:00.272361+00:00, queued_by_job_id=1, pid=5877 2024-05-26T00:10:04.476727198Z [2024-05-26T00:10:04.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:09:00+00:00, map_index=-1, run_start_date=2024-05-26 00:10:02.622152+00:00, run_end_date=2024-05-26 00:10:03.861227+00:00, run_duration=1.239075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:00.272361+00:00, queued_by_job_id=1, pid=5883 2024-05-26T00:10:06.721191091Z [2024-05-26T00:10:06.720+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:10:06.721229088Z 2024-05-26T00:10:06.721431349Z [2024-05-26T00:10:06.721+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:10:06.722035980Z [2024-05-26T00:10:06.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:10:06.722047374Z 2024-05-26T00:10:06.724486452Z [2024-05-26T00:10:06.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:10:06.724680718Z [2024-05-26T00:10:06.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:10:06.768846734Z [2024-05-26T00:10:06.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:06.769061985Z [2024-05-26T00:10:06.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:06.774432304Z [2024-05-26T00:10:06.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd3a72d0-1ddf-4f1a-b896-62c11314960f 2024-05-26T00:10:06.774793651Z [2024-05-26T00:10:06.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:05:00+00:00, map_index=-1, run_start_date=2024-05-26 00:10:05.265604+00:00, run_end_date=2024-05-26 00:10:05.698193+00:00, run_duration=0.432589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:03.446321+00:00, queued_by_job_id=1, pid=5907 2024-05-26T00:10:09.684052935Z [2024-05-26T00:10:09.683+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:10:09.684079528Z 2024-05-26T00:10:09.684186010Z [2024-05-26T00:10:09.684+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:10:09.684752536Z [2024-05-26T00:10:09.684+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:10:09.684762003Z 2024-05-26T00:10:09.695861968Z [2024-05-26T00:10:09.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:10:09.700838562Z [2024-05-26T00:10:09.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:10:09.774609899Z [2024-05-26T00:10:09.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status queued for try_number 1 2024-05-26T00:10:09.776422177Z [2024-05-26T00:10:09.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:09.785635718Z [2024-05-26T00:10:09.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8568ee37-4655-45fa-b412-4137a98586d6 2024-05-26T00:10:09.785968567Z [2024-05-26T00:10:09.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:05:00+00:00, map_index=0, run_start_date=2024-05-26 00:10:08.433727+00:00, run_end_date=2024-05-26 00:10:08.836964+00:00, run_duration=0.403237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:06.722487+00:00, queued_by_job_id=1, pid=5915 2024-05-26T00:10:11.985722550Z [2024-05-26T00:10:11.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:10:11.986274646Z [2024-05-26T00:10:11.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:05:00+00:00, run_id=scheduled__2024-05-26T00:05:00+00:00, run_start_date=2024-05-26 00:10:00.126605+00:00, run_end_date=2024-05-26 00:10:11.985788+00:00, run_duration=11.859183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:05:00+00:00, data_interval_end=2024-05-26 00:10:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:10:11.996402648Z [2024-05-26T00:10:11.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:10:00+00:00, run_after=2024-05-26T00:15:00+00:00 2024-05-26T00:10:12.050838992Z [2024-05-26T00:10:12.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:05:00+00:00 exited with status success for try_number 1 2024-05-26T00:10:12.060096693Z [2024-05-26T00:10:12.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:05:00+00:00, map_index=-1, run_start_date=2024-05-26 00:10:11.344497+00:00, run_end_date=2024-05-26 00:10:11.730095+00:00, run_duration=0.385598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:10:09.690630+00:00, queued_by_job_id=1, pid=5923 2024-05-26T00:11:00.392531003Z [2024-05-26T00:11:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:11:00+00:00, run_after=2024-05-26T00:12:00+00:00 2024-05-26T00:11:00.405308197Z [2024-05-26T00:11:00.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:11:00+00:00, run_after=2024-05-26T00:12:00+00:00 2024-05-26T00:11:00.412356549Z [2024-05-26T00:11:00.412+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:11:00.474136716Z [2024-05-26T00:11:00.473+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:11:00.474165870Z 2024-05-26T00:11:00.474169831Z 2024-05-26T00:11:00.474173129Z 2024-05-26T00:11:00.474558029Z [2024-05-26T00:11:00.474+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:11:00.474949592Z [2024-05-26T00:11:00.474+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:11:00.475298950Z [2024-05-26T00:11:00.475+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:11:00.476749267Z [2024-05-26T00:11:00.476+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:11:00.476757352Z 2024-05-26T00:11:00.476760835Z 2024-05-26T00:11:00.476780597Z 2024-05-26T00:11:00.483267154Z [2024-05-26T00:11:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:11:00.483695900Z [2024-05-26T00:11:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:11:00.484191022Z [2024-05-26T00:11:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:11:00.484439254Z [2024-05-26T00:11:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:11:00.485034468Z [2024-05-26T00:11:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:11:00.485260446Z [2024-05-26T00:11:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:11:00.711666877Z [2024-05-26T00:11:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:11:00.711842646Z [2024-05-26T00:11:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:11:00.712166095Z [2024-05-26T00:11:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:11:00.723643225Z [2024-05-26T00:11:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 519b0db1-0f75-42a6-9398-21abe4ed57b6 2024-05-26T00:11:00.723671666Z [2024-05-26T00:11:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e5860c2-3371-4bbb-81e9-2a14c9f1bf48 2024-05-26T00:11:00.723675667Z [2024-05-26T00:11:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 969c0009-d742-45e7-a74b-fd390338557b 2024-05-26T00:11:01.873369499Z [2024-05-26T00:11:01.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:11:01.873578144Z [2024-05-26T00:11:01.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:10:00+00:00, run_id=scheduled__2024-05-26T00:10:00+00:00, run_start_date=2024-05-26 00:11:00.421491+00:00, run_end_date=2024-05-26 00:11:01.873189+00:00, run_duration=1.451698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:10:00+00:00, data_interval_end=2024-05-26 00:11:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:11:01.895895202Z [2024-05-26T00:11:01.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:11:00+00:00, run_after=2024-05-26T00:12:00+00:00 2024-05-26T00:11:01.965644855Z [2024-05-26T00:11:01.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:11:01.973729304Z [2024-05-26T00:11:01.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=-1, run_start_date=2024-05-26 00:11:01.326911+00:00, run_end_date=2024-05-26 00:11:01.729455+00:00, run_duration=0.402544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:11:00.478773+00:00, queued_by_job_id=1, pid=5945 2024-05-26T00:11:04.493460851Z [2024-05-26T00:11:04.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:11:04.494301899Z [2024-05-26T00:11:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:10:00+00:00, run_id=scheduled__2024-05-26T00:10:00+00:00, run_start_date=2024-05-26 00:11:00.422767+00:00, run_end_date=2024-05-26 00:11:04.493632+00:00, run_duration=4.070865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:10:00+00:00, data_interval_end=2024-05-26 00:11:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:11:04.527128230Z [2024-05-26T00:11:04.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:11:00+00:00, run_after=2024-05-26T00:12:00+00:00 2024-05-26T00:11:04.579603076Z [2024-05-26T00:11:04.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:11:04.587134232Z [2024-05-26T00:11:04.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=-1, run_start_date=2024-05-26 00:11:02.555260+00:00, run_end_date=2024-05-26 00:11:03.940138+00:00, run_duration=1.384878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:11:00.478773+00:00, queued_by_job_id=1, pid=5964 2024-05-26T00:11:06.070987835Z [2024-05-26T00:11:06.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:11:06.071428790Z [2024-05-26T00:11:06.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:10:00+00:00, run_id=scheduled__2024-05-26T00:10:00+00:00, run_start_date=2024-05-26 00:11:00.424065+00:00, run_end_date=2024-05-26 00:11:06.070840+00:00, run_duration=5.646775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:10:00+00:00, data_interval_end=2024-05-26 00:11:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:11:06.082386283Z [2024-05-26T00:11:06.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:11:00+00:00, run_after=2024-05-26T00:12:00+00:00 2024-05-26T00:11:06.118089761Z [2024-05-26T00:11:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:11:06.126763516Z [2024-05-26T00:11:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=-1, run_start_date=2024-05-26 00:11:02.465394+00:00, run_end_date=2024-05-26 00:11:05.573674+00:00, run_duration=3.10828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:11:00.478773+00:00, queued_by_job_id=1, pid=5963 2024-05-26T00:12:00.358131094Z [2024-05-26T00:12:00.357+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:12:00+00:00, run_after=2024-05-26T00:13:00+00:00 2024-05-26T00:12:00.366784985Z [2024-05-26T00:12:00.366+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:12:00.372941931Z [2024-05-26T00:12:00.372+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:12:00.383800708Z [2024-05-26T00:12:00.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:12:00+00:00, run_after=2024-05-26T00:13:00+00:00 2024-05-26T00:12:00.481911908Z [2024-05-26T00:12:00.481+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:12:00.481942124Z 2024-05-26T00:12:00.481949282Z 2024-05-26T00:12:00.481954547Z 2024-05-26T00:12:00.481959598Z 2024-05-26T00:12:00.482557232Z [2024-05-26T00:12:00.482+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:12:00.482922099Z [2024-05-26T00:12:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:12:00.483351902Z [2024-05-26T00:12:00.483+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:12:00.483713469Z [2024-05-26T00:12:00.483+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:12:00.484922937Z [2024-05-26T00:12:00.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:12:00.484951950Z 2024-05-26T00:12:00.484960202Z 2024-05-26T00:12:00.484965842Z 2024-05-26T00:12:00.484970709Z 2024-05-26T00:12:00.490422213Z [2024-05-26T00:12:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:12:00.490701583Z [2024-05-26T00:12:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:12:00.491116681Z [2024-05-26T00:12:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:12:00.491556861Z [2024-05-26T00:12:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:12:00.492226756Z [2024-05-26T00:12:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:12:00.492521908Z [2024-05-26T00:12:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:12:00.492973847Z [2024-05-26T00:12:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:12:00.493858314Z [2024-05-26T00:12:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:12:00.868657128Z [2024-05-26T00:12:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:12:00.868790299Z [2024-05-26T00:12:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:11:00+00:00 exited with status queued for try_number 1 2024-05-26T00:12:00.868871333Z [2024-05-26T00:12:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:11:00+00:00 exited with status queued for try_number 1 2024-05-26T00:12:00.868926970Z [2024-05-26T00:12:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:11:00+00:00 exited with status queued for try_number 1 2024-05-26T00:12:00.886653153Z [2024-05-26T00:12:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc03474e-5a26-4250-80a2-259e2ce4603e 2024-05-26T00:12:00.886690715Z [2024-05-26T00:12:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to b198b4df-2f07-431a-933d-3f252fa1c5db 2024-05-26T00:12:00.886818002Z [2024-05-26T00:12:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bca29e1-4c93-4aac-bc6d-561bf0119ffa 2024-05-26T00:12:00.886897194Z [2024-05-26T00:12:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97b95129-3501-4840-9cc3-4cd6b55005b6 2024-05-26T00:12:02.036000353Z [2024-05-26T00:12:02.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:12:02.036211523Z [2024-05-26T00:12:02.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:10:00+00:00, run_id=scheduled__2024-05-26T00:10:00+00:00, run_start_date=2024-05-26 00:12:00.393069+00:00, run_end_date=2024-05-26 00:12:02.035920+00:00, run_duration=1.642851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:10:00+00:00, data_interval_end=2024-05-26 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:12:02.044117331Z [2024-05-26T00:12:02.043+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:12:00+00:00, run_after=2024-05-26T00:14:00+00:00 2024-05-26T00:12:02.050742388Z [2024-05-26T00:12:02.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:12:02.050883274Z [2024-05-26T00:12:02.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:11:00+00:00, run_id=scheduled__2024-05-26T00:11:00+00:00, run_start_date=2024-05-26 00:12:00.394804+00:00, run_end_date=2024-05-26 00:12:02.050654+00:00, run_duration=1.65585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:11:00+00:00, data_interval_end=2024-05-26 00:12:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:12:02.060350292Z [2024-05-26T00:12:02.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:12:00+00:00, run_after=2024-05-26T00:13:00+00:00 2024-05-26T00:12:02.118726265Z [2024-05-26T00:12:02.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:12:02.118781541Z [2024-05-26T00:12:02.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:11:00+00:00 exited with status success for try_number 1 2024-05-26T00:12:02.127088406Z [2024-05-26T00:12:02.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=-1, run_start_date=2024-05-26 00:12:01.359030+00:00, run_end_date=2024-05-26 00:12:01.753534+00:00, run_duration=0.394504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:12:00.486928+00:00, queued_by_job_id=1, pid=5996 2024-05-26T00:12:02.127288948Z [2024-05-26T00:12:02.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:11:00+00:00, map_index=-1, run_start_date=2024-05-26 00:12:01.419612+00:00, run_end_date=2024-05-26 00:12:01.844641+00:00, run_duration=0.425029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:12:00.486928+00:00, queued_by_job_id=1, pid=5997 2024-05-26T00:12:04.314891680Z [2024-05-26T00:12:04.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:12:04.316014062Z [2024-05-26T00:12:04.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:11:00+00:00, run_id=scheduled__2024-05-26T00:11:00+00:00, run_start_date=2024-05-26 00:12:00.396593+00:00, run_end_date=2024-05-26 00:12:04.315258+00:00, run_duration=3.918665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:11:00+00:00, data_interval_end=2024-05-26 00:12:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:12:04.325344966Z [2024-05-26T00:12:04.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:12:00+00:00, run_after=2024-05-26T00:13:00+00:00 2024-05-26T00:12:04.375123476Z [2024-05-26T00:12:04.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:11:00+00:00 exited with status success for try_number 1 2024-05-26T00:12:04.381874960Z [2024-05-26T00:12:04.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:11:00+00:00, map_index=-1, run_start_date=2024-05-26 00:12:02.387465+00:00, run_end_date=2024-05-26 00:12:03.718731+00:00, run_duration=1.331266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:12:00.486928+00:00, queued_by_job_id=1, pid=6020 2024-05-26T00:12:05.452533672Z [2024-05-26T00:12:05.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:12:05.452993363Z [2024-05-26T00:12:05.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:11:00+00:00, run_id=scheduled__2024-05-26T00:11:00+00:00, run_start_date=2024-05-26 00:12:00.397728+00:00, run_end_date=2024-05-26 00:12:05.452462+00:00, run_duration=5.054734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:11:00+00:00, data_interval_end=2024-05-26 00:12:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:12:05.465434379Z [2024-05-26T00:12:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:12:00+00:00, run_after=2024-05-26T00:13:00+00:00 2024-05-26T00:12:05.492323133Z [2024-05-26T00:12:05.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:11:00+00:00 exited with status success for try_number 1 2024-05-26T00:12:05.497252300Z [2024-05-26T00:12:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:11:00+00:00, map_index=-1, run_start_date=2024-05-26 00:12:02.503965+00:00, run_end_date=2024-05-26 00:12:04.798089+00:00, run_duration=2.294124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:12:00.486928+00:00, queued_by_job_id=1, pid=6021 2024-05-26T00:13:00.458327729Z [2024-05-26T00:13:00.457+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:13:00.482322892Z [2024-05-26T00:13:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:13:00+00:00, run_after=2024-05-26T00:14:00+00:00 2024-05-26T00:13:00.498298241Z [2024-05-26T00:13:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:13:00+00:00, run_after=2024-05-26T00:14:00+00:00 2024-05-26T00:13:00.598773026Z [2024-05-26T00:13:00.598+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:13:00.598846506Z 2024-05-26T00:13:00.598859584Z 2024-05-26T00:13:00.598908675Z 2024-05-26T00:13:00.599076129Z [2024-05-26T00:13:00.598+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:13:00.599493940Z [2024-05-26T00:13:00.599+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:13:00.599967100Z [2024-05-26T00:13:00.599+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:13:00.601138986Z [2024-05-26T00:13:00.600+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:13:00.601162719Z 2024-05-26T00:13:00.601171796Z 2024-05-26T00:13:00.601180301Z 2024-05-26T00:13:00.607397782Z [2024-05-26T00:13:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:13:00.607810326Z [2024-05-26T00:13:00.607+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:13:00.608393102Z [2024-05-26T00:13:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:13:00.608736687Z [2024-05-26T00:13:00.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:13:00.609216393Z [2024-05-26T00:13:00.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:13:00.609533129Z [2024-05-26T00:13:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:13:00.861338504Z [2024-05-26T00:13:00.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status queued for try_number 1 2024-05-26T00:13:00.861845130Z [2024-05-26T00:13:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status queued for try_number 1 2024-05-26T00:13:00.862045183Z [2024-05-26T00:13:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status queued for try_number 1 2024-05-26T00:13:00.870696070Z [2024-05-26T00:13:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23033a43-ab36-467a-b938-b4ced8684d4f 2024-05-26T00:13:00.870908921Z [2024-05-26T00:13:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to af9d35a8-31d0-42da-839e-6fe115828da6 2024-05-26T00:13:00.871069379Z [2024-05-26T00:13:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06acec16-f8d1-4e8e-8631-310b4a601961 2024-05-26T00:13:02.010861791Z [2024-05-26T00:13:02.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:13:02.011290482Z [2024-05-26T00:13:02.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:12:00+00:00, run_id=scheduled__2024-05-26T00:12:00+00:00, run_start_date=2024-05-26 00:13:00.510599+00:00, run_end_date=2024-05-26 00:13:02.010941+00:00, run_duration=1.500342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:12:00+00:00, data_interval_end=2024-05-26 00:13:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:13:02.020927257Z [2024-05-26T00:13:02.020+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:13:00+00:00, run_after=2024-05-26T00:14:00+00:00 2024-05-26T00:13:02.065629716Z [2024-05-26T00:13:02.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status success for try_number 1 2024-05-26T00:13:02.072123697Z [2024-05-26T00:13:02.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:12:00+00:00, map_index=-1, run_start_date=2024-05-26 00:13:01.391067+00:00, run_end_date=2024-05-26 00:13:01.749967+00:00, run_duration=0.3589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:13:00.602531+00:00, queued_by_job_id=1, pid=6053 2024-05-26T00:13:04.296418940Z [2024-05-26T00:13:04.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:13:04.297050268Z [2024-05-26T00:13:04.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:12:00+00:00, run_id=scheduled__2024-05-26T00:12:00+00:00, run_start_date=2024-05-26 00:13:00.511818+00:00, run_end_date=2024-05-26 00:13:04.296312+00:00, run_duration=3.784494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:12:00+00:00, data_interval_end=2024-05-26 00:13:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:13:04.312080991Z [2024-05-26T00:13:04.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:13:00+00:00, run_after=2024-05-26T00:14:00+00:00 2024-05-26T00:13:04.392506588Z [2024-05-26T00:13:04.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status success for try_number 1 2024-05-26T00:13:04.401697937Z [2024-05-26T00:13:04.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:12:00+00:00, map_index=-1, run_start_date=2024-05-26 00:13:02.368656+00:00, run_end_date=2024-05-26 00:13:03.602302+00:00, run_duration=1.233646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:13:00.602531+00:00, queued_by_job_id=1, pid=6071 2024-05-26T00:13:05.436227687Z [2024-05-26T00:13:05.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:13:05.436644603Z [2024-05-26T00:13:05.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:12:00+00:00, run_id=scheduled__2024-05-26T00:12:00+00:00, run_start_date=2024-05-26 00:13:00.512834+00:00, run_end_date=2024-05-26 00:13:05.436160+00:00, run_duration=4.923326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:12:00+00:00, data_interval_end=2024-05-26 00:13:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:13:05.445466870Z [2024-05-26T00:13:05.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:13:00+00:00, run_after=2024-05-26T00:14:00+00:00 2024-05-26T00:13:05.557791543Z [2024-05-26T00:13:05.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status success for try_number 1 2024-05-26T00:13:05.568470018Z [2024-05-26T00:13:05.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:12:00+00:00, map_index=-1, run_start_date=2024-05-26 00:13:02.501702+00:00, run_end_date=2024-05-26 00:13:04.284962+00:00, run_duration=1.78326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:13:00.602531+00:00, queued_by_job_id=1, pid=6072 2024-05-26T00:13:31.185875263Z [2024-05-26T00:13:31.185+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:14:00.272003766Z [2024-05-26T00:14:00.271+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:14:00.299068953Z [2024-05-26T00:14:00.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:14:00+00:00, run_after=2024-05-26T00:15:00+00:00 2024-05-26T00:14:00.312630767Z [2024-05-26T00:14:00.312+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:14:00.333186411Z [2024-05-26T00:14:00.332+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:14:00+00:00, run_after=2024-05-26T00:15:00+00:00 2024-05-26T00:14:00.429322258Z [2024-05-26T00:14:00.428+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:14:00.429355680Z 2024-05-26T00:14:00.429382350Z 2024-05-26T00:14:00.429387117Z 2024-05-26T00:14:00.429391550Z 2024-05-26T00:14:00.429726178Z [2024-05-26T00:14:00.429+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:14:00.429956820Z [2024-05-26T00:14:00.429+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:14:00.430040912Z [2024-05-26T00:14:00.429+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:14:00.430354859Z [2024-05-26T00:14:00.429+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:14:00.431675365Z [2024-05-26T00:14:00.431+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:14:00.431691957Z 2024-05-26T00:14:00.431697382Z 2024-05-26T00:14:00.431701853Z 2024-05-26T00:14:00.431706153Z 2024-05-26T00:14:00.438254405Z [2024-05-26T00:14:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:14:00.438415945Z [2024-05-26T00:14:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:14:00.438843966Z [2024-05-26T00:14:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:14:00.439037728Z [2024-05-26T00:14:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:14:00.439382545Z [2024-05-26T00:14:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:14:00.439656155Z [2024-05-26T00:14:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:14:00.439984827Z [2024-05-26T00:14:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:14:00.440160139Z [2024-05-26T00:14:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:14:00.773872424Z [2024-05-26T00:14:00.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status queued for try_number 1 2024-05-26T00:14:00.774047001Z [2024-05-26T00:14:00.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:13:00+00:00 exited with status queued for try_number 1 2024-05-26T00:14:00.774142427Z [2024-05-26T00:14:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:13:00+00:00 exited with status queued for try_number 1 2024-05-26T00:14:00.774222616Z [2024-05-26T00:14:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:13:00+00:00 exited with status queued for try_number 1 2024-05-26T00:14:00.794424207Z [2024-05-26T00:14:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5ac56dd-0cb0-4b1c-b6c3-372955315c2c 2024-05-26T00:14:00.794460509Z [2024-05-26T00:14:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d98e897-44ed-4aa0-8662-2bf8506699d7 2024-05-26T00:14:00.794466117Z [2024-05-26T00:14:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 352033f2-7557-439b-9725-a7102d46f5b0 2024-05-26T00:14:00.794471718Z [2024-05-26T00:14:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67e931a9-39d0-4e34-82e0-2246608655b5 2024-05-26T00:14:01.849383053Z [2024-05-26T00:14:01.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:14:01.849823901Z [2024-05-26T00:14:01.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:12:00+00:00, run_id=scheduled__2024-05-26T00:12:00+00:00, run_start_date=2024-05-26 00:14:00.343856+00:00, run_end_date=2024-05-26 00:14:01.849327+00:00, run_duration=1.505471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:12:00+00:00, data_interval_end=2024-05-26 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:14:01.868149483Z [2024-05-26T00:14:01.867+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:14:00+00:00, run_after=2024-05-26T00:16:00+00:00 2024-05-26T00:14:01.876873026Z [2024-05-26T00:14:01.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:14:01.880346789Z [2024-05-26T00:14:01.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:13:00+00:00, run_id=scheduled__2024-05-26T00:13:00+00:00, run_start_date=2024-05-26 00:14:00.345336+00:00, run_end_date=2024-05-26 00:14:01.876789+00:00, run_duration=1.531453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:13:00+00:00, data_interval_end=2024-05-26 00:14:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:14:01.892947583Z [2024-05-26T00:14:01.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:14:00+00:00, run_after=2024-05-26T00:15:00+00:00 2024-05-26T00:14:03.096497934Z [2024-05-26T00:14:03.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:12:00+00:00 exited with status success for try_number 1 2024-05-26T00:14:03.096798342Z [2024-05-26T00:14:03.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:13:00+00:00 exited with status success for try_number 1 2024-05-26T00:14:03.114722618Z [2024-05-26T00:14:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:12:00+00:00, map_index=-1, run_start_date=2024-05-26 00:14:01.383792+00:00, run_end_date=2024-05-26 00:14:01.818773+00:00, run_duration=0.434981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:14:00.433312+00:00, queued_by_job_id=1, pid=6105 2024-05-26T00:14:03.115158142Z [2024-05-26T00:14:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:13:00+00:00, map_index=-1, run_start_date=2024-05-26 00:14:01.405119+00:00, run_end_date=2024-05-26 00:14:01.851543+00:00, run_duration=0.446424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:14:00.433312+00:00, queued_by_job_id=1, pid=6106 2024-05-26T00:14:04.161433281Z [2024-05-26T00:14:04.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:14:04.161522044Z [2024-05-26T00:14:04.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:13:00+00:00, run_id=scheduled__2024-05-26T00:13:00+00:00, run_start_date=2024-05-26 00:14:00.346514+00:00, run_end_date=2024-05-26 00:14:04.161247+00:00, run_duration=3.814733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:13:00+00:00, data_interval_end=2024-05-26 00:14:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:14:04.170250199Z [2024-05-26T00:14:04.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:14:00+00:00, run_after=2024-05-26T00:15:00+00:00 2024-05-26T00:14:04.221266748Z [2024-05-26T00:14:04.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:13:00+00:00 exited with status success for try_number 1 2024-05-26T00:14:04.227220243Z [2024-05-26T00:14:04.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:13:00+00:00, map_index=-1, run_start_date=2024-05-26 00:14:02.423472+00:00, run_end_date=2024-05-26 00:14:03.640495+00:00, run_duration=1.217023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:14:00.433312+00:00, queued_by_job_id=1, pid=6127 2024-05-26T00:14:05.284191995Z [2024-05-26T00:14:05.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:14:05.284364798Z [2024-05-26T00:14:05.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:13:00+00:00, run_id=scheduled__2024-05-26T00:13:00+00:00, run_start_date=2024-05-26 00:14:00.348065+00:00, run_end_date=2024-05-26 00:14:05.284059+00:00, run_duration=4.935994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:13:00+00:00, data_interval_end=2024-05-26 00:14:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:14:05.295457916Z [2024-05-26T00:14:05.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:14:00+00:00, run_after=2024-05-26T00:15:00+00:00 2024-05-26T00:14:05.335332866Z [2024-05-26T00:14:05.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:13:00+00:00 exited with status success for try_number 1 2024-05-26T00:14:05.343220300Z [2024-05-26T00:14:05.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:13:00+00:00, map_index=-1, run_start_date=2024-05-26 00:14:02.600172+00:00, run_end_date=2024-05-26 00:14:04.331730+00:00, run_duration=1.731558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:14:00.433312+00:00, queued_by_job_id=1, pid=6130 2024-05-26T00:15:00.531071289Z [2024-05-26T00:15:00.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:15:00+00:00, run_after=2024-05-26T00:16:00+00:00 2024-05-26T00:15:00.538944651Z [2024-05-26T00:15:00.538+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:15:00.551167205Z [2024-05-26T00:15:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:15:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:15:00.575041380Z [2024-05-26T00:15:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:15:00+00:00, run_after=2024-05-26T00:16:00+00:00 2024-05-26T00:15:00.683055419Z [2024-05-26T00:15:00.682+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:15:00.683131440Z 2024-05-26T00:15:00.683136325Z 2024-05-26T00:15:00.683139428Z 2024-05-26T00:15:00.683142349Z 2024-05-26T00:15:00.683175469Z [2024-05-26T00:15:00.682+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:15:00.683321290Z [2024-05-26T00:15:00.683+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:15:00.683450819Z [2024-05-26T00:15:00.683+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:15:00.683545346Z [2024-05-26T00:15:00.683+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:15:00.684438411Z [2024-05-26T00:15:00.684+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:15:00.684446412Z 2024-05-26T00:15:00.684450138Z 2024-05-26T00:15:00.684498832Z 2024-05-26T00:15:00.684503432Z 2024-05-26T00:15:00.689758185Z [2024-05-26T00:15:00.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:15:00.689849741Z [2024-05-26T00:15:00.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:15:00.690135640Z [2024-05-26T00:15:00.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:15:00.690254336Z [2024-05-26T00:15:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:15:00.690577382Z [2024-05-26T00:15:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:15:00.690698037Z [2024-05-26T00:15:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:15:00.690919263Z [2024-05-26T00:15:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:15:00.691046548Z [2024-05-26T00:15:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:15:01.254459292Z [2024-05-26T00:15:01.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:15:01.254520095Z [2024-05-26T00:15:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status queued for try_number 1 2024-05-26T00:15:01.254682869Z [2024-05-26T00:15:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status queued for try_number 1 2024-05-26T00:15:01.254798484Z [2024-05-26T00:15:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status queued for try_number 1 2024-05-26T00:15:01.273019293Z [2024-05-26T00:15:01.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfadea91-2097-4288-b062-630e380baf05 2024-05-26T00:15:01.273437365Z [2024-05-26T00:15:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to b53cb5a7-20ee-48c1-a654-f81d1d8b7ebf 2024-05-26T00:15:01.273804909Z [2024-05-26T00:15:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to bab7e67b-1fec-406b-958e-f6a5c7c3506a 2024-05-26T00:15:01.274186539Z [2024-05-26T00:15:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84fe6804-8c22-46dc-b700-ce725dbb117c 2024-05-26T00:15:02.496167831Z [2024-05-26T00:15:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:15:02.496625797Z [2024-05-26T00:15:02.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:14:00+00:00, run_id=scheduled__2024-05-26T00:14:00+00:00, run_start_date=2024-05-26 00:15:00.600595+00:00, run_end_date=2024-05-26 00:15:02.496116+00:00, run_duration=1.895521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:14:00+00:00, data_interval_end=2024-05-26 00:15:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:15:02.507627419Z [2024-05-26T00:15:02.507+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:15:00+00:00, run_after=2024-05-26T00:16:00+00:00 2024-05-26T00:15:02.585041490Z [2024-05-26T00:15:02.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status success for try_number 1 2024-05-26T00:15:02.599884518Z [2024-05-26T00:15:02.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:14:00+00:00, map_index=-1, run_start_date=2024-05-26 00:15:01.607660+00:00, run_end_date=2024-05-26 00:15:02.000188+00:00, run_duration=0.392528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:15:00.685597+00:00, queued_by_job_id=1, pid=6163 2024-05-26T00:15:04.115630048Z [2024-05-26T00:15:04.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:15:04.115773415Z [2024-05-26T00:15:04.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:14:00+00:00, run_id=scheduled__2024-05-26T00:14:00+00:00, run_start_date=2024-05-26 00:15:00.603802+00:00, run_end_date=2024-05-26 00:15:04.115484+00:00, run_duration=3.511682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:14:00+00:00, data_interval_end=2024-05-26 00:15:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:15:04.132209519Z [2024-05-26T00:15:04.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:15:00+00:00, run_after=2024-05-26T00:16:00+00:00 2024-05-26T00:15:04.169467587Z [2024-05-26T00:15:04.169+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:15:04.169494848Z 2024-05-26T00:15:04.169510496Z [2024-05-26T00:15:04.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:15:04.169982507Z [2024-05-26T00:15:04.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:15:04.169995368Z 2024-05-26T00:15:04.173275686Z [2024-05-26T00:15:04.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:15:04.173406702Z [2024-05-26T00:15:04.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:15:04.292948997Z [2024-05-26T00:15:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:15:04.292986086Z [2024-05-26T00:15:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:15:04.293021532Z [2024-05-26T00:15:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status success for try_number 1 2024-05-26T00:15:04.301501444Z [2024-05-26T00:15:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:14:00+00:00, map_index=-1, run_start_date=2024-05-26 00:15:02.678635+00:00, run_end_date=2024-05-26 00:15:04.062773+00:00, run_duration=1.384138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:15:00.685597+00:00, queued_by_job_id=1, pid=6187 2024-05-26T00:15:04.301592912Z [2024-05-26T00:15:04.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0a62d7e-6ef7-411e-8c2f-da529bcceb12 2024-05-26T00:15:04.301736854Z [2024-05-26T00:15:04.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=-1, run_start_date=2024-05-26 00:15:02.717525+00:00, run_end_date=2024-05-26 00:15:03.127495+00:00, run_duration=0.40997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:15:00.685597+00:00, queued_by_job_id=1, pid=6188 2024-05-26T00:15:05.455928204Z [2024-05-26T00:15:05.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:15:05.456179589Z [2024-05-26T00:15:05.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:14:00+00:00, run_id=scheduled__2024-05-26T00:14:00+00:00, run_start_date=2024-05-26 00:15:00.604908+00:00, run_end_date=2024-05-26 00:15:05.455876+00:00, run_duration=4.850968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:14:00+00:00, data_interval_end=2024-05-26 00:15:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:15:05.469988001Z [2024-05-26T00:15:05.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:15:00+00:00, run_after=2024-05-26T00:16:00+00:00 2024-05-26T00:15:05.534472110Z [2024-05-26T00:15:05.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status success for try_number 1 2024-05-26T00:15:05.547886376Z [2024-05-26T00:15:05.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:14:00+00:00, map_index=-1, run_start_date=2024-05-26 00:15:02.725009+00:00, run_end_date=2024-05-26 00:15:04.406973+00:00, run_duration=1.681964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:15:00.685597+00:00, queued_by_job_id=1, pid=6189 2024-05-26T00:15:06.634212603Z [2024-05-26T00:15:06.633+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:15:06.634241203Z 2024-05-26T00:15:06.634686052Z [2024-05-26T00:15:06.634+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:15:06.636270824Z [2024-05-26T00:15:06.635+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:15:06.636284370Z 2024-05-26T00:15:06.640140945Z [2024-05-26T00:15:06.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:15:06.640540317Z [2024-05-26T00:15:06.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:15:06.703142837Z [2024-05-26T00:15:06.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:15:06.703637686Z [2024-05-26T00:15:06.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:15:06.710425732Z [2024-05-26T00:15:06.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0b01935-9103-43b0-b23e-f27bc4fd7de2 2024-05-26T00:15:06.710980947Z [2024-05-26T00:15:06.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=-1, run_start_date=2024-05-26 00:15:05.956877+00:00, run_end_date=2024-05-26 00:15:06.394009+00:00, run_duration=0.437132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:15:04.170259+00:00, queued_by_job_id=1, pid=6212 2024-05-26T00:15:09.268400971Z [2024-05-26T00:15:09.267+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:15:09.268433222Z 2024-05-26T00:15:09.268623524Z [2024-05-26T00:15:09.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:15:09.269588792Z [2024-05-26T00:15:09.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:15:09.269634753Z 2024-05-26T00:15:09.273152449Z [2024-05-26T00:15:09.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:15:09.273426365Z [2024-05-26T00:15:09.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:15:09.324519910Z [2024-05-26T00:15:09.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status queued for try_number 1 2024-05-26T00:15:09.324553830Z [2024-05-26T00:15:09.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:15:09.329684705Z [2024-05-26T00:15:09.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ee0aa51-93fc-4fc8-a5a1-f276ee73496e 2024-05-26T00:15:09.329871894Z [2024-05-26T00:15:09.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=0, run_start_date=2024-05-26 00:15:08.160788+00:00, run_end_date=2024-05-26 00:15:08.528419+00:00, run_duration=0.367631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:15:06.637164+00:00, queued_by_job_id=1, pid=6220 2024-05-26T00:15:11.536138901Z [2024-05-26T00:15:11.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:15:11.536557915Z [2024-05-26T00:15:11.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:10:00+00:00, run_id=scheduled__2024-05-26T00:10:00+00:00, run_start_date=2024-05-26 00:15:00.596838+00:00, run_end_date=2024-05-26 00:15:11.536005+00:00, run_duration=10.939167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:10:00+00:00, data_interval_end=2024-05-26 00:15:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:15:11.544457801Z [2024-05-26T00:15:11.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:15:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:15:11.583363657Z [2024-05-26T00:15:11.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:10:00+00:00 exited with status success for try_number 1 2024-05-26T00:15:11.590156974Z [2024-05-26T00:15:11.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:10:00+00:00, map_index=-1, run_start_date=2024-05-26 00:15:10.772700+00:00, run_end_date=2024-05-26 00:15:11.194311+00:00, run_duration=0.421611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:15:09.270271+00:00, queued_by_job_id=1, pid=6228 2024-05-26T00:16:00.767606543Z [2024-05-26T00:16:00.766+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:16:00.785254548Z [2024-05-26T00:16:00.784+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:16:00+00:00, run_after=2024-05-26T00:17:00+00:00 2024-05-26T00:16:00.792318182Z [2024-05-26T00:16:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:16:00.808766282Z [2024-05-26T00:16:00.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:16:00+00:00, run_after=2024-05-26T00:17:00+00:00 2024-05-26T00:16:00.880523523Z [2024-05-26T00:16:00.880+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:16:00.880549344Z 2024-05-26T00:16:00.880553103Z 2024-05-26T00:16:00.880556369Z 2024-05-26T00:16:00.880559424Z 2024-05-26T00:16:00.880763476Z [2024-05-26T00:16:00.880+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:16:00.880961398Z [2024-05-26T00:16:00.880+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:16:00.881172073Z [2024-05-26T00:16:00.880+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:16:00.881391296Z [2024-05-26T00:16:00.881+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:16:00.882116447Z [2024-05-26T00:16:00.881+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:16:00.882128518Z 2024-05-26T00:16:00.882131969Z 2024-05-26T00:16:00.882135239Z 2024-05-26T00:16:00.882138335Z 2024-05-26T00:16:00.885498825Z [2024-05-26T00:16:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:16:00.885663364Z [2024-05-26T00:16:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:16:00.885989912Z [2024-05-26T00:16:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:16:00.886169915Z [2024-05-26T00:16:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:16:00.886572288Z [2024-05-26T00:16:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:16:00.886783662Z [2024-05-26T00:16:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:16:00.887059683Z [2024-05-26T00:16:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:16:00.887256102Z [2024-05-26T00:16:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:16:01.343878515Z [2024-05-26T00:16:01.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status queued for try_number 1 2024-05-26T00:16:01.343917859Z [2024-05-26T00:16:01.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status queued for try_number 1 2024-05-26T00:16:01.345358647Z [2024-05-26T00:16:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status queued for try_number 1 2024-05-26T00:16:01.346563612Z [2024-05-26T00:16:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status queued for try_number 1 2024-05-26T00:16:01.372515399Z [2024-05-26T00:16:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83a9386e-f46c-499c-9523-72abe44d46bc 2024-05-26T00:16:01.372567816Z [2024-05-26T00:16:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca4e1fb-1b9c-4d92-a946-a8c415f6e674 2024-05-26T00:16:01.372666591Z [2024-05-26T00:16:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 929edb15-a226-4ab4-bfd2-33ed5efa6659 2024-05-26T00:16:01.372853472Z [2024-05-26T00:16:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52410538-6fcc-4c5f-9584-fbcdfeb202fa 2024-05-26T00:16:02.647446971Z [2024-05-26T00:16:02.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:16:02.647773335Z [2024-05-26T00:16:02.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:14:00+00:00, run_id=scheduled__2024-05-26T00:14:00+00:00, run_start_date=2024-05-26 00:16:00.821007+00:00, run_end_date=2024-05-26 00:16:02.647285+00:00, run_duration=1.826278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:14:00+00:00, data_interval_end=2024-05-26 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:16:02.655540674Z [2024-05-26T00:16:02.655+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:16:00+00:00, run_after=2024-05-26T00:18:00+00:00 2024-05-26T00:16:02.669088144Z [2024-05-26T00:16:02.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:16:02.669447208Z [2024-05-26T00:16:02.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:15:00+00:00, run_id=scheduled__2024-05-26T00:15:00+00:00, run_start_date=2024-05-26 00:16:00.822432+00:00, run_end_date=2024-05-26 00:16:02.668952+00:00, run_duration=1.84652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:15:00+00:00, data_interval_end=2024-05-26 00:16:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:16:02.679006287Z [2024-05-26T00:16:02.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:16:00+00:00, run_after=2024-05-26T00:17:00+00:00 2024-05-26T00:16:02.734953100Z [2024-05-26T00:16:02.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:14:00+00:00 exited with status success for try_number 1 2024-05-26T00:16:02.735731751Z [2024-05-26T00:16:02.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status success for try_number 1 2024-05-26T00:16:02.756799564Z [2024-05-26T00:16:02.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:14:00+00:00, map_index=-1, run_start_date=2024-05-26 00:16:01.967044+00:00, run_end_date=2024-05-26 00:16:02.323506+00:00, run_duration=0.356462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:16:00.883074+00:00, queued_by_job_id=1, pid=6252 2024-05-26T00:16:02.757656887Z [2024-05-26T00:16:02.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:15:00+00:00, map_index=-1, run_start_date=2024-05-26 00:16:02.092396+00:00, run_end_date=2024-05-26 00:16:02.500225+00:00, run_duration=0.407829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:16:00.883074+00:00, queued_by_job_id=1, pid=6253 2024-05-26T00:16:06.240963509Z [2024-05-26T00:16:06.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:16:06.241466888Z [2024-05-26T00:16:06.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:15:00+00:00, run_id=scheduled__2024-05-26T00:15:00+00:00, run_start_date=2024-05-26 00:16:00.823601+00:00, run_end_date=2024-05-26 00:16:06.240912+00:00, run_duration=5.417311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:15:00+00:00, data_interval_end=2024-05-26 00:16:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:16:06.253444043Z [2024-05-26T00:16:06.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:16:00+00:00, run_after=2024-05-26T00:17:00+00:00 2024-05-26T00:16:06.263766109Z [2024-05-26T00:16:06.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:16:06.264049178Z [2024-05-26T00:16:06.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:15:00+00:00, run_id=scheduled__2024-05-26T00:15:00+00:00, run_start_date=2024-05-26 00:16:00.824926+00:00, run_end_date=2024-05-26 00:16:06.263671+00:00, run_duration=5.438745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:15:00+00:00, data_interval_end=2024-05-26 00:16:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:16:06.275578919Z [2024-05-26T00:16:06.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:16:00+00:00, run_after=2024-05-26T00:17:00+00:00 2024-05-26T00:16:06.319330999Z [2024-05-26T00:16:06.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status success for try_number 1 2024-05-26T00:16:06.319554263Z [2024-05-26T00:16:06.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status success for try_number 1 2024-05-26T00:16:06.329475839Z [2024-05-26T00:16:06.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:15:00+00:00, map_index=-1, run_start_date=2024-05-26 00:16:03.410948+00:00, run_end_date=2024-05-26 00:16:05.463023+00:00, run_duration=2.052075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:16:00.883074+00:00, queued_by_job_id=1, pid=6277 2024-05-26T00:16:06.329501111Z [2024-05-26T00:16:06.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:15:00+00:00, map_index=-1, run_start_date=2024-05-26 00:16:03.139098+00:00, run_end_date=2024-05-26 00:16:05.867617+00:00, run_duration=2.728519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:16:00.883074+00:00, queued_by_job_id=1, pid=6276 2024-05-26T00:17:01.021568739Z [2024-05-26T00:17:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:17:01.039504949Z [2024-05-26T00:17:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:17:00+00:00, run_after=2024-05-26T00:18:00+00:00 2024-05-26T00:17:01.064127348Z [2024-05-26T00:17:01.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:17:00+00:00, run_after=2024-05-26T00:18:00+00:00 2024-05-26T00:17:01.161948502Z [2024-05-26T00:17:01.161+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:17:01.161984775Z 2024-05-26T00:17:01.161991680Z 2024-05-26T00:17:01.161997920Z 2024-05-26T00:17:01.162091190Z [2024-05-26T00:17:01.161+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:17:01.162288868Z [2024-05-26T00:17:01.162+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:17:01.162468094Z [2024-05-26T00:17:01.162+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:17:01.163508365Z [2024-05-26T00:17:01.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:17:01.163555172Z 2024-05-26T00:17:01.163560781Z 2024-05-26T00:17:01.163564457Z 2024-05-26T00:17:01.168951435Z [2024-05-26T00:17:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:17:01.169202293Z [2024-05-26T00:17:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:17:01.169606171Z [2024-05-26T00:17:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:17:01.169780814Z [2024-05-26T00:17:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:17:01.170114067Z [2024-05-26T00:17:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:17:01.170276869Z [2024-05-26T00:17:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:17:01.398825566Z [2024-05-26T00:17:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status queued for try_number 1 2024-05-26T00:17:01.398894606Z [2024-05-26T00:17:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status queued for try_number 1 2024-05-26T00:17:01.399921421Z [2024-05-26T00:17:01.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status queued for try_number 1 2024-05-26T00:17:01.408273802Z [2024-05-26T00:17:01.407+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f5fe214-039d-49f8-9585-d565b84f2ba0 2024-05-26T00:17:01.408405365Z [2024-05-26T00:17:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to a68e2f84-b202-4110-b865-c8d567cebb2a 2024-05-26T00:17:01.408537600Z [2024-05-26T00:17:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52f9aa0a-5d74-4c29-bfad-04b0677a58ad 2024-05-26T00:17:03.663451258Z [2024-05-26T00:17:03.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:17:03.664147100Z [2024-05-26T00:17:03.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:16:00+00:00, run_id=scheduled__2024-05-26T00:16:00+00:00, run_start_date=2024-05-26 00:17:01.077851+00:00, run_end_date=2024-05-26 00:17:03.663582+00:00, run_duration=2.585731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:16:00+00:00, data_interval_end=2024-05-26 00:17:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:17:03.673719114Z [2024-05-26T00:17:03.673+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:17:00+00:00, run_after=2024-05-26T00:18:00+00:00 2024-05-26T00:17:03.728539834Z [2024-05-26T00:17:03.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status success for try_number 1 2024-05-26T00:17:03.743619341Z [2024-05-26T00:17:03.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:16:00+00:00, map_index=-1, run_start_date=2024-05-26 00:17:02.096911+00:00, run_end_date=2024-05-26 00:17:02.606103+00:00, run_duration=0.509192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:17:01.164693+00:00, queued_by_job_id=1, pid=6308 2024-05-26T00:17:05.962295407Z [2024-05-26T00:17:05.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:17:05.962660995Z [2024-05-26T00:17:05.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:16:00+00:00, run_id=scheduled__2024-05-26T00:16:00+00:00, run_start_date=2024-05-26 00:17:01.079401+00:00, run_end_date=2024-05-26 00:17:05.962270+00:00, run_duration=4.882869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:16:00+00:00, data_interval_end=2024-05-26 00:17:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:17:05.977345871Z [2024-05-26T00:17:05.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:17:00+00:00, run_after=2024-05-26T00:18:00+00:00 2024-05-26T00:17:05.988063703Z [2024-05-26T00:17:05.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:17:05.988821021Z [2024-05-26T00:17:05.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:16:00+00:00, run_id=scheduled__2024-05-26T00:16:00+00:00, run_start_date=2024-05-26 00:17:01.080903+00:00, run_end_date=2024-05-26 00:17:05.988187+00:00, run_duration=4.907284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:16:00+00:00, data_interval_end=2024-05-26 00:17:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:17:06.009277358Z [2024-05-26T00:17:06.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:17:00+00:00, run_after=2024-05-26T00:18:00+00:00 2024-05-26T00:17:06.042103526Z [2024-05-26T00:17:06.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status success for try_number 1 2024-05-26T00:17:06.042125138Z [2024-05-26T00:17:06.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status success for try_number 1 2024-05-26T00:17:06.047924487Z [2024-05-26T00:17:06.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:16:00+00:00, map_index=-1, run_start_date=2024-05-26 00:17:03.167183+00:00, run_end_date=2024-05-26 00:17:05.118458+00:00, run_duration=1.951275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:17:01.164693+00:00, queued_by_job_id=1, pid=6327 2024-05-26T00:17:06.048078958Z [2024-05-26T00:17:06.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:16:00+00:00, map_index=-1, run_start_date=2024-05-26 00:17:03.130066+00:00, run_end_date=2024-05-26 00:17:05.509435+00:00, run_duration=2.379369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:17:01.164693+00:00, queued_by_job_id=1, pid=6326 2024-05-26T00:18:00.112971458Z [2024-05-26T00:18:00.112+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:18:00.125535732Z [2024-05-26T00:18:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:18:00+00:00, run_after=2024-05-26T00:19:00+00:00 2024-05-26T00:18:00.140560933Z [2024-05-26T00:18:00.139+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:18:00.162433334Z [2024-05-26T00:18:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:18:00+00:00, run_after=2024-05-26T00:19:00+00:00 2024-05-26T00:18:00.250788771Z [2024-05-26T00:18:00.250+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:18:00.250822177Z 2024-05-26T00:18:00.250826535Z 2024-05-26T00:18:00.250829806Z 2024-05-26T00:18:00.250833021Z 2024-05-26T00:18:00.250986206Z [2024-05-26T00:18:00.250+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:18:00.251234330Z [2024-05-26T00:18:00.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:18:00.251602595Z [2024-05-26T00:18:00.251+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:18:00.251825987Z [2024-05-26T00:18:00.251+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:18:00.258180398Z [2024-05-26T00:18:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:18:00.258215761Z 2024-05-26T00:18:00.258224906Z 2024-05-26T00:18:00.258232023Z 2024-05-26T00:18:00.258257416Z 2024-05-26T00:18:00.264341532Z [2024-05-26T00:18:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:18:00.264601572Z [2024-05-26T00:18:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:18:00.264891589Z [2024-05-26T00:18:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:18:00.265057878Z [2024-05-26T00:18:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:18:00.265325929Z [2024-05-26T00:18:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:18:00.265492851Z [2024-05-26T00:18:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:18:00.265757407Z [2024-05-26T00:18:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:18:00.266002221Z [2024-05-26T00:18:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:18:00.832868831Z [2024-05-26T00:18:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status queued for try_number 1 2024-05-26T00:18:00.836130651Z [2024-05-26T00:18:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:17:00+00:00 exited with status queued for try_number 1 2024-05-26T00:18:00.836281566Z [2024-05-26T00:18:00.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:17:00+00:00 exited with status queued for try_number 1 2024-05-26T00:18:00.836399769Z [2024-05-26T00:18:00.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:17:00+00:00 exited with status queued for try_number 1 2024-05-26T00:18:00.856328178Z [2024-05-26T00:18:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66985bcb-38ba-4936-af0f-c3c7f87f53f3 2024-05-26T00:18:00.856546577Z [2024-05-26T00:18:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4d7716f-ebc3-4f32-b28d-8eaba66e6a2c 2024-05-26T00:18:00.856704348Z [2024-05-26T00:18:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85b42bf8-5253-4b43-80a2-b1b5f87174a8 2024-05-26T00:18:00.856852607Z [2024-05-26T00:18:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8319ff65-97da-4ad0-83c1-f3ca9aabb1c9 2024-05-26T00:18:02.300686306Z [2024-05-26T00:18:02.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:18:02.304167974Z [2024-05-26T00:18:02.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:16:00+00:00, run_id=scheduled__2024-05-26T00:16:00+00:00, run_start_date=2024-05-26 00:18:00.175317+00:00, run_end_date=2024-05-26 00:18:02.300616+00:00, run_duration=2.125299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:16:00+00:00, data_interval_end=2024-05-26 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:18:02.331097856Z [2024-05-26T00:18:02.330+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:18:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:18:02.477084789Z [2024-05-26T00:18:02.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:16:00+00:00 exited with status success for try_number 1 2024-05-26T00:18:02.489030940Z [2024-05-26T00:18:02.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:16:00+00:00, map_index=-1, run_start_date=2024-05-26 00:18:01.442405+00:00, run_end_date=2024-05-26 00:18:01.852998+00:00, run_duration=0.410593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:18:00.260251+00:00, queued_by_job_id=1, pid=6355 2024-05-26T00:18:03.550497406Z [2024-05-26T00:18:03.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:18:03.550853517Z [2024-05-26T00:18:03.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:17:00+00:00, run_id=scheduled__2024-05-26T00:17:00+00:00, run_start_date=2024-05-26 00:18:00.176619+00:00, run_end_date=2024-05-26 00:18:03.550393+00:00, run_duration=3.373774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:17:00+00:00, data_interval_end=2024-05-26 00:18:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:18:03.561133676Z [2024-05-26T00:18:03.560+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:18:00+00:00, run_after=2024-05-26T00:19:00+00:00 2024-05-26T00:18:03.616296086Z [2024-05-26T00:18:03.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:17:00+00:00 exited with status success for try_number 1 2024-05-26T00:18:03.622355419Z [2024-05-26T00:18:03.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:17:00+00:00, map_index=-1, run_start_date=2024-05-26 00:18:02.031661+00:00, run_end_date=2024-05-26 00:18:02.509020+00:00, run_duration=0.477359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:18:00.260251+00:00, queued_by_job_id=1, pid=6368 2024-05-26T00:18:04.680180087Z [2024-05-26T00:18:04.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:18:04.680623429Z [2024-05-26T00:18:04.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:17:00+00:00, run_id=scheduled__2024-05-26T00:17:00+00:00, run_start_date=2024-05-26 00:18:00.177619+00:00, run_end_date=2024-05-26 00:18:04.680252+00:00, run_duration=4.502633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:17:00+00:00, data_interval_end=2024-05-26 00:18:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:18:04.690728660Z [2024-05-26T00:18:04.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:18:00+00:00, run_after=2024-05-26T00:19:00+00:00 2024-05-26T00:18:04.735923184Z [2024-05-26T00:18:04.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:17:00+00:00 exited with status success for try_number 1 2024-05-26T00:18:04.746000625Z [2024-05-26T00:18:04.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:17:00+00:00, map_index=-1, run_start_date=2024-05-26 00:18:02.695338+00:00, run_end_date=2024-05-26 00:18:04.225734+00:00, run_duration=1.530396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:18:00.260251+00:00, queued_by_job_id=1, pid=6379 2024-05-26T00:18:05.794704010Z [2024-05-26T00:18:05.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:18:05.795328970Z [2024-05-26T00:18:05.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:17:00+00:00, run_id=scheduled__2024-05-26T00:17:00+00:00, run_start_date=2024-05-26 00:18:00.178590+00:00, run_end_date=2024-05-26 00:18:05.794932+00:00, run_duration=5.616342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:17:00+00:00, data_interval_end=2024-05-26 00:18:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:18:05.805715635Z [2024-05-26T00:18:05.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:18:00+00:00, run_after=2024-05-26T00:19:00+00:00 2024-05-26T00:18:05.847911854Z [2024-05-26T00:18:05.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:17:00+00:00 exited with status success for try_number 1 2024-05-26T00:18:05.862250718Z [2024-05-26T00:18:05.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:17:00+00:00, map_index=-1, run_start_date=2024-05-26 00:18:03.252077+00:00, run_end_date=2024-05-26 00:18:05.394280+00:00, run_duration=2.142203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:18:00.260251+00:00, queued_by_job_id=1, pid=6390 2024-05-26T00:18:31.270707389Z [2024-05-26T00:18:31.269+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:19:00.550643993Z [2024-05-26T00:19:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:19:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:19:00.563676813Z [2024-05-26T00:19:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:19:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:19:00.570640789Z [2024-05-26T00:19:00.570+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:19:00.632042725Z [2024-05-26T00:19:00.631+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:19:00.632072129Z 2024-05-26T00:19:00.632077917Z 2024-05-26T00:19:00.632083117Z 2024-05-26T00:19:00.632176592Z [2024-05-26T00:19:00.631+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:19:00.632346335Z [2024-05-26T00:19:00.632+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:19:00.632577304Z [2024-05-26T00:19:00.632+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:19:00.633514433Z [2024-05-26T00:19:00.633+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:19:00.633531383Z 2024-05-26T00:19:00.633536560Z 2024-05-26T00:19:00.633541405Z 2024-05-26T00:19:00.637281753Z [2024-05-26T00:19:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:19:00.637561224Z [2024-05-26T00:19:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:19:00.637823034Z [2024-05-26T00:19:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:19:00.638107256Z [2024-05-26T00:19:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:19:00.638218936Z [2024-05-26T00:19:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:19:00.638505243Z [2024-05-26T00:19:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:19:00.952711436Z [2024-05-26T00:19:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status queued for try_number 1 2024-05-26T00:19:00.953025327Z [2024-05-26T00:19:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status queued for try_number 1 2024-05-26T00:19:00.953231166Z [2024-05-26T00:19:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status queued for try_number 1 2024-05-26T00:19:00.965523748Z [2024-05-26T00:19:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 724c37d0-1ca0-4a06-a4a8-d1a944756409 2024-05-26T00:19:00.965934004Z [2024-05-26T00:19:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7696b922-bf19-4e10-9c87-0648e6e938bc 2024-05-26T00:19:00.966192431Z [2024-05-26T00:19:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17997eee-d162-4ed8-8d48-6675ba034ba9 2024-05-26T00:19:03.082989309Z [2024-05-26T00:19:03.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:19:03.083190492Z [2024-05-26T00:19:03.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:18:00+00:00, run_id=scheduled__2024-05-26T00:18:00+00:00, run_start_date=2024-05-26 00:19:00.579793+00:00, run_end_date=2024-05-26 00:19:03.082905+00:00, run_duration=2.503112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:18:00+00:00, data_interval_end=2024-05-26 00:19:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:19:03.104382998Z [2024-05-26T00:19:03.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:19:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:19:03.179728186Z [2024-05-26T00:19:03.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status success for try_number 1 2024-05-26T00:19:03.187637220Z [2024-05-26T00:19:03.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:18:00+00:00, map_index=-1, run_start_date=2024-05-26 00:19:01.709204+00:00, run_end_date=2024-05-26 00:19:02.141152+00:00, run_duration=0.431948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:19:00.634345+00:00, queued_by_job_id=1, pid=6417 2024-05-26T00:19:05.420223632Z [2024-05-26T00:19:05.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:19:05.420575520Z [2024-05-26T00:19:05.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:18:00+00:00, run_id=scheduled__2024-05-26T00:18:00+00:00, run_start_date=2024-05-26 00:19:00.581254+00:00, run_end_date=2024-05-26 00:19:05.420143+00:00, run_duration=4.838889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:18:00+00:00, data_interval_end=2024-05-26 00:19:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:19:05.435809558Z [2024-05-26T00:19:05.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:19:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:19:05.521885957Z [2024-05-26T00:19:05.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status success for try_number 1 2024-05-26T00:19:05.527930745Z [2024-05-26T00:19:05.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:18:00+00:00, map_index=-1, run_start_date=2024-05-26 00:19:02.675657+00:00, run_end_date=2024-05-26 00:19:04.234578+00:00, run_duration=1.558921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:19:00.634345+00:00, queued_by_job_id=1, pid=6435 2024-05-26T00:19:06.576795271Z [2024-05-26T00:19:06.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:19:06.576973388Z [2024-05-26T00:19:06.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:18:00+00:00, run_id=scheduled__2024-05-26T00:18:00+00:00, run_start_date=2024-05-26 00:19:00.582361+00:00, run_end_date=2024-05-26 00:19:06.576656+00:00, run_duration=5.994295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:18:00+00:00, data_interval_end=2024-05-26 00:19:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:19:06.584973568Z [2024-05-26T00:19:06.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:19:00+00:00, run_after=2024-05-26T00:20:00+00:00 2024-05-26T00:19:06.618720288Z [2024-05-26T00:19:06.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status success for try_number 1 2024-05-26T00:19:06.624818171Z [2024-05-26T00:19:06.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:18:00+00:00, map_index=-1, run_start_date=2024-05-26 00:19:02.743306+00:00, run_end_date=2024-05-26 00:19:06.461689+00:00, run_duration=3.718383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:19:00.634345+00:00, queued_by_job_id=1, pid=6436 2024-05-26T00:20:00.985001195Z [2024-05-26T00:20:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:21:00+00:00 2024-05-26T00:20:00.993336438Z [2024-05-26T00:20:00.992+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:20:01.002849247Z [2024-05-26T00:20:01.002+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:20:01.019017501Z [2024-05-26T00:20:01.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:25:00+00:00 2024-05-26T00:20:01.034762869Z [2024-05-26T00:20:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:21:00+00:00 2024-05-26T00:20:01.192431562Z [2024-05-26T00:20:01.191+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T00:20:01.192474722Z 2024-05-26T00:20:01.192484031Z 2024-05-26T00:20:01.192497698Z 2024-05-26T00:20:01.192506319Z 2024-05-26T00:20:01.192514776Z 2024-05-26T00:20:01.192536609Z [2024-05-26T00:20:01.192+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:20:01.193168483Z [2024-05-26T00:20:01.192+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:20:01.193685955Z [2024-05-26T00:20:01.193+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:20:01.194144621Z [2024-05-26T00:20:01.193+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:20:01.194420692Z [2024-05-26T00:20:01.194+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:20:01.196621034Z [2024-05-26T00:20:01.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:20:01.196648177Z 2024-05-26T00:20:01.196658017Z 2024-05-26T00:20:01.196667953Z 2024-05-26T00:20:01.196676213Z 2024-05-26T00:20:01.196684645Z 2024-05-26T00:20:01.207039800Z [2024-05-26T00:20:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:20:01.207259066Z [2024-05-26T00:20:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:20:01.207800722Z [2024-05-26T00:20:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:20:01.208200682Z [2024-05-26T00:20:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:20:01.208661075Z [2024-05-26T00:20:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:20:01.208923188Z [2024-05-26T00:20:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:20:01.209255206Z [2024-05-26T00:20:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:20:01.209318590Z [2024-05-26T00:20:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:20:01.209586920Z [2024-05-26T00:20:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:20:01.209756134Z [2024-05-26T00:20:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:20:01.559684103Z [2024-05-26T00:20:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:01.559737559Z [2024-05-26T00:20:01.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:01.559961939Z [2024-05-26T00:20:01.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:19:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:01.560171547Z [2024-05-26T00:20:01.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:19:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:01.560341550Z [2024-05-26T00:20:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:19:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:01.576890493Z [2024-05-26T00:20:01.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0725171e-0cf4-431c-b34a-7da6e5c105c5 2024-05-26T00:20:01.577114110Z [2024-05-26T00:20:01.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3594a965-7c92-447c-a06b-ea8ca13113fc 2024-05-26T00:20:01.577307132Z [2024-05-26T00:20:01.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to fffdd195-15c2-4c9d-be22-94a91c996ef1 2024-05-26T00:20:01.577490306Z [2024-05-26T00:20:01.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32049a95-6e38-49c6-8ee1-a037e83d7aed 2024-05-26T00:20:01.577688903Z [2024-05-26T00:20:01.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to e93e70cc-e1b1-423e-924b-cdae08d68773 2024-05-26T00:20:02.923207709Z [2024-05-26T00:20:02.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:20:02.923543499Z [2024-05-26T00:20:02.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:18:00+00:00, run_id=scheduled__2024-05-26T00:18:00+00:00, run_start_date=2024-05-26 00:20:01.048931+00:00, run_end_date=2024-05-26 00:20:02.923099+00:00, run_duration=1.874168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:18:00+00:00, data_interval_end=2024-05-26 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:20:02.932415710Z [2024-05-26T00:20:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:22:00+00:00 2024-05-26T00:20:03.007438977Z [2024-05-26T00:20:03.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:18:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:03.012629193Z [2024-05-26T00:20:03.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:18:00+00:00, map_index=-1, run_start_date=2024-05-26 00:20:02.073996+00:00, run_end_date=2024-05-26 00:20:02.577358+00:00, run_duration=0.503362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:01.201391+00:00, queued_by_job_id=1, pid=6465 2024-05-26T00:20:04.097784834Z [2024-05-26T00:20:04.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:20:04.103967868Z [2024-05-26T00:20:04.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:19:00+00:00, run_id=scheduled__2024-05-26T00:19:00+00:00, run_start_date=2024-05-26 00:20:01.050635+00:00, run_end_date=2024-05-26 00:20:04.097666+00:00, run_duration=3.047031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:19:00+00:00, data_interval_end=2024-05-26 00:20:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:20:04.137163603Z [2024-05-26T00:20:04.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:21:00+00:00 2024-05-26T00:20:04.205793137Z [2024-05-26T00:20:04.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:19:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:04.216091144Z [2024-05-26T00:20:04.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:19:00+00:00, map_index=-1, run_start_date=2024-05-26 00:20:02.773022+00:00, run_end_date=2024-05-26 00:20:03.269416+00:00, run_duration=0.496394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:01.201391+00:00, queued_by_job_id=1, pid=6479 2024-05-26T00:20:05.303141590Z [2024-05-26T00:20:05.302+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:20:05.303167493Z 2024-05-26T00:20:05.303307918Z [2024-05-26T00:20:05.303+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:20:05.307108468Z [2024-05-26T00:20:05.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:20:05.307130467Z 2024-05-26T00:20:05.311767337Z [2024-05-26T00:20:05.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:20:05.312464099Z [2024-05-26T00:20:05.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:20:05.406887423Z [2024-05-26T00:20:05.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:05.407037991Z [2024-05-26T00:20:05.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:05.412096226Z [2024-05-26T00:20:05.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to a67a1eeb-89ad-460e-a630-46fe4105fd8b 2024-05-26T00:20:05.412579368Z [2024-05-26T00:20:05.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:15:00+00:00, map_index=-1, run_start_date=2024-05-26 00:20:03.953362+00:00, run_end_date=2024-05-26 00:20:04.601620+00:00, run_duration=0.648258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:01.201391+00:00, queued_by_job_id=1, pid=6496 2024-05-26T00:20:06.695628535Z [2024-05-26T00:20:06.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:20:06.695858384Z [2024-05-26T00:20:06.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:19:00+00:00, run_id=scheduled__2024-05-26T00:19:00+00:00, run_start_date=2024-05-26 00:20:01.052239+00:00, run_end_date=2024-05-26 00:20:06.695584+00:00, run_duration=5.643345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:19:00+00:00, data_interval_end=2024-05-26 00:20:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:20:06.706178797Z [2024-05-26T00:20:06.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:21:00+00:00 2024-05-26T00:20:06.713047147Z [2024-05-26T00:20:06.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:20:06.713187809Z [2024-05-26T00:20:06.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:19:00+00:00, run_id=scheduled__2024-05-26T00:19:00+00:00, run_start_date=2024-05-26 00:20:01.053829+00:00, run_end_date=2024-05-26 00:20:06.712954+00:00, run_duration=5.659125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:19:00+00:00, data_interval_end=2024-05-26 00:20:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:20:06.723427870Z [2024-05-26T00:20:06.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:21:00+00:00 2024-05-26T00:20:06.776473266Z [2024-05-26T00:20:06.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:19:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:06.776551735Z [2024-05-26T00:20:06.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:19:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:06.784365664Z [2024-05-26T00:20:06.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:19:00+00:00, map_index=-1, run_start_date=2024-05-26 00:20:03.851372+00:00, run_end_date=2024-05-26 00:20:05.645208+00:00, run_duration=1.793836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:01.201391+00:00, queued_by_job_id=1, pid=6495 2024-05-26T00:20:06.784455994Z [2024-05-26T00:20:06.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:19:00+00:00, map_index=-1, run_start_date=2024-05-26 00:20:04.286503+00:00, run_end_date=2024-05-26 00:20:06.352090+00:00, run_duration=2.065587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:01.201391+00:00, queued_by_job_id=1, pid=6502 2024-05-26T00:20:08.121000938Z [2024-05-26T00:20:08.120+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:20:08.121059153Z 2024-05-26T00:20:08.121103061Z [2024-05-26T00:20:08.120+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:20:08.121686512Z [2024-05-26T00:20:08.121+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:20:08.121811906Z 2024-05-26T00:20:08.124890997Z [2024-05-26T00:20:08.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:20:08.124932670Z [2024-05-26T00:20:08.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:20:08.195748590Z [2024-05-26T00:20:08.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:08.195790494Z [2024-05-26T00:20:08.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:08.204098866Z [2024-05-26T00:20:08.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6be9b08d-b054-42b8-8d1d-4c0bc8edff7d 2024-05-26T00:20:08.204482521Z [2024-05-26T00:20:08.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:15:00+00:00, map_index=-1, run_start_date=2024-05-26 00:20:07.317700+00:00, run_end_date=2024-05-26 00:20:07.681346+00:00, run_duration=0.363646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:05.309170+00:00, queued_by_job_id=1, pid=6525 2024-05-26T00:20:11.172520280Z [2024-05-26T00:20:11.171+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:20:11.172642429Z 2024-05-26T00:20:11.172709795Z [2024-05-26T00:20:11.172+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:20:11.173606668Z [2024-05-26T00:20:11.173+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:20:11.173627309Z 2024-05-26T00:20:11.176306474Z [2024-05-26T00:20:11.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:20:11.176445831Z [2024-05-26T00:20:11.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:20:11.256128258Z [2024-05-26T00:20:11.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status queued for try_number 1 2024-05-26T00:20:11.256443457Z [2024-05-26T00:20:11.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:11.265121945Z [2024-05-26T00:20:11.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a0dd9e4-3c14-4b6c-bd2c-a15a358d4d75 2024-05-26T00:20:11.265364468Z [2024-05-26T00:20:11.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:15:00+00:00, map_index=0, run_start_date=2024-05-26 00:20:09.930955+00:00, run_end_date=2024-05-26 00:20:10.342925+00:00, run_duration=0.41197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:08.122161+00:00, queued_by_job_id=1, pid=6533 2024-05-26T00:20:14.373712969Z [2024-05-26T00:20:14.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:20:14.374051824Z [2024-05-26T00:20:14.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:15:00+00:00, run_id=scheduled__2024-05-26T00:15:00+00:00, run_start_date=2024-05-26 00:20:01.047123+00:00, run_end_date=2024-05-26 00:20:14.373598+00:00, run_duration=13.326475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:15:00+00:00, data_interval_end=2024-05-26 00:20:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:20:14.380109221Z [2024-05-26T00:20:14.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:20:00+00:00, run_after=2024-05-26T00:25:00+00:00 2024-05-26T00:20:14.411417298Z [2024-05-26T00:20:14.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:15:00+00:00 exited with status success for try_number 1 2024-05-26T00:20:14.417429900Z [2024-05-26T00:20:14.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:15:00+00:00, map_index=-1, run_start_date=2024-05-26 00:20:12.948627+00:00, run_end_date=2024-05-26 00:20:13.308622+00:00, run_duration=0.359995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:20:11.173898+00:00, queued_by_job_id=1, pid=6541 2024-05-26T00:21:00.458813932Z [2024-05-26T00:21:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:21:00+00:00, run_after=2024-05-26T00:22:00+00:00 2024-05-26T00:21:00.474201545Z [2024-05-26T00:21:00.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:21:00+00:00, run_after=2024-05-26T00:22:00+00:00 2024-05-26T00:21:00.481149845Z [2024-05-26T00:21:00.480+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:21:00.578440445Z [2024-05-26T00:21:00.577+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:21:00.578479092Z 2024-05-26T00:21:00.578513508Z 2024-05-26T00:21:00.578522042Z 2024-05-26T00:21:00.578580232Z [2024-05-26T00:21:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:21:00.578949623Z [2024-05-26T00:21:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:21:00.579279045Z [2024-05-26T00:21:00.578+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:21:00.581248636Z [2024-05-26T00:21:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:21:00.581269598Z 2024-05-26T00:21:00.581276265Z 2024-05-26T00:21:00.581282946Z 2024-05-26T00:21:00.587705011Z [2024-05-26T00:21:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:21:00.588220222Z [2024-05-26T00:21:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:21:00.588531780Z [2024-05-26T00:21:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:21:00.588626544Z [2024-05-26T00:21:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:21:00.589082333Z [2024-05-26T00:21:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:21:00.589150194Z [2024-05-26T00:21:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:21:00.845934927Z [2024-05-26T00:21:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:21:00.846500254Z [2024-05-26T00:21:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:21:00.846742381Z [2024-05-26T00:21:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:21:00.854806582Z [2024-05-26T00:21:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 567bb9a0-6916-40e5-94b4-4b2f83608113 2024-05-26T00:21:00.855016075Z [2024-05-26T00:21:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8131121-3560-4fee-b7c3-8d05f0ce574a 2024-05-26T00:21:00.855232924Z [2024-05-26T00:21:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29bb5fe8-3d8e-4625-8459-2c4fd9e8df10 2024-05-26T00:21:01.913231098Z [2024-05-26T00:21:01.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:21:01.913281616Z [2024-05-26T00:21:01.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:20:00+00:00, run_id=scheduled__2024-05-26T00:20:00+00:00, run_start_date=2024-05-26 00:21:00.492369+00:00, run_end_date=2024-05-26 00:21:01.912675+00:00, run_duration=1.420306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:20:00+00:00, data_interval_end=2024-05-26 00:21:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:21:01.925079382Z [2024-05-26T00:21:01.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:21:00+00:00, run_after=2024-05-26T00:22:00+00:00 2024-05-26T00:21:01.985962856Z [2024-05-26T00:21:01.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:21:01.991442778Z [2024-05-26T00:21:01.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=-1, run_start_date=2024-05-26 00:21:01.378258+00:00, run_end_date=2024-05-26 00:21:01.792436+00:00, run_duration=0.414178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:21:00.582513+00:00, queued_by_job_id=1, pid=6563 2024-05-26T00:21:05.230519772Z [2024-05-26T00:21:05.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:21:05.230684105Z [2024-05-26T00:21:05.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:20:00+00:00, run_id=scheduled__2024-05-26T00:20:00+00:00, run_start_date=2024-05-26 00:21:00.494466+00:00, run_end_date=2024-05-26 00:21:05.230431+00:00, run_duration=4.735965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:20:00+00:00, data_interval_end=2024-05-26 00:21:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:21:05.241078058Z [2024-05-26T00:21:05.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:21:00+00:00, run_after=2024-05-26T00:22:00+00:00 2024-05-26T00:21:05.249019642Z [2024-05-26T00:21:05.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:21:05.249139348Z [2024-05-26T00:21:05.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:20:00+00:00, run_id=scheduled__2024-05-26T00:20:00+00:00, run_start_date=2024-05-26 00:21:00.496827+00:00, run_end_date=2024-05-26 00:21:05.248889+00:00, run_duration=4.752062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:20:00+00:00, data_interval_end=2024-05-26 00:21:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:21:05.261370921Z [2024-05-26T00:21:05.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:21:00+00:00, run_after=2024-05-26T00:22:00+00:00 2024-05-26T00:21:05.303387462Z [2024-05-26T00:21:05.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:21:05.303607131Z [2024-05-26T00:21:05.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:21:05.310024393Z [2024-05-26T00:21:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=-1, run_start_date=2024-05-26 00:21:02.368334+00:00, run_end_date=2024-05-26 00:21:04.258205+00:00, run_duration=1.889871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:21:00.582513+00:00, queued_by_job_id=1, pid=6581 2024-05-26T00:21:05.310220865Z [2024-05-26T00:21:05.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=-1, run_start_date=2024-05-26 00:21:02.447558+00:00, run_end_date=2024-05-26 00:21:04.848631+00:00, run_duration=2.401073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:21:00.582513+00:00, queued_by_job_id=1, pid=6582 2024-05-26T00:22:01.026087820Z [2024-05-26T00:22:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:22:00+00:00, run_after=2024-05-26T00:23:00+00:00 2024-05-26T00:22:01.040903544Z [2024-05-26T00:22:01.040+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:22:01.062987230Z [2024-05-26T00:22:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:22:00+00:00, run_after=2024-05-26T00:23:00+00:00 2024-05-26T00:22:01.072659728Z [2024-05-26T00:22:01.072+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:22:01.201084383Z [2024-05-26T00:22:01.200+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:22:01.201123396Z 2024-05-26T00:22:01.201131364Z 2024-05-26T00:22:01.201137615Z 2024-05-26T00:22:01.201143330Z 2024-05-26T00:22:01.201681868Z [2024-05-26T00:22:01.201+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:22:01.202206414Z [2024-05-26T00:22:01.201+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:22:01.202965087Z [2024-05-26T00:22:01.202+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:22:01.203580628Z [2024-05-26T00:22:01.203+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:22:01.205107040Z [2024-05-26T00:22:01.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:22:01.205128930Z 2024-05-26T00:22:01.205136681Z 2024-05-26T00:22:01.205143676Z 2024-05-26T00:22:01.205150019Z 2024-05-26T00:22:01.211274598Z [2024-05-26T00:22:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:22:01.211752670Z [2024-05-26T00:22:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:22:01.212467290Z [2024-05-26T00:22:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:22:01.212777758Z [2024-05-26T00:22:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:22:01.213306655Z [2024-05-26T00:22:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:22:01.213861339Z [2024-05-26T00:22:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:22:01.214611618Z [2024-05-26T00:22:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:22:01.215061455Z [2024-05-26T00:22:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:22:01.676345772Z [2024-05-26T00:22:01.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:22:01.676538101Z [2024-05-26T00:22:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:21:00+00:00 exited with status queued for try_number 1 2024-05-26T00:22:01.676679753Z [2024-05-26T00:22:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:21:00+00:00 exited with status queued for try_number 1 2024-05-26T00:22:01.676721030Z [2024-05-26T00:22:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:21:00+00:00 exited with status queued for try_number 1 2024-05-26T00:22:01.690957029Z [2024-05-26T00:22:01.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41a5bfb1-0e7f-4a2a-8dfa-b7f69bff6d94 2024-05-26T00:22:01.691260004Z [2024-05-26T00:22:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3302a96b-7030-45d7-8317-1e5f19b569bc 2024-05-26T00:22:01.691462312Z [2024-05-26T00:22:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1a80749-80ed-459a-af10-ddb72c4c6592 2024-05-26T00:22:01.691764653Z [2024-05-26T00:22:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2b3f95c-1cd2-47de-95c1-2e07a92757bf 2024-05-26T00:22:03.479325087Z [2024-05-26T00:22:03.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:22:03.479794943Z [2024-05-26T00:22:03.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:20:00+00:00, run_id=scheduled__2024-05-26T00:20:00+00:00, run_start_date=2024-05-26 00:22:01.085230+00:00, run_end_date=2024-05-26 00:22:03.479245+00:00, run_duration=2.394015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:20:00+00:00, data_interval_end=2024-05-26 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:22:03.491512329Z [2024-05-26T00:22:03.491+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:22:00+00:00, run_after=2024-05-26T00:24:00+00:00 2024-05-26T00:22:03.512612473Z [2024-05-26T00:22:03.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:22:03.512990541Z [2024-05-26T00:22:03.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:21:00+00:00, run_id=scheduled__2024-05-26T00:21:00+00:00, run_start_date=2024-05-26 00:22:01.086633+00:00, run_end_date=2024-05-26 00:22:03.512532+00:00, run_duration=2.425899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:21:00+00:00, data_interval_end=2024-05-26 00:22:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:22:03.531259887Z [2024-05-26T00:22:03.530+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:22:00+00:00, run_after=2024-05-26T00:23:00+00:00 2024-05-26T00:22:03.624432235Z [2024-05-26T00:22:03.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:22:03.624739501Z [2024-05-26T00:22:03.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:21:00+00:00 exited with status success for try_number 1 2024-05-26T00:22:03.634784833Z [2024-05-26T00:22:03.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:21:00+00:00, map_index=-1, run_start_date=2024-05-26 00:22:02.177865+00:00, run_end_date=2024-05-26 00:22:02.718389+00:00, run_duration=0.540524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:22:01.206655+00:00, queued_by_job_id=1, pid=6616 2024-05-26T00:22:03.635375601Z [2024-05-26T00:22:03.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=-1, run_start_date=2024-05-26 00:22:02.102863+00:00, run_end_date=2024-05-26 00:22:02.535255+00:00, run_duration=0.432392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:22:01.206655+00:00, queued_by_job_id=1, pid=6615 2024-05-26T00:22:06.157852310Z [2024-05-26T00:22:06.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:22:06.158437448Z [2024-05-26T00:22:06.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:21:00+00:00, run_id=scheduled__2024-05-26T00:21:00+00:00, run_start_date=2024-05-26 00:22:01.087841+00:00, run_end_date=2024-05-26 00:22:06.157990+00:00, run_duration=5.070149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:21:00+00:00, data_interval_end=2024-05-26 00:22:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:22:06.174296206Z [2024-05-26T00:22:06.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:22:00+00:00, run_after=2024-05-26T00:23:00+00:00 2024-05-26T00:22:06.183428152Z [2024-05-26T00:22:06.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:22:06.183717010Z [2024-05-26T00:22:06.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:21:00+00:00, run_id=scheduled__2024-05-26T00:21:00+00:00, run_start_date=2024-05-26 00:22:01.089270+00:00, run_end_date=2024-05-26 00:22:06.183325+00:00, run_duration=5.094055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:21:00+00:00, data_interval_end=2024-05-26 00:22:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:22:06.193330790Z [2024-05-26T00:22:06.193+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:22:00+00:00, run_after=2024-05-26T00:23:00+00:00 2024-05-26T00:22:06.230133989Z [2024-05-26T00:22:06.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:21:00+00:00 exited with status success for try_number 1 2024-05-26T00:22:06.230189238Z [2024-05-26T00:22:06.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:21:00+00:00 exited with status success for try_number 1 2024-05-26T00:22:06.240160047Z [2024-05-26T00:22:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:21:00+00:00, map_index=-1, run_start_date=2024-05-26 00:22:03.344950+00:00, run_end_date=2024-05-26 00:22:05.243501+00:00, run_duration=1.898551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:22:01.206655+00:00, queued_by_job_id=1, pid=6639 2024-05-26T00:22:06.240179716Z [2024-05-26T00:22:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:21:00+00:00, map_index=-1, run_start_date=2024-05-26 00:22:03.366481+00:00, run_end_date=2024-05-26 00:22:05.551395+00:00, run_duration=2.184914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:22:01.206655+00:00, queued_by_job_id=1, pid=6640 2024-05-26T00:23:00.174548377Z [2024-05-26T00:23:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:23:00+00:00, run_after=2024-05-26T00:24:00+00:00 2024-05-26T00:23:00.187199255Z [2024-05-26T00:23:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:23:00+00:00, run_after=2024-05-26T00:24:00+00:00 2024-05-26T00:23:00.193648229Z [2024-05-26T00:23:00.193+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:23:00.256500515Z [2024-05-26T00:23:00.255+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:23:00.256527389Z 2024-05-26T00:23:00.256532719Z 2024-05-26T00:23:00.256537167Z 2024-05-26T00:23:00.256920152Z [2024-05-26T00:23:00.256+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:23:00.257291793Z [2024-05-26T00:23:00.256+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:23:00.257612378Z [2024-05-26T00:23:00.257+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:23:00.258786443Z [2024-05-26T00:23:00.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:23:00.258799385Z 2024-05-26T00:23:00.258803816Z 2024-05-26T00:23:00.258808242Z 2024-05-26T00:23:00.264886846Z [2024-05-26T00:23:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:23:00.265327142Z [2024-05-26T00:23:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:23:00.266088077Z [2024-05-26T00:23:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:23:00.266439123Z [2024-05-26T00:23:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:23:00.266994340Z [2024-05-26T00:23:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:23:00.267264750Z [2024-05-26T00:23:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:23:00.585258048Z [2024-05-26T00:23:00.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status queued for try_number 1 2024-05-26T00:23:00.585543564Z [2024-05-26T00:23:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status queued for try_number 1 2024-05-26T00:23:00.585739485Z [2024-05-26T00:23:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status queued for try_number 1 2024-05-26T00:23:00.594331019Z [2024-05-26T00:23:00.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29017bfa-9c4d-49cb-b5b8-588a75faef1c 2024-05-26T00:23:00.594637612Z [2024-05-26T00:23:00.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8acdf011-cab0-4e3a-af7e-8dd95ed97b3d 2024-05-26T00:23:00.594921508Z [2024-05-26T00:23:00.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 888976f6-c545-40b6-a2cd-9ec19fe25a36 2024-05-26T00:23:02.108598972Z [2024-05-26T00:23:02.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:23:02.108952900Z [2024-05-26T00:23:02.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:22:00+00:00, run_id=scheduled__2024-05-26T00:22:00+00:00, run_start_date=2024-05-26 00:23:00.203274+00:00, run_end_date=2024-05-26 00:23:02.108553+00:00, run_duration=1.905279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:22:00+00:00, data_interval_end=2024-05-26 00:23:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:23:02.123647054Z [2024-05-26T00:23:02.123+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:23:00+00:00, run_after=2024-05-26T00:24:00+00:00 2024-05-26T00:23:02.181948484Z [2024-05-26T00:23:02.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status success for try_number 1 2024-05-26T00:23:02.193685990Z [2024-05-26T00:23:02.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:22:00+00:00, map_index=-1, run_start_date=2024-05-26 00:23:01.082966+00:00, run_end_date=2024-05-26 00:23:01.487275+00:00, run_duration=0.404309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:23:00.260706+00:00, queued_by_job_id=1, pid=6672 2024-05-26T00:23:03.730293099Z [2024-05-26T00:23:03.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:23:03.730796721Z [2024-05-26T00:23:03.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:22:00+00:00, run_id=scheduled__2024-05-26T00:22:00+00:00, run_start_date=2024-05-26 00:23:00.204677+00:00, run_end_date=2024-05-26 00:23:03.730121+00:00, run_duration=3.525444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:22:00+00:00, data_interval_end=2024-05-26 00:23:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:23:03.742023940Z [2024-05-26T00:23:03.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:23:00+00:00, run_after=2024-05-26T00:24:00+00:00 2024-05-26T00:23:03.791970998Z [2024-05-26T00:23:03.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status success for try_number 1 2024-05-26T00:23:03.797314765Z [2024-05-26T00:23:03.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:22:00+00:00, map_index=-1, run_start_date=2024-05-26 00:23:01.974309+00:00, run_end_date=2024-05-26 00:23:03.393452+00:00, run_duration=1.419143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:23:00.260706+00:00, queued_by_job_id=1, pid=6690 2024-05-26T00:23:04.840935175Z [2024-05-26T00:23:04.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:23:04.841086615Z [2024-05-26T00:23:04.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:22:00+00:00, run_id=scheduled__2024-05-26T00:22:00+00:00, run_start_date=2024-05-26 00:23:00.205755+00:00, run_end_date=2024-05-26 00:23:04.840846+00:00, run_duration=4.635091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:22:00+00:00, data_interval_end=2024-05-26 00:23:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:23:04.865368156Z [2024-05-26T00:23:04.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:23:00+00:00, run_after=2024-05-26T00:24:00+00:00 2024-05-26T00:23:04.899345340Z [2024-05-26T00:23:04.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status success for try_number 1 2024-05-26T00:23:04.903735193Z [2024-05-26T00:23:04.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:22:00+00:00, map_index=-1, run_start_date=2024-05-26 00:23:01.993971+00:00, run_end_date=2024-05-26 00:23:03.848149+00:00, run_duration=1.854178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:23:00.260706+00:00, queued_by_job_id=1, pid=6691 2024-05-26T00:23:31.361095708Z [2024-05-26T00:23:31.360+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:24:00.212872350Z [2024-05-26T00:24:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:24:00+00:00, run_after=2024-05-26T00:25:00+00:00 2024-05-26T00:24:00.240356253Z [2024-05-26T00:24:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:24:00+00:00, run_after=2024-05-26T00:25:00+00:00 2024-05-26T00:24:00.261682622Z [2024-05-26T00:24:00.259+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:24:00.266486122Z [2024-05-26T00:24:00.265+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:24:00.391147661Z [2024-05-26T00:24:00.390+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:24:00.391219444Z 2024-05-26T00:24:00.391233295Z 2024-05-26T00:24:00.391243386Z 2024-05-26T00:24:00.391253012Z 2024-05-26T00:24:00.391449699Z [2024-05-26T00:24:00.391+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:24:00.391770121Z [2024-05-26T00:24:00.391+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:24:00.392157655Z [2024-05-26T00:24:00.391+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:24:00.392474450Z [2024-05-26T00:24:00.392+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:24:00.393969745Z [2024-05-26T00:24:00.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:24:00.393998267Z 2024-05-26T00:24:00.394009125Z 2024-05-26T00:24:00.394018687Z 2024-05-26T00:24:00.394028761Z 2024-05-26T00:24:00.402841566Z [2024-05-26T00:24:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:24:00.403903314Z [2024-05-26T00:24:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:24:00.404883618Z [2024-05-26T00:24:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:24:00.405571098Z [2024-05-26T00:24:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:24:00.406553347Z [2024-05-26T00:24:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:24:00.406995236Z [2024-05-26T00:24:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:24:00.410377368Z [2024-05-26T00:24:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:24:00.411042599Z [2024-05-26T00:24:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:24:00.721746116Z [2024-05-26T00:24:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status queued for try_number 1 2024-05-26T00:24:00.721936904Z [2024-05-26T00:24:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:23:00+00:00 exited with status queued for try_number 1 2024-05-26T00:24:00.722018635Z [2024-05-26T00:24:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:23:00+00:00 exited with status queued for try_number 1 2024-05-26T00:24:00.722115939Z [2024-05-26T00:24:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:23:00+00:00 exited with status queued for try_number 1 2024-05-26T00:24:00.729826777Z [2024-05-26T00:24:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7ac0c14-1be4-4232-ae78-a74638f67dda 2024-05-26T00:24:00.729877286Z [2024-05-26T00:24:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb91d237-5ee3-42a2-b9eb-6ecdac381067 2024-05-26T00:24:00.731668654Z [2024-05-26T00:24:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to d628985b-e6fe-4603-a20d-c291f31d6b1e 2024-05-26T00:24:00.731682059Z [2024-05-26T00:24:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cdca7b7-5452-4044-a8d6-f149ac93200b 2024-05-26T00:24:02.074655633Z [2024-05-26T00:24:02.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:24:02.075014751Z [2024-05-26T00:24:02.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:22:00+00:00, run_id=scheduled__2024-05-26T00:22:00+00:00, run_start_date=2024-05-26 00:24:00.284164+00:00, run_end_date=2024-05-26 00:24:02.074586+00:00, run_duration=1.790422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:22:00+00:00, data_interval_end=2024-05-26 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:24:02.085927842Z [2024-05-26T00:24:02.085+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:24:00+00:00, run_after=2024-05-26T00:26:00+00:00 2024-05-26T00:24:02.095051977Z [2024-05-26T00:24:02.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:24:02.095239507Z [2024-05-26T00:24:02.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:23:00+00:00, run_id=scheduled__2024-05-26T00:23:00+00:00, run_start_date=2024-05-26 00:24:00.288224+00:00, run_end_date=2024-05-26 00:24:02.094968+00:00, run_duration=1.806744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:23:00+00:00, data_interval_end=2024-05-26 00:24:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:24:02.107466520Z [2024-05-26T00:24:02.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:24:00+00:00, run_after=2024-05-26T00:25:00+00:00 2024-05-26T00:24:02.172157712Z [2024-05-26T00:24:02.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:22:00+00:00 exited with status success for try_number 1 2024-05-26T00:24:02.172186981Z [2024-05-26T00:24:02.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:23:00+00:00 exited with status success for try_number 1 2024-05-26T00:24:02.181255025Z [2024-05-26T00:24:02.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:22:00+00:00, map_index=-1, run_start_date=2024-05-26 00:24:01.263266+00:00, run_end_date=2024-05-26 00:24:01.694964+00:00, run_duration=0.431698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:24:00.395953+00:00, queued_by_job_id=1, pid=6724 2024-05-26T00:24:02.181364400Z [2024-05-26T00:24:02.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:23:00+00:00, map_index=-1, run_start_date=2024-05-26 00:24:01.496924+00:00, run_end_date=2024-05-26 00:24:01.950043+00:00, run_duration=0.453119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:24:00.395953+00:00, queued_by_job_id=1, pid=6725 2024-05-26T00:24:04.026501275Z [2024-05-26T00:24:04.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:24:04.026876253Z [2024-05-26T00:24:04.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:23:00+00:00, run_id=scheduled__2024-05-26T00:23:00+00:00, run_start_date=2024-05-26 00:24:00.291963+00:00, run_end_date=2024-05-26 00:24:04.026307+00:00, run_duration=3.734344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:23:00+00:00, data_interval_end=2024-05-26 00:24:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:24:04.040652219Z [2024-05-26T00:24:04.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:24:00+00:00, run_after=2024-05-26T00:25:00+00:00 2024-05-26T00:24:04.093366718Z [2024-05-26T00:24:04.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:23:00+00:00 exited with status success for try_number 1 2024-05-26T00:24:04.102099515Z [2024-05-26T00:24:04.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:23:00+00:00, map_index=-1, run_start_date=2024-05-26 00:24:02.530730+00:00, run_end_date=2024-05-26 00:24:03.821650+00:00, run_duration=1.29092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:24:00.395953+00:00, queued_by_job_id=1, pid=6748 2024-05-26T00:24:05.163089031Z [2024-05-26T00:24:05.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:24:05.164397208Z [2024-05-26T00:24:05.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:23:00+00:00, run_id=scheduled__2024-05-26T00:23:00+00:00, run_start_date=2024-05-26 00:24:00.294190+00:00, run_end_date=2024-05-26 00:24:05.163322+00:00, run_duration=4.869132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:23:00+00:00, data_interval_end=2024-05-26 00:24:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:24:05.183172022Z [2024-05-26T00:24:05.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:24:00+00:00, run_after=2024-05-26T00:25:00+00:00 2024-05-26T00:24:05.223000011Z [2024-05-26T00:24:05.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:23:00+00:00 exited with status success for try_number 1 2024-05-26T00:24:05.232661930Z [2024-05-26T00:24:05.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:23:00+00:00, map_index=-1, run_start_date=2024-05-26 00:24:02.726742+00:00, run_end_date=2024-05-26 00:24:04.656819+00:00, run_duration=1.930077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:24:00.395953+00:00, queued_by_job_id=1, pid=6749 2024-05-26T00:25:00.228532968Z [2024-05-26T00:25:00.226+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:25:00.245505724Z [2024-05-26T00:25:00.245+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:25:00+00:00, run_after=2024-05-26T00:26:00+00:00 2024-05-26T00:25:00.261393149Z [2024-05-26T00:25:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:25:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:25:00.288977137Z [2024-05-26T00:25:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:25:00+00:00, run_after=2024-05-26T00:26:00+00:00 2024-05-26T00:25:00.407014415Z [2024-05-26T00:25:00.406+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:25:00.407052970Z 2024-05-26T00:25:00.407060977Z 2024-05-26T00:25:00.407067576Z 2024-05-26T00:25:00.407074109Z 2024-05-26T00:25:00.407502235Z [2024-05-26T00:25:00.407+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:25:00.408010785Z [2024-05-26T00:25:00.407+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:25:00.408326152Z [2024-05-26T00:25:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:25:00.408697720Z [2024-05-26T00:25:00.408+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:25:00.409918021Z [2024-05-26T00:25:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:25:00.409940326Z 2024-05-26T00:25:00.409947732Z 2024-05-26T00:25:00.409954288Z 2024-05-26T00:25:00.409960906Z 2024-05-26T00:25:00.415883001Z [2024-05-26T00:25:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:25:00.416354356Z [2024-05-26T00:25:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:25:00.416832260Z [2024-05-26T00:25:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:25:00.417186975Z [2024-05-26T00:25:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:25:00.417660466Z [2024-05-26T00:25:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:25:00.418001277Z [2024-05-26T00:25:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:25:00.418463561Z [2024-05-26T00:25:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:25:00.418795909Z [2024-05-26T00:25:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:25:00.794147066Z [2024-05-26T00:25:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:25:00.794363563Z [2024-05-26T00:25:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status queued for try_number 1 2024-05-26T00:25:00.794488312Z [2024-05-26T00:25:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status queued for try_number 1 2024-05-26T00:25:00.794594431Z [2024-05-26T00:25:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status queued for try_number 1 2024-05-26T00:25:00.813680630Z [2024-05-26T00:25:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to 525355ae-4715-43b1-ac5b-437d8631c21d 2024-05-26T00:25:00.813877713Z [2024-05-26T00:25:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to 741a6fb0-d8dd-47e2-9fae-ef3cce687c96 2024-05-26T00:25:00.813974435Z [2024-05-26T00:25:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7952c722-1e69-49a9-b5d0-e50b076b7dba 2024-05-26T00:25:00.814147800Z [2024-05-26T00:25:00.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to a478c9bf-273a-458f-b353-ed83ac533110 2024-05-26T00:25:02.565157776Z [2024-05-26T00:25:02.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:25:02.568236869Z [2024-05-26T00:25:02.567+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:24:00+00:00, run_id=scheduled__2024-05-26T00:24:00+00:00, run_start_date=2024-05-26 00:25:00.307305+00:00, run_end_date=2024-05-26 00:25:02.567762+00:00, run_duration=2.260457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:24:00+00:00, data_interval_end=2024-05-26 00:25:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:25:02.600160559Z [2024-05-26T00:25:02.599+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:25:00+00:00, run_after=2024-05-26T00:26:00+00:00 2024-05-26T00:25:02.701873525Z [2024-05-26T00:25:02.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status success for try_number 1 2024-05-26T00:25:02.708377853Z [2024-05-26T00:25:02.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:24:00+00:00, map_index=-1, run_start_date=2024-05-26 00:25:01.330417+00:00, run_end_date=2024-05-26 00:25:01.704330+00:00, run_duration=0.373913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:25:00.411605+00:00, queued_by_job_id=1, pid=6782 2024-05-26T00:25:03.217496004Z [2024-05-26T00:25:03.214+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:25:03.217524183Z 2024-05-26T00:25:03.217530326Z [2024-05-26T00:25:03.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:25:03.217545645Z [2024-05-26T00:25:03.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:25:03.217550659Z 2024-05-26T00:25:03.218859986Z [2024-05-26T00:25:03.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:25:03.218964666Z [2024-05-26T00:25:03.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:25:03.264046526Z [2024-05-26T00:25:03.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:25:03.264191203Z [2024-05-26T00:25:03.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:25:03.275875610Z [2024-05-26T00:25:03.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a7c4b55-e8c4-498e-af1f-62e6a62a718a 2024-05-26T00:25:03.276086187Z [2024-05-26T00:25:03.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=-1, run_start_date=2024-05-26 00:25:02.560859+00:00, run_end_date=2024-05-26 00:25:02.981200+00:00, run_duration=0.420341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:25:00.411605+00:00, queued_by_job_id=1, pid=6808 2024-05-26T00:25:04.565793314Z [2024-05-26T00:25:04.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:25:04.566158547Z [2024-05-26T00:25:04.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:24:00+00:00, run_id=scheduled__2024-05-26T00:24:00+00:00, run_start_date=2024-05-26 00:25:00.309707+00:00, run_end_date=2024-05-26 00:25:04.565825+00:00, run_duration=4.256118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:24:00+00:00, data_interval_end=2024-05-26 00:25:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:25:04.576399831Z [2024-05-26T00:25:04.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:25:00+00:00, run_after=2024-05-26T00:26:00+00:00 2024-05-26T00:25:04.583501823Z [2024-05-26T00:25:04.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:25:04.583874074Z [2024-05-26T00:25:04.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:24:00+00:00, run_id=scheduled__2024-05-26T00:24:00+00:00, run_start_date=2024-05-26 00:25:00.311599+00:00, run_end_date=2024-05-26 00:25:04.583536+00:00, run_duration=4.271937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:24:00+00:00, data_interval_end=2024-05-26 00:25:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:25:04.596217805Z [2024-05-26T00:25:04.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:25:00+00:00, run_after=2024-05-26T00:26:00+00:00 2024-05-26T00:25:04.646564316Z [2024-05-26T00:25:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status success for try_number 1 2024-05-26T00:25:04.646932752Z [2024-05-26T00:25:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status success for try_number 1 2024-05-26T00:25:04.655795568Z [2024-05-26T00:25:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:24:00+00:00, map_index=-1, run_start_date=2024-05-26 00:25:02.481607+00:00, run_end_date=2024-05-26 00:25:03.780131+00:00, run_duration=1.298524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:25:00.411605+00:00, queued_by_job_id=1, pid=6806 2024-05-26T00:25:04.656195679Z [2024-05-26T00:25:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:24:00+00:00, map_index=-1, run_start_date=2024-05-26 00:25:02.529581+00:00, run_end_date=2024-05-26 00:25:04.196262+00:00, run_duration=1.666681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:25:00.411605+00:00, queued_by_job_id=1, pid=6807 2024-05-26T00:25:05.787377160Z [2024-05-26T00:25:05.786+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:25:05.787411588Z 2024-05-26T00:25:05.787807675Z [2024-05-26T00:25:05.787+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:25:05.788807247Z [2024-05-26T00:25:05.788+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:25:05.788819358Z 2024-05-26T00:25:05.792665008Z [2024-05-26T00:25:05.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:25:05.793093737Z [2024-05-26T00:25:05.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:25:05.906354686Z [2024-05-26T00:25:05.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:25:05.906756693Z [2024-05-26T00:25:05.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:25:05.921260148Z [2024-05-26T00:25:05.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to 857d4586-43c0-408c-a4ef-305f302ee4f9 2024-05-26T00:25:05.921755444Z [2024-05-26T00:25:05.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=-1, run_start_date=2024-05-26 00:25:04.993506+00:00, run_end_date=2024-05-26 00:25:05.326588+00:00, run_duration=0.333082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:25:03.216054+00:00, queued_by_job_id=1, pid=6831 2024-05-26T00:25:08.192210289Z [2024-05-26T00:25:08.191+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:25:08.192259580Z 2024-05-26T00:25:08.192298563Z [2024-05-26T00:25:08.191+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:25:08.193521392Z [2024-05-26T00:25:08.193+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:25:08.193547221Z 2024-05-26T00:25:08.197518775Z [2024-05-26T00:25:08.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:25:08.197843948Z [2024-05-26T00:25:08.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:25:08.272556202Z [2024-05-26T00:25:08.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status queued for try_number 1 2024-05-26T00:25:08.273155395Z [2024-05-26T00:25:08.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:25:08.289977487Z [2024-05-26T00:25:08.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05689ee8-3421-481c-aa93-44d6013999e2 2024-05-26T00:25:08.290157143Z [2024-05-26T00:25:08.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=0, run_start_date=2024-05-26 00:25:07.510093+00:00, run_end_date=2024-05-26 00:25:07.960938+00:00, run_duration=0.450845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:25:05.789426+00:00, queued_by_job_id=1, pid=6839 2024-05-26T00:25:10.603931482Z [2024-05-26T00:25:10.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:25:10.604284367Z [2024-05-26T00:25:10.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:20:00+00:00, run_id=scheduled__2024-05-26T00:20:00+00:00, run_start_date=2024-05-26 00:25:00.303962+00:00, run_end_date=2024-05-26 00:25:10.603819+00:00, run_duration=10.299857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:20:00+00:00, data_interval_end=2024-05-26 00:25:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:25:10.611166885Z [2024-05-26T00:25:10.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:25:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:25:10.646498593Z [2024-05-26T00:25:10.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:20:00+00:00 exited with status success for try_number 1 2024-05-26T00:25:10.651260815Z [2024-05-26T00:25:10.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:20:00+00:00, map_index=-1, run_start_date=2024-05-26 00:25:09.875413+00:00, run_end_date=2024-05-26 00:25:10.295936+00:00, run_duration=0.420523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:25:08.194210+00:00, queued_by_job_id=1, pid=6847 2024-05-26T00:26:00.213430454Z [2024-05-26T00:26:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:27:00+00:00 2024-05-26T00:26:00.224369183Z [2024-05-26T00:26:00.223+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:26:00.239444332Z [2024-05-26T00:26:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:27:00+00:00 2024-05-26T00:26:00.249278456Z [2024-05-26T00:26:00.248+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:26:00.368951259Z [2024-05-26T00:26:00.368+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:26:00.368990041Z 2024-05-26T00:26:00.369002077Z 2024-05-26T00:26:00.369010140Z 2024-05-26T00:26:00.369017061Z 2024-05-26T00:26:00.369334739Z [2024-05-26T00:26:00.368+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:26:00.369444328Z [2024-05-26T00:26:00.369+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:26:00.369628683Z [2024-05-26T00:26:00.369+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:26:00.369855724Z [2024-05-26T00:26:00.369+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:26:00.371060637Z [2024-05-26T00:26:00.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:26:00.371185140Z 2024-05-26T00:26:00.371195589Z 2024-05-26T00:26:00.371203545Z 2024-05-26T00:26:00.371210633Z 2024-05-26T00:26:00.378554746Z [2024-05-26T00:26:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:26:00.378706575Z [2024-05-26T00:26:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:26:00.379169976Z [2024-05-26T00:26:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:26:00.379395157Z [2024-05-26T00:26:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:26:00.379736524Z [2024-05-26T00:26:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:26:00.379922971Z [2024-05-26T00:26:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:26:00.380264758Z [2024-05-26T00:26:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:26:00.380559611Z [2024-05-26T00:26:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:26:00.656591169Z [2024-05-26T00:26:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status queued for try_number 1 2024-05-26T00:26:00.656764227Z [2024-05-26T00:26:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:26:00.656790779Z [2024-05-26T00:26:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:26:00.656839199Z [2024-05-26T00:26:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:26:00.674627700Z [2024-05-26T00:26:00.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78da93b5-c105-4cad-a8ba-c615f4e86090 2024-05-26T00:26:00.675100157Z [2024-05-26T00:26:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e588b13-2cd2-46fd-bce7-458382e8a9af 2024-05-26T00:26:00.675637893Z [2024-05-26T00:26:00.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed6060de-d365-40e7-8ae2-fa2e4ab0f96b 2024-05-26T00:26:00.676031146Z [2024-05-26T00:26:00.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 799e892e-b36d-4bfa-a141-1c906276473d 2024-05-26T00:26:01.917289653Z [2024-05-26T00:26:01.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:26:01.917456940Z [2024-05-26T00:26:01.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:24:00+00:00, run_id=scheduled__2024-05-26T00:24:00+00:00, run_start_date=2024-05-26 00:26:00.262105+00:00, run_end_date=2024-05-26 00:26:01.917129+00:00, run_duration=1.655024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:24:00+00:00, data_interval_end=2024-05-26 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:26:01.930935225Z [2024-05-26T00:26:01.930+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:26:01.937347867Z [2024-05-26T00:26:01.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:26:01.937483754Z [2024-05-26T00:26:01.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:25:00+00:00, run_id=scheduled__2024-05-26T00:25:00+00:00, run_start_date=2024-05-26 00:26:00.263753+00:00, run_end_date=2024-05-26 00:26:01.937149+00:00, run_duration=1.673396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:25:00+00:00, data_interval_end=2024-05-26 00:26:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:26:01.947210124Z [2024-05-26T00:26:01.946+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:27:00+00:00 2024-05-26T00:26:01.998600316Z [2024-05-26T00:26:01.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:24:00+00:00 exited with status success for try_number 1 2024-05-26T00:26:01.998878492Z [2024-05-26T00:26:01.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:26:02.011295292Z [2024-05-26T00:26:02.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=-1, run_start_date=2024-05-26 00:26:01.344368+00:00, run_end_date=2024-05-26 00:26:01.784202+00:00, run_duration=0.439834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:26:00.373066+00:00, queued_by_job_id=1, pid=6871 2024-05-26T00:26:02.011554571Z [2024-05-26T00:26:02.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:24:00+00:00, map_index=-1, run_start_date=2024-05-26 00:26:01.256503+00:00, run_end_date=2024-05-26 00:26:01.736835+00:00, run_duration=0.480332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:26:00.373066+00:00, queued_by_job_id=1, pid=6870 2024-05-26T00:26:05.314722996Z [2024-05-26T00:26:05.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:26:05.315291529Z [2024-05-26T00:26:05.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:25:00+00:00, run_id=scheduled__2024-05-26T00:25:00+00:00, run_start_date=2024-05-26 00:26:00.265245+00:00, run_end_date=2024-05-26 00:26:05.314611+00:00, run_duration=5.049366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:25:00+00:00, data_interval_end=2024-05-26 00:26:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:26:05.333829299Z [2024-05-26T00:26:05.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:27:00+00:00 2024-05-26T00:26:05.358627413Z [2024-05-26T00:26:05.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:26:05.359172102Z [2024-05-26T00:26:05.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:25:00+00:00, run_id=scheduled__2024-05-26T00:25:00+00:00, run_start_date=2024-05-26 00:26:00.266781+00:00, run_end_date=2024-05-26 00:26:05.358687+00:00, run_duration=5.091906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:25:00+00:00, data_interval_end=2024-05-26 00:26:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:26:05.374039394Z [2024-05-26T00:26:05.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:27:00+00:00 2024-05-26T00:26:05.450880300Z [2024-05-26T00:26:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:26:05.450914372Z [2024-05-26T00:26:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:26:05.460684528Z [2024-05-26T00:26:05.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=-1, run_start_date=2024-05-26 00:26:02.714953+00:00, run_end_date=2024-05-26 00:26:04.558769+00:00, run_duration=1.843816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:26:00.373066+00:00, queued_by_job_id=1, pid=6895 2024-05-26T00:26:05.460891683Z [2024-05-26T00:26:05.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=-1, run_start_date=2024-05-26 00:26:02.467985+00:00, run_end_date=2024-05-26 00:26:04.829963+00:00, run_duration=2.361978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:26:00.373066+00:00, queued_by_job_id=1, pid=6894 2024-05-26T00:26:43.387681709Z [2024-05-26T00:26:43.386+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:27:00+00:00 2024-05-26T00:26:43.443427062Z [2024-05-26T00:26:43.442+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:26:43.443461912Z 2024-05-26T00:26:43.443879696Z [2024-05-26T00:26:43.443+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 has 0/16 running and queued tasks 2024-05-26T00:26:43.445276169Z [2024-05-26T00:26:43.444+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:26:43.445290209Z 2024-05-26T00:26:43.449510557Z [2024-05-26T00:26:43.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:26:43.450200088Z [2024-05-26T00:26:43.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:26:43.511959608Z [2024-05-26T00:26:43.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:26:43.519545045Z [2024-05-26T00:26:43.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a3f12ac-c171-4896-b05e-ee4a6405ecfe 2024-05-26T00:26:44.915980526Z [2024-05-26T00:26:44.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:26:44.916188931Z [2024-05-26T00:26:44.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, execution_date=2024-05-26 00:25:00+00:00, run_id=scheduled__2024-05-26T00:25:00+00:00, run_start_date=2024-05-26 00:26:43.399214+00:00, run_end_date=2024-05-26 00:26:44.915655+00:00, run_duration=1.516441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:25:00+00:00, data_interval_end=2024-05-26 00:26:00+00:00, dag_hash=a5a6a1feb641b658154ee4f3e90cf0ec 2024-05-26T00:26:44.926855322Z [2024-05-26T00:26:44.926+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 to 2024-05-26T00:26:00+00:00, run_after=2024-05-26T00:27:00+00:00 2024-05-26T00:26:44.960976318Z [2024-05-26T00:26:44.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:26:44.971206068Z [2024-05-26T00:26:44.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=-1, run_start_date=2024-05-26 00:26:44.131391+00:00, run_end_date=2024-05-26 00:26:44.561723+00:00, run_duration=0.430332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:26:43.446040+00:00, queued_by_job_id=1, pid=6926 2024-05-26T00:27:00.206201189Z [2024-05-26T00:27:00.205+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:27:00.227870973Z [2024-05-26T00:27:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:27:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:27:00.243724700Z [2024-05-26T00:27:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:27:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:27:00.258100616Z [2024-05-26T00:27:00.257+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 to 2024-05-26T00:27:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:27:00.392552321Z [2024-05-26T00:27:00.392+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:27:00.392580268Z 2024-05-26T00:27:00.392585578Z 2024-05-26T00:27:00.392590382Z 2024-05-26T00:27:00.392594713Z 2024-05-26T00:27:00.392789519Z [2024-05-26T00:27:00.392+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:27:00.393078485Z [2024-05-26T00:27:00.392+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 has 0/16 running and queued tasks 2024-05-26T00:27:00.393397010Z [2024-05-26T00:27:00.392+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:27:00.393717252Z [2024-05-26T00:27:00.393+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:27:00.394470929Z [2024-05-26T00:27:00.394+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:27:00.394486163Z 2024-05-26T00:27:00.394491962Z 2024-05-26T00:27:00.394497746Z 2024-05-26T00:27:00.394503334Z 2024-05-26T00:27:00.399338339Z [2024-05-26T00:27:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:27:00.399354664Z [2024-05-26T00:27:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:27:00.399762999Z [2024-05-26T00:27:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:27:00.399993853Z [2024-05-26T00:27:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:27:00.400410847Z [2024-05-26T00:27:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:27:00.400440897Z [2024-05-26T00:27:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:27:00.400779156Z [2024-05-26T00:27:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:27:00.400798125Z [2024-05-26T00:27:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:27:00.832685772Z [2024-05-26T00:27:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status queued for try_number 1 2024-05-26T00:27:00.832932245Z [2024-05-26T00:27:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status queued for try_number 1 2024-05-26T00:27:00.833067174Z [2024-05-26T00:27:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status queued for try_number 1 2024-05-26T00:27:00.833195430Z [2024-05-26T00:27:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status queued for try_number 1 2024-05-26T00:27:00.848858241Z [2024-05-26T00:27:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3f15b21-7926-40b6-9ebd-a416057c24e3 2024-05-26T00:27:00.849033119Z [2024-05-26T00:27:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8319a46b-2f04-474f-99a0-68052addbd00 2024-05-26T00:27:00.849208288Z [2024-05-26T00:27:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3117aa51-5f7a-4748-8841-a4b28a7509da 2024-05-26T00:27:00.849398461Z [2024-05-26T00:27:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0768efda-3cb6-4039-964e-dec874108ce1 2024-05-26T00:27:02.290258477Z [2024-05-26T00:27:02.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status success for try_number 1 2024-05-26T00:27:02.301127103Z [2024-05-26T00:27:02.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:26:00+00:00, map_index=-1, run_start_date=2024-05-26 00:27:01.594702+00:00, run_end_date=2024-05-26 00:27:02.052949+00:00, run_duration=0.458247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:27:00.395583+00:00, queued_by_job_id=1, pid=6946 2024-05-26T00:27:02.459127515Z [2024-05-26T00:27:02.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:27:02.459465339Z [2024-05-26T00:27:02.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:26:00+00:00, run_id=scheduled__2024-05-26T00:26:00+00:00, run_start_date=2024-05-26 00:27:00.272566+00:00, run_end_date=2024-05-26 00:27:02.459132+00:00, run_duration=2.186566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:26:00+00:00, data_interval_end=2024-05-26 00:27:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:27:02.467948783Z [2024-05-26T00:27:02.467+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:27:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:27:02.474746286Z [2024-05-26T00:27:02.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:27:02.474992408Z [2024-05-26T00:27:02.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, execution_date=2024-05-26 00:26:00+00:00, run_id=scheduled__2024-05-26T00:26:00+00:00, run_start_date=2024-05-26 00:27:00.274073+00:00, run_end_date=2024-05-26 00:27:02.474742+00:00, run_duration=2.200669, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:26:00+00:00, data_interval_end=2024-05-26 00:27:00+00:00, dag_hash=a5a6a1feb641b658154ee4f3e90cf0ec 2024-05-26T00:27:02.485004527Z [2024-05-26T00:27:02.484+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 to 2024-05-26T00:27:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:27:02.631253874Z [2024-05-26T00:27:02.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status success for try_number 1 2024-05-26T00:27:02.641698212Z [2024-05-26T00:27:02.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:26:00+00:00, map_index=-1, run_start_date=2024-05-26 00:27:01.670086+00:00, run_end_date=2024-05-26 00:27:02.314811+00:00, run_duration=0.644725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:27:00.395583+00:00, queued_by_job_id=1, pid=6947 2024-05-26T00:27:04.985339220Z [2024-05-26T00:27:04.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:27:04.985773578Z [2024-05-26T00:27:04.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:26:00+00:00, run_id=scheduled__2024-05-26T00:26:00+00:00, run_start_date=2024-05-26 00:27:00.275406+00:00, run_end_date=2024-05-26 00:27:04.985259+00:00, run_duration=4.709853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:26:00+00:00, data_interval_end=2024-05-26 00:27:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:27:05.005048916Z [2024-05-26T00:27:05.004+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:27:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:27:05.047751743Z [2024-05-26T00:27:05.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status success for try_number 1 2024-05-26T00:27:05.053399005Z [2024-05-26T00:27:05.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:26:00+00:00, map_index=-1, run_start_date=2024-05-26 00:27:02.655474+00:00, run_end_date=2024-05-26 00:27:03.997367+00:00, run_duration=1.341893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:27:00.395583+00:00, queued_by_job_id=1, pid=6970 2024-05-26T00:27:05.961713877Z [2024-05-26T00:27:05.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:27:05.962189961Z [2024-05-26T00:27:05.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:26:00+00:00, run_id=scheduled__2024-05-26T00:26:00+00:00, run_start_date=2024-05-26 00:27:00.276995+00:00, run_end_date=2024-05-26 00:27:05.961561+00:00, run_duration=5.684566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:26:00+00:00, data_interval_end=2024-05-26 00:27:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:27:05.974253529Z [2024-05-26T00:27:05.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:27:00+00:00, run_after=2024-05-26T00:28:00+00:00 2024-05-26T00:27:06.054190767Z [2024-05-26T00:27:06.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status success for try_number 1 2024-05-26T00:27:06.059360530Z [2024-05-26T00:27:06.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:26:00+00:00, map_index=-1, run_start_date=2024-05-26 00:27:02.808977+00:00, run_end_date=2024-05-26 00:27:05.245089+00:00, run_duration=2.436112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:27:00.395583+00:00, queued_by_job_id=1, pid=6971 2024-05-26T00:28:01.112977066Z [2024-05-26T00:28:01.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:28:01.127491930Z [2024-05-26T00:28:01.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:29:00+00:00 2024-05-26T00:28:01.142153985Z [2024-05-26T00:28:01.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:29:00+00:00 2024-05-26T00:28:01.151100058Z [2024-05-26T00:28:01.150+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:28:01.165479807Z [2024-05-26T00:28:01.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:29:00+00:00 2024-05-26T00:28:01.323218713Z [2024-05-26T00:28:01.322+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T00:28:01.323252833Z 2024-05-26T00:28:01.323287122Z 2024-05-26T00:28:01.323294185Z 2024-05-26T00:28:01.323300647Z 2024-05-26T00:28:01.323307016Z 2024-05-26T00:28:01.323577629Z [2024-05-26T00:28:01.323+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:28:01.323872859Z [2024-05-26T00:28:01.323+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:28:01.324161539Z [2024-05-26T00:28:01.323+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 has 0/16 running and queued tasks 2024-05-26T00:28:01.324411459Z [2024-05-26T00:28:01.324+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:28:01.324620206Z [2024-05-26T00:28:01.324+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:28:01.325898680Z [2024-05-26T00:28:01.325+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:28:01.325920506Z 2024-05-26T00:28:01.325928824Z 2024-05-26T00:28:01.325935511Z 2024-05-26T00:28:01.325941934Z 2024-05-26T00:28:01.325948753Z 2024-05-26T00:28:01.333076191Z [2024-05-26T00:28:01.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:28:01.333438520Z [2024-05-26T00:28:01.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:28:01.333857387Z [2024-05-26T00:28:01.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:28:01.334161812Z [2024-05-26T00:28:01.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:28:01.334526562Z [2024-05-26T00:28:01.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:28:01.334778213Z [2024-05-26T00:28:01.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:28:01.335651749Z [2024-05-26T00:28:01.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:28:01.335941389Z [2024-05-26T00:28:01.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:28:01.336314014Z [2024-05-26T00:28:01.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:28:01.337103127Z [2024-05-26T00:28:01.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:28:01.892672560Z [2024-05-26T00:28:01.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status queued for try_number 1 2024-05-26T00:28:01.892724267Z [2024-05-26T00:28:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status queued for try_number 1 2024-05-26T00:28:01.892801321Z [2024-05-26T00:28:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status queued for try_number 1 2024-05-26T00:28:01.892953501Z [2024-05-26T00:28:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status queued for try_number 1 2024-05-26T00:28:01.892986971Z [2024-05-26T00:28:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status queued for try_number 1 2024-05-26T00:28:01.904978140Z [2024-05-26T00:28:01.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to db4fd833-f849-414b-b6fa-c2f7da0be61b 2024-05-26T00:28:01.905087809Z [2024-05-26T00:28:01.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 867f7e11-8542-4a38-9013-1a4a18fac89a 2024-05-26T00:28:01.905231092Z [2024-05-26T00:28:01.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa875bb6-02c8-499f-bcdd-d7596171218c 2024-05-26T00:28:01.905346046Z [2024-05-26T00:28:01.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to d89c4db7-6e0e-4102-b840-cbdb9f2a2c05 2024-05-26T00:28:01.905454440Z [2024-05-26T00:28:01.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92057c4f-cd67-4db2-a6da-fd18cd9650c6 2024-05-26T00:28:02.068457495Z [2024-05-26T00:28:02.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status failed for try_number 1 2024-05-26T00:28:02.080452221Z [2024-05-26T00:28:02.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:27:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:28:01.328504+00:00, queued_by_job_id=1, pid=None 2024-05-26T00:28:02.080919396Z [2024-05-26T00:28:02.080+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T00:28:02.083900177Z [2024-05-26T00:28:02.083+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T00:28:02.104986083Z [2024-05-26T00:28:02.104+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240526T002700, start_date=, end_date=20240526T002802 2024-05-26T00:28:03.113402852Z [2024-05-26T00:28:03.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:28:03.113602378Z [2024-05-26T00:28:03.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:26:00+00:00, run_id=scheduled__2024-05-26T00:26:00+00:00, run_start_date=2024-05-26 00:28:01.191355+00:00, run_end_date=2024-05-26 00:28:03.113290+00:00, run_duration=1.921935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:26:00+00:00, data_interval_end=2024-05-26 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:28:03.122309094Z [2024-05-26T00:28:03.122+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:28:03.133428116Z [2024-05-26T00:28:03.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:28:03.133559058Z [2024-05-26T00:28:03.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:27:00+00:00, run_id=scheduled__2024-05-26T00:27:00+00:00, run_start_date=2024-05-26 00:28:01.194852+00:00, run_end_date=2024-05-26 00:28:03.133318+00:00, run_duration=1.938466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:27:00+00:00, data_interval_end=2024-05-26 00:28:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:28:03.142955818Z [2024-05-26T00:28:03.142+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:29:00+00:00 2024-05-26T00:28:04.328440297Z [2024-05-26T00:28:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:26:00+00:00 exited with status success for try_number 1 2024-05-26T00:28:04.328499611Z [2024-05-26T00:28:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status success for try_number 1 2024-05-26T00:28:04.354942102Z [2024-05-26T00:28:04.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:26:00+00:00, map_index=-1, run_start_date=2024-05-26 00:28:02.534320+00:00, run_end_date=2024-05-26 00:28:03.081019+00:00, run_duration=0.546699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:28:01.328504+00:00, queued_by_job_id=1, pid=7016 2024-05-26T00:28:04.355066840Z [2024-05-26T00:28:04.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:27:00+00:00, map_index=-1, run_start_date=2024-05-26 00:28:02.624018+00:00, run_end_date=2024-05-26 00:28:03.112024+00:00, run_duration=0.488006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:28:01.328504+00:00, queued_by_job_id=1, pid=7017 2024-05-26T00:28:06.512207466Z [2024-05-26T00:28:06.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:28:06.512335910Z [2024-05-26T00:28:06.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:27:00+00:00, run_id=scheduled__2024-05-26T00:27:00+00:00, run_start_date=2024-05-26 00:28:01.200959+00:00, run_end_date=2024-05-26 00:28:06.512046+00:00, run_duration=5.311087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:27:00+00:00, data_interval_end=2024-05-26 00:28:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:28:06.520612192Z [2024-05-26T00:28:06.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:29:00+00:00 2024-05-26T00:28:06.526415331Z [2024-05-26T00:28:06.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:28:06.526584980Z [2024-05-26T00:28:06.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:27:00+00:00, run_id=scheduled__2024-05-26T00:27:00+00:00, run_start_date=2024-05-26 00:28:01.203208+00:00, run_end_date=2024-05-26 00:28:06.526127+00:00, run_duration=5.322919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:27:00+00:00, data_interval_end=2024-05-26 00:28:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:28:06.535069681Z [2024-05-26T00:28:06.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:29:00+00:00 2024-05-26T00:28:06.642418200Z [2024-05-26T00:28:06.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status success for try_number 1 2024-05-26T00:28:06.642613980Z [2024-05-26T00:28:06.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status success for try_number 1 2024-05-26T00:28:06.651273980Z [2024-05-26T00:28:06.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:27:00+00:00, map_index=-1, run_start_date=2024-05-26 00:28:04.082666+00:00, run_end_date=2024-05-26 00:28:05.532351+00:00, run_duration=1.449685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:28:01.328504+00:00, queued_by_job_id=1, pid=7041 2024-05-26T00:28:06.651800040Z [2024-05-26T00:28:06.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:27:00+00:00, map_index=-1, run_start_date=2024-05-26 00:28:03.906415+00:00, run_end_date=2024-05-26 00:28:05.775429+00:00, run_duration=1.869014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:28:01.328504+00:00, queued_by_job_id=1, pid=7040 2024-05-26T00:28:13.198053426Z [2024-05-26T00:28:13.197+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:28:13.198101162Z 2024-05-26T00:28:13.198181584Z [2024-05-26T00:28:13.197+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 has 0/16 running and queued tasks 2024-05-26T00:28:13.198881238Z [2024-05-26T00:28:13.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:28:13.198890418Z 2024-05-26T00:28:13.201446423Z [2024-05-26T00:28:13.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:27:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:28:13.201602270Z [2024-05-26T00:28:13.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:28:13.258161364Z [2024-05-26T00:28:13.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status queued for try_number 2 2024-05-26T00:28:13.265682717Z [2024-05-26T00:28:13.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to a36401ab-12d4-4501-8c10-5b085f12c125 2024-05-26T00:28:14.524638320Z [2024-05-26T00:28:14.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:27:00+00:00 exited with status failed for try_number 2 2024-05-26T00:28:14.529947332Z [2024-05-26T00:28:14.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:27:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-26 00:28:02.087085+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:28:13.199236+00:00, queued_by_job_id=1, pid=None 2024-05-26T00:28:14.529972133Z [2024-05-26T00:28:14.529+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T00:28:14.532376173Z [2024-05-26T00:28:14.531+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T00:28:14.544490332Z [2024-05-26T00:28:14.543+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240526T002700, start_date=, end_date=20240526T002814 2024-05-26T00:28:15.628826043Z [2024-05-26T00:28:15.628+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-26T00:28:15.629179915Z [2024-05-26T00:28:15.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, execution_date=2024-05-26 00:27:00+00:00, run_id=scheduled__2024-05-26T00:27:00+00:00, run_start_date=2024-05-26 00:28:01.198297+00:00, run_end_date=2024-05-26 00:28:15.628734+00:00, run_duration=14.430437, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:27:00+00:00, data_interval_end=2024-05-26 00:28:00+00:00, dag_hash=a5a6a1feb641b658154ee4f3e90cf0ec 2024-05-26T00:28:15.637721343Z [2024-05-26T00:28:15.637+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 to 2024-05-26T00:28:00+00:00, run_after=2024-05-26T00:29:00+00:00 2024-05-26T00:28:31.440662893Z [2024-05-26T00:28:31.439+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:29:01.072909398Z [2024-05-26T00:29:01.072+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:29:01.091334576Z [2024-05-26T00:29:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 to 2024-05-26T00:29:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:29:01.104833812Z [2024-05-26T00:29:01.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:29:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:29:01.117191769Z [2024-05-26T00:29:01.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:29:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:29:01.235494867Z [2024-05-26T00:29:01.234+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:29:01.235574073Z 2024-05-26T00:29:01.235584559Z 2024-05-26T00:29:01.235591378Z 2024-05-26T00:29:01.235598267Z 2024-05-26T00:29:01.235699373Z [2024-05-26T00:29:01.235+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:29:01.235922898Z [2024-05-26T00:29:01.235+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330 has 0/16 running and queued tasks 2024-05-26T00:29:01.236294708Z [2024-05-26T00:29:01.235+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:29:01.236495505Z [2024-05-26T00:29:01.236+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:29:01.237510157Z [2024-05-26T00:29:01.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:29:01.237543038Z 2024-05-26T00:29:01.237551507Z 2024-05-26T00:29:01.237558052Z 2024-05-26T00:29:01.237565045Z 2024-05-26T00:29:01.243232532Z [2024-05-26T00:29:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:29:01.243567229Z [2024-05-26T00:29:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:29:01.244038660Z [2024-05-26T00:29:01.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:29:01.244375231Z [2024-05-26T00:29:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:29:01.244836184Z [2024-05-26T00:29:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:29:01.245190448Z [2024-05-26T00:29:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:29:01.245546603Z [2024-05-26T00:29:01.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:29:01.245815426Z [2024-05-26T00:29:01.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:29:01.873105777Z [2024-05-26T00:29:01.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status queued for try_number 1 2024-05-26T00:29:01.873364459Z [2024-05-26T00:29:01.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status queued for try_number 1 2024-05-26T00:29:01.873603355Z [2024-05-26T00:29:01.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status queued for try_number 1 2024-05-26T00:29:01.873746194Z [2024-05-26T00:29:01.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status queued for try_number 1 2024-05-26T00:29:01.888504312Z [2024-05-26T00:29:01.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02147c0a-1fe4-4d67-b562-9f796be243ce 2024-05-26T00:29:01.888688540Z [2024-05-26T00:29:01.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 253fbd6e-d178-45ff-86aa-6bf291e02dd7 2024-05-26T00:29:01.888842096Z [2024-05-26T00:29:01.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fbe8b63-55c2-487e-b05f-909bfa71ddb9 2024-05-26T00:29:01.889009250Z [2024-05-26T00:29:01.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 399618b8-6819-449c-bc71-5c9e53172695 2024-05-26T00:29:02.958583185Z [2024-05-26T00:29:02.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:29:02.959124655Z [2024-05-26T00:29:02.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:28:00+00:00, run_id=scheduled__2024-05-26T00:28:00+00:00, run_start_date=2024-05-26 00:29:01.129194+00:00, run_end_date=2024-05-26 00:29:02.958766+00:00, run_duration=1.829572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:28:00+00:00, data_interval_end=2024-05-26 00:29:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:29:02.970772307Z [2024-05-26T00:29:02.970+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:29:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:29:03.062206971Z [2024-05-26T00:29:03.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status failed for try_number 1 2024-05-26T00:29:03.062247092Z [2024-05-26T00:29:03.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status success for try_number 1 2024-05-26T00:29:03.070631248Z [2024-05-26T00:29:03.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:29:01.238913+00:00, queued_by_job_id=1, pid=None 2024-05-26T00:29:03.071078825Z [2024-05-26T00:29:03.070+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T00:29:03.075034861Z [2024-05-26T00:29:03.074+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T00:29:03.093842593Z [2024-05-26T00:29:03.093+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_70899a71-e430-48c8-a75f-e8e9ee1aa330, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240526T002800, start_date=, end_date=20240526T002903 2024-05-26T00:29:03.105005204Z [2024-05-26T00:29:03.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:28:00+00:00, map_index=-1, run_start_date=2024-05-26 00:29:02.182289+00:00, run_end_date=2024-05-26 00:29:02.634457+00:00, run_duration=0.452168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:29:01.238913+00:00, queued_by_job_id=1, pid=7095 2024-05-26T00:29:05.729900736Z [2024-05-26T00:29:05.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:29:05.730442326Z [2024-05-26T00:29:05.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:28:00+00:00, run_id=scheduled__2024-05-26T00:28:00+00:00, run_start_date=2024-05-26 00:29:01.133908+00:00, run_end_date=2024-05-26 00:29:05.730034+00:00, run_duration=4.596126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:28:00+00:00, data_interval_end=2024-05-26 00:29:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:29:05.742928526Z [2024-05-26T00:29:05.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:29:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:29:05.751466409Z [2024-05-26T00:29:05.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:29:05.751974252Z [2024-05-26T00:29:05.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:28:00+00:00, run_id=scheduled__2024-05-26T00:28:00+00:00, run_start_date=2024-05-26 00:29:01.132319+00:00, run_end_date=2024-05-26 00:29:05.751686+00:00, run_duration=4.619367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:28:00+00:00, data_interval_end=2024-05-26 00:29:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:29:05.763033028Z [2024-05-26T00:29:05.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:29:00+00:00, run_after=2024-05-26T00:30:00+00:00 2024-05-26T00:29:05.814283941Z [2024-05-26T00:29:05.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status success for try_number 1 2024-05-26T00:29:05.814538243Z [2024-05-26T00:29:05.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status success for try_number 1 2024-05-26T00:29:05.823963795Z [2024-05-26T00:29:05.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:28:00+00:00, map_index=-1, run_start_date=2024-05-26 00:29:03.163680+00:00, run_end_date=2024-05-26 00:29:04.753503+00:00, run_duration=1.589823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:29:01.238913+00:00, queued_by_job_id=1, pid=7114 2024-05-26T00:29:05.824401110Z [2024-05-26T00:29:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:28:00+00:00, map_index=-1, run_start_date=2024-05-26 00:29:03.082585+00:00, run_end_date=2024-05-26 00:29:05.170567+00:00, run_duration=2.087982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:29:01.238913+00:00, queued_by_job_id=1, pid=7113 2024-05-26T00:30:00.129456810Z [2024-05-26T00:30:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:31:00+00:00 2024-05-26T00:30:00.137471543Z [2024-05-26T00:30:00.137+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:30:00.143503646Z [2024-05-26T00:30:00.143+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:30:00.162309479Z [2024-05-26T00:30:00.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:35:00+00:00 2024-05-26T00:30:00.180944290Z [2024-05-26T00:30:00.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:31:00+00:00 2024-05-26T00:30:00.282888610Z [2024-05-26T00:30:00.282+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T00:30:00.282921196Z 2024-05-26T00:30:00.282927748Z 2024-05-26T00:30:00.282934301Z 2024-05-26T00:30:00.282940172Z 2024-05-26T00:30:00.282946462Z 2024-05-26T00:30:00.283265750Z [2024-05-26T00:30:00.282+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:30:00.283672573Z [2024-05-26T00:30:00.283+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:30:00.283994013Z [2024-05-26T00:30:00.283+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:30:00.284407494Z [2024-05-26T00:30:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:30:00.284713346Z [2024-05-26T00:30:00.284+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:30:00.285803250Z [2024-05-26T00:30:00.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:30:00.285821914Z 2024-05-26T00:30:00.285828445Z 2024-05-26T00:30:00.285856790Z 2024-05-26T00:30:00.285863135Z 2024-05-26T00:30:00.285868742Z 2024-05-26T00:30:00.293906324Z [2024-05-26T00:30:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:30:00.294173185Z [2024-05-26T00:30:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:30:00.294529764Z [2024-05-26T00:30:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:30:00.294757058Z [2024-05-26T00:30:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:30:00.295099663Z [2024-05-26T00:30:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:30:00.295423745Z [2024-05-26T00:30:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:30:00.295815706Z [2024-05-26T00:30:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:30:00.296232031Z [2024-05-26T00:30:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:30:00.296612582Z [2024-05-26T00:30:00.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:30:00.296850373Z [2024-05-26T00:30:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:30:00.887884065Z [2024-05-26T00:30:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:00.887947849Z [2024-05-26T00:30:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:00.888012276Z [2024-05-26T00:30:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:29:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:00.888061630Z [2024-05-26T00:30:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:29:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:00.888291216Z [2024-05-26T00:30:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:29:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:00.906033388Z [2024-05-26T00:30:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1dd91c0-3706-4bee-8e4f-c4aae978dc2a 2024-05-26T00:30:00.906220443Z [2024-05-26T00:30:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to a15312f4-c3a5-420f-b809-ed34930e7643 2024-05-26T00:30:00.906364082Z [2024-05-26T00:30:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4b1214f-a19f-4e90-9993-c04754a3fd83 2024-05-26T00:30:00.906526906Z [2024-05-26T00:30:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1063b9b6-f6fa-425f-b4bf-6b218d4bcd70 2024-05-26T00:30:00.906630763Z [2024-05-26T00:30:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf1f43c8-6420-4457-b5cf-63e32a8e6f2c 2024-05-26T00:30:02.208792932Z [2024-05-26T00:30:02.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:30:02.209082194Z [2024-05-26T00:30:02.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:28:00+00:00, run_id=scheduled__2024-05-26T00:28:00+00:00, run_start_date=2024-05-26 00:30:00.196510+00:00, run_end_date=2024-05-26 00:30:02.208715+00:00, run_duration=2.012205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:28:00+00:00, data_interval_end=2024-05-26 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:30:02.216781985Z [2024-05-26T00:30:02.216+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:32:00+00:00 2024-05-26T00:30:02.223030857Z [2024-05-26T00:30:02.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:30:02.223137879Z [2024-05-26T00:30:02.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:29:00+00:00, run_id=scheduled__2024-05-26T00:29:00+00:00, run_start_date=2024-05-26 00:30:00.198205+00:00, run_end_date=2024-05-26 00:30:02.222865+00:00, run_duration=2.02466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:29:00+00:00, data_interval_end=2024-05-26 00:30:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:30:02.232107615Z [2024-05-26T00:30:02.231+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:31:00+00:00 2024-05-26T00:30:02.276540585Z [2024-05-26T00:30:02.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:28:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:02.276567186Z [2024-05-26T00:30:02.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:29:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:02.282663314Z [2024-05-26T00:30:02.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:29:00+00:00, map_index=-1, run_start_date=2024-05-26 00:30:01.566204+00:00, run_end_date=2024-05-26 00:30:01.921854+00:00, run_duration=0.35565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:00.289770+00:00, queued_by_job_id=1, pid=7151 2024-05-26T00:30:02.282844703Z [2024-05-26T00:30:02.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:28:00+00:00, map_index=-1, run_start_date=2024-05-26 00:30:01.317489+00:00, run_end_date=2024-05-26 00:30:01.780507+00:00, run_duration=0.463018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:00.289770+00:00, queued_by_job_id=1, pid=7148 2024-05-26T00:30:03.376523910Z [2024-05-26T00:30:03.376+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:30:03.376571090Z 2024-05-26T00:30:03.376662188Z [2024-05-26T00:30:03.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:30:03.377140920Z [2024-05-26T00:30:03.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:30:03.377153990Z 2024-05-26T00:30:03.381248831Z [2024-05-26T00:30:03.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:30:03.381398990Z [2024-05-26T00:30:03.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:30:03.477183162Z [2024-05-26T00:30:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:03.477444083Z [2024-05-26T00:30:03.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:03.483356710Z [2024-05-26T00:30:03.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79acf268-3d2f-4f40-a25e-ea932387810c 2024-05-26T00:30:03.483633625Z [2024-05-26T00:30:03.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=-1, run_start_date=2024-05-26 00:30:02.658225+00:00, run_end_date=2024-05-26 00:30:03.025967+00:00, run_duration=0.367742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:00.289770+00:00, queued_by_job_id=1, pid=7185 2024-05-26T00:30:04.132918838Z [2024-05-26T00:30:04.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:30:04.133352100Z [2024-05-26T00:30:04.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:29:00+00:00, run_id=scheduled__2024-05-26T00:29:00+00:00, run_start_date=2024-05-26 00:30:00.199865+00:00, run_end_date=2024-05-26 00:30:04.132824+00:00, run_duration=3.932959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:29:00+00:00, data_interval_end=2024-05-26 00:30:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:30:04.142463610Z [2024-05-26T00:30:04.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:31:00+00:00 2024-05-26T00:30:04.197846991Z [2024-05-26T00:30:04.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:29:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:04.203310784Z [2024-05-26T00:30:04.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:29:00+00:00, map_index=-1, run_start_date=2024-05-26 00:30:02.370040+00:00, run_end_date=2024-05-26 00:30:03.649067+00:00, run_duration=1.279027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:00.289770+00:00, queued_by_job_id=1, pid=7172 2024-05-26T00:30:04.925464755Z [2024-05-26T00:30:04.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:30:04.925694193Z [2024-05-26T00:30:04.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:29:00+00:00, run_id=scheduled__2024-05-26T00:29:00+00:00, run_start_date=2024-05-26 00:30:00.201349+00:00, run_end_date=2024-05-26 00:30:04.925355+00:00, run_duration=4.724006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:29:00+00:00, data_interval_end=2024-05-26 00:30:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:30:04.935563398Z [2024-05-26T00:30:04.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:31:00+00:00 2024-05-26T00:30:04.979238189Z [2024-05-26T00:30:04.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:29:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:04.987923293Z [2024-05-26T00:30:04.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:29:00+00:00, map_index=-1, run_start_date=2024-05-26 00:30:02.551844+00:00, run_end_date=2024-05-26 00:30:04.134423+00:00, run_duration=1.582579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:00.289770+00:00, queued_by_job_id=1, pid=7179 2024-05-26T00:30:06.062802829Z [2024-05-26T00:30:06.062+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:30:06.062872838Z 2024-05-26T00:30:06.062885099Z [2024-05-26T00:30:06.062+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:30:06.063222352Z [2024-05-26T00:30:06.062+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:30:06.063239757Z 2024-05-26T00:30:06.065436786Z [2024-05-26T00:30:06.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:30:06.065588513Z [2024-05-26T00:30:06.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:30:06.118751747Z [2024-05-26T00:30:06.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:06.119141180Z [2024-05-26T00:30:06.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:06.131931156Z [2024-05-26T00:30:06.131+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc9859f1-0334-4a46-9a99-075e73d66978 2024-05-26T00:30:06.132401963Z [2024-05-26T00:30:06.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=-1, run_start_date=2024-05-26 00:30:05.364418+00:00, run_end_date=2024-05-26 00:30:05.724412+00:00, run_duration=0.359994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:03.377486+00:00, queued_by_job_id=1, pid=7203 2024-05-26T00:30:08.473947876Z [2024-05-26T00:30:08.473+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:30:08.473976876Z 2024-05-26T00:30:08.474100036Z [2024-05-26T00:30:08.473+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:30:08.475182715Z [2024-05-26T00:30:08.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:30:08.475192187Z 2024-05-26T00:30:08.480404864Z [2024-05-26T00:30:08.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:30:08.480707269Z [2024-05-26T00:30:08.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:30:08.555364547Z [2024-05-26T00:30:08.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status queued for try_number 1 2024-05-26T00:30:08.555857452Z [2024-05-26T00:30:08.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:08.563256200Z [2024-05-26T00:30:08.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1adfffe-5189-4570-862d-e9900410cedc 2024-05-26T00:30:08.563617848Z [2024-05-26T00:30:08.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=0, run_start_date=2024-05-26 00:30:07.793199+00:00, run_end_date=2024-05-26 00:30:08.111554+00:00, run_duration=0.318355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:06.063447+00:00, queued_by_job_id=1, pid=7211 2024-05-26T00:30:11.553449514Z [2024-05-26T00:30:11.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:30:11.553499313Z [2024-05-26T00:30:11.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:25:00+00:00, run_id=scheduled__2024-05-26T00:25:00+00:00, run_start_date=2024-05-26 00:30:00.194561+00:00, run_end_date=2024-05-26 00:30:11.549481+00:00, run_duration=11.35492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:25:00+00:00, data_interval_end=2024-05-26 00:30:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:30:11.557757692Z [2024-05-26T00:30:11.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:30:00+00:00, run_after=2024-05-26T00:35:00+00:00 2024-05-26T00:30:11.591188707Z [2024-05-26T00:30:11.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:25:00+00:00 exited with status success for try_number 1 2024-05-26T00:30:11.597028335Z [2024-05-26T00:30:11.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:25:00+00:00, map_index=-1, run_start_date=2024-05-26 00:30:10.157280+00:00, run_end_date=2024-05-26 00:30:10.520301+00:00, run_duration=0.363021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:30:08.476324+00:00, queued_by_job_id=1, pid=7219 2024-05-26T00:31:01.084537675Z [2024-05-26T00:31:01.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:31:00+00:00, run_after=2024-05-26T00:32:00+00:00 2024-05-26T00:31:01.100367960Z [2024-05-26T00:31:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:31:00+00:00, run_after=2024-05-26T00:32:00+00:00 2024-05-26T00:31:01.110999068Z [2024-05-26T00:31:01.110+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:31:01.199570465Z [2024-05-26T00:31:01.198+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:31:01.199614429Z 2024-05-26T00:31:01.199621082Z 2024-05-26T00:31:01.199626528Z 2024-05-26T00:31:01.200303394Z [2024-05-26T00:31:01.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:31:01.200845433Z [2024-05-26T00:31:01.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:31:01.201328216Z [2024-05-26T00:31:01.200+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:31:01.205144815Z [2024-05-26T00:31:01.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:31:01.205180794Z 2024-05-26T00:31:01.205185816Z 2024-05-26T00:31:01.205196060Z 2024-05-26T00:31:01.214691643Z [2024-05-26T00:31:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:31:01.215145561Z [2024-05-26T00:31:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:31:01.215827992Z [2024-05-26T00:31:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:31:01.216249914Z [2024-05-26T00:31:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:31:01.216837768Z [2024-05-26T00:31:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:31:01.217153437Z [2024-05-26T00:31:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:31:01.459920811Z [2024-05-26T00:31:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:31:01.459954375Z [2024-05-26T00:31:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:31:01.460124475Z [2024-05-26T00:31:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:31:01.485287240Z [2024-05-26T00:31:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28ce5687-edbb-4da4-a591-33b9cf65f0c5 2024-05-26T00:31:01.485456250Z [2024-05-26T00:31:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 014406ff-fd73-49b0-9fbb-d0d8907001d1 2024-05-26T00:31:01.485638192Z [2024-05-26T00:31:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1206c425-20c9-4199-833c-288b7579fe60 2024-05-26T00:31:02.615272775Z [2024-05-26T00:31:02.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:31:02.615870104Z [2024-05-26T00:31:02.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:30:00+00:00, run_id=scheduled__2024-05-26T00:30:00+00:00, run_start_date=2024-05-26 00:31:01.124245+00:00, run_end_date=2024-05-26 00:31:02.615093+00:00, run_duration=1.490848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:30:00+00:00, data_interval_end=2024-05-26 00:31:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:31:02.625670010Z [2024-05-26T00:31:02.625+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:31:00+00:00, run_after=2024-05-26T00:32:00+00:00 2024-05-26T00:31:02.682954948Z [2024-05-26T00:31:02.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:31:02.691757281Z [2024-05-26T00:31:02.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=-1, run_start_date=2024-05-26 00:31:02.018199+00:00, run_end_date=2024-05-26 00:31:02.429974+00:00, run_duration=0.411775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:31:01.209262+00:00, queued_by_job_id=1, pid=7240 2024-05-26T00:31:04.690623163Z [2024-05-26T00:31:04.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:31:04.692271120Z [2024-05-26T00:31:04.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:30:00+00:00, run_id=scheduled__2024-05-26T00:30:00+00:00, run_start_date=2024-05-26 00:31:01.125709+00:00, run_end_date=2024-05-26 00:31:04.690540+00:00, run_duration=3.564831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:30:00+00:00, data_interval_end=2024-05-26 00:31:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:31:04.717441092Z [2024-05-26T00:31:04.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:31:00+00:00, run_after=2024-05-26T00:32:00+00:00 2024-05-26T00:31:04.772479284Z [2024-05-26T00:31:04.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:31:04.780877528Z [2024-05-26T00:31:04.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=-1, run_start_date=2024-05-26 00:31:03.267203+00:00, run_end_date=2024-05-26 00:31:04.566287+00:00, run_duration=1.299084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:31:01.209262+00:00, queued_by_job_id=1, pid=7259 2024-05-26T00:31:06.370244262Z [2024-05-26T00:31:06.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:31:06.370755708Z [2024-05-26T00:31:06.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:30:00+00:00, run_id=scheduled__2024-05-26T00:30:00+00:00, run_start_date=2024-05-26 00:31:01.126862+00:00, run_end_date=2024-05-26 00:31:06.370299+00:00, run_duration=5.243437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:30:00+00:00, data_interval_end=2024-05-26 00:31:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:31:06.381692142Z [2024-05-26T00:31:06.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:31:00+00:00, run_after=2024-05-26T00:32:00+00:00 2024-05-26T00:31:06.429691395Z [2024-05-26T00:31:06.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:31:06.436412219Z [2024-05-26T00:31:06.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=-1, run_start_date=2024-05-26 00:31:03.028374+00:00, run_end_date=2024-05-26 00:31:06.097505+00:00, run_duration=3.069131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:31:01.209262+00:00, queued_by_job_id=1, pid=7257 2024-05-26T00:32:00.236552982Z [2024-05-26T00:32:00.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:32:00+00:00, run_after=2024-05-26T00:33:00+00:00 2024-05-26T00:32:00.251721989Z [2024-05-26T00:32:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:32:00+00:00, run_after=2024-05-26T00:33:00+00:00 2024-05-26T00:32:00.262061348Z [2024-05-26T00:32:00.261+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:32:00.270160051Z [2024-05-26T00:32:00.269+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:32:00.361375654Z [2024-05-26T00:32:00.360+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:32:00.361416898Z 2024-05-26T00:32:00.361429328Z 2024-05-26T00:32:00.361438301Z 2024-05-26T00:32:00.361446862Z 2024-05-26T00:32:00.361471917Z [2024-05-26T00:32:00.361+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:32:00.361598005Z [2024-05-26T00:32:00.361+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:32:00.361958797Z [2024-05-26T00:32:00.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:32:00.362059616Z [2024-05-26T00:32:00.361+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:32:00.362854255Z [2024-05-26T00:32:00.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:32:00.362865051Z 2024-05-26T00:32:00.362873083Z 2024-05-26T00:32:00.362880008Z 2024-05-26T00:32:00.362885736Z 2024-05-26T00:32:00.367273021Z [2024-05-26T00:32:00.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:32:00.367301342Z [2024-05-26T00:32:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:32:00.367621849Z [2024-05-26T00:32:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:32:00.367802769Z [2024-05-26T00:32:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:32:00.368843003Z [2024-05-26T00:32:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:32:00.368859593Z [2024-05-26T00:32:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:32:00.368867583Z [2024-05-26T00:32:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:32:00.368875424Z [2024-05-26T00:32:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:32:00.634975645Z [2024-05-26T00:32:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:32:00.635234570Z [2024-05-26T00:32:00.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:31:00+00:00 exited with status queued for try_number 1 2024-05-26T00:32:00.635340502Z [2024-05-26T00:32:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:31:00+00:00 exited with status queued for try_number 1 2024-05-26T00:32:00.635465511Z [2024-05-26T00:32:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:31:00+00:00 exited with status queued for try_number 1 2024-05-26T00:32:00.645666987Z [2024-05-26T00:32:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c31d2c9-d9d7-42d2-ab5d-f855be4a6fda 2024-05-26T00:32:00.645821213Z [2024-05-26T00:32:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2acf9643-0139-4619-b154-c383caf7c628 2024-05-26T00:32:00.645973234Z [2024-05-26T00:32:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 939815b1-4cad-4937-b794-e2b400699c97 2024-05-26T00:32:00.646137587Z [2024-05-26T00:32:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9775e1d-7533-4a0f-af9e-922bc5345b15 2024-05-26T00:32:02.201803981Z [2024-05-26T00:32:02.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:32:02.202196264Z [2024-05-26T00:32:02.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:30:00+00:00, run_id=scheduled__2024-05-26T00:30:00+00:00, run_start_date=2024-05-26 00:32:00.282293+00:00, run_end_date=2024-05-26 00:32:02.201694+00:00, run_duration=1.919401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:30:00+00:00, data_interval_end=2024-05-26 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:32:02.215868494Z [2024-05-26T00:32:02.215+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:32:00+00:00, run_after=2024-05-26T00:34:00+00:00 2024-05-26T00:32:02.223402737Z [2024-05-26T00:32:02.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:32:02.223740658Z [2024-05-26T00:32:02.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:31:00+00:00, run_id=scheduled__2024-05-26T00:31:00+00:00, run_start_date=2024-05-26 00:32:00.283643+00:00, run_end_date=2024-05-26 00:32:02.223331+00:00, run_duration=1.939688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:31:00+00:00, data_interval_end=2024-05-26 00:32:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:32:02.241230578Z [2024-05-26T00:32:02.240+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:32:00+00:00, run_after=2024-05-26T00:33:00+00:00 2024-05-26T00:32:02.330320435Z [2024-05-26T00:32:02.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:32:02.330406016Z [2024-05-26T00:32:02.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:31:00+00:00 exited with status success for try_number 1 2024-05-26T00:32:02.349326633Z [2024-05-26T00:32:02.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=-1, run_start_date=2024-05-26 00:32:01.249553+00:00, run_end_date=2024-05-26 00:32:01.581952+00:00, run_duration=0.332399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:32:00.363730+00:00, queued_by_job_id=1, pid=7292 2024-05-26T00:32:02.349951389Z [2024-05-26T00:32:02.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:31:00+00:00, map_index=-1, run_start_date=2024-05-26 00:32:01.316998+00:00, run_end_date=2024-05-26 00:32:01.735917+00:00, run_duration=0.418919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:32:00.363730+00:00, queued_by_job_id=1, pid=7293 2024-05-26T00:32:04.520063887Z [2024-05-26T00:32:04.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:32:04.520456830Z [2024-05-26T00:32:04.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:31:00+00:00, run_id=scheduled__2024-05-26T00:31:00+00:00, run_start_date=2024-05-26 00:32:00.284843+00:00, run_end_date=2024-05-26 00:32:04.520138+00:00, run_duration=4.235295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:31:00+00:00, data_interval_end=2024-05-26 00:32:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:32:04.529506196Z [2024-05-26T00:32:04.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:32:00+00:00, run_after=2024-05-26T00:33:00+00:00 2024-05-26T00:32:04.536606507Z [2024-05-26T00:32:04.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:32:04.537005939Z [2024-05-26T00:32:04.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:31:00+00:00, run_id=scheduled__2024-05-26T00:31:00+00:00, run_start_date=2024-05-26 00:32:00.286449+00:00, run_end_date=2024-05-26 00:32:04.536716+00:00, run_duration=4.250267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:31:00+00:00, data_interval_end=2024-05-26 00:32:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:32:04.546280860Z [2024-05-26T00:32:04.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:32:00+00:00, run_after=2024-05-26T00:33:00+00:00 2024-05-26T00:32:04.574214387Z [2024-05-26T00:32:04.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:31:00+00:00 exited with status success for try_number 1 2024-05-26T00:32:04.574380325Z [2024-05-26T00:32:04.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:31:00+00:00 exited with status success for try_number 1 2024-05-26T00:32:04.580525847Z [2024-05-26T00:32:04.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:31:00+00:00, map_index=-1, run_start_date=2024-05-26 00:32:02.375835+00:00, run_end_date=2024-05-26 00:32:03.742973+00:00, run_duration=1.367138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:32:00.363730+00:00, queued_by_job_id=1, pid=7317 2024-05-26T00:32:04.580767572Z [2024-05-26T00:32:04.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:31:00+00:00, map_index=-1, run_start_date=2024-05-26 00:32:02.291164+00:00, run_end_date=2024-05-26 00:32:03.988432+00:00, run_duration=1.697268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:32:00.363730+00:00, queued_by_job_id=1, pid=7316 2024-05-26T00:33:00.231364743Z [2024-05-26T00:33:00.230+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:33:00+00:00, run_after=2024-05-26T00:34:00+00:00 2024-05-26T00:33:00.247662378Z [2024-05-26T00:33:00.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:33:00+00:00, run_after=2024-05-26T00:34:00+00:00 2024-05-26T00:33:00.257114344Z [2024-05-26T00:33:00.256+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:33:00.337990488Z [2024-05-26T00:33:00.337+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:33:00.338021993Z 2024-05-26T00:33:00.338027692Z 2024-05-26T00:33:00.338033426Z 2024-05-26T00:33:00.338478623Z [2024-05-26T00:33:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:33:00.338723078Z [2024-05-26T00:33:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:33:00.338940218Z [2024-05-26T00:33:00.338+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:33:00.339797949Z [2024-05-26T00:33:00.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:33:00.339831115Z 2024-05-26T00:33:00.339836788Z 2024-05-26T00:33:00.339841106Z 2024-05-26T00:33:00.343912144Z [2024-05-26T00:33:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:33:00.344194145Z [2024-05-26T00:33:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:33:00.344625372Z [2024-05-26T00:33:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:33:00.344817025Z [2024-05-26T00:33:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:33:00.345120105Z [2024-05-26T00:33:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:33:00.345304463Z [2024-05-26T00:33:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:33:00.553205897Z [2024-05-26T00:33:00.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status queued for try_number 1 2024-05-26T00:33:00.553442899Z [2024-05-26T00:33:00.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status queued for try_number 1 2024-05-26T00:33:00.553615820Z [2024-05-26T00:33:00.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status queued for try_number 1 2024-05-26T00:33:00.565080689Z [2024-05-26T00:33:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9191f47-9600-4935-83b0-4da7f5f6029a 2024-05-26T00:33:00.565341019Z [2024-05-26T00:33:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6a465b4-44ad-49cf-8475-549babe20c85 2024-05-26T00:33:00.565543651Z [2024-05-26T00:33:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7e77ade-c44d-4efc-bc0a-027e2e402f19 2024-05-26T00:33:01.711887855Z [2024-05-26T00:33:01.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:33:01.712172594Z [2024-05-26T00:33:01.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:32:00+00:00, run_id=scheduled__2024-05-26T00:32:00+00:00, run_start_date=2024-05-26 00:33:00.273450+00:00, run_end_date=2024-05-26 00:33:01.711810+00:00, run_duration=1.43836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:32:00+00:00, data_interval_end=2024-05-26 00:33:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:33:01.722968201Z [2024-05-26T00:33:01.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:33:00+00:00, run_after=2024-05-26T00:34:00+00:00 2024-05-26T00:33:01.782920379Z [2024-05-26T00:33:01.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status success for try_number 1 2024-05-26T00:33:01.788495710Z [2024-05-26T00:33:01.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:32:00+00:00, map_index=-1, run_start_date=2024-05-26 00:33:01.178502+00:00, run_end_date=2024-05-26 00:33:01.589277+00:00, run_duration=0.410775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:33:00.340735+00:00, queued_by_job_id=1, pid=7349 2024-05-26T00:33:04.341139239Z [2024-05-26T00:33:04.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:33:04.341505584Z [2024-05-26T00:33:04.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:32:00+00:00, run_id=scheduled__2024-05-26T00:32:00+00:00, run_start_date=2024-05-26 00:33:00.274800+00:00, run_end_date=2024-05-26 00:33:04.341146+00:00, run_duration=4.066346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:32:00+00:00, data_interval_end=2024-05-26 00:33:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:33:04.352314430Z [2024-05-26T00:33:04.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:33:00+00:00, run_after=2024-05-26T00:34:00+00:00 2024-05-26T00:33:04.359064008Z [2024-05-26T00:33:04.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:33:04.359436106Z [2024-05-26T00:33:04.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:32:00+00:00, run_id=scheduled__2024-05-26T00:32:00+00:00, run_start_date=2024-05-26 00:33:00.275956+00:00, run_end_date=2024-05-26 00:33:04.359126+00:00, run_duration=4.08317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:32:00+00:00, data_interval_end=2024-05-26 00:33:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:33:04.367933298Z [2024-05-26T00:33:04.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:33:00+00:00, run_after=2024-05-26T00:34:00+00:00 2024-05-26T00:33:04.403388945Z [2024-05-26T00:33:04.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status success for try_number 1 2024-05-26T00:33:04.403750231Z [2024-05-26T00:33:04.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status success for try_number 1 2024-05-26T00:33:04.413250838Z [2024-05-26T00:33:04.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:32:00+00:00, map_index=-1, run_start_date=2024-05-26 00:33:02.191972+00:00, run_end_date=2024-05-26 00:33:03.434341+00:00, run_duration=1.242369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:33:00.340735+00:00, queued_by_job_id=1, pid=7368 2024-05-26T00:33:04.413541194Z [2024-05-26T00:33:04.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:32:00+00:00, map_index=-1, run_start_date=2024-05-26 00:33:02.182842+00:00, run_end_date=2024-05-26 00:33:03.793472+00:00, run_duration=1.61063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:33:00.340735+00:00, queued_by_job_id=1, pid=7367 2024-05-26T00:33:31.520262402Z [2024-05-26T00:33:31.519+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:34:00.145408956Z [2024-05-26T00:34:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:34:00+00:00, run_after=2024-05-26T00:35:00+00:00 2024-05-26T00:34:00.156312083Z [2024-05-26T00:34:00.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:34:00.171428591Z [2024-05-26T00:34:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:34:00+00:00, run_after=2024-05-26T00:35:00+00:00 2024-05-26T00:34:00.181518678Z [2024-05-26T00:34:00.181+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:34:00.305221021Z [2024-05-26T00:34:00.304+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:34:00.305250211Z 2024-05-26T00:34:00.305256720Z 2024-05-26T00:34:00.305298889Z 2024-05-26T00:34:00.305303450Z 2024-05-26T00:34:00.305553607Z [2024-05-26T00:34:00.305+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:34:00.305856833Z [2024-05-26T00:34:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:34:00.306053814Z [2024-05-26T00:34:00.305+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:34:00.306237172Z [2024-05-26T00:34:00.306+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:34:00.307439753Z [2024-05-26T00:34:00.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:34:00.307452865Z 2024-05-26T00:34:00.307458166Z 2024-05-26T00:34:00.307462503Z 2024-05-26T00:34:00.307466675Z 2024-05-26T00:34:00.315947704Z [2024-05-26T00:34:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:34:00.316400270Z [2024-05-26T00:34:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:34:00.316954165Z [2024-05-26T00:34:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:34:00.317306319Z [2024-05-26T00:34:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:34:00.317818154Z [2024-05-26T00:34:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:34:00.318120747Z [2024-05-26T00:34:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:34:00.318553975Z [2024-05-26T00:34:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:34:00.318829415Z [2024-05-26T00:34:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:34:00.664798296Z [2024-05-26T00:34:00.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status queued for try_number 1 2024-05-26T00:34:00.664835110Z [2024-05-26T00:34:00.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:33:00+00:00 exited with status queued for try_number 1 2024-05-26T00:34:00.665001819Z [2024-05-26T00:34:00.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:33:00+00:00 exited with status queued for try_number 1 2024-05-26T00:34:00.665140625Z [2024-05-26T00:34:00.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:33:00+00:00 exited with status queued for try_number 1 2024-05-26T00:34:00.677623366Z [2024-05-26T00:34:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2601eddd-2651-4725-ac48-37d2c0fbb32a 2024-05-26T00:34:00.677735200Z [2024-05-26T00:34:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to e571dbca-ccd6-41d9-91a6-623044fbc6e7 2024-05-26T00:34:00.677883431Z [2024-05-26T00:34:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 814def64-d42b-4873-a962-a41a444ba733 2024-05-26T00:34:00.678405778Z [2024-05-26T00:34:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d4e1f9e-25c1-40cc-a463-c9594857feb0 2024-05-26T00:34:01.871907619Z [2024-05-26T00:34:01.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:34:01.872180475Z [2024-05-26T00:34:01.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:32:00+00:00, run_id=scheduled__2024-05-26T00:32:00+00:00, run_start_date=2024-05-26 00:34:00.196163+00:00, run_end_date=2024-05-26 00:34:01.871846+00:00, run_duration=1.675683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:32:00+00:00, data_interval_end=2024-05-26 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:34:01.880130322Z [2024-05-26T00:34:01.879+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:34:00+00:00, run_after=2024-05-26T00:36:00+00:00 2024-05-26T00:34:01.886496915Z [2024-05-26T00:34:01.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:34:01.886637807Z [2024-05-26T00:34:01.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:33:00+00:00, run_id=scheduled__2024-05-26T00:33:00+00:00, run_start_date=2024-05-26 00:34:00.197684+00:00, run_end_date=2024-05-26 00:34:01.886420+00:00, run_duration=1.688736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:33:00+00:00, data_interval_end=2024-05-26 00:34:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:34:01.896786591Z [2024-05-26T00:34:01.896+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:34:00+00:00, run_after=2024-05-26T00:35:00+00:00 2024-05-26T00:34:01.954946850Z [2024-05-26T00:34:01.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:32:00+00:00 exited with status success for try_number 1 2024-05-26T00:34:01.955140062Z [2024-05-26T00:34:01.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:33:00+00:00 exited with status success for try_number 1 2024-05-26T00:34:01.967953115Z [2024-05-26T00:34:01.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:32:00+00:00, map_index=-1, run_start_date=2024-05-26 00:34:01.212387+00:00, run_end_date=2024-05-26 00:34:01.669674+00:00, run_duration=0.457287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:34:00.309699+00:00, queued_by_job_id=1, pid=7401 2024-05-26T00:34:01.968433042Z [2024-05-26T00:34:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:33:00+00:00, map_index=-1, run_start_date=2024-05-26 00:34:01.319746+00:00, run_end_date=2024-05-26 00:34:01.750435+00:00, run_duration=0.430689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:34:00.309699+00:00, queued_by_job_id=1, pid=7402 2024-05-26T00:34:04.217787361Z [2024-05-26T00:34:04.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:34:04.219496652Z [2024-05-26T00:34:04.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:33:00+00:00, run_id=scheduled__2024-05-26T00:33:00+00:00, run_start_date=2024-05-26 00:34:00.199296+00:00, run_end_date=2024-05-26 00:34:04.217690+00:00, run_duration=4.018394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:33:00+00:00, data_interval_end=2024-05-26 00:34:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:34:04.229582425Z [2024-05-26T00:34:04.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:34:00+00:00, run_after=2024-05-26T00:35:00+00:00 2024-05-26T00:34:04.238044088Z [2024-05-26T00:34:04.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:34:04.238699999Z [2024-05-26T00:34:04.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:33:00+00:00, run_id=scheduled__2024-05-26T00:33:00+00:00, run_start_date=2024-05-26 00:34:00.201040+00:00, run_end_date=2024-05-26 00:34:04.238106+00:00, run_duration=4.037066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:33:00+00:00, data_interval_end=2024-05-26 00:34:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:34:04.254935786Z [2024-05-26T00:34:04.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:34:00+00:00, run_after=2024-05-26T00:35:00+00:00 2024-05-26T00:34:04.335854796Z [2024-05-26T00:34:04.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:33:00+00:00 exited with status success for try_number 1 2024-05-26T00:34:04.354086051Z [2024-05-26T00:34:04.353+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:33:00+00:00, map_index=-1, run_start_date=2024-05-26 00:34:02.364652+00:00, run_end_date=2024-05-26 00:34:03.700669+00:00, run_duration=1.336017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:34:00.309699+00:00, queued_by_job_id=1, pid=7425 2024-05-26T00:34:05.474589688Z [2024-05-26T00:34:05.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:33:00+00:00 exited with status success for try_number 1 2024-05-26T00:34:05.479342209Z [2024-05-26T00:34:05.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:33:00+00:00, map_index=-1, run_start_date=2024-05-26 00:34:02.485256+00:00, run_end_date=2024-05-26 00:34:04.174993+00:00, run_duration=1.689737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:34:00.309699+00:00, queued_by_job_id=1, pid=7426 2024-05-26T00:35:00.089768535Z [2024-05-26T00:35:00.089+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:35:00.118212315Z [2024-05-26T00:35:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:35:00+00:00, run_after=2024-05-26T00:36:00+00:00 2024-05-26T00:35:00.130307428Z [2024-05-26T00:35:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:35:00+00:00, run_after=2024-05-26T00:36:00+00:00 2024-05-26T00:35:00.143192817Z [2024-05-26T00:35:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:35:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:35:00.254903169Z [2024-05-26T00:35:00.254+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:35:00.254957951Z 2024-05-26T00:35:00.254993824Z 2024-05-26T00:35:00.255000072Z 2024-05-26T00:35:00.255024658Z 2024-05-26T00:35:00.255451357Z [2024-05-26T00:35:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:35:00.255860344Z [2024-05-26T00:35:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:35:00.256453168Z [2024-05-26T00:35:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:35:00.256877371Z [2024-05-26T00:35:00.256+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:35:00.258064581Z [2024-05-26T00:35:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:35:00.258079569Z 2024-05-26T00:35:00.258085113Z 2024-05-26T00:35:00.258089575Z 2024-05-26T00:35:00.258094187Z 2024-05-26T00:35:00.263458692Z [2024-05-26T00:35:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:35:00.263652066Z [2024-05-26T00:35:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:35:00.264079725Z [2024-05-26T00:35:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:35:00.264425185Z [2024-05-26T00:35:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:35:00.264906162Z [2024-05-26T00:35:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:35:00.265172957Z [2024-05-26T00:35:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:35:00.265624794Z [2024-05-26T00:35:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:35:00.265944293Z [2024-05-26T00:35:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:35:00.553629280Z [2024-05-26T00:35:00.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:35:00.553686022Z [2024-05-26T00:35:00.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status queued for try_number 1 2024-05-26T00:35:00.556567843Z [2024-05-26T00:35:00.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status queued for try_number 1 2024-05-26T00:35:00.556787231Z [2024-05-26T00:35:00.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status queued for try_number 1 2024-05-26T00:35:00.565129268Z [2024-05-26T00:35:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 731a60e3-a84b-4265-b404-a4aab549239f 2024-05-26T00:35:00.565339315Z [2024-05-26T00:35:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53832b4a-a5a8-45dd-a124-e454bc275eee 2024-05-26T00:35:00.565526432Z [2024-05-26T00:35:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d995127-3844-44d4-a757-14a505899449 2024-05-26T00:35:00.565724960Z [2024-05-26T00:35:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbc68517-d2b2-46da-a803-7eb9cad865b8 2024-05-26T00:35:02.845540514Z [2024-05-26T00:35:02.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:35:02.845816220Z [2024-05-26T00:35:02.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:34:00+00:00, run_id=scheduled__2024-05-26T00:34:00+00:00, run_start_date=2024-05-26 00:35:00.157402+00:00, run_end_date=2024-05-26 00:35:02.845436+00:00, run_duration=2.688034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:34:00+00:00, data_interval_end=2024-05-26 00:35:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:35:02.861387602Z [2024-05-26T00:35:02.856+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:35:00+00:00, run_after=2024-05-26T00:36:00+00:00 2024-05-26T00:35:02.925475410Z [2024-05-26T00:35:02.925+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:35:02.925504049Z 2024-05-26T00:35:02.925518161Z [2024-05-26T00:35:02.925+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:35:02.925992999Z [2024-05-26T00:35:02.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:35:02.926000008Z 2024-05-26T00:35:02.928415195Z [2024-05-26T00:35:02.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:35:02.928942834Z [2024-05-26T00:35:02.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:35:02.979473839Z [2024-05-26T00:35:02.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:35:02.980074909Z [2024-05-26T00:35:02.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:35:02.980372470Z [2024-05-26T00:35:02.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status success for try_number 1 2024-05-26T00:35:02.989859325Z [2024-05-26T00:35:02.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=-1, run_start_date=2024-05-26 00:35:02.249802+00:00, run_end_date=2024-05-26 00:35:02.563853+00:00, run_duration=0.314051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:35:00.259670+00:00, queued_by_job_id=1, pid=7483 2024-05-26T00:35:02.990319048Z [2024-05-26T00:35:02.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e872475-3d50-4dca-a1ba-61061706df02 2024-05-26T00:35:02.990591642Z [2024-05-26T00:35:02.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:34:00+00:00, map_index=-1, run_start_date=2024-05-26 00:35:01.213431+00:00, run_end_date=2024-05-26 00:35:01.618682+00:00, run_duration=0.405251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:35:00.259670+00:00, queued_by_job_id=1, pid=7459 2024-05-26T00:35:04.103480552Z [2024-05-26T00:35:04.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:35:04.104102994Z [2024-05-26T00:35:04.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:34:00+00:00, run_id=scheduled__2024-05-26T00:34:00+00:00, run_start_date=2024-05-26 00:35:00.158656+00:00, run_end_date=2024-05-26 00:35:04.103375+00:00, run_duration=3.944719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:34:00+00:00, data_interval_end=2024-05-26 00:35:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:35:04.116254045Z [2024-05-26T00:35:04.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:35:00+00:00, run_after=2024-05-26T00:36:00+00:00 2024-05-26T00:35:04.195797293Z [2024-05-26T00:35:04.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status success for try_number 1 2024-05-26T00:35:04.201225374Z [2024-05-26T00:35:04.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:34:00+00:00, map_index=-1, run_start_date=2024-05-26 00:35:02.326214+00:00, run_end_date=2024-05-26 00:35:03.554549+00:00, run_duration=1.228335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:35:00.259670+00:00, queued_by_job_id=1, pid=7484 2024-05-26T00:35:05.276762606Z [2024-05-26T00:35:05.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:35:05.276994338Z [2024-05-26T00:35:05.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:34:00+00:00, run_id=scheduled__2024-05-26T00:34:00+00:00, run_start_date=2024-05-26 00:35:00.159939+00:00, run_end_date=2024-05-26 00:35:05.276681+00:00, run_duration=5.116742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:34:00+00:00, data_interval_end=2024-05-26 00:35:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:35:05.295988970Z [2024-05-26T00:35:05.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:35:00+00:00, run_after=2024-05-26T00:36:00+00:00 2024-05-26T00:35:05.314408858Z [2024-05-26T00:35:05.314+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:35:05.314429246Z 2024-05-26T00:35:05.315655183Z [2024-05-26T00:35:05.314+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:35:05.316455867Z [2024-05-26T00:35:05.316+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:35:05.316479670Z 2024-05-26T00:35:05.318604261Z [2024-05-26T00:35:05.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:35:05.318667397Z [2024-05-26T00:35:05.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:35:05.393467640Z [2024-05-26T00:35:05.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:35:05.394237641Z [2024-05-26T00:35:05.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status success for try_number 1 2024-05-26T00:35:05.394519721Z [2024-05-26T00:35:05.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:35:05.408995773Z [2024-05-26T00:35:05.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:34:00+00:00, map_index=-1, run_start_date=2024-05-26 00:35:02.433167+00:00, run_end_date=2024-05-26 00:35:04.152859+00:00, run_duration=1.719692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:35:00.259670+00:00, queued_by_job_id=1, pid=7485 2024-05-26T00:35:05.409662055Z [2024-05-26T00:35:05.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=-1, run_start_date=2024-05-26 00:35:04.776157+00:00, run_end_date=2024-05-26 00:35:05.131071+00:00, run_duration=0.354914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:35:02.926303+00:00, queued_by_job_id=1, pid=7508 2024-05-26T00:35:05.410023794Z [2024-05-26T00:35:05.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58cbed19-38d9-4aaa-9562-ef4195d5ad6e 2024-05-26T00:35:07.429799900Z [2024-05-26T00:35:07.429+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:35:07.429843429Z 2024-05-26T00:35:07.429852699Z [2024-05-26T00:35:07.429+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:35:07.430851041Z [2024-05-26T00:35:07.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:35:07.430898180Z 2024-05-26T00:35:07.435887887Z [2024-05-26T00:35:07.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:35:07.435982129Z [2024-05-26T00:35:07.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:35:07.488606974Z [2024-05-26T00:35:07.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status queued for try_number 1 2024-05-26T00:35:07.488818949Z [2024-05-26T00:35:07.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:35:07.493860125Z [2024-05-26T00:35:07.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f52700e-57de-472b-88ab-376e4260000d 2024-05-26T00:35:07.494117726Z [2024-05-26T00:35:07.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=0, run_start_date=2024-05-26 00:35:06.906421+00:00, run_end_date=2024-05-26 00:35:07.296819+00:00, run_duration=0.390398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:35:05.316754+00:00, queued_by_job_id=1, pid=7516 2024-05-26T00:35:10.383639546Z [2024-05-26T00:35:10.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:35:10.383805553Z [2024-05-26T00:35:10.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:30:00+00:00, run_id=scheduled__2024-05-26T00:30:00+00:00, run_start_date=2024-05-26 00:35:00.155782+00:00, run_end_date=2024-05-26 00:35:10.383391+00:00, run_duration=10.227609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:30:00+00:00, data_interval_end=2024-05-26 00:35:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:35:10.393218916Z [2024-05-26T00:35:10.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:35:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:35:10.451930101Z [2024-05-26T00:35:10.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:30:00+00:00 exited with status success for try_number 1 2024-05-26T00:35:10.460670604Z [2024-05-26T00:35:10.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:30:00+00:00, map_index=-1, run_start_date=2024-05-26 00:35:09.100677+00:00, run_end_date=2024-05-26 00:35:09.513162+00:00, run_duration=0.412485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:35:07.431337+00:00, queued_by_job_id=1, pid=7524 2024-05-26T00:36:00.140184045Z [2024-05-26T00:36:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:36:00+00:00, run_after=2024-05-26T00:37:00+00:00 2024-05-26T00:36:00.152409459Z [2024-05-26T00:36:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:36:00+00:00, run_after=2024-05-26T00:37:00+00:00 2024-05-26T00:36:00.158098190Z [2024-05-26T00:36:00.157+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:36:00.163510620Z [2024-05-26T00:36:00.163+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:36:00.248495993Z [2024-05-26T00:36:00.248+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:36:00.248526994Z 2024-05-26T00:36:00.248533928Z 2024-05-26T00:36:00.248539994Z 2024-05-26T00:36:00.248545796Z 2024-05-26T00:36:00.248562257Z [2024-05-26T00:36:00.248+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:36:00.248683254Z [2024-05-26T00:36:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:36:00.248799313Z [2024-05-26T00:36:00.248+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:36:00.249158858Z [2024-05-26T00:36:00.248+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:36:00.250998087Z [2024-05-26T00:36:00.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:36:00.251017009Z 2024-05-26T00:36:00.251023329Z 2024-05-26T00:36:00.251028686Z 2024-05-26T00:36:00.251034189Z 2024-05-26T00:36:00.255088976Z [2024-05-26T00:36:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:36:00.255158486Z [2024-05-26T00:36:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:36:00.255402210Z [2024-05-26T00:36:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:36:00.255564693Z [2024-05-26T00:36:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:36:00.255746245Z [2024-05-26T00:36:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:36:00.255863490Z [2024-05-26T00:36:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:36:00.256161097Z [2024-05-26T00:36:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:36:00.256261684Z [2024-05-26T00:36:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:36:00.542406081Z [2024-05-26T00:36:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status queued for try_number 1 2024-05-26T00:36:00.542436023Z [2024-05-26T00:36:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status queued for try_number 1 2024-05-26T00:36:00.542467413Z [2024-05-26T00:36:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status queued for try_number 1 2024-05-26T00:36:00.542518398Z [2024-05-26T00:36:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status queued for try_number 1 2024-05-26T00:36:00.550253425Z [2024-05-26T00:36:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 499b656e-62a7-40f1-8325-53da2277fea4 2024-05-26T00:36:00.550309210Z [2024-05-26T00:36:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f095ff0-1915-421b-b4bf-405363b3becf 2024-05-26T00:36:00.550413022Z [2024-05-26T00:36:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 490e5bf9-3562-4211-8fba-d8148be0201b 2024-05-26T00:36:00.550499475Z [2024-05-26T00:36:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to b128cfd8-20e9-49af-8162-382ad1ed9510 2024-05-26T00:36:01.829540865Z [2024-05-26T00:36:01.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status success for try_number 1 2024-05-26T00:36:01.836705203Z [2024-05-26T00:36:01.836+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:35:00+00:00, map_index=-1, run_start_date=2024-05-26 00:36:01.281850+00:00, run_end_date=2024-05-26 00:36:01.677667+00:00, run_duration=0.395817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:36:00.250932+00:00, queued_by_job_id=1, pid=7547 2024-05-26T00:36:02.881984147Z [2024-05-26T00:36:02.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:36:02.882531245Z [2024-05-26T00:36:02.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:34:00+00:00, run_id=scheduled__2024-05-26T00:34:00+00:00, run_start_date=2024-05-26 00:36:00.172810+00:00, run_end_date=2024-05-26 00:36:02.881818+00:00, run_duration=2.709008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:34:00+00:00, data_interval_end=2024-05-26 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:36:02.889551752Z [2024-05-26T00:36:02.889+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:36:00+00:00, run_after=2024-05-26T00:38:00+00:00 2024-05-26T00:36:02.896839235Z [2024-05-26T00:36:02.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:36:02.897122635Z [2024-05-26T00:36:02.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:35:00+00:00, run_id=scheduled__2024-05-26T00:35:00+00:00, run_start_date=2024-05-26 00:36:00.173929+00:00, run_end_date=2024-05-26 00:36:02.896635+00:00, run_duration=2.722706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:35:00+00:00, data_interval_end=2024-05-26 00:36:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:36:02.906410966Z [2024-05-26T00:36:02.906+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:36:00+00:00, run_after=2024-05-26T00:37:00+00:00 2024-05-26T00:36:02.966920046Z [2024-05-26T00:36:02.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:34:00+00:00 exited with status success for try_number 1 2024-05-26T00:36:02.973184263Z [2024-05-26T00:36:02.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:34:00+00:00, map_index=-1, run_start_date=2024-05-26 00:36:01.388674+00:00, run_end_date=2024-05-26 00:36:01.789012+00:00, run_duration=0.400338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:36:00.250932+00:00, queued_by_job_id=1, pid=7548 2024-05-26T00:36:04.057999528Z [2024-05-26T00:36:04.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:36:04.058392262Z [2024-05-26T00:36:04.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:35:00+00:00, run_id=scheduled__2024-05-26T00:35:00+00:00, run_start_date=2024-05-26 00:36:00.174891+00:00, run_end_date=2024-05-26 00:36:04.057905+00:00, run_duration=3.883014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:35:00+00:00, data_interval_end=2024-05-26 00:36:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:36:04.066834625Z [2024-05-26T00:36:04.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:36:00+00:00, run_after=2024-05-26T00:37:00+00:00 2024-05-26T00:36:04.074354724Z [2024-05-26T00:36:04.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:36:04.074935907Z [2024-05-26T00:36:04.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:35:00+00:00, run_id=scheduled__2024-05-26T00:35:00+00:00, run_start_date=2024-05-26 00:36:00.175892+00:00, run_end_date=2024-05-26 00:36:04.074264+00:00, run_duration=3.898372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:35:00+00:00, data_interval_end=2024-05-26 00:36:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:36:04.084304412Z [2024-05-26T00:36:04.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:36:00+00:00, run_after=2024-05-26T00:37:00+00:00 2024-05-26T00:36:04.118890562Z [2024-05-26T00:36:04.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status success for try_number 1 2024-05-26T00:36:04.124009866Z [2024-05-26T00:36:04.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:35:00+00:00, map_index=-1, run_start_date=2024-05-26 00:36:02.447192+00:00, run_end_date=2024-05-26 00:36:03.889491+00:00, run_duration=1.442299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:36:00.250932+00:00, queued_by_job_id=1, pid=7572 2024-05-26T00:36:05.218862338Z [2024-05-26T00:36:05.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status success for try_number 1 2024-05-26T00:36:05.224865446Z [2024-05-26T00:36:05.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:35:00+00:00, map_index=-1, run_start_date=2024-05-26 00:36:02.439859+00:00, run_end_date=2024-05-26 00:36:03.997924+00:00, run_duration=1.558065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:36:00.250932+00:00, queued_by_job_id=1, pid=7571 2024-05-26T00:37:00.383358445Z [2024-05-26T00:37:00.382+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:37:00.404282867Z [2024-05-26T00:37:00.403+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:37:00+00:00, run_after=2024-05-26T00:38:00+00:00 2024-05-26T00:37:00.418784276Z [2024-05-26T00:37:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:37:00+00:00, run_after=2024-05-26T00:38:00+00:00 2024-05-26T00:37:00.510403191Z [2024-05-26T00:37:00.509+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:37:00.510438273Z 2024-05-26T00:37:00.510442302Z 2024-05-26T00:37:00.510445520Z 2024-05-26T00:37:00.510766518Z [2024-05-26T00:37:00.510+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:37:00.510845553Z [2024-05-26T00:37:00.510+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:37:00.510993908Z [2024-05-26T00:37:00.510+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:37:00.512107575Z [2024-05-26T00:37:00.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:37:00.512123829Z 2024-05-26T00:37:00.512128435Z 2024-05-26T00:37:00.512133023Z 2024-05-26T00:37:00.516581361Z [2024-05-26T00:37:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:37:00.516975808Z [2024-05-26T00:37:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:37:00.517340161Z [2024-05-26T00:37:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:37:00.517557023Z [2024-05-26T00:37:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:37:00.517954240Z [2024-05-26T00:37:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:37:00.518123464Z [2024-05-26T00:37:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:37:00.834805569Z [2024-05-26T00:37:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status queued for try_number 1 2024-05-26T00:37:00.834870163Z [2024-05-26T00:37:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status queued for try_number 1 2024-05-26T00:37:00.835020555Z [2024-05-26T00:37:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status queued for try_number 1 2024-05-26T00:37:00.844202468Z [2024-05-26T00:37:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90957522-37af-4af8-8205-feb0129c269d 2024-05-26T00:37:00.844409022Z [2024-05-26T00:37:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to e004ba5d-b238-4494-9be2-b582b73f90cc 2024-05-26T00:37:00.844574346Z [2024-05-26T00:37:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ce96362-11a9-4c7c-9eea-6860ee092907 2024-05-26T00:37:02.798771362Z [2024-05-26T00:37:02.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:37:02.800537813Z [2024-05-26T00:37:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:36:00+00:00, run_id=scheduled__2024-05-26T00:36:00+00:00, run_start_date=2024-05-26 00:37:00.431919+00:00, run_end_date=2024-05-26 00:37:02.798509+00:00, run_duration=2.36659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:36:00+00:00, data_interval_end=2024-05-26 00:37:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:37:02.833022601Z [2024-05-26T00:37:02.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:37:00+00:00, run_after=2024-05-26T00:38:00+00:00 2024-05-26T00:37:02.901833840Z [2024-05-26T00:37:02.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status success for try_number 1 2024-05-26T00:37:02.907934072Z [2024-05-26T00:37:02.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:36:00+00:00, map_index=-1, run_start_date=2024-05-26 00:37:01.306141+00:00, run_end_date=2024-05-26 00:37:01.976610+00:00, run_duration=0.670469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:37:00.512931+00:00, queued_by_job_id=1, pid=7604 2024-05-26T00:37:05.080085197Z [2024-05-26T00:37:05.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:37:05.080641520Z [2024-05-26T00:37:05.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:36:00+00:00, run_id=scheduled__2024-05-26T00:36:00+00:00, run_start_date=2024-05-26 00:37:00.433300+00:00, run_end_date=2024-05-26 00:37:05.080013+00:00, run_duration=4.646713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:36:00+00:00, data_interval_end=2024-05-26 00:37:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:37:05.089187423Z [2024-05-26T00:37:05.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:37:00+00:00, run_after=2024-05-26T00:38:00+00:00 2024-05-26T00:37:05.096250362Z [2024-05-26T00:37:05.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:37:05.096505614Z [2024-05-26T00:37:05.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:36:00+00:00, run_id=scheduled__2024-05-26T00:36:00+00:00, run_start_date=2024-05-26 00:37:00.434374+00:00, run_end_date=2024-05-26 00:37:05.096156+00:00, run_duration=4.661782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:36:00+00:00, data_interval_end=2024-05-26 00:37:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:37:05.105781119Z [2024-05-26T00:37:05.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:37:00+00:00, run_after=2024-05-26T00:38:00+00:00 2024-05-26T00:37:05.136832800Z [2024-05-26T00:37:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status success for try_number 1 2024-05-26T00:37:05.136860310Z [2024-05-26T00:37:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status success for try_number 1 2024-05-26T00:37:05.142954715Z [2024-05-26T00:37:05.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:36:00+00:00, map_index=-1, run_start_date=2024-05-26 00:37:02.674345+00:00, run_end_date=2024-05-26 00:37:04.584030+00:00, run_duration=1.909685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:37:00.512931+00:00, queued_by_job_id=1, pid=7623 2024-05-26T00:37:05.143137333Z [2024-05-26T00:37:05.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:36:00+00:00, map_index=-1, run_start_date=2024-05-26 00:37:02.400756+00:00, run_end_date=2024-05-26 00:37:04.197372+00:00, run_duration=1.796616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:37:00.512931+00:00, queued_by_job_id=1, pid=7617 2024-05-26T00:38:00.840885106Z [2024-05-26T00:38:00.839+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:38:00.864024365Z [2024-05-26T00:38:00.863+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:38:00+00:00, run_after=2024-05-26T00:39:00+00:00 2024-05-26T00:38:00.877829942Z [2024-05-26T00:38:00.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:38:00+00:00, run_after=2024-05-26T00:39:00+00:00 2024-05-26T00:38:00.885469948Z [2024-05-26T00:38:00.885+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:38:01.005844934Z [2024-05-26T00:38:01.005+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:38:01.005870377Z 2024-05-26T00:38:01.005876741Z 2024-05-26T00:38:01.005883064Z 2024-05-26T00:38:01.005888191Z 2024-05-26T00:38:01.006421524Z [2024-05-26T00:38:01.005+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:38:01.006774881Z [2024-05-26T00:38:01.006+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:38:01.007149748Z [2024-05-26T00:38:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:38:01.007722972Z [2024-05-26T00:38:01.007+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:38:01.008742101Z [2024-05-26T00:38:01.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:38:01.008757340Z 2024-05-26T00:38:01.008763499Z 2024-05-26T00:38:01.008768895Z 2024-05-26T00:38:01.008773564Z 2024-05-26T00:38:01.014315681Z [2024-05-26T00:38:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:38:01.014624460Z [2024-05-26T00:38:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:38:01.015112446Z [2024-05-26T00:38:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:38:01.015379974Z [2024-05-26T00:38:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:38:01.015855411Z [2024-05-26T00:38:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:38:01.016127779Z [2024-05-26T00:38:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:38:01.016589596Z [2024-05-26T00:38:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:38:01.016872197Z [2024-05-26T00:38:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:38:01.313001500Z [2024-05-26T00:38:01.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status queued for try_number 1 2024-05-26T00:38:01.313204980Z [2024-05-26T00:38:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:37:00+00:00 exited with status queued for try_number 1 2024-05-26T00:38:01.313406028Z [2024-05-26T00:38:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:37:00+00:00 exited with status queued for try_number 1 2024-05-26T00:38:01.313607872Z [2024-05-26T00:38:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:37:00+00:00 exited with status queued for try_number 1 2024-05-26T00:38:01.322953367Z [2024-05-26T00:38:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ffe04fa-9e25-4e09-8c09-362161fa2871 2024-05-26T00:38:01.323125714Z [2024-05-26T00:38:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b84216a-3c77-4fd2-b2ea-00b790300822 2024-05-26T00:38:01.323285797Z [2024-05-26T00:38:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34c00258-4590-4261-af18-cf37cc9cb1f8 2024-05-26T00:38:01.323451913Z [2024-05-26T00:38:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1e71388-6119-46a2-bd98-15adb2502c37 2024-05-26T00:38:02.555136619Z [2024-05-26T00:38:02.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:38:02.555472253Z [2024-05-26T00:38:02.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:36:00+00:00, run_id=scheduled__2024-05-26T00:36:00+00:00, run_start_date=2024-05-26 00:38:00.898589+00:00, run_end_date=2024-05-26 00:38:02.555109+00:00, run_duration=1.65652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:36:00+00:00, data_interval_end=2024-05-26 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:38:02.563229896Z [2024-05-26T00:38:02.562+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:38:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:38:02.569148211Z [2024-05-26T00:38:02.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:38:02.569480358Z [2024-05-26T00:38:02.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:37:00+00:00, run_id=scheduled__2024-05-26T00:37:00+00:00, run_start_date=2024-05-26 00:38:00.900083+00:00, run_end_date=2024-05-26 00:38:02.569093+00:00, run_duration=1.66901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:37:00+00:00, data_interval_end=2024-05-26 00:38:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:38:02.578717646Z [2024-05-26T00:38:02.578+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:38:00+00:00, run_after=2024-05-26T00:39:00+00:00 2024-05-26T00:38:02.639450638Z [2024-05-26T00:38:02.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:36:00+00:00 exited with status success for try_number 1 2024-05-26T00:38:02.639984343Z [2024-05-26T00:38:02.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:37:00+00:00 exited with status success for try_number 1 2024-05-26T00:38:02.653819127Z [2024-05-26T00:38:02.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:36:00+00:00, map_index=-1, run_start_date=2024-05-26 00:38:01.905673+00:00, run_end_date=2024-05-26 00:38:02.276750+00:00, run_duration=0.371077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:38:01.010371+00:00, queued_by_job_id=1, pid=7658 2024-05-26T00:38:02.654275297Z [2024-05-26T00:38:02.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:37:00+00:00, map_index=-1, run_start_date=2024-05-26 00:38:01.858008+00:00, run_end_date=2024-05-26 00:38:02.333370+00:00, run_duration=0.475362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:38:01.010371+00:00, queued_by_job_id=1, pid=7657 2024-05-26T00:38:04.847119741Z [2024-05-26T00:38:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:38:04.847584515Z [2024-05-26T00:38:04.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:37:00+00:00, run_id=scheduled__2024-05-26T00:37:00+00:00, run_start_date=2024-05-26 00:38:00.901294+00:00, run_end_date=2024-05-26 00:38:04.847033+00:00, run_duration=3.945739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:37:00+00:00, data_interval_end=2024-05-26 00:38:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:38:04.885154689Z [2024-05-26T00:38:04.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:38:00+00:00, run_after=2024-05-26T00:39:00+00:00 2024-05-26T00:38:04.920449398Z [2024-05-26T00:38:04.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:38:04.929538603Z [2024-05-26T00:38:04.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:37:00+00:00, run_id=scheduled__2024-05-26T00:37:00+00:00, run_start_date=2024-05-26 00:38:00.902363+00:00, run_end_date=2024-05-26 00:38:04.920371+00:00, run_duration=4.018008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:37:00+00:00, data_interval_end=2024-05-26 00:38:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:38:04.965711304Z [2024-05-26T00:38:04.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:38:00+00:00, run_after=2024-05-26T00:39:00+00:00 2024-05-26T00:38:05.016881861Z [2024-05-26T00:38:05.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:37:00+00:00 exited with status success for try_number 1 2024-05-26T00:38:05.023123453Z [2024-05-26T00:38:05.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:37:00+00:00, map_index=-1, run_start_date=2024-05-26 00:38:02.987809+00:00, run_end_date=2024-05-26 00:38:04.299637+00:00, run_duration=1.311828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:38:01.010371+00:00, queued_by_job_id=1, pid=7681 2024-05-26T00:38:06.125553456Z [2024-05-26T00:38:06.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:37:00+00:00 exited with status success for try_number 1 2024-05-26T00:38:06.136290800Z [2024-05-26T00:38:06.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:37:00+00:00, map_index=-1, run_start_date=2024-05-26 00:38:03.191488+00:00, run_end_date=2024-05-26 00:38:04.798075+00:00, run_duration=1.606587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:38:01.010371+00:00, queued_by_job_id=1, pid=7682 2024-05-26T00:38:31.621861977Z [2024-05-26T00:38:31.621+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:39:00.696636773Z [2024-05-26T00:39:00.696+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:39:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:39:00.713038235Z [2024-05-26T00:39:00.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:39:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:39:00.722612303Z [2024-05-26T00:39:00.722+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:39:00.785264074Z [2024-05-26T00:39:00.784+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:39:00.785312882Z 2024-05-26T00:39:00.785320662Z 2024-05-26T00:39:00.785327878Z 2024-05-26T00:39:00.785422085Z [2024-05-26T00:39:00.785+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:39:00.785433849Z [2024-05-26T00:39:00.785+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:39:00.785525943Z [2024-05-26T00:39:00.785+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:39:00.786190568Z [2024-05-26T00:39:00.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:39:00.786209269Z 2024-05-26T00:39:00.786217046Z 2024-05-26T00:39:00.786224031Z 2024-05-26T00:39:00.789843051Z [2024-05-26T00:39:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:39:00.790080148Z [2024-05-26T00:39:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:39:00.790431286Z [2024-05-26T00:39:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:39:00.790447684Z [2024-05-26T00:39:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:39:00.790679898Z [2024-05-26T00:39:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:39:00.790775817Z [2024-05-26T00:39:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:39:01.027208115Z [2024-05-26T00:39:01.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status queued for try_number 1 2024-05-26T00:39:01.027429227Z [2024-05-26T00:39:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status queued for try_number 1 2024-05-26T00:39:01.027639403Z [2024-05-26T00:39:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status queued for try_number 1 2024-05-26T00:39:01.036155014Z [2024-05-26T00:39:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to b22f99af-3909-44b4-8556-88960f5088d2 2024-05-26T00:39:01.036485603Z [2024-05-26T00:39:01.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5af6352b-8943-4ad6-94e3-ca4006b6c732 2024-05-26T00:39:01.036706644Z [2024-05-26T00:39:01.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c7ea61e-d9b9-40f1-98e3-5454266c2a31 2024-05-26T00:39:02.178545468Z [2024-05-26T00:39:02.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:39:02.178880670Z [2024-05-26T00:39:02.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:38:00+00:00, run_id=scheduled__2024-05-26T00:38:00+00:00, run_start_date=2024-05-26 00:39:00.735060+00:00, run_end_date=2024-05-26 00:39:02.178482+00:00, run_duration=1.443422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:38:00+00:00, data_interval_end=2024-05-26 00:39:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:39:02.194573686Z [2024-05-26T00:39:02.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:39:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:39:02.248897484Z [2024-05-26T00:39:02.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status success for try_number 1 2024-05-26T00:39:02.254531626Z [2024-05-26T00:39:02.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:38:00+00:00, map_index=-1, run_start_date=2024-05-26 00:39:01.597090+00:00, run_end_date=2024-05-26 00:39:02.069542+00:00, run_duration=0.472452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:39:00.786886+00:00, queued_by_job_id=1, pid=7714 2024-05-26T00:39:04.723978042Z [2024-05-26T00:39:04.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:39:04.724147139Z [2024-05-26T00:39:04.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:38:00+00:00, run_id=scheduled__2024-05-26T00:38:00+00:00, run_start_date=2024-05-26 00:39:00.736354+00:00, run_end_date=2024-05-26 00:39:04.723853+00:00, run_duration=3.987499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:38:00+00:00, data_interval_end=2024-05-26 00:39:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:39:04.733601105Z [2024-05-26T00:39:04.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:39:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:39:04.806332017Z [2024-05-26T00:39:04.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status success for try_number 1 2024-05-26T00:39:04.811678670Z [2024-05-26T00:39:04.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:38:00+00:00, map_index=-1, run_start_date=2024-05-26 00:39:02.738724+00:00, run_end_date=2024-05-26 00:39:04.599451+00:00, run_duration=1.860727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:39:00.786886+00:00, queued_by_job_id=1, pid=7732 2024-05-26T00:39:05.895560945Z [2024-05-26T00:39:05.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:39:05.895798563Z [2024-05-26T00:39:05.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:38:00+00:00, run_id=scheduled__2024-05-26T00:38:00+00:00, run_start_date=2024-05-26 00:39:00.737376+00:00, run_end_date=2024-05-26 00:39:05.895499+00:00, run_duration=5.158123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:38:00+00:00, data_interval_end=2024-05-26 00:39:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:39:05.903920488Z [2024-05-26T00:39:05.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:39:00+00:00, run_after=2024-05-26T00:40:00+00:00 2024-05-26T00:39:05.937965316Z [2024-05-26T00:39:05.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status success for try_number 1 2024-05-26T00:39:05.944289864Z [2024-05-26T00:39:05.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:38:00+00:00, map_index=-1, run_start_date=2024-05-26 00:39:02.872136+00:00, run_end_date=2024-05-26 00:39:05.700810+00:00, run_duration=2.828674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:39:00.786886+00:00, queued_by_job_id=1, pid=7733 2024-05-26T00:40:00.637807591Z [2024-05-26T00:40:00.637+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:41:00+00:00 2024-05-26T00:40:00.651675655Z [2024-05-26T00:40:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:45:00+00:00 2024-05-26T00:40:00.662415855Z [2024-05-26T00:40:00.660+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:40:00.669562802Z [2024-05-26T00:40:00.669+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:40:00.683191956Z [2024-05-26T00:40:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:41:00+00:00 2024-05-26T00:40:00.802703348Z [2024-05-26T00:40:00.802+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T00:40:00.802742879Z 2024-05-26T00:40:00.802747963Z 2024-05-26T00:40:00.802753196Z 2024-05-26T00:40:00.802757557Z 2024-05-26T00:40:00.802762122Z 2024-05-26T00:40:00.802776677Z [2024-05-26T00:40:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:40:00.802959842Z [2024-05-26T00:40:00.802+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:40:00.803083078Z [2024-05-26T00:40:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:40:00.803278228Z [2024-05-26T00:40:00.803+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:40:00.803407530Z [2024-05-26T00:40:00.803+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:40:00.804436726Z [2024-05-26T00:40:00.804+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:40:00.804452406Z 2024-05-26T00:40:00.804458208Z 2024-05-26T00:40:00.804471777Z 2024-05-26T00:40:00.804476446Z 2024-05-26T00:40:00.804481212Z 2024-05-26T00:40:00.808398881Z [2024-05-26T00:40:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:40:00.808583224Z [2024-05-26T00:40:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:40:00.808880824Z [2024-05-26T00:40:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:40:00.809029489Z [2024-05-26T00:40:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:40:00.809348153Z [2024-05-26T00:40:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:40:00.809494491Z [2024-05-26T00:40:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:40:00.809778462Z [2024-05-26T00:40:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:40:00.809915983Z [2024-05-26T00:40:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:40:00.810270261Z [2024-05-26T00:40:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:40:00.810331905Z [2024-05-26T00:40:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:40:01.406112965Z [2024-05-26T00:40:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:01.406855116Z [2024-05-26T00:40:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:01.407228377Z [2024-05-26T00:40:01.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:39:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:01.407541784Z [2024-05-26T00:40:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:39:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:01.407737381Z [2024-05-26T00:40:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:39:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:01.421752935Z [2024-05-26T00:40:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34773470-991d-427b-a5d2-afd64f6cdaee 2024-05-26T00:40:01.422016543Z [2024-05-26T00:40:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac52c8a2-f1f5-4fc7-a83a-1fc96728c797 2024-05-26T00:40:01.422256704Z [2024-05-26T00:40:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 791e463f-9770-4b1b-932e-aa540ec77be2 2024-05-26T00:40:01.422423507Z [2024-05-26T00:40:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1628b717-add8-4ace-9148-f8de30e79038 2024-05-26T00:40:01.423184707Z [2024-05-26T00:40:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb2dd2a7-6b3f-43a8-84c8-583b9d605049 2024-05-26T00:40:02.714759066Z [2024-05-26T00:40:02.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:40:02.715135951Z [2024-05-26T00:40:02.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:39:00+00:00, run_id=scheduled__2024-05-26T00:39:00+00:00, run_start_date=2024-05-26 00:40:00.698844+00:00, run_end_date=2024-05-26 00:40:02.714751+00:00, run_duration=2.015907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:39:00+00:00, data_interval_end=2024-05-26 00:40:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:40:02.724877269Z [2024-05-26T00:40:02.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:41:00+00:00 2024-05-26T00:40:02.748323707Z [2024-05-26T00:40:02.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:40:02.749966286Z [2024-05-26T00:40:02.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:38:00+00:00, run_id=scheduled__2024-05-26T00:38:00+00:00, run_start_date=2024-05-26 00:40:00.697084+00:00, run_end_date=2024-05-26 00:40:02.749618+00:00, run_duration=2.052534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:38:00+00:00, data_interval_end=2024-05-26 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:40:02.761086023Z [2024-05-26T00:40:02.760+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:42:00+00:00 2024-05-26T00:40:02.807211383Z [2024-05-26T00:40:02.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:38:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:02.807430567Z [2024-05-26T00:40:02.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:39:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:02.814331270Z [2024-05-26T00:40:02.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:39:00+00:00, map_index=-1, run_start_date=2024-05-26 00:40:01.775576+00:00, run_end_date=2024-05-26 00:40:02.184994+00:00, run_duration=0.409418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:00.805557+00:00, queued_by_job_id=1, pid=7767 2024-05-26T00:40:02.814719254Z [2024-05-26T00:40:02.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:38:00+00:00, map_index=-1, run_start_date=2024-05-26 00:40:02.061768+00:00, run_end_date=2024-05-26 00:40:02.484090+00:00, run_duration=0.422322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:00.805557+00:00, queued_by_job_id=1, pid=7774 2024-05-26T00:40:04.712332704Z [2024-05-26T00:40:04.711+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:40:04.712384991Z 2024-05-26T00:40:04.712425868Z [2024-05-26T00:40:04.712+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:40:04.712946752Z [2024-05-26T00:40:04.712+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:40:04.712963445Z 2024-05-26T00:40:04.715211440Z [2024-05-26T00:40:04.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:40:04.715299461Z [2024-05-26T00:40:04.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:40:04.780248772Z [2024-05-26T00:40:04.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:04.780335745Z [2024-05-26T00:40:04.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:04.790418973Z [2024-05-26T00:40:04.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 990d2ad0-6cfc-42aa-b37f-b7266775882f 2024-05-26T00:40:04.790454720Z [2024-05-26T00:40:04.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:35:00+00:00, map_index=-1, run_start_date=2024-05-26 00:40:03.383042+00:00, run_end_date=2024-05-26 00:40:04.084822+00:00, run_duration=0.70178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:00.805557+00:00, queued_by_job_id=1, pid=7803 2024-05-26T00:40:04.855251418Z [2024-05-26T00:40:04.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:40:04.855473921Z [2024-05-26T00:40:04.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:39:00+00:00, run_id=scheduled__2024-05-26T00:39:00+00:00, run_start_date=2024-05-26 00:40:00.701511+00:00, run_end_date=2024-05-26 00:40:04.855156+00:00, run_duration=4.153645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:39:00+00:00, data_interval_end=2024-05-26 00:40:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:40:04.870090166Z [2024-05-26T00:40:04.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:41:00+00:00 2024-05-26T00:40:06.027489715Z [2024-05-26T00:40:06.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:40:06.028049941Z [2024-05-26T00:40:06.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:39:00+00:00, run_id=scheduled__2024-05-26T00:39:00+00:00, run_start_date=2024-05-26 00:40:00.700011+00:00, run_end_date=2024-05-26 00:40:06.027386+00:00, run_duration=5.327375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:39:00+00:00, data_interval_end=2024-05-26 00:40:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:40:06.041979240Z [2024-05-26T00:40:06.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:41:00+00:00 2024-05-26T00:40:06.091602829Z [2024-05-26T00:40:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:39:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:06.091826179Z [2024-05-26T00:40:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:39:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:06.098130009Z [2024-05-26T00:40:06.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:39:00+00:00, map_index=-1, run_start_date=2024-05-26 00:40:02.993875+00:00, run_end_date=2024-05-26 00:40:04.739973+00:00, run_duration=1.746098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:00.805557+00:00, queued_by_job_id=1, pid=7787 2024-05-26T00:40:06.098595548Z [2024-05-26T00:40:06.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:39:00+00:00, map_index=-1, run_start_date=2024-05-26 00:40:03.521488+00:00, run_end_date=2024-05-26 00:40:05.079916+00:00, run_duration=1.558428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:00.805557+00:00, queued_by_job_id=1, pid=7804 2024-05-26T00:40:07.239440512Z [2024-05-26T00:40:07.239+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:40:07.239472750Z 2024-05-26T00:40:07.239837933Z [2024-05-26T00:40:07.239+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:40:07.240466391Z [2024-05-26T00:40:07.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:40:07.240477993Z 2024-05-26T00:40:07.243210748Z [2024-05-26T00:40:07.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:40:07.243388404Z [2024-05-26T00:40:07.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:40:07.321583411Z [2024-05-26T00:40:07.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:07.329771032Z [2024-05-26T00:40:07.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42d6e9d0-c88a-4bb8-8315-528fbb48ccad 2024-05-26T00:40:07.422553488Z [2024-05-26T00:40:07.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:07.430972565Z [2024-05-26T00:40:07.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:35:00+00:00, map_index=-1, run_start_date=2024-05-26 00:40:06.688246+00:00, run_end_date=2024-05-26 00:40:07.106706+00:00, run_duration=0.41846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:04.713263+00:00, queued_by_job_id=1, pid=7822 2024-05-26T00:40:09.769306895Z [2024-05-26T00:40:09.768+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:40:09.769348192Z 2024-05-26T00:40:09.769615276Z [2024-05-26T00:40:09.769+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:40:09.770757835Z [2024-05-26T00:40:09.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:40:09.770775300Z 2024-05-26T00:40:09.774006902Z [2024-05-26T00:40:09.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:40:09.774251852Z [2024-05-26T00:40:09.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:40:09.858573983Z [2024-05-26T00:40:09.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status queued for try_number 1 2024-05-26T00:40:09.859096661Z [2024-05-26T00:40:09.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:09.869987387Z [2024-05-26T00:40:09.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16761059-2b5a-4d10-a55b-1f506895b5e6 2024-05-26T00:40:09.870527270Z [2024-05-26T00:40:09.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:35:00+00:00, map_index=0, run_start_date=2024-05-26 00:40:08.960936+00:00, run_end_date=2024-05-26 00:40:09.332444+00:00, run_duration=0.371508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:07.240954+00:00, queued_by_job_id=1, pid=7830 2024-05-26T00:40:12.120918380Z [2024-05-26T00:40:12.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:40:12.121328665Z [2024-05-26T00:40:12.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:35:00+00:00, run_id=scheduled__2024-05-26T00:35:00+00:00, run_start_date=2024-05-26 00:40:00.695734+00:00, run_end_date=2024-05-26 00:40:12.120708+00:00, run_duration=11.424974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:35:00+00:00, data_interval_end=2024-05-26 00:40:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:40:12.134553664Z [2024-05-26T00:40:12.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:40:00+00:00, run_after=2024-05-26T00:45:00+00:00 2024-05-26T00:40:12.182887169Z [2024-05-26T00:40:12.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:35:00+00:00 exited with status success for try_number 1 2024-05-26T00:40:12.188720528Z [2024-05-26T00:40:12.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:35:00+00:00, map_index=-1, run_start_date=2024-05-26 00:40:11.527392+00:00, run_end_date=2024-05-26 00:40:11.879308+00:00, run_duration=0.351916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:40:09.771283+00:00, queued_by_job_id=1, pid=7838 2024-05-26T00:41:00.138925105Z [2024-05-26T00:41:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:41:00.159717829Z [2024-05-26T00:41:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:41:00+00:00, run_after=2024-05-26T00:42:00+00:00 2024-05-26T00:41:00.179998429Z [2024-05-26T00:41:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:41:00+00:00, run_after=2024-05-26T00:42:00+00:00 2024-05-26T00:41:00.298592517Z [2024-05-26T00:41:00.297+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:41:00.298642715Z 2024-05-26T00:41:00.298653722Z 2024-05-26T00:41:00.298662528Z 2024-05-26T00:41:00.298671025Z [2024-05-26T00:41:00.298+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:41:00.299248550Z [2024-05-26T00:41:00.298+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:41:00.299647011Z [2024-05-26T00:41:00.299+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:41:00.301398567Z [2024-05-26T00:41:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:41:00.301452060Z 2024-05-26T00:41:00.301459908Z 2024-05-26T00:41:00.301466504Z 2024-05-26T00:41:00.308610859Z [2024-05-26T00:41:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:41:00.308942403Z [2024-05-26T00:41:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:41:00.309434187Z [2024-05-26T00:41:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:41:00.309668312Z [2024-05-26T00:41:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:41:00.310166500Z [2024-05-26T00:41:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:41:00.310398746Z [2024-05-26T00:41:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:41:00.550776158Z [2024-05-26T00:41:00.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:41:00.550863567Z [2024-05-26T00:41:00.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:41:00.550914522Z [2024-05-26T00:41:00.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:41:00.562014311Z [2024-05-26T00:41:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2b1575e-e18f-44a3-956b-a69e4afab0b5 2024-05-26T00:41:00.562081783Z [2024-05-26T00:41:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to f70cea38-7ae5-4dcc-8c91-bb6986aae1cc 2024-05-26T00:41:00.562203110Z [2024-05-26T00:41:00.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2152f53a-72a0-42bb-9532-6c8f5bf50c1a 2024-05-26T00:41:01.700712956Z [2024-05-26T00:41:01.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:41:01.701511747Z [2024-05-26T00:41:01.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:40:00+00:00, run_id=scheduled__2024-05-26T00:40:00+00:00, run_start_date=2024-05-26 00:41:00.197995+00:00, run_end_date=2024-05-26 00:41:01.700566+00:00, run_duration=1.502571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:40:00+00:00, data_interval_end=2024-05-26 00:41:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:41:01.712514404Z [2024-05-26T00:41:01.712+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:41:00+00:00, run_after=2024-05-26T00:42:00+00:00 2024-05-26T00:41:01.762058437Z [2024-05-26T00:41:01.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:41:01.770374237Z [2024-05-26T00:41:01.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=-1, run_start_date=2024-05-26 00:41:01.151239+00:00, run_end_date=2024-05-26 00:41:01.526032+00:00, run_duration=0.374793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:41:00.303248+00:00, queued_by_job_id=1, pid=7859 2024-05-26T00:41:03.943544343Z [2024-05-26T00:41:03.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:41:03.943945852Z [2024-05-26T00:41:03.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:40:00+00:00, run_id=scheduled__2024-05-26T00:40:00+00:00, run_start_date=2024-05-26 00:41:00.200100+00:00, run_end_date=2024-05-26 00:41:03.943437+00:00, run_duration=3.743337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:40:00+00:00, data_interval_end=2024-05-26 00:41:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:41:03.953005575Z [2024-05-26T00:41:03.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:41:00+00:00, run_after=2024-05-26T00:42:00+00:00 2024-05-26T00:41:03.965290429Z [2024-05-26T00:41:03.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:41:03.965429652Z [2024-05-26T00:41:03.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:40:00+00:00, run_id=scheduled__2024-05-26T00:40:00+00:00, run_start_date=2024-05-26 00:41:00.202695+00:00, run_end_date=2024-05-26 00:41:03.965196+00:00, run_duration=3.762501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:40:00+00:00, data_interval_end=2024-05-26 00:41:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:41:03.979810275Z [2024-05-26T00:41:03.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:41:00+00:00, run_after=2024-05-26T00:42:00+00:00 2024-05-26T00:41:04.080507058Z [2024-05-26T00:41:04.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:41:04.080583291Z [2024-05-26T00:41:04.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:41:04.091874974Z [2024-05-26T00:41:04.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=-1, run_start_date=2024-05-26 00:41:02.108468+00:00, run_end_date=2024-05-26 00:41:03.432408+00:00, run_duration=1.32394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:41:00.303248+00:00, queued_by_job_id=1, pid=7877 2024-05-26T00:41:04.092124609Z [2024-05-26T00:41:04.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=-1, run_start_date=2024-05-26 00:41:02.217382+00:00, run_end_date=2024-05-26 00:41:03.873992+00:00, run_duration=1.65661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:41:00.303248+00:00, queued_by_job_id=1, pid=7878 2024-05-26T00:42:00.551999000Z [2024-05-26T00:42:00.550+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:42:00.573104653Z [2024-05-26T00:42:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:42:00+00:00, run_after=2024-05-26T00:43:00+00:00 2024-05-26T00:42:00.580576313Z [2024-05-26T00:42:00.580+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:42:00.595172198Z [2024-05-26T00:42:00.594+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:42:00+00:00, run_after=2024-05-26T00:43:00+00:00 2024-05-26T00:42:00.665466412Z [2024-05-26T00:42:00.664+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:42:00.665487565Z 2024-05-26T00:42:00.665491808Z 2024-05-26T00:42:00.665494821Z 2024-05-26T00:42:00.665497736Z 2024-05-26T00:42:00.666660890Z [2024-05-26T00:42:00.665+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:42:00.667221201Z [2024-05-26T00:42:00.666+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:42:00.667526727Z [2024-05-26T00:42:00.667+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:42:00.667789130Z [2024-05-26T00:42:00.667+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:42:00.668922980Z [2024-05-26T00:42:00.668+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:42:00.668928503Z 2024-05-26T00:42:00.668931722Z 2024-05-26T00:42:00.668934886Z 2024-05-26T00:42:00.668937979Z 2024-05-26T00:42:00.674114609Z [2024-05-26T00:42:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:42:00.674492051Z [2024-05-26T00:42:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:42:00.674946892Z [2024-05-26T00:42:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:42:00.675213078Z [2024-05-26T00:42:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:42:00.675670241Z [2024-05-26T00:42:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:42:00.675917615Z [2024-05-26T00:42:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:42:00.676367683Z [2024-05-26T00:42:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:42:00.676588995Z [2024-05-26T00:42:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:42:01.283282051Z [2024-05-26T00:42:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:42:01.287819701Z [2024-05-26T00:42:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:41:00+00:00 exited with status queued for try_number 1 2024-05-26T00:42:01.288058075Z [2024-05-26T00:42:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:41:00+00:00 exited with status queued for try_number 1 2024-05-26T00:42:01.288215244Z [2024-05-26T00:42:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:41:00+00:00 exited with status queued for try_number 1 2024-05-26T00:42:01.311204365Z [2024-05-26T00:42:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to fea09ca1-8a9d-40d9-9848-22b015e840d5 2024-05-26T00:42:01.311424942Z [2024-05-26T00:42:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57e17850-1125-4ca2-ba42-82191ede666c 2024-05-26T00:42:01.311653444Z [2024-05-26T00:42:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 818dbf9e-cded-4287-a892-a499548c28b2 2024-05-26T00:42:01.311853819Z [2024-05-26T00:42:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6772c13-04b9-4961-ad81-53d4cbaba97e 2024-05-26T00:42:02.712335439Z [2024-05-26T00:42:02.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:42:02.712851183Z [2024-05-26T00:42:02.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:41:00+00:00, run_id=scheduled__2024-05-26T00:41:00+00:00, run_start_date=2024-05-26 00:42:00.606283+00:00, run_end_date=2024-05-26 00:42:02.712387+00:00, run_duration=2.106104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:41:00+00:00, data_interval_end=2024-05-26 00:42:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:42:02.729888431Z [2024-05-26T00:42:02.729+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:42:00+00:00, run_after=2024-05-26T00:43:00+00:00 2024-05-26T00:42:02.740901843Z [2024-05-26T00:42:02.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:42:02.741368995Z [2024-05-26T00:42:02.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:40:00+00:00, run_id=scheduled__2024-05-26T00:40:00+00:00, run_start_date=2024-05-26 00:42:00.605092+00:00, run_end_date=2024-05-26 00:42:02.740996+00:00, run_duration=2.135904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:40:00+00:00, data_interval_end=2024-05-26 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:42:02.753632167Z [2024-05-26T00:42:02.753+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:42:00+00:00, run_after=2024-05-26T00:44:00+00:00 2024-05-26T00:42:02.829454945Z [2024-05-26T00:42:02.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:42:02.829558765Z [2024-05-26T00:42:02.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:41:00+00:00 exited with status success for try_number 1 2024-05-26T00:42:02.837580492Z [2024-05-26T00:42:02.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=-1, run_start_date=2024-05-26 00:42:01.503314+00:00, run_end_date=2024-05-26 00:42:01.843187+00:00, run_duration=0.339873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:42:00.670358+00:00, queued_by_job_id=1, pid=7909 2024-05-26T00:42:02.837897785Z [2024-05-26T00:42:02.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:41:00+00:00, map_index=-1, run_start_date=2024-05-26 00:42:01.751692+00:00, run_end_date=2024-05-26 00:42:02.123005+00:00, run_duration=0.371313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:42:00.670358+00:00, queued_by_job_id=1, pid=7912 2024-05-26T00:42:04.962996843Z [2024-05-26T00:42:04.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:42:04.963345447Z [2024-05-26T00:42:04.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:41:00+00:00, run_id=scheduled__2024-05-26T00:41:00+00:00, run_start_date=2024-05-26 00:42:00.607334+00:00, run_end_date=2024-05-26 00:42:04.962933+00:00, run_duration=4.355599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:41:00+00:00, data_interval_end=2024-05-26 00:42:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:42:04.976489585Z [2024-05-26T00:42:04.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:42:00+00:00, run_after=2024-05-26T00:43:00+00:00 2024-05-26T00:42:04.984249310Z [2024-05-26T00:42:04.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:42:04.984828700Z [2024-05-26T00:42:04.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:41:00+00:00, run_id=scheduled__2024-05-26T00:41:00+00:00, run_start_date=2024-05-26 00:42:00.608507+00:00, run_end_date=2024-05-26 00:42:04.984200+00:00, run_duration=4.375693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:41:00+00:00, data_interval_end=2024-05-26 00:42:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:42:04.997556290Z [2024-05-26T00:42:04.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:42:00+00:00, run_after=2024-05-26T00:43:00+00:00 2024-05-26T00:42:05.051158650Z [2024-05-26T00:42:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:41:00+00:00 exited with status success for try_number 1 2024-05-26T00:42:05.051466972Z [2024-05-26T00:42:05.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:41:00+00:00 exited with status success for try_number 1 2024-05-26T00:42:05.059106972Z [2024-05-26T00:42:05.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:41:00+00:00, map_index=-1, run_start_date=2024-05-26 00:42:02.674376+00:00, run_end_date=2024-05-26 00:42:03.937533+00:00, run_duration=1.263157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:42:00.670358+00:00, queued_by_job_id=1, pid=7935 2024-05-26T00:42:05.059571334Z [2024-05-26T00:42:05.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:41:00+00:00, map_index=-1, run_start_date=2024-05-26 00:42:02.532727+00:00, run_end_date=2024-05-26 00:42:04.126442+00:00, run_duration=1.593715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:42:00.670358+00:00, queued_by_job_id=1, pid=7934 2024-05-26T00:43:01.056042351Z [2024-05-26T00:43:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:43:00+00:00, run_after=2024-05-26T00:44:00+00:00 2024-05-26T00:43:01.066297403Z [2024-05-26T00:43:01.065+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:43:01.079359743Z [2024-05-26T00:43:01.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:43:00+00:00, run_after=2024-05-26T00:44:00+00:00 2024-05-26T00:43:01.153520717Z [2024-05-26T00:43:01.153+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:43:01.153554876Z 2024-05-26T00:43:01.153582339Z 2024-05-26T00:43:01.153588935Z 2024-05-26T00:43:01.154011892Z [2024-05-26T00:43:01.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:43:01.154362870Z [2024-05-26T00:43:01.154+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:43:01.154691194Z [2024-05-26T00:43:01.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:43:01.155814935Z [2024-05-26T00:43:01.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:43:01.155852996Z 2024-05-26T00:43:01.155859718Z 2024-05-26T00:43:01.155865095Z 2024-05-26T00:43:01.160980706Z [2024-05-26T00:43:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:43:01.161440119Z [2024-05-26T00:43:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:43:01.161960299Z [2024-05-26T00:43:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:43:01.162324233Z [2024-05-26T00:43:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:43:01.162733553Z [2024-05-26T00:43:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:43:01.163111272Z [2024-05-26T00:43:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:43:01.443703709Z [2024-05-26T00:43:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status queued for try_number 1 2024-05-26T00:43:01.443790574Z [2024-05-26T00:43:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status queued for try_number 1 2024-05-26T00:43:01.443939492Z [2024-05-26T00:43:01.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status queued for try_number 1 2024-05-26T00:43:01.450984539Z [2024-05-26T00:43:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2ec7375-a428-4b84-8cf5-563526f2460f 2024-05-26T00:43:01.451054938Z [2024-05-26T00:43:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31bf6697-cc65-432b-be61-19e36b6df2cb 2024-05-26T00:43:01.451219428Z [2024-05-26T00:43:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 032b14c6-98d9-49cc-9844-615b5bbb41bf 2024-05-26T00:43:02.555344461Z [2024-05-26T00:43:02.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:43:02.555760936Z [2024-05-26T00:43:02.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:42:00+00:00, run_id=scheduled__2024-05-26T00:42:00+00:00, run_start_date=2024-05-26 00:43:01.091167+00:00, run_end_date=2024-05-26 00:43:02.555266+00:00, run_duration=1.464099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:42:00+00:00, data_interval_end=2024-05-26 00:43:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:43:02.565574882Z [2024-05-26T00:43:02.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:43:00+00:00, run_after=2024-05-26T00:44:00+00:00 2024-05-26T00:43:03.726490081Z [2024-05-26T00:43:03.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status success for try_number 1 2024-05-26T00:43:03.736057701Z [2024-05-26T00:43:03.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:42:00+00:00, map_index=-1, run_start_date=2024-05-26 00:43:02.117913+00:00, run_end_date=2024-05-26 00:43:02.499991+00:00, run_duration=0.382078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:43:01.157082+00:00, queued_by_job_id=1, pid=7967 2024-05-26T00:43:04.795458567Z [2024-05-26T00:43:04.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:43:04.797515266Z [2024-05-26T00:43:04.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:42:00+00:00, run_id=scheduled__2024-05-26T00:42:00+00:00, run_start_date=2024-05-26 00:43:01.092502+00:00, run_end_date=2024-05-26 00:43:04.795348+00:00, run_duration=3.702846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:42:00+00:00, data_interval_end=2024-05-26 00:43:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:43:04.813326429Z [2024-05-26T00:43:04.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:43:00+00:00, run_after=2024-05-26T00:44:00+00:00 2024-05-26T00:43:05.982454622Z [2024-05-26T00:43:05.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status success for try_number 1 2024-05-26T00:43:05.988646445Z [2024-05-26T00:43:05.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:42:00+00:00, map_index=-1, run_start_date=2024-05-26 00:43:02.923312+00:00, run_end_date=2024-05-26 00:43:04.686295+00:00, run_duration=1.762983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:43:01.157082+00:00, queued_by_job_id=1, pid=7984 2024-05-26T00:43:07.050131889Z [2024-05-26T00:43:07.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:43:07.050709072Z [2024-05-26T00:43:07.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:42:00+00:00, run_id=scheduled__2024-05-26T00:42:00+00:00, run_start_date=2024-05-26 00:43:01.093513+00:00, run_end_date=2024-05-26 00:43:07.050250+00:00, run_duration=5.956737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:42:00+00:00, data_interval_end=2024-05-26 00:43:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:43:07.069340384Z [2024-05-26T00:43:07.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:43:00+00:00, run_after=2024-05-26T00:44:00+00:00 2024-05-26T00:43:07.141985267Z [2024-05-26T00:43:07.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status success for try_number 1 2024-05-26T00:43:07.151193398Z [2024-05-26T00:43:07.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:42:00+00:00, map_index=-1, run_start_date=2024-05-26 00:43:03.084920+00:00, run_end_date=2024-05-26 00:43:06.472723+00:00, run_duration=3.387803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:43:01.157082+00:00, queued_by_job_id=1, pid=7985 2024-05-26T00:43:31.715287913Z [2024-05-26T00:43:31.714+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:44:00.439139278Z [2024-05-26T00:44:00.438+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:44:00.461769916Z [2024-05-26T00:44:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:44:00+00:00, run_after=2024-05-26T00:45:00+00:00 2024-05-26T00:44:00.492633271Z [2024-05-26T00:44:00.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:44:00+00:00, run_after=2024-05-26T00:45:00+00:00 2024-05-26T00:44:00.501272857Z [2024-05-26T00:44:00.500+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:44:00.596531870Z [2024-05-26T00:44:00.596+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:44:00.596558498Z 2024-05-26T00:44:00.596563966Z 2024-05-26T00:44:00.596568640Z 2024-05-26T00:44:00.596573023Z 2024-05-26T00:44:00.596801360Z [2024-05-26T00:44:00.596+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:44:00.597058180Z [2024-05-26T00:44:00.596+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:44:00.597314380Z [2024-05-26T00:44:00.597+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:44:00.597571642Z [2024-05-26T00:44:00.597+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:44:00.598422149Z [2024-05-26T00:44:00.598+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:44:00.598435656Z 2024-05-26T00:44:00.598440728Z 2024-05-26T00:44:00.598444779Z 2024-05-26T00:44:00.598468738Z 2024-05-26T00:44:00.604132425Z [2024-05-26T00:44:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:44:00.604491813Z [2024-05-26T00:44:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:44:00.604917980Z [2024-05-26T00:44:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:44:00.605227837Z [2024-05-26T00:44:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:44:00.605622687Z [2024-05-26T00:44:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:44:00.605888445Z [2024-05-26T00:44:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:44:00.606273430Z [2024-05-26T00:44:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:44:00.606545857Z [2024-05-26T00:44:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:44:01.100804141Z [2024-05-26T00:44:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status queued for try_number 1 2024-05-26T00:44:01.100863266Z [2024-05-26T00:44:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:43:00+00:00 exited with status queued for try_number 1 2024-05-26T00:44:01.100870019Z [2024-05-26T00:44:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:43:00+00:00 exited with status queued for try_number 1 2024-05-26T00:44:01.100954796Z [2024-05-26T00:44:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:43:00+00:00 exited with status queued for try_number 1 2024-05-26T00:44:01.113219711Z [2024-05-26T00:44:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33b8d493-f07b-43c5-ac45-a39d1642575a 2024-05-26T00:44:01.113259286Z [2024-05-26T00:44:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d300e69-3ebc-4c8e-b01c-121ca2fc8c3c 2024-05-26T00:44:01.113345670Z [2024-05-26T00:44:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4700f65a-424c-4051-b3ab-539eadb40ca5 2024-05-26T00:44:01.113454901Z [2024-05-26T00:44:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1343ec76-7ab1-447a-bbe9-de0244d06e90 2024-05-26T00:44:02.260857692Z [2024-05-26T00:44:02.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:44:02.261065761Z [2024-05-26T00:44:02.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:42:00+00:00, run_id=scheduled__2024-05-26T00:42:00+00:00, run_start_date=2024-05-26 00:44:00.512929+00:00, run_end_date=2024-05-26 00:44:02.260743+00:00, run_duration=1.747814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:42:00+00:00, data_interval_end=2024-05-26 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:44:02.268085361Z [2024-05-26T00:44:02.267+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:44:00+00:00, run_after=2024-05-26T00:46:00+00:00 2024-05-26T00:44:02.273889193Z [2024-05-26T00:44:02.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:44:02.274044052Z [2024-05-26T00:44:02.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:43:00+00:00, run_id=scheduled__2024-05-26T00:43:00+00:00, run_start_date=2024-05-26 00:44:00.514282+00:00, run_end_date=2024-05-26 00:44:02.273806+00:00, run_duration=1.759524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:43:00+00:00, data_interval_end=2024-05-26 00:44:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:44:02.284088169Z [2024-05-26T00:44:02.283+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:44:00+00:00, run_after=2024-05-26T00:45:00+00:00 2024-05-26T00:44:02.348353054Z [2024-05-26T00:44:02.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:42:00+00:00 exited with status success for try_number 1 2024-05-26T00:44:02.357841890Z [2024-05-26T00:44:02.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:42:00+00:00, map_index=-1, run_start_date=2024-05-26 00:44:01.656910+00:00, run_end_date=2024-05-26 00:44:02.050841+00:00, run_duration=0.393931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:44:00.599652+00:00, queued_by_job_id=1, pid=8020 2024-05-26T00:44:03.475501494Z [2024-05-26T00:44:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:43:00+00:00 exited with status success for try_number 1 2024-05-26T00:44:03.484168320Z [2024-05-26T00:44:03.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:43:00+00:00, map_index=-1, run_start_date=2024-05-26 00:44:01.746274+00:00, run_end_date=2024-05-26 00:44:02.212427+00:00, run_duration=0.466153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:44:00.599652+00:00, queued_by_job_id=1, pid=8021 2024-05-26T00:44:04.787585341Z [2024-05-26T00:44:04.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:44:04.788122867Z [2024-05-26T00:44:04.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:43:00+00:00, run_id=scheduled__2024-05-26T00:43:00+00:00, run_start_date=2024-05-26 00:44:00.515388+00:00, run_end_date=2024-05-26 00:44:04.787741+00:00, run_duration=4.272353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:43:00+00:00, data_interval_end=2024-05-26 00:44:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:44:04.798752291Z [2024-05-26T00:44:04.798+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:44:00+00:00, run_after=2024-05-26T00:45:00+00:00 2024-05-26T00:44:04.811632389Z [2024-05-26T00:44:04.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:44:04.811872922Z [2024-05-26T00:44:04.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:43:00+00:00, run_id=scheduled__2024-05-26T00:43:00+00:00, run_start_date=2024-05-26 00:44:00.516566+00:00, run_end_date=2024-05-26 00:44:04.811606+00:00, run_duration=4.29504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:43:00+00:00, data_interval_end=2024-05-26 00:44:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:44:04.821519787Z [2024-05-26T00:44:04.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:44:00+00:00, run_after=2024-05-26T00:45:00+00:00 2024-05-26T00:44:04.854209405Z [2024-05-26T00:44:04.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:43:00+00:00 exited with status success for try_number 1 2024-05-26T00:44:04.854238552Z [2024-05-26T00:44:04.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:43:00+00:00 exited with status success for try_number 1 2024-05-26T00:44:04.865830567Z [2024-05-26T00:44:04.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:43:00+00:00, map_index=-1, run_start_date=2024-05-26 00:44:02.714680+00:00, run_end_date=2024-05-26 00:44:04.672250+00:00, run_duration=1.95757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:44:00.599652+00:00, queued_by_job_id=1, pid=8045 2024-05-26T00:44:04.866109301Z [2024-05-26T00:44:04.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:43:00+00:00, map_index=-1, run_start_date=2024-05-26 00:44:02.554593+00:00, run_end_date=2024-05-26 00:44:03.774930+00:00, run_duration=1.220337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:44:00.599652+00:00, queued_by_job_id=1, pid=8044 2024-05-26T00:45:00.733578657Z [2024-05-26T00:45:00.733+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:45:00+00:00, run_after=2024-05-26T00:46:00+00:00 2024-05-26T00:45:00.766897821Z [2024-05-26T00:45:00.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:45:00+00:00, run_after=2024-05-26T00:46:00+00:00 2024-05-26T00:45:00.787127703Z [2024-05-26T00:45:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:45:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:45:00.798973030Z [2024-05-26T00:45:00.798+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:45:00.895669209Z [2024-05-26T00:45:00.895+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:45:00.895709797Z 2024-05-26T00:45:00.895723273Z 2024-05-26T00:45:00.895731460Z 2024-05-26T00:45:00.895739252Z 2024-05-26T00:45:00.896223020Z [2024-05-26T00:45:00.895+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:45:00.896647755Z [2024-05-26T00:45:00.896+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:45:00.897186475Z [2024-05-26T00:45:00.896+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:45:00.897651283Z [2024-05-26T00:45:00.897+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:45:00.899336182Z [2024-05-26T00:45:00.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:45:00.899360881Z 2024-05-26T00:45:00.899370556Z 2024-05-26T00:45:00.899378278Z 2024-05-26T00:45:00.899386061Z 2024-05-26T00:45:00.905941374Z [2024-05-26T00:45:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:45:00.906273749Z [2024-05-26T00:45:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:45:00.906710338Z [2024-05-26T00:45:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:45:00.906943311Z [2024-05-26T00:45:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:45:00.907418191Z [2024-05-26T00:45:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:45:00.907711317Z [2024-05-26T00:45:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:45:00.908170370Z [2024-05-26T00:45:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:45:00.908920389Z [2024-05-26T00:45:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:45:01.326867010Z [2024-05-26T00:45:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:45:01.331544125Z [2024-05-26T00:45:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status queued for try_number 1 2024-05-26T00:45:01.331782951Z [2024-05-26T00:45:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status queued for try_number 1 2024-05-26T00:45:01.332034794Z [2024-05-26T00:45:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status queued for try_number 1 2024-05-26T00:45:01.360981398Z [2024-05-26T00:45:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5383205b-1a6f-4fb3-b855-95b0bd746e4e 2024-05-26T00:45:01.361228711Z [2024-05-26T00:45:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37a06194-f929-40bc-98a8-fc547d86a835 2024-05-26T00:45:01.361410771Z [2024-05-26T00:45:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f74a207-f45d-406e-9623-410a524effba 2024-05-26T00:45:01.361598299Z [2024-05-26T00:45:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cc2c572-ebd3-4feb-aa89-f1b09b34a20e 2024-05-26T00:45:02.641641397Z [2024-05-26T00:45:02.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:45:02.641821863Z [2024-05-26T00:45:02.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:44:00+00:00, run_id=scheduled__2024-05-26T00:44:00+00:00, run_start_date=2024-05-26 00:45:00.814536+00:00, run_end_date=2024-05-26 00:45:02.641550+00:00, run_duration=1.827014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:44:00+00:00, data_interval_end=2024-05-26 00:45:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:45:02.652417012Z [2024-05-26T00:45:02.652+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:45:00+00:00, run_after=2024-05-26T00:46:00+00:00 2024-05-26T00:45:02.707783207Z [2024-05-26T00:45:02.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status success for try_number 1 2024-05-26T00:45:02.714652902Z [2024-05-26T00:45:02.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:44:00+00:00, map_index=-1, run_start_date=2024-05-26 00:45:01.772751+00:00, run_end_date=2024-05-26 00:45:02.262198+00:00, run_duration=0.489447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:45:00.901687+00:00, queued_by_job_id=1, pid=8078 2024-05-26T00:45:03.828482107Z [2024-05-26T00:45:03.827+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:45:03.828529102Z 2024-05-26T00:45:03.829098126Z [2024-05-26T00:45:03.828+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:45:03.830408262Z [2024-05-26T00:45:03.830+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:45:03.830421728Z 2024-05-26T00:45:03.835332703Z [2024-05-26T00:45:03.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:45:03.835734082Z [2024-05-26T00:45:03.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:45:03.892750487Z [2024-05-26T00:45:03.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:45:03.893161613Z [2024-05-26T00:45:03.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:45:03.907878105Z [2024-05-26T00:45:03.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to cae19185-6fab-4452-90a0-f17021c3fb24 2024-05-26T00:45:03.908212549Z [2024-05-26T00:45:03.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=-1, run_start_date=2024-05-26 00:45:02.929172+00:00, run_end_date=2024-05-26 00:45:03.312397+00:00, run_duration=0.383225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:45:00.901687+00:00, queued_by_job_id=1, pid=8104 2024-05-26T00:45:04.758235266Z [2024-05-26T00:45:04.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:45:04.758491044Z [2024-05-26T00:45:04.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:44:00+00:00, run_id=scheduled__2024-05-26T00:44:00+00:00, run_start_date=2024-05-26 00:45:00.815980+00:00, run_end_date=2024-05-26 00:45:04.758147+00:00, run_duration=3.942167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:44:00+00:00, data_interval_end=2024-05-26 00:45:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:45:04.766814820Z [2024-05-26T00:45:04.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:45:00+00:00, run_after=2024-05-26T00:46:00+00:00 2024-05-26T00:45:04.777008674Z [2024-05-26T00:45:04.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:45:04.777332346Z [2024-05-26T00:45:04.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:44:00+00:00, run_id=scheduled__2024-05-26T00:44:00+00:00, run_start_date=2024-05-26 00:45:00.817311+00:00, run_end_date=2024-05-26 00:45:04.776949+00:00, run_duration=3.959638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:44:00+00:00, data_interval_end=2024-05-26 00:45:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:45:04.793945052Z [2024-05-26T00:45:04.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:45:00+00:00, run_after=2024-05-26T00:46:00+00:00 2024-05-26T00:45:04.854387683Z [2024-05-26T00:45:04.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status success for try_number 1 2024-05-26T00:45:04.855273416Z [2024-05-26T00:45:04.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status success for try_number 1 2024-05-26T00:45:04.863930974Z [2024-05-26T00:45:04.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:44:00+00:00, map_index=-1, run_start_date=2024-05-26 00:45:02.843409+00:00, run_end_date=2024-05-26 00:45:04.107323+00:00, run_duration=1.263914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:45:00.901687+00:00, queued_by_job_id=1, pid=8102 2024-05-26T00:45:04.864257567Z [2024-05-26T00:45:04.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:44:00+00:00, map_index=-1, run_start_date=2024-05-26 00:45:02.880190+00:00, run_end_date=2024-05-26 00:45:04.612259+00:00, run_duration=1.732069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:45:00.901687+00:00, queued_by_job_id=1, pid=8103 2024-05-26T00:45:07.037408917Z [2024-05-26T00:45:07.036+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:45:07.037437266Z 2024-05-26T00:45:07.037521889Z [2024-05-26T00:45:07.037+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:45:07.039233616Z [2024-05-26T00:45:07.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:45:07.039267900Z 2024-05-26T00:45:07.043613273Z [2024-05-26T00:45:07.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:45:07.043761365Z [2024-05-26T00:45:07.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:45:07.111216236Z [2024-05-26T00:45:07.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:45:07.111245820Z [2024-05-26T00:45:07.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:45:07.117426146Z [2024-05-26T00:45:07.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 231fe79a-be9e-4c93-a785-85ccfb780451 2024-05-26T00:45:07.117673146Z [2024-05-26T00:45:07.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=-1, run_start_date=2024-05-26 00:45:05.692144+00:00, run_end_date=2024-05-26 00:45:06.050832+00:00, run_duration=0.358688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:45:03.831760+00:00, queued_by_job_id=1, pid=8127 2024-05-26T00:45:09.122051222Z [2024-05-26T00:45:09.121+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:45:09.122085683Z 2024-05-26T00:45:09.122150341Z [2024-05-26T00:45:09.121+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:45:09.122769301Z [2024-05-26T00:45:09.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:45:09.122776672Z 2024-05-26T00:45:09.125376142Z [2024-05-26T00:45:09.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:45:09.125409948Z [2024-05-26T00:45:09.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:45:09.195746806Z [2024-05-26T00:45:09.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status queued for try_number 1 2024-05-26T00:45:09.202718490Z [2024-05-26T00:45:09.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bc3c438-ab9f-4df4-8570-ad8bf9abbfe9 2024-05-26T00:45:09.281822604Z [2024-05-26T00:45:09.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:45:09.290268761Z [2024-05-26T00:45:09.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=0, run_start_date=2024-05-26 00:45:08.744565+00:00, run_end_date=2024-05-26 00:45:09.085615+00:00, run_duration=0.34105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:45:07.040195+00:00, queued_by_job_id=1, pid=8135 2024-05-26T00:45:11.631053594Z [2024-05-26T00:45:11.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:45:11.631420129Z [2024-05-26T00:45:11.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:40:00+00:00, run_id=scheduled__2024-05-26T00:40:00+00:00, run_start_date=2024-05-26 00:45:00.812881+00:00, run_end_date=2024-05-26 00:45:11.631041+00:00, run_duration=10.81816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:40:00+00:00, data_interval_end=2024-05-26 00:45:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:45:11.641952148Z [2024-05-26T00:45:11.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:45:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:45:11.680619866Z [2024-05-26T00:45:11.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:40:00+00:00 exited with status success for try_number 1 2024-05-26T00:45:11.686728009Z [2024-05-26T00:45:11.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:40:00+00:00, map_index=-1, run_start_date=2024-05-26 00:45:10.679747+00:00, run_end_date=2024-05-26 00:45:11.031122+00:00, run_duration=0.351375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:45:09.123181+00:00, queued_by_job_id=1, pid=8143 2024-05-26T00:46:00.737508644Z [2024-05-26T00:46:00.736+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:46:00.753325108Z [2024-05-26T00:46:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:46:00+00:00, run_after=2024-05-26T00:47:00+00:00 2024-05-26T00:46:00.759700960Z [2024-05-26T00:46:00.759+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:46:00.774410591Z [2024-05-26T00:46:00.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:46:00+00:00, run_after=2024-05-26T00:47:00+00:00 2024-05-26T00:46:00.844704543Z [2024-05-26T00:46:00.844+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:46:00.844747943Z 2024-05-26T00:46:00.844758630Z 2024-05-26T00:46:00.844767557Z 2024-05-26T00:46:00.844776132Z 2024-05-26T00:46:00.845474253Z [2024-05-26T00:46:00.845+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:46:00.846038275Z [2024-05-26T00:46:00.845+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:46:00.847276171Z [2024-05-26T00:46:00.846+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:46:00.847917792Z [2024-05-26T00:46:00.847+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:46:00.849287514Z [2024-05-26T00:46:00.848+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:46:00.849319013Z 2024-05-26T00:46:00.849347276Z 2024-05-26T00:46:00.849353723Z 2024-05-26T00:46:00.849359425Z 2024-05-26T00:46:00.857326397Z [2024-05-26T00:46:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:46:00.857765949Z [2024-05-26T00:46:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:46:00.858345195Z [2024-05-26T00:46:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:46:00.858704833Z [2024-05-26T00:46:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:46:00.859243754Z [2024-05-26T00:46:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:46:00.859511459Z [2024-05-26T00:46:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:46:00.859904852Z [2024-05-26T00:46:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:46:00.860183478Z [2024-05-26T00:46:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:46:01.228331764Z [2024-05-26T00:46:01.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status queued for try_number 1 2024-05-26T00:46:01.228373566Z [2024-05-26T00:46:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status queued for try_number 1 2024-05-26T00:46:01.228409630Z [2024-05-26T00:46:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status queued for try_number 1 2024-05-26T00:46:01.228500052Z [2024-05-26T00:46:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status queued for try_number 1 2024-05-26T00:46:01.245890353Z [2024-05-26T00:46:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36b8b2e7-de9c-4b73-8437-4ce3735e2a85 2024-05-26T00:46:01.245924690Z [2024-05-26T00:46:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to eca11c44-ec45-47c0-a527-48598b688b70 2024-05-26T00:46:01.246059409Z [2024-05-26T00:46:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to abf01106-f9f4-4f81-9b61-5af09108599f 2024-05-26T00:46:01.246135970Z [2024-05-26T00:46:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53d890f7-f5f7-425b-9b44-5e5414304ea7 2024-05-26T00:46:03.306285420Z [2024-05-26T00:46:03.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:46:03.306748125Z [2024-05-26T00:46:03.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:45:00+00:00, run_id=scheduled__2024-05-26T00:45:00+00:00, run_start_date=2024-05-26 00:46:00.786178+00:00, run_end_date=2024-05-26 00:46:03.306419+00:00, run_duration=2.520241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:45:00+00:00, data_interval_end=2024-05-26 00:46:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:46:03.326512620Z [2024-05-26T00:46:03.326+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:46:00+00:00, run_after=2024-05-26T00:47:00+00:00 2024-05-26T00:46:03.341520949Z [2024-05-26T00:46:03.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:46:03.341940323Z [2024-05-26T00:46:03.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:44:00+00:00, run_id=scheduled__2024-05-26T00:44:00+00:00, run_start_date=2024-05-26 00:46:00.784823+00:00, run_end_date=2024-05-26 00:46:03.341650+00:00, run_duration=2.556827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:44:00+00:00, data_interval_end=2024-05-26 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:46:03.361716303Z [2024-05-26T00:46:03.361+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:46:00+00:00, run_after=2024-05-26T00:48:00+00:00 2024-05-26T00:46:03.509931453Z [2024-05-26T00:46:03.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:44:00+00:00 exited with status success for try_number 1 2024-05-26T00:46:03.510841322Z [2024-05-26T00:46:03.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status success for try_number 1 2024-05-26T00:46:03.521894609Z [2024-05-26T00:46:03.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:45:00+00:00, map_index=-1, run_start_date=2024-05-26 00:46:01.798231+00:00, run_end_date=2024-05-26 00:46:02.321654+00:00, run_duration=0.523423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:46:00.850988+00:00, queued_by_job_id=1, pid=8166 2024-05-26T00:46:03.521996592Z [2024-05-26T00:46:03.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:44:00+00:00, map_index=-1, run_start_date=2024-05-26 00:46:02.088124+00:00, run_end_date=2024-05-26 00:46:02.594133+00:00, run_duration=0.506009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:46:00.850988+00:00, queued_by_job_id=1, pid=8168 2024-05-26T00:46:05.649105172Z [2024-05-26T00:46:05.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:46:05.658234446Z [2024-05-26T00:46:05.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:45:00+00:00, run_id=scheduled__2024-05-26T00:45:00+00:00, run_start_date=2024-05-26 00:46:00.787136+00:00, run_end_date=2024-05-26 00:46:05.657722+00:00, run_duration=4.870586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:45:00+00:00, data_interval_end=2024-05-26 00:46:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:46:05.666976374Z [2024-05-26T00:46:05.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:46:00+00:00, run_after=2024-05-26T00:47:00+00:00 2024-05-26T00:46:05.742378177Z [2024-05-26T00:46:05.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status success for try_number 1 2024-05-26T00:46:05.748694268Z [2024-05-26T00:46:05.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:45:00+00:00, map_index=-1, run_start_date=2024-05-26 00:46:03.107596+00:00, run_end_date=2024-05-26 00:46:05.072615+00:00, run_duration=1.965019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:46:00.850988+00:00, queued_by_job_id=1, pid=8185 2024-05-26T00:46:06.358769900Z [2024-05-26T00:46:06.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:46:06.358955267Z [2024-05-26T00:46:06.358+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:45:00+00:00, run_id=scheduled__2024-05-26T00:45:00+00:00, run_start_date=2024-05-26 00:46:00.788111+00:00, run_end_date=2024-05-26 00:46:06.358625+00:00, run_duration=5.570514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:45:00+00:00, data_interval_end=2024-05-26 00:46:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:46:06.368096431Z [2024-05-26T00:46:06.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:46:00+00:00, run_after=2024-05-26T00:47:00+00:00 2024-05-26T00:46:06.420555629Z [2024-05-26T00:46:06.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status success for try_number 1 2024-05-26T00:46:06.427024209Z [2024-05-26T00:46:06.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:45:00+00:00, map_index=-1, run_start_date=2024-05-26 00:46:03.565720+00:00, run_end_date=2024-05-26 00:46:05.687225+00:00, run_duration=2.121505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:46:00.850988+00:00, queued_by_job_id=1, pid=8191 2024-05-26T00:47:00.471009599Z [2024-05-26T00:47:00.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:47:00+00:00, run_after=2024-05-26T00:48:00+00:00 2024-05-26T00:47:00.486853445Z [2024-05-26T00:47:00.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:47:00+00:00, run_after=2024-05-26T00:48:00+00:00 2024-05-26T00:47:00.494706731Z [2024-05-26T00:47:00.494+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:47:00.583601822Z [2024-05-26T00:47:00.582+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:47:00.583650672Z 2024-05-26T00:47:00.583660202Z 2024-05-26T00:47:00.583668082Z 2024-05-26T00:47:00.583792926Z [2024-05-26T00:47:00.583+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:47:00.584248320Z [2024-05-26T00:47:00.583+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:47:00.584583618Z [2024-05-26T00:47:00.584+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:47:00.585564729Z [2024-05-26T00:47:00.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:47:00.585579005Z 2024-05-26T00:47:00.585583335Z 2024-05-26T00:47:00.585607728Z 2024-05-26T00:47:00.590246248Z [2024-05-26T00:47:00.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:47:00.590277911Z [2024-05-26T00:47:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:47:00.590606621Z [2024-05-26T00:47:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:47:00.590882051Z [2024-05-26T00:47:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:47:00.591175529Z [2024-05-26T00:47:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:47:00.591567773Z [2024-05-26T00:47:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:47:00.891780509Z [2024-05-26T00:47:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status queued for try_number 1 2024-05-26T00:47:00.892171337Z [2024-05-26T00:47:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status queued for try_number 1 2024-05-26T00:47:00.892404773Z [2024-05-26T00:47:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status queued for try_number 1 2024-05-26T00:47:00.901109817Z [2024-05-26T00:47:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d81db7c-1638-4415-bdcc-bf4ff6b7ac67 2024-05-26T00:47:00.901326122Z [2024-05-26T00:47:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ac18334-416f-4be5-a893-ea4adb19deb6 2024-05-26T00:47:00.901608902Z [2024-05-26T00:47:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85a9b7f1-b94c-453a-836c-21d448589099 2024-05-26T00:47:02.059266099Z [2024-05-26T00:47:02.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:47:02.059631850Z [2024-05-26T00:47:02.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:46:00+00:00, run_id=scheduled__2024-05-26T00:46:00+00:00, run_start_date=2024-05-26 00:47:00.506642+00:00, run_end_date=2024-05-26 00:47:02.059152+00:00, run_duration=1.55251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:46:00+00:00, data_interval_end=2024-05-26 00:47:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:47:02.070517683Z [2024-05-26T00:47:02.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:47:00+00:00, run_after=2024-05-26T00:48:00+00:00 2024-05-26T00:47:02.122301976Z [2024-05-26T00:47:02.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status success for try_number 1 2024-05-26T00:47:02.130198637Z [2024-05-26T00:47:02.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:46:00+00:00, map_index=-1, run_start_date=2024-05-26 00:47:01.413014+00:00, run_end_date=2024-05-26 00:47:01.793924+00:00, run_duration=0.38091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:47:00.586684+00:00, queued_by_job_id=1, pid=8223 2024-05-26T00:47:04.843101529Z [2024-05-26T00:47:04.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:47:04.843311972Z [2024-05-26T00:47:04.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:46:00+00:00, run_id=scheduled__2024-05-26T00:46:00+00:00, run_start_date=2024-05-26 00:47:00.509077+00:00, run_end_date=2024-05-26 00:47:04.842970+00:00, run_duration=4.333893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:46:00+00:00, data_interval_end=2024-05-26 00:47:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:47:04.861491439Z [2024-05-26T00:47:04.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:47:00+00:00, run_after=2024-05-26T00:48:00+00:00 2024-05-26T00:47:04.872829224Z [2024-05-26T00:47:04.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:47:04.873963816Z [2024-05-26T00:47:04.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:46:00+00:00, run_id=scheduled__2024-05-26T00:46:00+00:00, run_start_date=2024-05-26 00:47:00.508019+00:00, run_end_date=2024-05-26 00:47:04.873077+00:00, run_duration=4.365058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:46:00+00:00, data_interval_end=2024-05-26 00:47:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:47:04.893823168Z [2024-05-26T00:47:04.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:47:00+00:00, run_after=2024-05-26T00:48:00+00:00 2024-05-26T00:47:04.952239133Z [2024-05-26T00:47:04.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status success for try_number 1 2024-05-26T00:47:04.952425561Z [2024-05-26T00:47:04.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status success for try_number 1 2024-05-26T00:47:04.960318007Z [2024-05-26T00:47:04.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:46:00+00:00, map_index=-1, run_start_date=2024-05-26 00:47:02.439012+00:00, run_end_date=2024-05-26 00:47:03.724075+00:00, run_duration=1.285063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:47:00.586684+00:00, queued_by_job_id=1, pid=8242 2024-05-26T00:47:04.960622015Z [2024-05-26T00:47:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:46:00+00:00, map_index=-1, run_start_date=2024-05-26 00:47:02.384285+00:00, run_end_date=2024-05-26 00:47:03.912647+00:00, run_duration=1.528362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:47:00.586684+00:00, queued_by_job_id=1, pid=8241 2024-05-26T00:48:00.432523457Z [2024-05-26T00:48:00.431+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:48:00.446662950Z [2024-05-26T00:48:00.445+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:48:00.462980733Z [2024-05-26T00:48:00.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:48:00+00:00, run_after=2024-05-26T00:49:00+00:00 2024-05-26T00:48:00.478361416Z [2024-05-26T00:48:00.477+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:48:00+00:00, run_after=2024-05-26T00:49:00+00:00 2024-05-26T00:48:00.553677342Z [2024-05-26T00:48:00.549+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:48:00.553719239Z 2024-05-26T00:48:00.553766881Z 2024-05-26T00:48:00.553777496Z 2024-05-26T00:48:00.553786108Z 2024-05-26T00:48:00.554410269Z [2024-05-26T00:48:00.553+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:48:00.554872403Z [2024-05-26T00:48:00.554+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:48:00.555473976Z [2024-05-26T00:48:00.555+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:48:00.556014861Z [2024-05-26T00:48:00.555+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:48:00.561486597Z [2024-05-26T00:48:00.560+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:48:00.561512624Z 2024-05-26T00:48:00.561519929Z 2024-05-26T00:48:00.561525782Z 2024-05-26T00:48:00.561532088Z 2024-05-26T00:48:00.569830452Z [2024-05-26T00:48:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:48:00.570077521Z [2024-05-26T00:48:00.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:48:00.570550233Z [2024-05-26T00:48:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:48:00.570780047Z [2024-05-26T00:48:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:48:00.571101834Z [2024-05-26T00:48:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:48:00.571255865Z [2024-05-26T00:48:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:48:00.571664858Z [2024-05-26T00:48:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:48:00.571964000Z [2024-05-26T00:48:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:48:01.073815419Z [2024-05-26T00:48:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status queued for try_number 1 2024-05-26T00:48:01.073877129Z [2024-05-26T00:48:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:47:00+00:00 exited with status queued for try_number 1 2024-05-26T00:48:01.074012553Z [2024-05-26T00:48:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:47:00+00:00 exited with status queued for try_number 1 2024-05-26T00:48:01.074080015Z [2024-05-26T00:48:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:47:00+00:00 exited with status queued for try_number 1 2024-05-26T00:48:01.097010424Z [2024-05-26T00:48:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05638726-5f90-45e7-ac58-8dd9714f2c60 2024-05-26T00:48:01.097075479Z [2024-05-26T00:48:01.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62d7c0f7-80be-4931-b7a4-a226c707d964 2024-05-26T00:48:01.097159643Z [2024-05-26T00:48:01.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96b271f6-71f1-4760-bbc5-81bc82c8dd59 2024-05-26T00:48:01.097250074Z [2024-05-26T00:48:01.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd3ce0c5-82ba-47a5-a782-4f43cfacfb6b 2024-05-26T00:48:02.347843090Z [2024-05-26T00:48:02.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:48:02.348152247Z [2024-05-26T00:48:02.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:46:00+00:00, run_id=scheduled__2024-05-26T00:46:00+00:00, run_start_date=2024-05-26 00:48:00.486917+00:00, run_end_date=2024-05-26 00:48:02.347714+00:00, run_duration=1.860797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:46:00+00:00, data_interval_end=2024-05-26 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:48:02.355576291Z [2024-05-26T00:48:02.355+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:48:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:48:02.361651606Z [2024-05-26T00:48:02.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:48:02.361901150Z [2024-05-26T00:48:02.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:47:00+00:00, run_id=scheduled__2024-05-26T00:47:00+00:00, run_start_date=2024-05-26 00:48:00.488063+00:00, run_end_date=2024-05-26 00:48:02.361533+00:00, run_duration=1.87347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:47:00+00:00, data_interval_end=2024-05-26 00:48:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:48:02.371153381Z [2024-05-26T00:48:02.370+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:48:00+00:00, run_after=2024-05-26T00:49:00+00:00 2024-05-26T00:48:02.424447164Z [2024-05-26T00:48:02.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:46:00+00:00 exited with status success for try_number 1 2024-05-26T00:48:02.428054438Z [2024-05-26T00:48:02.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:47:00+00:00 exited with status success for try_number 1 2024-05-26T00:48:02.436719239Z [2024-05-26T00:48:02.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:46:00+00:00, map_index=-1, run_start_date=2024-05-26 00:48:01.361435+00:00, run_end_date=2024-05-26 00:48:01.750747+00:00, run_duration=0.389312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:48:00.564066+00:00, queued_by_job_id=1, pid=8275 2024-05-26T00:48:02.437050414Z [2024-05-26T00:48:02.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:47:00+00:00, map_index=-1, run_start_date=2024-05-26 00:48:01.397270+00:00, run_end_date=2024-05-26 00:48:01.804904+00:00, run_duration=0.407634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:48:00.564066+00:00, queued_by_job_id=1, pid=8276 2024-05-26T00:48:04.512200931Z [2024-05-26T00:48:04.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:48:04.512385912Z [2024-05-26T00:48:04.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:47:00+00:00, run_id=scheduled__2024-05-26T00:47:00+00:00, run_start_date=2024-05-26 00:48:00.489869+00:00, run_end_date=2024-05-26 00:48:04.512134+00:00, run_duration=4.022265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:47:00+00:00, data_interval_end=2024-05-26 00:48:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:48:04.525065875Z [2024-05-26T00:48:04.524+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:48:00+00:00, run_after=2024-05-26T00:49:00+00:00 2024-05-26T00:48:04.532087057Z [2024-05-26T00:48:04.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:48:04.532231572Z [2024-05-26T00:48:04.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:47:00+00:00, run_id=scheduled__2024-05-26T00:47:00+00:00, run_start_date=2024-05-26 00:48:00.489006+00:00, run_end_date=2024-05-26 00:48:04.532008+00:00, run_duration=4.043002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:47:00+00:00, data_interval_end=2024-05-26 00:48:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:48:04.542365723Z [2024-05-26T00:48:04.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:48:00+00:00, run_after=2024-05-26T00:49:00+00:00 2024-05-26T00:48:04.584436183Z [2024-05-26T00:48:04.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:47:00+00:00 exited with status success for try_number 1 2024-05-26T00:48:04.584774305Z [2024-05-26T00:48:04.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:47:00+00:00 exited with status success for try_number 1 2024-05-26T00:48:04.594612675Z [2024-05-26T00:48:04.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:47:00+00:00, map_index=-1, run_start_date=2024-05-26 00:48:02.578117+00:00, run_end_date=2024-05-26 00:48:04.054672+00:00, run_duration=1.476555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:48:00.564066+00:00, queued_by_job_id=1, pid=8300 2024-05-26T00:48:04.595207509Z [2024-05-26T00:48:04.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:47:00+00:00, map_index=-1, run_start_date=2024-05-26 00:48:02.501349+00:00, run_end_date=2024-05-26 00:48:04.237393+00:00, run_duration=1.736044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:48:00.564066+00:00, queued_by_job_id=1, pid=8299 2024-05-26T00:48:31.775943256Z [2024-05-26T00:48:31.775+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:49:00.454995863Z [2024-05-26T00:49:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:49:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:49:00.474736317Z [2024-05-26T00:49:00.474+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:49:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:49:00.483207831Z [2024-05-26T00:49:00.482+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:49:00.571588905Z [2024-05-26T00:49:00.571+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:49:00.571624182Z 2024-05-26T00:49:00.571641626Z 2024-05-26T00:49:00.571646663Z 2024-05-26T00:49:00.572074362Z [2024-05-26T00:49:00.571+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:49:00.572303388Z [2024-05-26T00:49:00.572+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:49:00.572547895Z [2024-05-26T00:49:00.572+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:49:00.573555101Z [2024-05-26T00:49:00.573+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:49:00.573574872Z 2024-05-26T00:49:00.573582355Z 2024-05-26T00:49:00.573589395Z 2024-05-26T00:49:00.579118898Z [2024-05-26T00:49:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:49:00.579552598Z [2024-05-26T00:49:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:49:00.580290944Z [2024-05-26T00:49:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:49:00.580781787Z [2024-05-26T00:49:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:49:00.581220025Z [2024-05-26T00:49:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:49:00.581428519Z [2024-05-26T00:49:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:49:00.897536512Z [2024-05-26T00:49:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status queued for try_number 1 2024-05-26T00:49:00.898002547Z [2024-05-26T00:49:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status queued for try_number 1 2024-05-26T00:49:00.898346053Z [2024-05-26T00:49:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status queued for try_number 1 2024-05-26T00:49:00.911434424Z [2024-05-26T00:49:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to c06d9be1-812b-4405-9fbe-0249383ec703 2024-05-26T00:49:00.911889106Z [2024-05-26T00:49:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4179a16-3a63-4ce8-9ac7-d59de85df33d 2024-05-26T00:49:00.912215878Z [2024-05-26T00:49:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 705727fe-66fa-43de-9366-772e2ac9ec1c 2024-05-26T00:49:02.042296009Z [2024-05-26T00:49:02.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:49:02.042847201Z [2024-05-26T00:49:02.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:48:00+00:00, run_id=scheduled__2024-05-26T00:48:00+00:00, run_start_date=2024-05-26 00:49:00.494802+00:00, run_end_date=2024-05-26 00:49:02.042151+00:00, run_duration=1.547349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:48:00+00:00, data_interval_end=2024-05-26 00:49:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:49:02.051822519Z [2024-05-26T00:49:02.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:49:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:49:02.096733568Z [2024-05-26T00:49:02.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status success for try_number 1 2024-05-26T00:49:02.102088488Z [2024-05-26T00:49:02.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:48:00+00:00, map_index=-1, run_start_date=2024-05-26 00:49:01.453289+00:00, run_end_date=2024-05-26 00:49:01.844217+00:00, run_duration=0.390928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:49:00.574911+00:00, queued_by_job_id=1, pid=8333 2024-05-26T00:49:04.463613279Z [2024-05-26T00:49:04.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:49:04.463642248Z [2024-05-26T00:49:04.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:48:00+00:00, run_id=scheduled__2024-05-26T00:48:00+00:00, run_start_date=2024-05-26 00:49:00.496268+00:00, run_end_date=2024-05-26 00:49:04.459165+00:00, run_duration=3.962897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:48:00+00:00, data_interval_end=2024-05-26 00:49:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:49:04.470788350Z [2024-05-26T00:49:04.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:49:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:49:04.546741195Z [2024-05-26T00:49:04.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status success for try_number 1 2024-05-26T00:49:04.552312720Z [2024-05-26T00:49:04.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:48:00+00:00, map_index=-1, run_start_date=2024-05-26 00:49:02.584772+00:00, run_end_date=2024-05-26 00:49:04.037103+00:00, run_duration=1.452331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:49:00.574911+00:00, queued_by_job_id=1, pid=8352 2024-05-26T00:49:05.719519740Z [2024-05-26T00:49:05.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:49:05.720090459Z [2024-05-26T00:49:05.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:48:00+00:00, run_id=scheduled__2024-05-26T00:48:00+00:00, run_start_date=2024-05-26 00:49:00.497422+00:00, run_end_date=2024-05-26 00:49:05.719732+00:00, run_duration=5.22231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:48:00+00:00, data_interval_end=2024-05-26 00:49:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:49:05.729884628Z [2024-05-26T00:49:05.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:49:00+00:00, run_after=2024-05-26T00:50:00+00:00 2024-05-26T00:49:05.762123479Z [2024-05-26T00:49:05.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status success for try_number 1 2024-05-26T00:49:05.768022363Z [2024-05-26T00:49:05.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:48:00+00:00, map_index=-1, run_start_date=2024-05-26 00:49:02.547052+00:00, run_end_date=2024-05-26 00:49:04.573105+00:00, run_duration=2.026053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:49:00.574911+00:00, queued_by_job_id=1, pid=8351 2024-05-26T00:50:00.528572382Z [2024-05-26T00:50:00.528+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:50:00.540500211Z [2024-05-26T00:50:00.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:51:00+00:00 2024-05-26T00:50:00.547901169Z [2024-05-26T00:50:00.547+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:50:00.558304886Z [2024-05-26T00:50:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:55:00+00:00 2024-05-26T00:50:00.569934039Z [2024-05-26T00:50:00.569+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:51:00+00:00 2024-05-26T00:50:00.662058178Z [2024-05-26T00:50:00.661+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T00:50:00.662128024Z 2024-05-26T00:50:00.662138442Z 2024-05-26T00:50:00.662148946Z 2024-05-26T00:50:00.662162270Z 2024-05-26T00:50:00.662175427Z 2024-05-26T00:50:00.662433453Z [2024-05-26T00:50:00.661+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:50:00.662795260Z [2024-05-26T00:50:00.662+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:50:00.663031178Z [2024-05-26T00:50:00.662+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:50:00.663368478Z [2024-05-26T00:50:00.663+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:50:00.663648637Z [2024-05-26T00:50:00.663+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:50:00.665888994Z [2024-05-26T00:50:00.664+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:50:00.665920890Z 2024-05-26T00:50:00.665936281Z 2024-05-26T00:50:00.665948825Z 2024-05-26T00:50:00.665960338Z 2024-05-26T00:50:00.665971904Z 2024-05-26T00:50:00.671848188Z [2024-05-26T00:50:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:50:00.672119486Z [2024-05-26T00:50:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:50:00.672402732Z [2024-05-26T00:50:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:50:00.672559245Z [2024-05-26T00:50:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:50:00.672850484Z [2024-05-26T00:50:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:50:00.673027890Z [2024-05-26T00:50:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:50:00.673265640Z [2024-05-26T00:50:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:50:00.673438643Z [2024-05-26T00:50:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:50:00.673637828Z [2024-05-26T00:50:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:50:00.673788979Z [2024-05-26T00:50:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:50:01.102330681Z [2024-05-26T00:50:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:01.102361079Z [2024-05-26T00:50:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:01.102402901Z [2024-05-26T00:50:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:49:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:01.102472509Z [2024-05-26T00:50:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:49:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:01.102525579Z [2024-05-26T00:50:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:49:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:01.134176237Z [2024-05-26T00:50:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00d7bf3c-ac42-4dd7-b692-603b11fb88b6 2024-05-26T00:50:01.134304187Z [2024-05-26T00:50:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b5cc026-1608-4605-8007-694238bcd479 2024-05-26T00:50:01.134432503Z [2024-05-26T00:50:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33fa622b-9be9-4780-88a9-91d9b4394a50 2024-05-26T00:50:01.134556575Z [2024-05-26T00:50:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a4deb2d-2d70-4786-8f4c-c322e147e1a4 2024-05-26T00:50:01.134718480Z [2024-05-26T00:50:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to dde1d774-d477-489e-a838-0fff855a4f68 2024-05-26T00:50:02.567876249Z [2024-05-26T00:50:02.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:50:02.568453301Z [2024-05-26T00:50:02.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:48:00+00:00, run_id=scheduled__2024-05-26T00:48:00+00:00, run_start_date=2024-05-26 00:50:00.581281+00:00, run_end_date=2024-05-26 00:50:02.568039+00:00, run_duration=1.986758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:48:00+00:00, data_interval_end=2024-05-26 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:50:02.577028134Z [2024-05-26T00:50:02.576+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:52:00+00:00 2024-05-26T00:50:02.584789527Z [2024-05-26T00:50:02.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:50:02.585385575Z [2024-05-26T00:50:02.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:49:00+00:00, run_id=scheduled__2024-05-26T00:49:00+00:00, run_start_date=2024-05-26 00:50:00.582238+00:00, run_end_date=2024-05-26 00:50:02.584977+00:00, run_duration=2.002739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:49:00+00:00, data_interval_end=2024-05-26 00:50:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:50:02.603199973Z [2024-05-26T00:50:02.602+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:51:00+00:00 2024-05-26T00:50:02.667455753Z [2024-05-26T00:50:02.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:48:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:02.667872501Z [2024-05-26T00:50:02.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:49:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:02.676292646Z [2024-05-26T00:50:02.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:48:00+00:00, map_index=-1, run_start_date=2024-05-26 00:50:01.713625+00:00, run_end_date=2024-05-26 00:50:02.184369+00:00, run_duration=0.470744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:00.667453+00:00, queued_by_job_id=1, pid=8381 2024-05-26T00:50:02.677367269Z [2024-05-26T00:50:02.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:49:00+00:00, map_index=-1, run_start_date=2024-05-26 00:50:01.987870+00:00, run_end_date=2024-05-26 00:50:02.393104+00:00, run_duration=0.405234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:00.667453+00:00, queued_by_job_id=1, pid=8388 2024-05-26T00:50:03.792117459Z [2024-05-26T00:50:03.791+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:50:03.792143935Z 2024-05-26T00:50:03.792287140Z [2024-05-26T00:50:03.792+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:50:03.792889518Z [2024-05-26T00:50:03.792+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:50:03.792896317Z 2024-05-26T00:50:03.795696155Z [2024-05-26T00:50:03.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:50:03.795961526Z [2024-05-26T00:50:03.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:50:03.874232638Z [2024-05-26T00:50:03.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:03.874716746Z [2024-05-26T00:50:03.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:03.893758327Z [2024-05-26T00:50:03.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63f880c4-ff95-49ac-84ea-5d14e84ddc7e 2024-05-26T00:50:03.893939595Z [2024-05-26T00:50:03.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:45:00+00:00, map_index=-1, run_start_date=2024-05-26 00:50:02.757672+00:00, run_end_date=2024-05-26 00:50:03.123043+00:00, run_duration=0.365371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:00.667453+00:00, queued_by_job_id=1, pid=8410 2024-05-26T00:50:05.071027980Z [2024-05-26T00:50:05.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:50:05.071855671Z [2024-05-26T00:50:05.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:49:00+00:00, run_id=scheduled__2024-05-26T00:49:00+00:00, run_start_date=2024-05-26 00:50:00.583173+00:00, run_end_date=2024-05-26 00:50:05.071232+00:00, run_duration=4.488059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:49:00+00:00, data_interval_end=2024-05-26 00:50:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:50:05.086196480Z [2024-05-26T00:50:05.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:51:00+00:00 2024-05-26T00:50:05.094626180Z [2024-05-26T00:50:05.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:50:05.095087141Z [2024-05-26T00:50:05.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:49:00+00:00, run_id=scheduled__2024-05-26T00:49:00+00:00, run_start_date=2024-05-26 00:50:00.584141+00:00, run_end_date=2024-05-26 00:50:05.094738+00:00, run_duration=4.510597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:49:00+00:00, data_interval_end=2024-05-26 00:50:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:50:05.106276267Z [2024-05-26T00:50:05.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:51:00+00:00 2024-05-26T00:50:05.154159797Z [2024-05-26T00:50:05.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:49:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:05.154443496Z [2024-05-26T00:50:05.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:49:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:05.161107681Z [2024-05-26T00:50:05.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:49:00+00:00, map_index=-1, run_start_date=2024-05-26 00:50:02.767101+00:00, run_end_date=2024-05-26 00:50:04.406252+00:00, run_duration=1.639151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:00.667453+00:00, queued_by_job_id=1, pid=8411 2024-05-26T00:50:05.161354549Z [2024-05-26T00:50:05.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:49:00+00:00, map_index=-1, run_start_date=2024-05-26 00:50:03.101772+00:00, run_end_date=2024-05-26 00:50:04.444578+00:00, run_duration=1.342806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:00.667453+00:00, queued_by_job_id=1, pid=8427 2024-05-26T00:50:07.379015329Z [2024-05-26T00:50:07.378+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:50:07.379082351Z 2024-05-26T00:50:07.379109390Z [2024-05-26T00:50:07.378+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:50:07.379816200Z [2024-05-26T00:50:07.379+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:50:07.379832787Z 2024-05-26T00:50:07.382118348Z [2024-05-26T00:50:07.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:50:07.382239667Z [2024-05-26T00:50:07.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:50:07.436343771Z [2024-05-26T00:50:07.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:07.436376253Z [2024-05-26T00:50:07.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:07.441647423Z [2024-05-26T00:50:07.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to b175c0b7-f634-436e-a753-21e222dd4136 2024-05-26T00:50:07.441987274Z [2024-05-26T00:50:07.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:45:00+00:00, map_index=-1, run_start_date=2024-05-26 00:50:05.840177+00:00, run_end_date=2024-05-26 00:50:06.230800+00:00, run_duration=0.390623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:03.793391+00:00, queued_by_job_id=1, pid=8440 2024-05-26T00:50:09.692314638Z [2024-05-26T00:50:09.691+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:50:09.692363588Z 2024-05-26T00:50:09.692451899Z [2024-05-26T00:50:09.692+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:50:09.693430176Z [2024-05-26T00:50:09.693+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:50:09.693446114Z 2024-05-26T00:50:09.697240256Z [2024-05-26T00:50:09.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:50:09.697494726Z [2024-05-26T00:50:09.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:50:09.765128196Z [2024-05-26T00:50:09.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status queued for try_number 1 2024-05-26T00:50:09.765165331Z [2024-05-26T00:50:09.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:09.773305912Z [2024-05-26T00:50:09.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1678355-ef5e-4ef5-88c8-982b1ba4b2dd 2024-05-26T00:50:09.773618013Z [2024-05-26T00:50:09.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:45:00+00:00, map_index=0, run_start_date=2024-05-26 00:50:08.959600+00:00, run_end_date=2024-05-26 00:50:09.343699+00:00, run_duration=0.384099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:07.380126+00:00, queued_by_job_id=1, pid=8448 2024-05-26T00:50:12.492442774Z [2024-05-26T00:50:12.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:50:12.492797486Z [2024-05-26T00:50:12.492+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:45:00+00:00, run_id=scheduled__2024-05-26T00:45:00+00:00, run_start_date=2024-05-26 00:50:00.580124+00:00, run_end_date=2024-05-26 00:50:12.492302+00:00, run_duration=11.912178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:45:00+00:00, data_interval_end=2024-05-26 00:50:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:50:12.501533778Z [2024-05-26T00:50:12.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:50:00+00:00, run_after=2024-05-26T00:55:00+00:00 2024-05-26T00:50:12.552935389Z [2024-05-26T00:50:12.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:45:00+00:00 exited with status success for try_number 1 2024-05-26T00:50:12.559003970Z [2024-05-26T00:50:12.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:45:00+00:00, map_index=-1, run_start_date=2024-05-26 00:50:11.454800+00:00, run_end_date=2024-05-26 00:50:11.871124+00:00, run_duration=0.416324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:50:09.693929+00:00, queued_by_job_id=1, pid=8456 2024-05-26T00:51:00.416479297Z [2024-05-26T00:51:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:51:00+00:00, run_after=2024-05-26T00:52:00+00:00 2024-05-26T00:51:00.432421180Z [2024-05-26T00:51:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:51:00+00:00, run_after=2024-05-26T00:52:00+00:00 2024-05-26T00:51:00.448307540Z [2024-05-26T00:51:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:51:00.540336136Z [2024-05-26T00:51:00.539+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:51:00.540356866Z 2024-05-26T00:51:00.540361556Z 2024-05-26T00:51:00.540365802Z 2024-05-26T00:51:00.540882494Z [2024-05-26T00:51:00.540+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:51:00.541174992Z [2024-05-26T00:51:00.540+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:51:00.541274604Z [2024-05-26T00:51:00.541+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:51:00.542058537Z [2024-05-26T00:51:00.541+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:51:00.542077471Z 2024-05-26T00:51:00.542082775Z 2024-05-26T00:51:00.542087515Z 2024-05-26T00:51:00.546803968Z [2024-05-26T00:51:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:51:00.546966698Z [2024-05-26T00:51:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:51:00.547343762Z [2024-05-26T00:51:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:51:00.547547256Z [2024-05-26T00:51:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:51:00.547961530Z [2024-05-26T00:51:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:51:00.548031676Z [2024-05-26T00:51:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:51:00.872627117Z [2024-05-26T00:51:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:51:00.874764537Z [2024-05-26T00:51:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:51:00.875007840Z [2024-05-26T00:51:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:51:00.885750504Z [2024-05-26T00:51:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36801bb7-a6ae-4be6-9bfc-d4920b632c28 2024-05-26T00:51:00.886036087Z [2024-05-26T00:51:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to a37a0fb1-9012-451b-91ae-b456719ecfdc 2024-05-26T00:51:00.886252669Z [2024-05-26T00:51:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89d0ed97-1761-47ec-b808-a3e7e9858002 2024-05-26T00:51:02.034994520Z [2024-05-26T00:51:02.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:51:02.036297374Z [2024-05-26T00:51:02.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:50:00+00:00, run_id=scheduled__2024-05-26T00:50:00+00:00, run_start_date=2024-05-26 00:51:00.475362+00:00, run_end_date=2024-05-26 00:51:02.034884+00:00, run_duration=1.559522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:50:00+00:00, data_interval_end=2024-05-26 00:51:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:51:02.049398615Z [2024-05-26T00:51:02.049+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:51:00+00:00, run_after=2024-05-26T00:52:00+00:00 2024-05-26T00:51:02.109273607Z [2024-05-26T00:51:02.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:51:02.116872496Z [2024-05-26T00:51:02.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=-1, run_start_date=2024-05-26 00:51:01.503353+00:00, run_end_date=2024-05-26 00:51:01.916384+00:00, run_duration=0.413031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:51:00.543329+00:00, queued_by_job_id=1, pid=8478 2024-05-26T00:51:04.485222870Z [2024-05-26T00:51:04.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:51:04.485249620Z [2024-05-26T00:51:04.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:50:00+00:00, run_id=scheduled__2024-05-26T00:50:00+00:00, run_start_date=2024-05-26 00:51:00.478833+00:00, run_end_date=2024-05-26 00:51:04.484894+00:00, run_duration=4.006061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:50:00+00:00, data_interval_end=2024-05-26 00:51:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:51:04.493375960Z [2024-05-26T00:51:04.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:51:00+00:00, run_after=2024-05-26T00:52:00+00:00 2024-05-26T00:51:04.503105119Z [2024-05-26T00:51:04.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:51:04.503938141Z [2024-05-26T00:51:04.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:50:00+00:00, run_id=scheduled__2024-05-26T00:50:00+00:00, run_start_date=2024-05-26 00:51:00.477256+00:00, run_end_date=2024-05-26 00:51:04.502998+00:00, run_duration=4.025742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:50:00+00:00, data_interval_end=2024-05-26 00:51:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:51:04.514677625Z [2024-05-26T00:51:04.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:51:00+00:00, run_after=2024-05-26T00:52:00+00:00 2024-05-26T00:51:04.559212529Z [2024-05-26T00:51:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:51:04.559705498Z [2024-05-26T00:51:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:51:04.569361596Z [2024-05-26T00:51:04.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=-1, run_start_date=2024-05-26 00:51:02.352602+00:00, run_end_date=2024-05-26 00:51:03.940749+00:00, run_duration=1.588147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:51:00.543329+00:00, queued_by_job_id=1, pid=8496 2024-05-26T00:51:04.569925496Z [2024-05-26T00:51:04.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=-1, run_start_date=2024-05-26 00:51:02.490463+00:00, run_end_date=2024-05-26 00:51:03.743753+00:00, run_duration=1.25329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:51:00.543329+00:00, queued_by_job_id=1, pid=8497 2024-05-26T00:52:00.368708436Z [2024-05-26T00:52:00.367+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:52:00+00:00, run_after=2024-05-26T00:53:00+00:00 2024-05-26T00:52:00.379146580Z [2024-05-26T00:52:00.378+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:52:00.395327846Z [2024-05-26T00:52:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:52:00+00:00, run_after=2024-05-26T00:53:00+00:00 2024-05-26T00:52:00.408224720Z [2024-05-26T00:52:00.407+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:52:00.551667797Z [2024-05-26T00:52:00.550+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:52:00.551738740Z 2024-05-26T00:52:00.551762064Z 2024-05-26T00:52:00.551865221Z 2024-05-26T00:52:00.551877190Z 2024-05-26T00:52:00.551956978Z [2024-05-26T00:52:00.551+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:52:00.552178081Z [2024-05-26T00:52:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:52:00.552400488Z [2024-05-26T00:52:00.552+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:52:00.552630151Z [2024-05-26T00:52:00.552+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:52:00.553925782Z [2024-05-26T00:52:00.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:52:00.553958756Z 2024-05-26T00:52:00.553968783Z 2024-05-26T00:52:00.553977503Z 2024-05-26T00:52:00.553985727Z 2024-05-26T00:52:00.561254873Z [2024-05-26T00:52:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:52:00.561370780Z [2024-05-26T00:52:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:52:00.561744952Z [2024-05-26T00:52:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:52:00.561906112Z [2024-05-26T00:52:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:52:00.562215634Z [2024-05-26T00:52:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:52:00.562347442Z [2024-05-26T00:52:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:52:00.562644229Z [2024-05-26T00:52:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:52:00.562797390Z [2024-05-26T00:52:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:52:00.888689285Z [2024-05-26T00:52:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:52:00.888776017Z [2024-05-26T00:52:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:51:00+00:00 exited with status queued for try_number 1 2024-05-26T00:52:00.888913849Z [2024-05-26T00:52:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:51:00+00:00 exited with status queued for try_number 1 2024-05-26T00:52:00.889024853Z [2024-05-26T00:52:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:51:00+00:00 exited with status queued for try_number 1 2024-05-26T00:52:00.899156415Z [2024-05-26T00:52:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc16e230-a000-42f1-8e82-aede08ae4575 2024-05-26T00:52:00.899572764Z [2024-05-26T00:52:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5b81f8f-a63c-4ee2-aaad-cc77a79cf432 2024-05-26T00:52:00.899924775Z [2024-05-26T00:52:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2acd7f93-80da-41c3-84cc-41894c27cbf1 2024-05-26T00:52:00.900192406Z [2024-05-26T00:52:00.899+0000] {scheduler_job.py:635} INFO - Setting external_id for to 551d7d6e-84f6-45e0-b669-ce53165d2796 2024-05-26T00:52:02.034323820Z [2024-05-26T00:52:02.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:52:02.034605648Z [2024-05-26T00:52:02.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:50:00+00:00, run_id=scheduled__2024-05-26T00:50:00+00:00, run_start_date=2024-05-26 00:52:00.427090+00:00, run_end_date=2024-05-26 00:52:02.034230+00:00, run_duration=1.60714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:50:00+00:00, data_interval_end=2024-05-26 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:52:02.043317607Z [2024-05-26T00:52:02.043+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:52:00+00:00, run_after=2024-05-26T00:54:00+00:00 2024-05-26T00:52:02.050573385Z [2024-05-26T00:52:02.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:52:02.050840377Z [2024-05-26T00:52:02.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:51:00+00:00, run_id=scheduled__2024-05-26T00:51:00+00:00, run_start_date=2024-05-26 00:52:00.429090+00:00, run_end_date=2024-05-26 00:52:02.050515+00:00, run_duration=1.621425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:51:00+00:00, data_interval_end=2024-05-26 00:52:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:52:02.060624324Z [2024-05-26T00:52:02.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:52:00+00:00, run_after=2024-05-26T00:53:00+00:00 2024-05-26T00:52:02.105200040Z [2024-05-26T00:52:02.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:52:02.110448471Z [2024-05-26T00:52:02.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=-1, run_start_date=2024-05-26 00:52:01.462681+00:00, run_end_date=2024-05-26 00:52:01.890845+00:00, run_duration=0.428164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:52:00.556116+00:00, queued_by_job_id=1, pid=8530 2024-05-26T00:52:03.224720687Z [2024-05-26T00:52:03.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:51:00+00:00 exited with status success for try_number 1 2024-05-26T00:52:03.231284117Z [2024-05-26T00:52:03.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:51:00+00:00, map_index=-1, run_start_date=2024-05-26 00:52:01.588534+00:00, run_end_date=2024-05-26 00:52:01.999268+00:00, run_duration=0.410734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:52:00.556116+00:00, queued_by_job_id=1, pid=8531 2024-05-26T00:52:04.401974555Z [2024-05-26T00:52:04.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:52:04.402471244Z [2024-05-26T00:52:04.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:51:00+00:00, run_id=scheduled__2024-05-26T00:51:00+00:00, run_start_date=2024-05-26 00:52:00.430830+00:00, run_end_date=2024-05-26 00:52:04.401923+00:00, run_duration=3.971093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:51:00+00:00, data_interval_end=2024-05-26 00:52:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:52:04.421466230Z [2024-05-26T00:52:04.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:52:00+00:00, run_after=2024-05-26T00:53:00+00:00 2024-05-26T00:52:04.492072298Z [2024-05-26T00:52:04.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:51:00+00:00 exited with status success for try_number 1 2024-05-26T00:52:04.519217941Z [2024-05-26T00:52:04.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:51:00+00:00, map_index=-1, run_start_date=2024-05-26 00:52:02.731168+00:00, run_end_date=2024-05-26 00:52:04.178166+00:00, run_duration=1.446998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:52:00.556116+00:00, queued_by_job_id=1, pid=8555 2024-05-26T00:52:05.000028176Z [2024-05-26T00:52:04.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:52:05.005331128Z [2024-05-26T00:52:05.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:51:00+00:00, run_id=scheduled__2024-05-26T00:51:00+00:00, run_start_date=2024-05-26 00:52:00.433107+00:00, run_end_date=2024-05-26 00:52:04.999930+00:00, run_duration=4.566823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:51:00+00:00, data_interval_end=2024-05-26 00:52:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:52:05.016902114Z [2024-05-26T00:52:05.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:52:00+00:00, run_after=2024-05-26T00:53:00+00:00 2024-05-26T00:52:05.059444557Z [2024-05-26T00:52:05.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:51:00+00:00 exited with status success for try_number 1 2024-05-26T00:52:05.069854628Z [2024-05-26T00:52:05.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:51:00+00:00, map_index=-1, run_start_date=2024-05-26 00:52:02.544574+00:00, run_end_date=2024-05-26 00:52:04.519996+00:00, run_duration=1.975422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:52:00.556116+00:00, queued_by_job_id=1, pid=8554 2024-05-26T00:53:00.407940583Z [2024-05-26T00:53:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:53:00+00:00, run_after=2024-05-26T00:54:00+00:00 2024-05-26T00:53:00.416630907Z [2024-05-26T00:53:00.416+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:53:00.444215452Z [2024-05-26T00:53:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:53:00+00:00, run_after=2024-05-26T00:54:00+00:00 2024-05-26T00:53:00.523626775Z [2024-05-26T00:53:00.523+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:53:00.525891667Z 2024-05-26T00:53:00.525921169Z 2024-05-26T00:53:00.525926884Z 2024-05-26T00:53:00.525934622Z [2024-05-26T00:53:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:53:00.525939325Z [2024-05-26T00:53:00.523+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:53:00.525944140Z [2024-05-26T00:53:00.523+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:53:00.525963095Z [2024-05-26T00:53:00.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:53:00.525967440Z 2024-05-26T00:53:00.525971550Z 2024-05-26T00:53:00.525975660Z 2024-05-26T00:53:00.528568643Z [2024-05-26T00:53:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:53:00.528617513Z [2024-05-26T00:53:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:53:00.528679706Z [2024-05-26T00:53:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:53:00.528757438Z [2024-05-26T00:53:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:53:00.528973930Z [2024-05-26T00:53:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:53:00.528987570Z [2024-05-26T00:53:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:53:00.743636823Z [2024-05-26T00:53:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status queued for try_number 1 2024-05-26T00:53:00.743660443Z [2024-05-26T00:53:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status queued for try_number 1 2024-05-26T00:53:00.743663884Z [2024-05-26T00:53:00.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status queued for try_number 1 2024-05-26T00:53:00.749923353Z [2024-05-26T00:53:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cdcec2e-c621-4295-bdf4-2b2a67ad4ae0 2024-05-26T00:53:00.749976422Z [2024-05-26T00:53:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b49ca88-88b7-47ad-be49-4c6d88e9f3bb 2024-05-26T00:53:00.751624717Z [2024-05-26T00:53:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d6bd0a6-2d52-4464-b2ba-cb9301cceb5c 2024-05-26T00:53:01.883696001Z [2024-05-26T00:53:01.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:53:01.884181782Z [2024-05-26T00:53:01.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:52:00+00:00, run_id=scheduled__2024-05-26T00:52:00+00:00, run_start_date=2024-05-26 00:53:00.462006+00:00, run_end_date=2024-05-26 00:53:01.883852+00:00, run_duration=1.421846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:52:00+00:00, data_interval_end=2024-05-26 00:53:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:53:01.894437575Z [2024-05-26T00:53:01.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:53:00+00:00, run_after=2024-05-26T00:54:00+00:00 2024-05-26T00:53:01.963496943Z [2024-05-26T00:53:01.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status success for try_number 1 2024-05-26T00:53:01.969646511Z [2024-05-26T00:53:01.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:52:00+00:00, map_index=-1, run_start_date=2024-05-26 00:53:01.313987+00:00, run_end_date=2024-05-26 00:53:01.663194+00:00, run_duration=0.349207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:53:00.524906+00:00, queued_by_job_id=1, pid=8587 2024-05-26T00:53:04.145013465Z [2024-05-26T00:53:04.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:53:04.145474865Z [2024-05-26T00:53:04.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:52:00+00:00, run_id=scheduled__2024-05-26T00:52:00+00:00, run_start_date=2024-05-26 00:53:00.464518+00:00, run_end_date=2024-05-26 00:53:04.145117+00:00, run_duration=3.680599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:52:00+00:00, data_interval_end=2024-05-26 00:53:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:53:04.154603834Z [2024-05-26T00:53:04.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:53:00+00:00, run_after=2024-05-26T00:54:00+00:00 2024-05-26T00:53:04.219636577Z [2024-05-26T00:53:04.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status success for try_number 1 2024-05-26T00:53:04.227366690Z [2024-05-26T00:53:04.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:52:00+00:00, map_index=-1, run_start_date=2024-05-26 00:53:02.286972+00:00, run_end_date=2024-05-26 00:53:03.686621+00:00, run_duration=1.399649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:53:00.524906+00:00, queued_by_job_id=1, pid=8605 2024-05-26T00:53:05.570825294Z [2024-05-26T00:53:05.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:53:05.571344185Z [2024-05-26T00:53:05.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:52:00+00:00, run_id=scheduled__2024-05-26T00:52:00+00:00, run_start_date=2024-05-26 00:53:00.465623+00:00, run_end_date=2024-05-26 00:53:05.570767+00:00, run_duration=5.105144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:52:00+00:00, data_interval_end=2024-05-26 00:53:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:53:05.580634377Z [2024-05-26T00:53:05.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:53:00+00:00, run_after=2024-05-26T00:54:00+00:00 2024-05-26T00:53:05.619663929Z [2024-05-26T00:53:05.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status success for try_number 1 2024-05-26T00:53:05.628112595Z [2024-05-26T00:53:05.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:52:00+00:00, map_index=-1, run_start_date=2024-05-26 00:53:02.442843+00:00, run_end_date=2024-05-26 00:53:05.316864+00:00, run_duration=2.874021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:53:00.524906+00:00, queued_by_job_id=1, pid=8606 2024-05-26T00:53:31.865144943Z [2024-05-26T00:53:31.864+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:54:00.288873872Z [2024-05-26T00:54:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:54:00+00:00, run_after=2024-05-26T00:55:00+00:00 2024-05-26T00:54:00.324503365Z [2024-05-26T00:54:00.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:54:00+00:00, run_after=2024-05-26T00:55:00+00:00 2024-05-26T00:54:00.335910080Z [2024-05-26T00:54:00.335+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:54:00.346169663Z [2024-05-26T00:54:00.345+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:54:00.457179358Z [2024-05-26T00:54:00.456+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:54:00.457204963Z 2024-05-26T00:54:00.457213447Z 2024-05-26T00:54:00.457216738Z 2024-05-26T00:54:00.457219797Z 2024-05-26T00:54:00.457237914Z [2024-05-26T00:54:00.457+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:54:00.457369854Z [2024-05-26T00:54:00.457+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:54:00.457433777Z [2024-05-26T00:54:00.457+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:54:00.457546815Z [2024-05-26T00:54:00.457+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:54:00.458261586Z [2024-05-26T00:54:00.458+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:54:00.458276560Z 2024-05-26T00:54:00.458281585Z 2024-05-26T00:54:00.458286148Z 2024-05-26T00:54:00.458326733Z 2024-05-26T00:54:00.462735371Z [2024-05-26T00:54:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:54:00.462905534Z [2024-05-26T00:54:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:54:00.463049141Z [2024-05-26T00:54:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:54:00.463134647Z [2024-05-26T00:54:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:54:00.463324350Z [2024-05-26T00:54:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:54:00.463384816Z [2024-05-26T00:54:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:54:00.463539491Z [2024-05-26T00:54:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:54:00.463739555Z [2024-05-26T00:54:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:54:00.992816389Z [2024-05-26T00:54:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status queued for try_number 1 2024-05-26T00:54:00.993095150Z [2024-05-26T00:54:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:53:00+00:00 exited with status queued for try_number 1 2024-05-26T00:54:00.993262108Z [2024-05-26T00:54:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:53:00+00:00 exited with status queued for try_number 1 2024-05-26T00:54:00.993423194Z [2024-05-26T00:54:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:53:00+00:00 exited with status queued for try_number 1 2024-05-26T00:54:01.021720696Z [2024-05-26T00:54:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed90e433-b34f-41a6-9efb-fa22c5928f32 2024-05-26T00:54:01.026232405Z [2024-05-26T00:54:01.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71c629ef-21d7-4f8e-ab30-d15b25808906 2024-05-26T00:54:01.026409785Z [2024-05-26T00:54:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b786ef3-4a97-4018-a1aa-91dfe333519a 2024-05-26T00:54:01.028292341Z [2024-05-26T00:54:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb8461fc-c254-413e-8279-2c4fd5674bb5 2024-05-26T00:54:02.340973193Z [2024-05-26T00:54:02.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:54:02.341342116Z [2024-05-26T00:54:02.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:52:00+00:00, run_id=scheduled__2024-05-26T00:52:00+00:00, run_start_date=2024-05-26 00:54:00.361484+00:00, run_end_date=2024-05-26 00:54:02.340922+00:00, run_duration=1.979438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:52:00+00:00, data_interval_end=2024-05-26 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:54:02.363321335Z [2024-05-26T00:54:02.363+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:54:00+00:00, run_after=2024-05-26T00:56:00+00:00 2024-05-26T00:54:02.381655938Z [2024-05-26T00:54:02.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:54:02.381793768Z [2024-05-26T00:54:02.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:53:00+00:00, run_id=scheduled__2024-05-26T00:53:00+00:00, run_start_date=2024-05-26 00:54:00.363227+00:00, run_end_date=2024-05-26 00:54:02.381570+00:00, run_duration=2.018343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:53:00+00:00, data_interval_end=2024-05-26 00:54:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:54:02.397877648Z [2024-05-26T00:54:02.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:54:00+00:00, run_after=2024-05-26T00:55:00+00:00 2024-05-26T00:54:03.649650039Z [2024-05-26T00:54:03.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:52:00+00:00 exited with status success for try_number 1 2024-05-26T00:54:03.650030607Z [2024-05-26T00:54:03.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:53:00+00:00 exited with status success for try_number 1 2024-05-26T00:54:03.658242666Z [2024-05-26T00:54:03.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:53:00+00:00, map_index=-1, run_start_date=2024-05-26 00:54:01.676473+00:00, run_end_date=2024-05-26 00:54:02.224617+00:00, run_duration=0.548144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:54:00.459259+00:00, queued_by_job_id=1, pid=8638 2024-05-26T00:54:03.661227608Z [2024-05-26T00:54:03.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:52:00+00:00, map_index=-1, run_start_date=2024-05-26 00:54:01.743644+00:00, run_end_date=2024-05-26 00:54:02.283766+00:00, run_duration=0.540122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:54:00.459259+00:00, queued_by_job_id=1, pid=8639 2024-05-26T00:54:04.716139577Z [2024-05-26T00:54:04.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:54:04.717764849Z [2024-05-26T00:54:04.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:53:00+00:00, run_id=scheduled__2024-05-26T00:53:00+00:00, run_start_date=2024-05-26 00:54:00.364712+00:00, run_end_date=2024-05-26 00:54:04.716057+00:00, run_duration=4.351345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:53:00+00:00, data_interval_end=2024-05-26 00:54:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:54:04.726428321Z [2024-05-26T00:54:04.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:54:00+00:00, run_after=2024-05-26T00:55:00+00:00 2024-05-26T00:54:04.762748668Z [2024-05-26T00:54:04.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:53:00+00:00 exited with status success for try_number 1 2024-05-26T00:54:04.768490175Z [2024-05-26T00:54:04.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:53:00+00:00, map_index=-1, run_start_date=2024-05-26 00:54:03.038124+00:00, run_end_date=2024-05-26 00:54:04.540067+00:00, run_duration=1.501943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:54:00.459259+00:00, queued_by_job_id=1, pid=8661 2024-05-26T00:54:05.827682622Z [2024-05-26T00:54:05.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:54:05.828346325Z [2024-05-26T00:54:05.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:53:00+00:00, run_id=scheduled__2024-05-26T00:53:00+00:00, run_start_date=2024-05-26 00:54:00.366047+00:00, run_end_date=2024-05-26 00:54:05.827543+00:00, run_duration=5.461496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:53:00+00:00, data_interval_end=2024-05-26 00:54:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:54:05.838805820Z [2024-05-26T00:54:05.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:54:00+00:00, run_after=2024-05-26T00:55:00+00:00 2024-05-26T00:54:05.878082020Z [2024-05-26T00:54:05.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:53:00+00:00 exited with status success for try_number 1 2024-05-26T00:54:05.884692649Z [2024-05-26T00:54:05.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:53:00+00:00, map_index=-1, run_start_date=2024-05-26 00:54:03.353446+00:00, run_end_date=2024-05-26 00:54:05.191009+00:00, run_duration=1.837563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:54:00.459259+00:00, queued_by_job_id=1, pid=8663 2024-05-26T00:55:00.067262835Z [2024-05-26T00:55:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:55:00.080425496Z [2024-05-26T00:55:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:55:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:55:00.092054948Z [2024-05-26T00:55:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:55:00+00:00, run_after=2024-05-26T00:56:00+00:00 2024-05-26T00:55:00.103510757Z [2024-05-26T00:55:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:55:00+00:00, run_after=2024-05-26T00:56:00+00:00 2024-05-26T00:55:00.184304039Z [2024-05-26T00:55:00.183+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:55:00.184367302Z 2024-05-26T00:55:00.184382722Z 2024-05-26T00:55:00.184391500Z 2024-05-26T00:55:00.184400191Z 2024-05-26T00:55:00.184962564Z [2024-05-26T00:55:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:55:00.185342324Z [2024-05-26T00:55:00.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:55:00.185482257Z [2024-05-26T00:55:00.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:55:00.185790876Z [2024-05-26T00:55:00.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:55:00.186874941Z [2024-05-26T00:55:00.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:55:00.186902836Z 2024-05-26T00:55:00.186910937Z 2024-05-26T00:55:00.186937945Z 2024-05-26T00:55:00.186945233Z 2024-05-26T00:55:00.193627669Z [2024-05-26T00:55:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T00:55:00.193953378Z [2024-05-26T00:55:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:55:00.194372773Z [2024-05-26T00:55:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:55:00.194733999Z [2024-05-26T00:55:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:55:00.195154782Z [2024-05-26T00:55:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:55:00.195284837Z [2024-05-26T00:55:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:55:00.195612531Z [2024-05-26T00:55:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:55:00.195779377Z [2024-05-26T00:55:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:55:00.546508673Z [2024-05-26T00:55:00.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:55:00.546546318Z [2024-05-26T00:55:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status queued for try_number 1 2024-05-26T00:55:00.546602981Z [2024-05-26T00:55:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status queued for try_number 1 2024-05-26T00:55:00.546693939Z [2024-05-26T00:55:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status queued for try_number 1 2024-05-26T00:55:00.559172666Z [2024-05-26T00:55:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0fbeb22-144f-4f46-a10d-ef64c1128fe1 2024-05-26T00:55:00.559241866Z [2024-05-26T00:55:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e646a19-0cc5-47f3-8ef0-c316eda40db6 2024-05-26T00:55:00.559356300Z [2024-05-26T00:55:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to b818e279-0584-4fef-8beb-689a53d8ebb4 2024-05-26T00:55:00.559451941Z [2024-05-26T00:55:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ad5a026-acea-46db-8700-e51b83e30f2c 2024-05-26T00:55:01.846625728Z [2024-05-26T00:55:01.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:55:01.847182162Z [2024-05-26T00:55:01.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:54:00+00:00, run_id=scheduled__2024-05-26T00:54:00+00:00, run_start_date=2024-05-26 00:55:00.115573+00:00, run_end_date=2024-05-26 00:55:01.846826+00:00, run_duration=1.731253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:54:00+00:00, data_interval_end=2024-05-26 00:55:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:55:01.857760855Z [2024-05-26T00:55:01.857+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:55:00+00:00, run_after=2024-05-26T00:56:00+00:00 2024-05-26T00:55:01.910646657Z [2024-05-26T00:55:01.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status success for try_number 1 2024-05-26T00:55:01.915470028Z [2024-05-26T00:55:01.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:54:00+00:00, map_index=-1, run_start_date=2024-05-26 00:55:01.035952+00:00, run_end_date=2024-05-26 00:55:01.424577+00:00, run_duration=0.388625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:55:00.188600+00:00, queued_by_job_id=1, pid=8696 2024-05-26T00:55:03.043212759Z [2024-05-26T00:55:03.042+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:55:03.043270709Z 2024-05-26T00:55:03.043409985Z [2024-05-26T00:55:03.043+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:55:03.044138265Z [2024-05-26T00:55:03.043+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:55:03.044152682Z 2024-05-26T00:55:03.046765515Z [2024-05-26T00:55:03.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T00:55:03.047007762Z [2024-05-26T00:55:03.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:55:03.114555883Z [2024-05-26T00:55:03.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:55:03.114928063Z [2024-05-26T00:55:03.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:55:03.121508784Z [2024-05-26T00:55:03.121+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2e8c41b-561a-4742-9ab9-9e50ed98e2e6 2024-05-26T00:55:03.121946962Z [2024-05-26T00:55:03.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=-1, run_start_date=2024-05-26 00:55:02.044320+00:00, run_end_date=2024-05-26 00:55:02.406401+00:00, run_duration=0.362081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:55:00.188600+00:00, queued_by_job_id=1, pid=8717 2024-05-26T00:55:04.285686580Z [2024-05-26T00:55:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:55:04.288629706Z [2024-05-26T00:55:04.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:54:00+00:00, run_id=scheduled__2024-05-26T00:54:00+00:00, run_start_date=2024-05-26 00:55:00.116559+00:00, run_end_date=2024-05-26 00:55:04.287625+00:00, run_duration=4.171066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:54:00+00:00, data_interval_end=2024-05-26 00:55:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:55:04.308494114Z [2024-05-26T00:55:04.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:55:00+00:00, run_after=2024-05-26T00:56:00+00:00 2024-05-26T00:55:04.327079860Z [2024-05-26T00:55:04.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:55:04.328755496Z [2024-05-26T00:55:04.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:54:00+00:00, run_id=scheduled__2024-05-26T00:54:00+00:00, run_start_date=2024-05-26 00:55:00.117778+00:00, run_end_date=2024-05-26 00:55:04.328229+00:00, run_duration=4.210451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:54:00+00:00, data_interval_end=2024-05-26 00:55:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:55:04.377963476Z [2024-05-26T00:55:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:55:00+00:00, run_after=2024-05-26T00:56:00+00:00 2024-05-26T00:55:04.532806673Z [2024-05-26T00:55:04.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status success for try_number 1 2024-05-26T00:55:04.532992593Z [2024-05-26T00:55:04.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status success for try_number 1 2024-05-26T00:55:04.542045010Z [2024-05-26T00:55:04.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:54:00+00:00, map_index=-1, run_start_date=2024-05-26 00:55:02.244967+00:00, run_end_date=2024-05-26 00:55:03.604736+00:00, run_duration=1.359769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:55:00.188600+00:00, queued_by_job_id=1, pid=8722 2024-05-26T00:55:04.542061957Z [2024-05-26T00:55:04.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:54:00+00:00, map_index=-1, run_start_date=2024-05-26 00:55:02.208961+00:00, run_end_date=2024-05-26 00:55:03.912726+00:00, run_duration=1.703765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:55:00.188600+00:00, queued_by_job_id=1, pid=8721 2024-05-26T00:55:06.491430437Z [2024-05-26T00:55:06.491+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:55:06.491463774Z 2024-05-26T00:55:06.491467385Z [2024-05-26T00:55:06.491+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:55:06.492156121Z [2024-05-26T00:55:06.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:55:06.492182173Z 2024-05-26T00:55:06.499051383Z [2024-05-26T00:55:06.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T00:55:06.499105119Z [2024-05-26T00:55:06.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T00:55:06.648250434Z [2024-05-26T00:55:06.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:55:06.648284694Z [2024-05-26T00:55:06.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:55:06.668659687Z [2024-05-26T00:55:06.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc7765d4-8195-4a40-b093-5d0e90a58faa 2024-05-26T00:55:06.669078933Z [2024-05-26T00:55:06.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=-1, run_start_date=2024-05-26 00:55:05.322965+00:00, run_end_date=2024-05-26 00:55:06.008806+00:00, run_duration=0.685841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:55:03.044470+00:00, queued_by_job_id=1, pid=8745 2024-05-26T00:55:09.192468516Z [2024-05-26T00:55:09.191+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T00:55:09.192516577Z 2024-05-26T00:55:09.192624223Z [2024-05-26T00:55:09.192+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:55:09.193615762Z [2024-05-26T00:55:09.193+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:55:09.193626479Z 2024-05-26T00:55:09.197160737Z [2024-05-26T00:55:09.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:55:09.197280060Z [2024-05-26T00:55:09.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T00:55:09.266132757Z [2024-05-26T00:55:09.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status queued for try_number 1 2024-05-26T00:55:09.266158628Z [2024-05-26T00:55:09.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:55:09.277054362Z [2024-05-26T00:55:09.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cff1ad4-a6d9-40c1-899b-950cc2676984 2024-05-26T00:55:09.277340970Z [2024-05-26T00:55:09.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=0, run_start_date=2024-05-26 00:55:08.147556+00:00, run_end_date=2024-05-26 00:55:08.554263+00:00, run_duration=0.406707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:55:06.492454+00:00, queued_by_job_id=1, pid=8753 2024-05-26T00:55:11.547767187Z [2024-05-26T00:55:11.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:55:11.548265646Z [2024-05-26T00:55:11.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:50:00+00:00, run_id=scheduled__2024-05-26T00:50:00+00:00, run_start_date=2024-05-26 00:55:00.114254+00:00, run_end_date=2024-05-26 00:55:11.547740+00:00, run_duration=11.433486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:50:00+00:00, data_interval_end=2024-05-26 00:55:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T00:55:11.557920364Z [2024-05-26T00:55:11.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:55:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:55:11.599069390Z [2024-05-26T00:55:11.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:50:00+00:00 exited with status success for try_number 1 2024-05-26T00:55:11.608579493Z [2024-05-26T00:55:11.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:50:00+00:00, map_index=-1, run_start_date=2024-05-26 00:55:10.771091+00:00, run_end_date=2024-05-26 00:55:11.116284+00:00, run_duration=0.345193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:55:09.194025+00:00, queued_by_job_id=1, pid=8761 2024-05-26T00:56:01.052589727Z [2024-05-26T00:56:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:56:00+00:00, run_after=2024-05-26T00:57:00+00:00 2024-05-26T00:56:01.063081459Z [2024-05-26T00:56:01.062+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:56:01.073837907Z [2024-05-26T00:56:01.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:56:01.090392671Z [2024-05-26T00:56:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:56:00+00:00, run_after=2024-05-26T00:57:00+00:00 2024-05-26T00:56:01.207209911Z [2024-05-26T00:56:01.206+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:56:01.207272545Z 2024-05-26T00:56:01.207300835Z 2024-05-26T00:56:01.207314844Z 2024-05-26T00:56:01.207331590Z 2024-05-26T00:56:01.207741747Z [2024-05-26T00:56:01.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:56:01.208390899Z [2024-05-26T00:56:01.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:56:01.208977678Z [2024-05-26T00:56:01.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:56:01.210294187Z [2024-05-26T00:56:01.209+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:56:01.215261700Z [2024-05-26T00:56:01.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:56:01.215297640Z 2024-05-26T00:56:01.215306737Z 2024-05-26T00:56:01.215314788Z 2024-05-26T00:56:01.215322824Z 2024-05-26T00:56:01.223477583Z [2024-05-26T00:56:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:56:01.223976515Z [2024-05-26T00:56:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:56:01.224484093Z [2024-05-26T00:56:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:56:01.224786304Z [2024-05-26T00:56:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:56:01.225265956Z [2024-05-26T00:56:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:56:01.225602525Z [2024-05-26T00:56:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:56:01.226056513Z [2024-05-26T00:56:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:56:01.226259398Z [2024-05-26T00:56:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:56:01.704714757Z [2024-05-26T00:56:01.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status queued for try_number 1 2024-05-26T00:56:01.704810654Z [2024-05-26T00:56:01.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status queued for try_number 1 2024-05-26T00:56:01.704930192Z [2024-05-26T00:56:01.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status queued for try_number 1 2024-05-26T00:56:01.705024243Z [2024-05-26T00:56:01.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status queued for try_number 1 2024-05-26T00:56:01.721095139Z [2024-05-26T00:56:01.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19e1ba9a-670c-4986-afb2-7a8847242b22 2024-05-26T00:56:01.721178765Z [2024-05-26T00:56:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbdc1c31-5de4-4d3a-b8ed-7689c86663f0 2024-05-26T00:56:01.721390639Z [2024-05-26T00:56:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d3b7ea8-5029-49da-9b4c-f5f35c590de9 2024-05-26T00:56:01.721526873Z [2024-05-26T00:56:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1d3b0d1-3567-4300-b89e-73c29e4c30aa 2024-05-26T00:56:02.912458351Z [2024-05-26T00:56:02.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:56:02.912844963Z [2024-05-26T00:56:02.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:54:00+00:00, run_id=scheduled__2024-05-26T00:54:00+00:00, run_start_date=2024-05-26 00:56:01.107375+00:00, run_end_date=2024-05-26 00:56:02.912277+00:00, run_duration=1.804902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:54:00+00:00, data_interval_end=2024-05-26 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:56:02.920594648Z [2024-05-26T00:56:02.920+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:56:00+00:00, run_after=2024-05-26T00:58:00+00:00 2024-05-26T00:56:02.992830849Z [2024-05-26T00:56:02.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:54:00+00:00 exited with status success for try_number 1 2024-05-26T00:56:02.993155244Z [2024-05-26T00:56:02.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status success for try_number 1 2024-05-26T00:56:03.007594621Z [2024-05-26T00:56:03.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:54:00+00:00, map_index=-1, run_start_date=2024-05-26 00:56:02.109260+00:00, run_end_date=2024-05-26 00:56:02.611395+00:00, run_duration=0.502135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:56:01.217315+00:00, queued_by_job_id=1, pid=8784 2024-05-26T00:56:03.008371947Z [2024-05-26T00:56:03.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:55:00+00:00, map_index=-1, run_start_date=2024-05-26 00:56:02.329663+00:00, run_end_date=2024-05-26 00:56:02.809579+00:00, run_duration=0.479916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:56:01.217315+00:00, queued_by_job_id=1, pid=8785 2024-05-26T00:56:04.106080056Z [2024-05-26T00:56:04.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:56:04.106374064Z [2024-05-26T00:56:04.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:55:00+00:00, run_id=scheduled__2024-05-26T00:55:00+00:00, run_start_date=2024-05-26 00:56:01.108853+00:00, run_end_date=2024-05-26 00:56:04.105977+00:00, run_duration=2.997124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:55:00+00:00, data_interval_end=2024-05-26 00:56:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:56:04.127453735Z [2024-05-26T00:56:04.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:56:00+00:00, run_after=2024-05-26T00:57:00+00:00 2024-05-26T00:56:05.226111354Z [2024-05-26T00:56:05.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:56:05.226149841Z [2024-05-26T00:56:05.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:55:00+00:00, run_id=scheduled__2024-05-26T00:55:00+00:00, run_start_date=2024-05-26 00:56:01.110488+00:00, run_end_date=2024-05-26 00:56:05.225162+00:00, run_duration=4.114674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:55:00+00:00, data_interval_end=2024-05-26 00:56:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:56:05.243152370Z [2024-05-26T00:56:05.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:56:00+00:00, run_after=2024-05-26T00:57:00+00:00 2024-05-26T00:56:05.314397846Z [2024-05-26T00:56:05.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status success for try_number 1 2024-05-26T00:56:05.320438922Z [2024-05-26T00:56:05.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:55:00+00:00, map_index=-1, run_start_date=2024-05-26 00:56:03.563747+00:00, run_end_date=2024-05-26 00:56:05.130282+00:00, run_duration=1.566535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:56:01.217315+00:00, queued_by_job_id=1, pid=8809 2024-05-26T00:56:06.364948435Z [2024-05-26T00:56:06.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:56:06.365201603Z [2024-05-26T00:56:06.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:55:00+00:00, run_id=scheduled__2024-05-26T00:55:00+00:00, run_start_date=2024-05-26 00:56:01.111885+00:00, run_end_date=2024-05-26 00:56:06.364801+00:00, run_duration=5.252916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:55:00+00:00, data_interval_end=2024-05-26 00:56:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:56:06.376302718Z [2024-05-26T00:56:06.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:56:00+00:00, run_after=2024-05-26T00:57:00+00:00 2024-05-26T00:56:06.442835885Z [2024-05-26T00:56:06.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status success for try_number 1 2024-05-26T00:56:06.460756119Z [2024-05-26T00:56:06.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:55:00+00:00, map_index=-1, run_start_date=2024-05-26 00:56:03.317962+00:00, run_end_date=2024-05-26 00:56:05.466882+00:00, run_duration=2.14892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:56:01.217315+00:00, queued_by_job_id=1, pid=8808 2024-05-26T00:57:01.083366714Z [2024-05-26T00:57:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:57:00+00:00, run_after=2024-05-26T00:58:00+00:00 2024-05-26T00:57:01.094401271Z [2024-05-26T00:57:01.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:57:01.105547366Z [2024-05-26T00:57:01.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:57:00+00:00, run_after=2024-05-26T00:58:00+00:00 2024-05-26T00:57:01.196853039Z [2024-05-26T00:57:01.196+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:57:01.196886060Z 2024-05-26T00:57:01.196890726Z 2024-05-26T00:57:01.196894583Z 2024-05-26T00:57:01.197090448Z [2024-05-26T00:57:01.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:57:01.197401903Z [2024-05-26T00:57:01.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:57:01.198018585Z [2024-05-26T00:57:01.197+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:57:01.199044073Z [2024-05-26T00:57:01.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:57:01.199050330Z 2024-05-26T00:57:01.199054191Z 2024-05-26T00:57:01.199057958Z 2024-05-26T00:57:01.208101333Z [2024-05-26T00:57:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:57:01.208226928Z [2024-05-26T00:57:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:57:01.208496852Z [2024-05-26T00:57:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:57:01.208629821Z [2024-05-26T00:57:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:57:01.208961557Z [2024-05-26T00:57:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:57:01.209209909Z [2024-05-26T00:57:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:57:01.459065422Z [2024-05-26T00:57:01.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status queued for try_number 1 2024-05-26T00:57:01.459250116Z [2024-05-26T00:57:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status queued for try_number 1 2024-05-26T00:57:01.459355326Z [2024-05-26T00:57:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status queued for try_number 1 2024-05-26T00:57:01.473629218Z [2024-05-26T00:57:01.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4528bbd9-49a8-4b43-9731-95ac9419c07b 2024-05-26T00:57:01.473651393Z [2024-05-26T00:57:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 656893cc-4801-4049-86e4-094aa4a967d9 2024-05-26T00:57:01.473865941Z [2024-05-26T00:57:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87d93a10-76e6-4846-bd68-13aa06599ba2 2024-05-26T00:57:02.623149335Z [2024-05-26T00:57:02.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:57:02.623364346Z [2024-05-26T00:57:02.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:56:00+00:00, run_id=scheduled__2024-05-26T00:56:00+00:00, run_start_date=2024-05-26 00:57:01.114573+00:00, run_end_date=2024-05-26 00:57:02.623059+00:00, run_duration=1.508486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:56:00+00:00, data_interval_end=2024-05-26 00:57:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:57:02.634814004Z [2024-05-26T00:57:02.634+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:57:00+00:00, run_after=2024-05-26T00:58:00+00:00 2024-05-26T00:57:02.689095929Z [2024-05-26T00:57:02.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status success for try_number 1 2024-05-26T00:57:02.698967214Z [2024-05-26T00:57:02.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:56:00+00:00, map_index=-1, run_start_date=2024-05-26 00:57:02.025557+00:00, run_end_date=2024-05-26 00:57:02.424122+00:00, run_duration=0.398565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:57:01.200909+00:00, queued_by_job_id=1, pid=8841 2024-05-26T00:57:05.097084585Z [2024-05-26T00:57:05.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:57:05.097268617Z [2024-05-26T00:57:05.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:56:00+00:00, run_id=scheduled__2024-05-26T00:56:00+00:00, run_start_date=2024-05-26 00:57:01.115756+00:00, run_end_date=2024-05-26 00:57:05.097004+00:00, run_duration=3.981248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:56:00+00:00, data_interval_end=2024-05-26 00:57:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:57:05.108180176Z [2024-05-26T00:57:05.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:57:00+00:00, run_after=2024-05-26T00:58:00+00:00 2024-05-26T00:57:05.155588242Z [2024-05-26T00:57:05.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status success for try_number 1 2024-05-26T00:57:05.161754572Z [2024-05-26T00:57:05.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:56:00+00:00, map_index=-1, run_start_date=2024-05-26 00:57:02.850386+00:00, run_end_date=2024-05-26 00:57:04.733984+00:00, run_duration=1.883598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:57:01.200909+00:00, queued_by_job_id=1, pid=8859 2024-05-26T00:57:06.210744806Z [2024-05-26T00:57:06.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:57:06.210774824Z [2024-05-26T00:57:06.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:56:00+00:00, run_id=scheduled__2024-05-26T00:56:00+00:00, run_start_date=2024-05-26 00:57:01.116798+00:00, run_end_date=2024-05-26 00:57:06.210459+00:00, run_duration=5.093661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:56:00+00:00, data_interval_end=2024-05-26 00:57:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:57:06.239980371Z [2024-05-26T00:57:06.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:57:00+00:00, run_after=2024-05-26T00:58:00+00:00 2024-05-26T00:57:06.289160295Z [2024-05-26T00:57:06.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status success for try_number 1 2024-05-26T00:57:06.299015888Z [2024-05-26T00:57:06.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:56:00+00:00, map_index=-1, run_start_date=2024-05-26 00:57:02.865085+00:00, run_end_date=2024-05-26 00:57:05.534224+00:00, run_duration=2.669139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:57:01.200909+00:00, queued_by_job_id=1, pid=8860 2024-05-26T00:58:00.993481856Z [2024-05-26T00:58:00.992+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:58:01.018262397Z [2024-05-26T00:58:01.017+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:58:00+00:00, run_after=2024-05-26T00:59:00+00:00 2024-05-26T00:58:01.026809734Z [2024-05-26T00:58:01.026+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:58:01.043137132Z [2024-05-26T00:58:01.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:58:00+00:00, run_after=2024-05-26T00:59:00+00:00 2024-05-26T00:58:01.160349426Z [2024-05-26T00:58:01.159+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T00:58:01.160380051Z 2024-05-26T00:58:01.160386089Z 2024-05-26T00:58:01.160391200Z 2024-05-26T00:58:01.160396075Z 2024-05-26T00:58:01.160641892Z [2024-05-26T00:58:01.160+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T00:58:01.160864158Z [2024-05-26T00:58:01.160+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:58:01.161137202Z [2024-05-26T00:58:01.160+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:58:01.161389540Z [2024-05-26T00:58:01.161+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:58:01.162334873Z [2024-05-26T00:58:01.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:58:01.162348697Z 2024-05-26T00:58:01.162354906Z 2024-05-26T00:58:01.162360004Z 2024-05-26T00:58:01.162364926Z 2024-05-26T00:58:01.167924304Z [2024-05-26T00:58:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:58:01.168137611Z [2024-05-26T00:58:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T00:58:01.168626403Z [2024-05-26T00:58:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:58:01.168900031Z [2024-05-26T00:58:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:58:01.169368286Z [2024-05-26T00:58:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:58:01.169686242Z [2024-05-26T00:58:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:58:01.170122498Z [2024-05-26T00:58:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:58:01.170304913Z [2024-05-26T00:58:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:58:01.568038901Z [2024-05-26T00:58:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status queued for try_number 1 2024-05-26T00:58:01.568239563Z [2024-05-26T00:58:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:57:00+00:00 exited with status queued for try_number 1 2024-05-26T00:58:01.568400199Z [2024-05-26T00:58:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:57:00+00:00 exited with status queued for try_number 1 2024-05-26T00:58:01.568479970Z [2024-05-26T00:58:01.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:57:00+00:00 exited with status queued for try_number 1 2024-05-26T00:58:01.578281780Z [2024-05-26T00:58:01.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2943b147-c91b-46bf-921a-9097d6ad83e6 2024-05-26T00:58:01.578593434Z [2024-05-26T00:58:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ee480e4-bb46-4de4-bc91-9e27d8fc9724 2024-05-26T00:58:01.578798384Z [2024-05-26T00:58:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2479b26-5430-4251-8e28-6e6e60902ff4 2024-05-26T00:58:01.578948410Z [2024-05-26T00:58:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dc45d31-854a-4f15-bb35-efee4c26d17b 2024-05-26T00:58:02.849628344Z [2024-05-26T00:58:02.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:58:02.849936214Z [2024-05-26T00:58:02.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:56:00+00:00, run_id=scheduled__2024-05-26T00:56:00+00:00, run_start_date=2024-05-26 00:58:01.058304+00:00, run_end_date=2024-05-26 00:58:02.849554+00:00, run_duration=1.79125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:56:00+00:00, data_interval_end=2024-05-26 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T00:58:02.858506226Z [2024-05-26T00:58:02.858+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T00:58:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:58:02.866103062Z [2024-05-26T00:58:02.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:58:02.866384359Z [2024-05-26T00:58:02.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:57:00+00:00, run_id=scheduled__2024-05-26T00:57:00+00:00, run_start_date=2024-05-26 00:58:01.059724+00:00, run_end_date=2024-05-26 00:58:02.866036+00:00, run_duration=1.806312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:57:00+00:00, data_interval_end=2024-05-26 00:58:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:58:02.876072613Z [2024-05-26T00:58:02.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:58:00+00:00, run_after=2024-05-26T00:59:00+00:00 2024-05-26T00:58:02.949830582Z [2024-05-26T00:58:02.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:56:00+00:00 exited with status success for try_number 1 2024-05-26T00:58:02.950028555Z [2024-05-26T00:58:02.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:57:00+00:00 exited with status success for try_number 1 2024-05-26T00:58:02.964087592Z [2024-05-26T00:58:02.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:57:00+00:00, map_index=-1, run_start_date=2024-05-26 00:58:02.132773+00:00, run_end_date=2024-05-26 00:58:02.560604+00:00, run_duration=0.427831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:58:01.163714+00:00, queued_by_job_id=1, pid=8893 2024-05-26T00:58:02.964495267Z [2024-05-26T00:58:02.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:56:00+00:00, map_index=-1, run_start_date=2024-05-26 00:58:02.180527+00:00, run_end_date=2024-05-26 00:58:02.527167+00:00, run_duration=0.34664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:58:01.163714+00:00, queued_by_job_id=1, pid=8894 2024-05-26T00:58:04.985710671Z [2024-05-26T00:58:04.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:58:04.985868857Z [2024-05-26T00:58:04.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:57:00+00:00, run_id=scheduled__2024-05-26T00:57:00+00:00, run_start_date=2024-05-26 00:58:01.060870+00:00, run_end_date=2024-05-26 00:58:04.985622+00:00, run_duration=3.924752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:57:00+00:00, data_interval_end=2024-05-26 00:58:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:58:04.995163668Z [2024-05-26T00:58:04.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:58:00+00:00, run_after=2024-05-26T00:59:00+00:00 2024-05-26T00:58:06.105308202Z [2024-05-26T00:58:06.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:58:06.106397627Z [2024-05-26T00:58:06.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:57:00+00:00, run_id=scheduled__2024-05-26T00:57:00+00:00, run_start_date=2024-05-26 00:58:01.062225+00:00, run_end_date=2024-05-26 00:58:06.105652+00:00, run_duration=5.043427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:57:00+00:00, data_interval_end=2024-05-26 00:58:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:58:06.118159904Z [2024-05-26T00:58:06.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:58:00+00:00, run_after=2024-05-26T00:59:00+00:00 2024-05-26T00:58:06.164776342Z [2024-05-26T00:58:06.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:57:00+00:00 exited with status success for try_number 1 2024-05-26T00:58:06.165744188Z [2024-05-26T00:58:06.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:57:00+00:00 exited with status success for try_number 1 2024-05-26T00:58:06.177582487Z [2024-05-26T00:58:06.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:57:00+00:00, map_index=-1, run_start_date=2024-05-26 00:58:03.242222+00:00, run_end_date=2024-05-26 00:58:04.947574+00:00, run_duration=1.705352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:58:01.163714+00:00, queued_by_job_id=1, pid=8917 2024-05-26T00:58:06.178004175Z [2024-05-26T00:58:06.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:57:00+00:00, map_index=-1, run_start_date=2024-05-26 00:58:03.287312+00:00, run_end_date=2024-05-26 00:58:04.989783+00:00, run_duration=1.702471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:58:01.163714+00:00, queued_by_job_id=1, pid=8918 2024-05-26T00:58:31.952618894Z [2024-05-26T00:58:31.951+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T00:59:00.449667778Z [2024-05-26T00:59:00.449+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T00:59:00.468350893Z [2024-05-26T00:59:00.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:59:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:59:00.482942222Z [2024-05-26T00:59:00.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:59:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:59:00.539984140Z [2024-05-26T00:59:00.539+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T00:59:00.540024468Z 2024-05-26T00:59:00.540029196Z 2024-05-26T00:59:00.540032904Z 2024-05-26T00:59:00.540546159Z [2024-05-26T00:59:00.539+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:59:00.541094896Z [2024-05-26T00:59:00.540+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T00:59:00.541513077Z [2024-05-26T00:59:00.541+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T00:59:00.543094233Z [2024-05-26T00:59:00.542+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T00:59:00.543106867Z 2024-05-26T00:59:00.543110713Z 2024-05-26T00:59:00.543114647Z 2024-05-26T00:59:00.549941550Z [2024-05-26T00:59:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:59:00.550555600Z [2024-05-26T00:59:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T00:59:00.551066915Z [2024-05-26T00:59:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:59:00.551383376Z [2024-05-26T00:59:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T00:59:00.551866368Z [2024-05-26T00:59:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T00:59:00.552182449Z [2024-05-26T00:59:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T00:59:00.786333601Z [2024-05-26T00:59:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status queued for try_number 1 2024-05-26T00:59:00.786395662Z [2024-05-26T00:59:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status queued for try_number 1 2024-05-26T00:59:00.786542297Z [2024-05-26T00:59:00.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status queued for try_number 1 2024-05-26T00:59:00.797254430Z [2024-05-26T00:59:00.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d5c90d3-0e06-4641-90f8-dc3ee74177dc 2024-05-26T00:59:00.797535733Z [2024-05-26T00:59:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28ead5ae-bc9c-4148-9a16-26da611ea467 2024-05-26T00:59:00.797915888Z [2024-05-26T00:59:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4811d4c7-439b-44e5-87d1-90f92e4d1b62 2024-05-26T00:59:01.950660064Z [2024-05-26T00:59:01.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:59:01.951389296Z [2024-05-26T00:59:01.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:58:00+00:00, run_id=scheduled__2024-05-26T00:58:00+00:00, run_start_date=2024-05-26 00:59:00.491891+00:00, run_end_date=2024-05-26 00:59:01.950799+00:00, run_duration=1.458908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:58:00+00:00, data_interval_end=2024-05-26 00:59:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T00:59:01.965557254Z [2024-05-26T00:59:01.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T00:59:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:59:02.021250749Z [2024-05-26T00:59:02.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status success for try_number 1 2024-05-26T00:59:02.031362570Z [2024-05-26T00:59:02.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:58:00+00:00, map_index=-1, run_start_date=2024-05-26 00:59:01.337117+00:00, run_end_date=2024-05-26 00:59:01.696137+00:00, run_duration=0.35902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:59:00.545466+00:00, queued_by_job_id=1, pid=8949 2024-05-26T00:59:04.170787551Z [2024-05-26T00:59:04.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:59:04.171164493Z [2024-05-26T00:59:04.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:58:00+00:00, run_id=scheduled__2024-05-26T00:58:00+00:00, run_start_date=2024-05-26 00:59:00.493065+00:00, run_end_date=2024-05-26 00:59:04.170865+00:00, run_duration=3.6778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:58:00+00:00, data_interval_end=2024-05-26 00:59:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T00:59:04.181781386Z [2024-05-26T00:59:04.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:59:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:59:04.199371746Z [2024-05-26T00:59:04.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T00:59:04.204464301Z [2024-05-26T00:59:04.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:58:00+00:00, run_id=scheduled__2024-05-26T00:58:00+00:00, run_start_date=2024-05-26 00:59:00.494086+00:00, run_end_date=2024-05-26 00:59:04.203923+00:00, run_duration=3.709837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:58:00+00:00, data_interval_end=2024-05-26 00:59:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T00:59:04.241152727Z [2024-05-26T00:59:04.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T00:59:00+00:00, run_after=2024-05-26T01:00:00+00:00 2024-05-26T00:59:04.294874937Z [2024-05-26T00:59:04.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status success for try_number 1 2024-05-26T00:59:04.300276193Z [2024-05-26T00:59:04.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:58:00+00:00, map_index=-1, run_start_date=2024-05-26 00:59:02.255805+00:00, run_end_date=2024-05-26 00:59:03.650911+00:00, run_duration=1.395106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:59:00.545466+00:00, queued_by_job_id=1, pid=8967 2024-05-26T00:59:05.436355848Z [2024-05-26T00:59:05.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status success for try_number 1 2024-05-26T00:59:05.439615844Z [2024-05-26T00:59:05.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:58:00+00:00, map_index=-1, run_start_date=2024-05-26 00:59:02.243249+00:00, run_end_date=2024-05-26 00:59:04.112485+00:00, run_duration=1.869236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 00:59:00.545466+00:00, queued_by_job_id=1, pid=8968 2024-05-26T01:00:00.882930113Z [2024-05-26T01:00:00.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:05:00+00:00 2024-05-26T01:00:00.895805571Z [2024-05-26T01:00:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:01:00+00:00 2024-05-26T01:00:00.901626166Z [2024-05-26T01:00:00.901+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:00:00.908077159Z [2024-05-26T01:00:00.907+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:00:00.918635107Z [2024-05-26T01:00:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:01:00+00:00 2024-05-26T01:00:01.031815187Z [2024-05-26T01:00:01.031+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T01:00:01.031843415Z 2024-05-26T01:00:01.031847980Z 2024-05-26T01:00:01.031852842Z 2024-05-26T01:00:01.031857756Z 2024-05-26T01:00:01.031861968Z 2024-05-26T01:00:01.032069104Z [2024-05-26T01:00:01.031+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:00:01.032219342Z [2024-05-26T01:00:01.032+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:00:01.032367315Z [2024-05-26T01:00:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:00:01.032514088Z [2024-05-26T01:00:01.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:00:01.032647996Z [2024-05-26T01:00:01.032+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:00:01.033593745Z [2024-05-26T01:00:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:00:01.033607425Z 2024-05-26T01:00:01.033611950Z 2024-05-26T01:00:01.033616393Z 2024-05-26T01:00:01.033620001Z 2024-05-26T01:00:01.033623513Z 2024-05-26T01:00:01.040002330Z [2024-05-26T01:00:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:00:01.040068791Z [2024-05-26T01:00:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:00:01.040381300Z [2024-05-26T01:00:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:00:01.040536391Z [2024-05-26T01:00:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:00:01.040848704Z [2024-05-26T01:00:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:00:01.041004344Z [2024-05-26T01:00:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:00:01.041281685Z [2024-05-26T01:00:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:00:01.041430707Z [2024-05-26T01:00:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:00:01.041722388Z [2024-05-26T01:00:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:00:01.041863427Z [2024-05-26T01:00:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:00:01.731665076Z [2024-05-26T01:00:01.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:01.731933485Z [2024-05-26T01:00:01.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:01.732073807Z [2024-05-26T01:00:01.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:59:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:01.732201214Z [2024-05-26T01:00:01.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:59:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:01.732331837Z [2024-05-26T01:00:01.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:59:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:01.743805363Z [2024-05-26T01:00:01.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95bb563d-d63d-4289-91af-1a62dd422442 2024-05-26T01:00:01.744069582Z [2024-05-26T01:00:01.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f79d02a-4f26-4ef6-8747-ab0b2a5e2433 2024-05-26T01:00:01.744239512Z [2024-05-26T01:00:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4adb5c93-da6e-49d8-9dde-9f16cb8a27f7 2024-05-26T01:00:01.744407408Z [2024-05-26T01:00:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50d52876-c7a1-4d82-be38-74e64d755d26 2024-05-26T01:00:01.744671768Z [2024-05-26T01:00:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4da38f29-e5aa-43dd-a51f-2ed53c29d34a 2024-05-26T01:00:03.092900192Z [2024-05-26T01:00:03.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:00:03.093521497Z [2024-05-26T01:00:03.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 00:59:00+00:00, run_id=scheduled__2024-05-26T00:59:00+00:00, run_start_date=2024-05-26 01:00:00.931440+00:00, run_end_date=2024-05-26 01:00:03.092807+00:00, run_duration=2.161367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:59:00+00:00, data_interval_end=2024-05-26 01:00:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:00:03.105243956Z [2024-05-26T01:00:03.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:01:00+00:00 2024-05-26T01:00:03.130174546Z [2024-05-26T01:00:03.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:00:03.130589920Z [2024-05-26T01:00:03.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 00:58:00+00:00, run_id=scheduled__2024-05-26T00:58:00+00:00, run_start_date=2024-05-26 01:00:00.930431+00:00, run_end_date=2024-05-26 01:00:03.130053+00:00, run_duration=2.199622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:58:00+00:00, data_interval_end=2024-05-26 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:00:03.143147485Z [2024-05-26T01:00:03.142+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:02:00+00:00 2024-05-26T01:00:03.245826648Z [2024-05-26T01:00:03.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T00:58:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:03.245859851Z [2024-05-26T01:00:03.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:59:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:03.258589273Z [2024-05-26T01:00:03.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:59:00+00:00, map_index=-1, run_start_date=2024-05-26 01:00:01.947250+00:00, run_end_date=2024-05-26 01:00:02.473127+00:00, run_duration=0.525877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:01.035343+00:00, queued_by_job_id=1, pid=9002 2024-05-26T01:00:03.261173236Z [2024-05-26T01:00:03.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T00:58:00+00:00, map_index=-1, run_start_date=2024-05-26 01:00:02.139227+00:00, run_end_date=2024-05-26 01:00:02.610885+00:00, run_duration=0.471658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:01.035343+00:00, queued_by_job_id=1, pid=9003 2024-05-26T01:00:04.344472992Z [2024-05-26T01:00:04.344+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:00:04.344534809Z 2024-05-26T01:00:04.344569222Z [2024-05-26T01:00:04.344+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:00:04.345132398Z [2024-05-26T01:00:04.344+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:00:04.345144505Z 2024-05-26T01:00:04.348287006Z [2024-05-26T01:00:04.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:00:04.348503618Z [2024-05-26T01:00:04.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:00:04.415292078Z [2024-05-26T01:00:04.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:04.415333224Z [2024-05-26T01:00:04.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:04.433345538Z [2024-05-26T01:00:04.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e11b0a-fe0e-48cc-909e-260616b5fd33 2024-05-26T01:00:04.433389788Z [2024-05-26T01:00:04.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T00:55:00+00:00, map_index=-1, run_start_date=2024-05-26 01:00:03.349640+00:00, run_end_date=2024-05-26 01:00:03.803186+00:00, run_duration=0.453546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:01.035343+00:00, queued_by_job_id=1, pid=9029 2024-05-26T01:00:05.623922325Z [2024-05-26T01:00:05.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:00:05.624100415Z [2024-05-26T01:00:05.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:59:00+00:00, run_id=scheduled__2024-05-26T00:59:00+00:00, run_start_date=2024-05-26 01:00:00.932540+00:00, run_end_date=2024-05-26 01:00:05.623717+00:00, run_duration=4.691177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:59:00+00:00, data_interval_end=2024-05-26 01:00:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:00:05.635155406Z [2024-05-26T01:00:05.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:01:00+00:00 2024-05-26T01:00:05.734845950Z [2024-05-26T01:00:05.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:59:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:05.738911835Z [2024-05-26T01:00:05.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:59:00+00:00, map_index=-1, run_start_date=2024-05-26 01:00:03.610047+00:00, run_end_date=2024-05-26 01:00:05.114747+00:00, run_duration=1.5047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:01.035343+00:00, queued_by_job_id=1, pid=9033 2024-05-26T01:00:06.835299336Z [2024-05-26T01:00:06.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:00:06.836008889Z [2024-05-26T01:00:06.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:59:00+00:00, run_id=scheduled__2024-05-26T00:59:00+00:00, run_start_date=2024-05-26 01:00:00.934236+00:00, run_end_date=2024-05-26 01:00:06.835233+00:00, run_duration=5.900997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:59:00+00:00, data_interval_end=2024-05-26 01:00:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:00:06.848983750Z [2024-05-26T01:00:06.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:01:00+00:00 2024-05-26T01:00:06.894600603Z [2024-05-26T01:00:06.894+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:00:06.894638454Z 2024-05-26T01:00:06.894642123Z [2024-05-26T01:00:06.894+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:00:06.895094365Z [2024-05-26T01:00:06.894+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:00:06.895125706Z 2024-05-26T01:00:06.897398128Z [2024-05-26T01:00:06.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:00:06.897448647Z [2024-05-26T01:00:06.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:00:06.950631870Z [2024-05-26T01:00:06.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:06.950655743Z [2024-05-26T01:00:06.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T00:59:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:06.955595459Z [2024-05-26T01:00:06.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T00:59:00+00:00, map_index=-1, run_start_date=2024-05-26 01:00:03.622893+00:00, run_end_date=2024-05-26 01:00:06.652805+00:00, run_duration=3.029912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:01.035343+00:00, queued_by_job_id=1, pid=9039 2024-05-26T01:00:06.955617927Z [2024-05-26T01:00:06.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 165a2594-5173-4643-9968-cc51faeeda55 2024-05-26T01:00:07.042200292Z [2024-05-26T01:00:07.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:07.053432088Z [2024-05-26T01:00:07.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T00:55:00+00:00, map_index=-1, run_start_date=2024-05-26 01:00:06.368844+00:00, run_end_date=2024-05-26 01:00:06.786234+00:00, run_duration=0.41739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:04.345483+00:00, queued_by_job_id=1, pid=9057 2024-05-26T01:00:09.918710652Z [2024-05-26T01:00:09.918+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:00:09.918795677Z 2024-05-26T01:00:09.919262754Z [2024-05-26T01:00:09.918+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:00:09.920641300Z [2024-05-26T01:00:09.920+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:00:09.920652637Z 2024-05-26T01:00:09.925223265Z [2024-05-26T01:00:09.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:00:09.925703771Z [2024-05-26T01:00:09.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:00:09.977498364Z [2024-05-26T01:00:09.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status queued for try_number 1 2024-05-26T01:00:09.977811261Z [2024-05-26T01:00:09.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:09.983032145Z [2024-05-26T01:00:09.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0db0f9b-ea8b-49d4-a100-c485fa1dbb0e 2024-05-26T01:00:09.983386872Z [2024-05-26T01:00:09.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T00:55:00+00:00, map_index=0, run_start_date=2024-05-26 01:00:08.578354+00:00, run_end_date=2024-05-26 01:00:08.936966+00:00, run_duration=0.358612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:06.895405+00:00, queued_by_job_id=1, pid=9065 2024-05-26T01:00:12.120997471Z [2024-05-26T01:00:12.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:00:12.121696406Z [2024-05-26T01:00:12.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 00:55:00+00:00, run_id=scheduled__2024-05-26T00:55:00+00:00, run_start_date=2024-05-26 01:00:00.929309+00:00, run_end_date=2024-05-26 01:00:12.121139+00:00, run_duration=11.19183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 00:55:00+00:00, data_interval_end=2024-05-26 01:00:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:00:12.131962711Z [2024-05-26T01:00:12.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:00:00+00:00, run_after=2024-05-26T01:05:00+00:00 2024-05-26T01:00:12.171882939Z [2024-05-26T01:00:12.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T00:55:00+00:00 exited with status success for try_number 1 2024-05-26T01:00:12.177469730Z [2024-05-26T01:00:12.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T00:55:00+00:00, map_index=-1, run_start_date=2024-05-26 01:00:11.527791+00:00, run_end_date=2024-05-26 01:00:11.920603+00:00, run_duration=0.392812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:00:09.921495+00:00, queued_by_job_id=1, pid=9073 2024-05-26T01:01:00.263067542Z [2024-05-26T01:01:00.262+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:01:00+00:00, run_after=2024-05-26T01:02:00+00:00 2024-05-26T01:01:00.274877506Z [2024-05-26T01:01:00.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:01:00+00:00, run_after=2024-05-26T01:02:00+00:00 2024-05-26T01:01:00.281821490Z [2024-05-26T01:01:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:01:00.350607684Z [2024-05-26T01:01:00.350+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:01:00.350641771Z 2024-05-26T01:01:00.350648765Z 2024-05-26T01:01:00.350653651Z 2024-05-26T01:01:00.351013895Z [2024-05-26T01:01:00.350+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:01:00.351272828Z [2024-05-26T01:01:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:01:00.351512688Z [2024-05-26T01:01:00.351+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:01:00.352425259Z [2024-05-26T01:01:00.352+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:01:00.352439927Z 2024-05-26T01:01:00.352445733Z 2024-05-26T01:01:00.352477611Z 2024-05-26T01:01:00.355582860Z [2024-05-26T01:01:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:01:00.355851711Z [2024-05-26T01:01:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:01:00.356220346Z [2024-05-26T01:01:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:01:00.356454680Z [2024-05-26T01:01:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:01:00.356810173Z [2024-05-26T01:01:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:01:00.357041154Z [2024-05-26T01:01:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:01:00.574805774Z [2024-05-26T01:01:00.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:01:00.575029267Z [2024-05-26T01:01:00.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:01:00.575178901Z [2024-05-26T01:01:00.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:01:00.587114716Z [2024-05-26T01:01:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 489fe20c-dbf7-4db6-9947-ee97c711e79a 2024-05-26T01:01:00.587314997Z [2024-05-26T01:01:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to f84d2005-160f-4fc6-97f4-253cac590f90 2024-05-26T01:01:00.587535969Z [2024-05-26T01:01:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to c86978a8-bdb2-4839-900d-c4f65b7fbf2a 2024-05-26T01:01:01.729798856Z [2024-05-26T01:01:01.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:01:01.730037700Z [2024-05-26T01:01:01.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:00:00+00:00, run_id=scheduled__2024-05-26T01:00:00+00:00, run_start_date=2024-05-26 01:01:00.292127+00:00, run_end_date=2024-05-26 01:01:01.729692+00:00, run_duration=1.437565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:00:00+00:00, data_interval_end=2024-05-26 01:01:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:01:01.744871026Z [2024-05-26T01:01:01.744+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:01:00+00:00, run_after=2024-05-26T01:02:00+00:00 2024-05-26T01:01:01.793054238Z [2024-05-26T01:01:01.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:01:01.799105783Z [2024-05-26T01:01:01.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=-1, run_start_date=2024-05-26 01:01:01.212907+00:00, run_end_date=2024-05-26 01:01:01.581217+00:00, run_duration=0.36831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:01:00.353235+00:00, queued_by_job_id=1, pid=9095 2024-05-26T01:01:04.033429656Z [2024-05-26T01:01:04.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:01:04.033872105Z [2024-05-26T01:01:04.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:00:00+00:00, run_id=scheduled__2024-05-26T01:00:00+00:00, run_start_date=2024-05-26 01:01:00.293347+00:00, run_end_date=2024-05-26 01:01:04.033315+00:00, run_duration=3.739968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:00:00+00:00, data_interval_end=2024-05-26 01:01:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:01:04.045725064Z [2024-05-26T01:01:04.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:01:00+00:00, run_after=2024-05-26T01:02:00+00:00 2024-05-26T01:01:04.053810949Z [2024-05-26T01:01:04.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:01:04.053974832Z [2024-05-26T01:01:04.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:00:00+00:00, run_id=scheduled__2024-05-26T01:00:00+00:00, run_start_date=2024-05-26 01:01:00.295132+00:00, run_end_date=2024-05-26 01:01:04.053638+00:00, run_duration=3.758506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:00:00+00:00, data_interval_end=2024-05-26 01:01:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:01:04.071241315Z [2024-05-26T01:01:04.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:01:00+00:00, run_after=2024-05-26T01:02:00+00:00 2024-05-26T01:01:04.119563795Z [2024-05-26T01:01:04.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:01:04.120430889Z [2024-05-26T01:01:04.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:01:04.131774074Z [2024-05-26T01:01:04.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=-1, run_start_date=2024-05-26 01:01:02.224759+00:00, run_end_date=2024-05-26 01:01:03.402375+00:00, run_duration=1.177616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:01:00.353235+00:00, queued_by_job_id=1, pid=9114 2024-05-26T01:01:04.131960050Z [2024-05-26T01:01:04.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=-1, run_start_date=2024-05-26 01:01:02.108715+00:00, run_end_date=2024-05-26 01:01:03.687226+00:00, run_duration=1.578511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:01:00.353235+00:00, queued_by_job_id=1, pid=9113 2024-05-26T01:02:00.733382346Z [2024-05-26T01:02:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:02:00+00:00, run_after=2024-05-26T01:03:00+00:00 2024-05-26T01:02:00.763597490Z [2024-05-26T01:02:00.761+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:02:00+00:00, run_after=2024-05-26T01:03:00+00:00 2024-05-26T01:02:00.778064902Z [2024-05-26T01:02:00.777+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:02:00.796055548Z [2024-05-26T01:02:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:02:00.937743999Z [2024-05-26T01:02:00.937+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:02:00.937781125Z 2024-05-26T01:02:00.937789843Z 2024-05-26T01:02:00.937796847Z 2024-05-26T01:02:00.937803444Z 2024-05-26T01:02:00.938128337Z [2024-05-26T01:02:00.937+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:02:00.938560791Z [2024-05-26T01:02:00.938+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:02:00.938865050Z [2024-05-26T01:02:00.938+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:02:00.939251375Z [2024-05-26T01:02:00.938+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:02:00.940857101Z [2024-05-26T01:02:00.940+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:02:00.940885671Z 2024-05-26T01:02:00.940926288Z 2024-05-26T01:02:00.940935171Z 2024-05-26T01:02:00.940943570Z 2024-05-26T01:02:00.948166053Z [2024-05-26T01:02:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:02:00.948541849Z [2024-05-26T01:02:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:02:00.949008351Z [2024-05-26T01:02:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:02:00.949213406Z [2024-05-26T01:02:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:02:00.949590700Z [2024-05-26T01:02:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:02:00.949789225Z [2024-05-26T01:02:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:02:00.950186066Z [2024-05-26T01:02:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:02:00.950438873Z [2024-05-26T01:02:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:02:01.209183522Z [2024-05-26T01:02:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:02:01.211376935Z [2024-05-26T01:02:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:01:00+00:00 exited with status queued for try_number 1 2024-05-26T01:02:01.211469422Z [2024-05-26T01:02:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:01:00+00:00 exited with status queued for try_number 1 2024-05-26T01:02:01.211601974Z [2024-05-26T01:02:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:01:00+00:00 exited with status queued for try_number 1 2024-05-26T01:02:01.220929932Z [2024-05-26T01:02:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e046f5-ca9f-495d-9424-24b99b0e288a 2024-05-26T01:02:01.221077517Z [2024-05-26T01:02:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bb3b3ba-29bd-4cae-b9d0-abfe2b5dbc33 2024-05-26T01:02:01.221226617Z [2024-05-26T01:02:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to f375213a-5686-423e-93cc-b26481b7354a 2024-05-26T01:02:01.221370068Z [2024-05-26T01:02:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f67f3cb-d63e-4645-a89e-f1c4dcde0d6b 2024-05-26T01:02:02.408136059Z [2024-05-26T01:02:02.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:02:02.408534980Z [2024-05-26T01:02:02.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:00:00+00:00, run_id=scheduled__2024-05-26T01:00:00+00:00, run_start_date=2024-05-26 01:02:00.813993+00:00, run_end_date=2024-05-26 01:02:02.408184+00:00, run_duration=1.594191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:00:00+00:00, data_interval_end=2024-05-26 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:02:02.415495449Z [2024-05-26T01:02:02.415+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:02:00+00:00, run_after=2024-05-26T01:04:00+00:00 2024-05-26T01:02:02.422581612Z [2024-05-26T01:02:02.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:02:02.422897868Z [2024-05-26T01:02:02.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:01:00+00:00, run_id=scheduled__2024-05-26T01:01:00+00:00, run_start_date=2024-05-26 01:02:00.817166+00:00, run_end_date=2024-05-26 01:02:02.422510+00:00, run_duration=1.605344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:01:00+00:00, data_interval_end=2024-05-26 01:02:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:02:02.432541473Z [2024-05-26T01:02:02.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:02:00+00:00, run_after=2024-05-26T01:03:00+00:00 2024-05-26T01:02:02.479913386Z [2024-05-26T01:02:02.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:02:02.480081510Z [2024-05-26T01:02:02.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:01:00+00:00 exited with status success for try_number 1 2024-05-26T01:02:02.487138443Z [2024-05-26T01:02:02.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=-1, run_start_date=2024-05-26 01:02:01.748894+00:00, run_end_date=2024-05-26 01:02:02.216587+00:00, run_duration=0.467693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:02:00.942834+00:00, queued_by_job_id=1, pid=9148 2024-05-26T01:02:02.487385962Z [2024-05-26T01:02:02.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:01:00+00:00, map_index=-1, run_start_date=2024-05-26 01:02:01.861503+00:00, run_end_date=2024-05-26 01:02:02.283453+00:00, run_duration=0.42195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:02:00.942834+00:00, queued_by_job_id=1, pid=9149 2024-05-26T01:02:04.980310248Z [2024-05-26T01:02:04.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:02:04.981240909Z [2024-05-26T01:02:04.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:01:00+00:00, run_id=scheduled__2024-05-26T01:01:00+00:00, run_start_date=2024-05-26 01:02:00.820054+00:00, run_end_date=2024-05-26 01:02:04.980356+00:00, run_duration=4.160302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:01:00+00:00, data_interval_end=2024-05-26 01:02:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:02:05.011200958Z [2024-05-26T01:02:05.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:02:00+00:00, run_after=2024-05-26T01:03:00+00:00 2024-05-26T01:02:05.019822107Z [2024-05-26T01:02:05.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:02:05.020263979Z [2024-05-26T01:02:05.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:01:00+00:00, run_id=scheduled__2024-05-26T01:01:00+00:00, run_start_date=2024-05-26 01:02:00.821822+00:00, run_end_date=2024-05-26 01:02:05.019705+00:00, run_duration=4.197883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:01:00+00:00, data_interval_end=2024-05-26 01:02:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:02:05.032333084Z [2024-05-26T01:02:05.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:02:00+00:00, run_after=2024-05-26T01:03:00+00:00 2024-05-26T01:02:05.070131991Z [2024-05-26T01:02:05.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:01:00+00:00 exited with status success for try_number 1 2024-05-26T01:02:05.070220596Z [2024-05-26T01:02:05.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:01:00+00:00 exited with status success for try_number 1 2024-05-26T01:02:05.080953297Z [2024-05-26T01:02:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:01:00+00:00, map_index=-1, run_start_date=2024-05-26 01:02:02.924543+00:00, run_end_date=2024-05-26 01:02:04.219786+00:00, run_duration=1.295243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:02:00.942834+00:00, queued_by_job_id=1, pid=9173 2024-05-26T01:02:05.081647377Z [2024-05-26T01:02:05.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:01:00+00:00, map_index=-1, run_start_date=2024-05-26 01:02:02.902885+00:00, run_end_date=2024-05-26 01:02:04.584849+00:00, run_duration=1.681964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:02:00.942834+00:00, queued_by_job_id=1, pid=9172 2024-05-26T01:03:00.070377279Z [2024-05-26T01:03:00.069+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:03:00.085958616Z [2024-05-26T01:03:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:03:00+00:00, run_after=2024-05-26T01:04:00+00:00 2024-05-26T01:03:00.097447101Z [2024-05-26T01:03:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:03:00+00:00, run_after=2024-05-26T01:04:00+00:00 2024-05-26T01:03:00.150652171Z [2024-05-26T01:03:00.150+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:03:00.150717712Z 2024-05-26T01:03:00.150725949Z 2024-05-26T01:03:00.150732628Z 2024-05-26T01:03:00.150739181Z [2024-05-26T01:03:00.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:03:00.150845629Z [2024-05-26T01:03:00.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:03:00.150898943Z [2024-05-26T01:03:00.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:03:00.151363413Z [2024-05-26T01:03:00.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:03:00.151384579Z 2024-05-26T01:03:00.151388111Z 2024-05-26T01:03:00.151391049Z 2024-05-26T01:03:00.154452903Z [2024-05-26T01:03:00.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:03:00.154488023Z [2024-05-26T01:03:00.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:03:00.154563429Z [2024-05-26T01:03:00.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:03:00.154800554Z [2024-05-26T01:03:00.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:03:00.155064738Z [2024-05-26T01:03:00.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:03:00.155650986Z [2024-05-26T01:03:00.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:03:00.427235991Z [2024-05-26T01:03:00.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status queued for try_number 1 2024-05-26T01:03:00.427421029Z [2024-05-26T01:03:00.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status queued for try_number 1 2024-05-26T01:03:00.427589396Z [2024-05-26T01:03:00.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status queued for try_number 1 2024-05-26T01:03:00.439504279Z [2024-05-26T01:03:00.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bc48a4b-cbea-4e78-9946-3fa1251ff0cd 2024-05-26T01:03:00.439818216Z [2024-05-26T01:03:00.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad58995f-bc26-4aad-a776-cf4cdc9c3f2d 2024-05-26T01:03:00.440023535Z [2024-05-26T01:03:00.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87317501-9351-4a1a-bece-03159ea5a3e7 2024-05-26T01:03:01.716493735Z [2024-05-26T01:03:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status success for try_number 1 2024-05-26T01:03:01.727323780Z [2024-05-26T01:03:01.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:02:00+00:00, map_index=-1, run_start_date=2024-05-26 01:03:00.981374+00:00, run_end_date=2024-05-26 01:03:01.511025+00:00, run_duration=0.529651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:03:00.152109+00:00, queued_by_job_id=1, pid=9205 2024-05-26T01:03:02.788860128Z [2024-05-26T01:03:02.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:03:02.789071833Z [2024-05-26T01:03:02.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:02:00+00:00, run_id=scheduled__2024-05-26T01:02:00+00:00, run_start_date=2024-05-26 01:03:00.106460+00:00, run_end_date=2024-05-26 01:03:02.788783+00:00, run_duration=2.682323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:02:00+00:00, data_interval_end=2024-05-26 01:03:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:03:02.798763413Z [2024-05-26T01:03:02.798+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:03:00+00:00, run_after=2024-05-26T01:04:00+00:00 2024-05-26T01:03:03.908706548Z [2024-05-26T01:03:03.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:03:03.909183996Z [2024-05-26T01:03:03.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:02:00+00:00, run_id=scheduled__2024-05-26T01:02:00+00:00, run_start_date=2024-05-26 01:03:00.107677+00:00, run_end_date=2024-05-26 01:03:03.908606+00:00, run_duration=3.800929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:02:00+00:00, data_interval_end=2024-05-26 01:03:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:03:03.917647384Z [2024-05-26T01:03:03.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:03:00+00:00, run_after=2024-05-26T01:04:00+00:00 2024-05-26T01:03:03.972567397Z [2024-05-26T01:03:03.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status success for try_number 1 2024-05-26T01:03:03.977355313Z [2024-05-26T01:03:03.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:02:00+00:00, map_index=-1, run_start_date=2024-05-26 01:03:02.480993+00:00, run_end_date=2024-05-26 01:03:03.720649+00:00, run_duration=1.239656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:03:00.152109+00:00, queued_by_job_id=1, pid=9224 2024-05-26T01:03:04.871735630Z [2024-05-26T01:03:04.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:03:04.872015667Z [2024-05-26T01:03:04.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:02:00+00:00, run_id=scheduled__2024-05-26T01:02:00+00:00, run_start_date=2024-05-26 01:03:00.108854+00:00, run_end_date=2024-05-26 01:03:04.871643+00:00, run_duration=4.762789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:02:00+00:00, data_interval_end=2024-05-26 01:03:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:03:04.890672824Z [2024-05-26T01:03:04.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:03:00+00:00, run_after=2024-05-26T01:04:00+00:00 2024-05-26T01:03:04.926224468Z [2024-05-26T01:03:04.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status success for try_number 1 2024-05-26T01:03:04.940107401Z [2024-05-26T01:03:04.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:02:00+00:00, map_index=-1, run_start_date=2024-05-26 01:03:02.295973+00:00, run_end_date=2024-05-26 01:03:04.172090+00:00, run_duration=1.876117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:03:00.152109+00:00, queued_by_job_id=1, pid=9223 2024-05-26T01:03:32.035831403Z [2024-05-26T01:03:32.034+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:04:00.299882217Z [2024-05-26T01:04:00.299+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:04:00.314897641Z [2024-05-26T01:04:00.314+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:04:00.328190925Z [2024-05-26T01:04:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:04:00+00:00, run_after=2024-05-26T01:05:00+00:00 2024-05-26T01:04:00.341196854Z [2024-05-26T01:04:00.340+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:04:00+00:00, run_after=2024-05-26T01:05:00+00:00 2024-05-26T01:04:00.426947601Z [2024-05-26T01:04:00.426+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:04:00.426989718Z 2024-05-26T01:04:00.426995267Z 2024-05-26T01:04:00.426999900Z 2024-05-26T01:04:00.427004433Z 2024-05-26T01:04:00.427303409Z [2024-05-26T01:04:00.427+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:04:00.427551740Z [2024-05-26T01:04:00.427+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:04:00.427784805Z [2024-05-26T01:04:00.427+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:04:00.427973608Z [2024-05-26T01:04:00.427+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:04:00.429065077Z [2024-05-26T01:04:00.428+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:04:00.429080452Z 2024-05-26T01:04:00.429085927Z 2024-05-26T01:04:00.429090605Z 2024-05-26T01:04:00.429094937Z 2024-05-26T01:04:00.434070526Z [2024-05-26T01:04:00.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:04:00.434321984Z [2024-05-26T01:04:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:04:00.434706778Z [2024-05-26T01:04:00.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:04:00.434994375Z [2024-05-26T01:04:00.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:04:00.435316124Z [2024-05-26T01:04:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:04:00.435557585Z [2024-05-26T01:04:00.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:04:00.436012314Z [2024-05-26T01:04:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:04:00.436197382Z [2024-05-26T01:04:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:04:00.959281582Z [2024-05-26T01:04:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status queued for try_number 1 2024-05-26T01:04:00.959374505Z [2024-05-26T01:04:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:03:00+00:00 exited with status queued for try_number 1 2024-05-26T01:04:00.959500215Z [2024-05-26T01:04:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:03:00+00:00 exited with status queued for try_number 1 2024-05-26T01:04:00.959601281Z [2024-05-26T01:04:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:03:00+00:00 exited with status queued for try_number 1 2024-05-26T01:04:00.976874734Z [2024-05-26T01:04:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05dcf86c-769e-4d3b-8794-351653122b98 2024-05-26T01:04:00.977039218Z [2024-05-26T01:04:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to e17f32bf-e607-45e2-b976-07ca69cc4a6e 2024-05-26T01:04:00.977260638Z [2024-05-26T01:04:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 895df7a8-0dc4-4b7c-9c0a-0ea9ff080135 2024-05-26T01:04:00.977410789Z [2024-05-26T01:04:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c6bda61-cd72-4cbb-862a-c85214586f98 2024-05-26T01:04:02.389671959Z [2024-05-26T01:04:02.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:04:02.389867324Z [2024-05-26T01:04:02.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:02:00+00:00, run_id=scheduled__2024-05-26T01:02:00+00:00, run_start_date=2024-05-26 01:04:00.356310+00:00, run_end_date=2024-05-26 01:04:02.389553+00:00, run_duration=2.033243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:02:00+00:00, data_interval_end=2024-05-26 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:04:02.398738795Z [2024-05-26T01:04:02.398+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:04:00+00:00, run_after=2024-05-26T01:06:00+00:00 2024-05-26T01:04:02.413547604Z [2024-05-26T01:04:02.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:04:02.413711267Z [2024-05-26T01:04:02.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:03:00+00:00, run_id=scheduled__2024-05-26T01:03:00+00:00, run_start_date=2024-05-26 01:04:00.357758+00:00, run_end_date=2024-05-26 01:04:02.413462+00:00, run_duration=2.055704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:03:00+00:00, data_interval_end=2024-05-26 01:04:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:04:02.442370119Z [2024-05-26T01:04:02.439+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:04:00+00:00, run_after=2024-05-26T01:05:00+00:00 2024-05-26T01:04:02.507745094Z [2024-05-26T01:04:02.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:02:00+00:00 exited with status success for try_number 1 2024-05-26T01:04:02.513812948Z [2024-05-26T01:04:02.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:02:00+00:00, map_index=-1, run_start_date=2024-05-26 01:04:01.365665+00:00, run_end_date=2024-05-26 01:04:01.971938+00:00, run_duration=0.606273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:04:00.430195+00:00, queued_by_job_id=1, pid=9252 2024-05-26T01:04:03.630098477Z [2024-05-26T01:04:03.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:03:00+00:00 exited with status success for try_number 1 2024-05-26T01:04:03.644384589Z [2024-05-26T01:04:03.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:03:00+00:00, map_index=-1, run_start_date=2024-05-26 01:04:01.756376+00:00, run_end_date=2024-05-26 01:04:02.309470+00:00, run_duration=0.553094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:04:00.430195+00:00, queued_by_job_id=1, pid=9259 2024-05-26T01:04:05.841414291Z [2024-05-26T01:04:05.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:04:05.841643317Z [2024-05-26T01:04:05.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:03:00+00:00, run_id=scheduled__2024-05-26T01:03:00+00:00, run_start_date=2024-05-26 01:04:00.358955+00:00, run_end_date=2024-05-26 01:04:05.841362+00:00, run_duration=5.482407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:03:00+00:00, data_interval_end=2024-05-26 01:04:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:04:05.857065652Z [2024-05-26T01:04:05.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:04:00+00:00, run_after=2024-05-26T01:05:00+00:00 2024-05-26T01:04:05.870904606Z [2024-05-26T01:04:05.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:04:05.871545609Z [2024-05-26T01:04:05.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:03:00+00:00, run_id=scheduled__2024-05-26T01:03:00+00:00, run_start_date=2024-05-26 01:04:00.360185+00:00, run_end_date=2024-05-26 01:04:05.871222+00:00, run_duration=5.511037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:03:00+00:00, data_interval_end=2024-05-26 01:04:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:04:05.893111935Z [2024-05-26T01:04:05.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:04:00+00:00, run_after=2024-05-26T01:05:00+00:00 2024-05-26T01:04:05.938880343Z [2024-05-26T01:04:05.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:03:00+00:00 exited with status success for try_number 1 2024-05-26T01:04:05.939005836Z [2024-05-26T01:04:05.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:03:00+00:00 exited with status success for try_number 1 2024-05-26T01:04:05.951345159Z [2024-05-26T01:04:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:03:00+00:00, map_index=-1, run_start_date=2024-05-26 01:04:03.030013+00:00, run_end_date=2024-05-26 01:04:04.914213+00:00, run_duration=1.8842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:04:00.430195+00:00, queued_by_job_id=1, pid=9287 2024-05-26T01:04:05.951853139Z [2024-05-26T01:04:05.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:03:00+00:00, map_index=-1, run_start_date=2024-05-26 01:04:02.732227+00:00, run_end_date=2024-05-26 01:04:04.951666+00:00, run_duration=2.219439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:04:00.430195+00:00, queued_by_job_id=1, pid=9276 2024-05-26T01:05:00.583849051Z [2024-05-26T01:05:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:05:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:05:00.596221589Z [2024-05-26T01:05:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:05:00+00:00, run_after=2024-05-26T01:06:00+00:00 2024-05-26T01:05:00.608488436Z [2024-05-26T01:05:00.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:05:00+00:00, run_after=2024-05-26T01:06:00+00:00 2024-05-26T01:05:00.614613701Z [2024-05-26T01:05:00.614+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:05:00.727632019Z [2024-05-26T01:05:00.725+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:05:00.727701671Z 2024-05-26T01:05:00.727708835Z 2024-05-26T01:05:00.727713676Z 2024-05-26T01:05:00.727718749Z 2024-05-26T01:05:00.727724149Z [2024-05-26T01:05:00.726+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:05:00.727743623Z [2024-05-26T01:05:00.726+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:05:00.727748432Z [2024-05-26T01:05:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:05:00.727753801Z [2024-05-26T01:05:00.726+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:05:00.727759101Z [2024-05-26T01:05:00.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:05:00.727763723Z 2024-05-26T01:05:00.727768342Z 2024-05-26T01:05:00.727773091Z 2024-05-26T01:05:00.727777859Z 2024-05-26T01:05:00.733349414Z [2024-05-26T01:05:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:05:00.733483534Z [2024-05-26T01:05:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:05:00.733640513Z [2024-05-26T01:05:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:05:00.733731438Z [2024-05-26T01:05:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:05:00.733938423Z [2024-05-26T01:05:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:05:00.734030021Z [2024-05-26T01:05:00.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:05:00.734230110Z [2024-05-26T01:05:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:05:00.734323674Z [2024-05-26T01:05:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:05:01.168056142Z [2024-05-26T01:05:01.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:05:01.168182341Z [2024-05-26T01:05:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status queued for try_number 1 2024-05-26T01:05:01.168302587Z [2024-05-26T01:05:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status queued for try_number 1 2024-05-26T01:05:01.168433079Z [2024-05-26T01:05:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status queued for try_number 1 2024-05-26T01:05:01.176704066Z [2024-05-26T01:05:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2226af59-12ae-4280-a760-2b9391b404f9 2024-05-26T01:05:01.176955747Z [2024-05-26T01:05:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07548a7a-5f37-470d-a2d6-033b4da30473 2024-05-26T01:05:01.177166442Z [2024-05-26T01:05:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9072ec50-23ce-48bb-9105-f88368314a92 2024-05-26T01:05:01.177317433Z [2024-05-26T01:05:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2d7339d-acf2-497e-9389-4f5b6c18709e 2024-05-26T01:05:02.916493398Z [2024-05-26T01:05:02.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:05:02.916908295Z [2024-05-26T01:05:02.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:04:00+00:00, run_id=scheduled__2024-05-26T01:04:00+00:00, run_start_date=2024-05-26 01:05:00.624217+00:00, run_end_date=2024-05-26 01:05:02.916400+00:00, run_duration=2.292183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:04:00+00:00, data_interval_end=2024-05-26 01:05:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:05:02.933224868Z [2024-05-26T01:05:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:05:00+00:00, run_after=2024-05-26T01:06:00+00:00 2024-05-26T01:05:03.062954273Z [2024-05-26T01:05:03.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status success for try_number 1 2024-05-26T01:05:03.069047427Z [2024-05-26T01:05:03.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:04:00+00:00, map_index=-1, run_start_date=2024-05-26 01:05:01.720616+00:00, run_end_date=2024-05-26 01:05:02.136597+00:00, run_duration=0.415981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:05:00.729006+00:00, queued_by_job_id=1, pid=9315 2024-05-26T01:05:04.121469789Z [2024-05-26T01:05:04.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:05:04.121792986Z [2024-05-26T01:05:04.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:04:00+00:00, run_id=scheduled__2024-05-26T01:04:00+00:00, run_start_date=2024-05-26 01:05:00.625233+00:00, run_end_date=2024-05-26 01:05:04.121411+00:00, run_duration=3.496178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:04:00+00:00, data_interval_end=2024-05-26 01:05:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:05:04.150775659Z [2024-05-26T01:05:04.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:05:00+00:00, run_after=2024-05-26T01:06:00+00:00 2024-05-26T01:05:04.196261141Z [2024-05-26T01:05:04.195+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:05:04.196293122Z 2024-05-26T01:05:04.196304318Z [2024-05-26T01:05:04.196+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:05:04.196790268Z [2024-05-26T01:05:04.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:05:04.196795782Z 2024-05-26T01:05:04.199454042Z [2024-05-26T01:05:04.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:05:04.199552673Z [2024-05-26T01:05:04.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:05:04.292577650Z [2024-05-26T01:05:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:05:04.295349669Z [2024-05-26T01:05:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:05:04.295713752Z [2024-05-26T01:05:04.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status success for try_number 1 2024-05-26T01:05:04.315404678Z [2024-05-26T01:05:04.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ed0151f-6167-4c1c-be61-91529e0e793f 2024-05-26T01:05:04.320067655Z [2024-05-26T01:05:04.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=-1, run_start_date=2024-05-26 01:05:02.816405+00:00, run_end_date=2024-05-26 01:05:03.356924+00:00, run_duration=0.540519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:05:00.729006+00:00, queued_by_job_id=1, pid=9341 2024-05-26T01:05:04.320413067Z [2024-05-26T01:05:04.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:04:00+00:00, map_index=-1, run_start_date=2024-05-26 01:05:02.591737+00:00, run_end_date=2024-05-26 01:05:04.066645+00:00, run_duration=1.474908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:05:00.729006+00:00, queued_by_job_id=1, pid=9339 2024-05-26T01:05:05.491860796Z [2024-05-26T01:05:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:05:05.491885920Z [2024-05-26T01:05:05.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:04:00+00:00, run_id=scheduled__2024-05-26T01:04:00+00:00, run_start_date=2024-05-26 01:05:00.626153+00:00, run_end_date=2024-05-26 01:05:05.483683+00:00, run_duration=4.85753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:04:00+00:00, data_interval_end=2024-05-26 01:05:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:05:05.497016277Z [2024-05-26T01:05:05.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:05:00+00:00, run_after=2024-05-26T01:06:00+00:00 2024-05-26T01:05:05.563263550Z [2024-05-26T01:05:05.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status success for try_number 1 2024-05-26T01:05:05.568588223Z [2024-05-26T01:05:05.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:04:00+00:00, map_index=-1, run_start_date=2024-05-26 01:05:02.753613+00:00, run_end_date=2024-05-26 01:05:04.720918+00:00, run_duration=1.967305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:05:00.729006+00:00, queued_by_job_id=1, pid=9340 2024-05-26T01:05:06.953171149Z [2024-05-26T01:05:06.952+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:05:06.953207377Z 2024-05-26T01:05:06.953408435Z [2024-05-26T01:05:06.953+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:05:06.954052987Z [2024-05-26T01:05:06.953+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:05:06.954069012Z 2024-05-26T01:05:06.956747017Z [2024-05-26T01:05:06.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:05:06.956938068Z [2024-05-26T01:05:06.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:05:07.031955322Z [2024-05-26T01:05:07.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:05:07.032019123Z [2024-05-26T01:05:07.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:05:07.035504257Z [2024-05-26T01:05:07.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60a4e19d-b3b6-4400-b8f6-66d40e11796f 2024-05-26T01:05:07.035658072Z [2024-05-26T01:05:07.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=-1, run_start_date=2024-05-26 01:05:06.339326+00:00, run_end_date=2024-05-26 01:05:06.712560+00:00, run_duration=0.373234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:05:04.197322+00:00, queued_by_job_id=1, pid=9364 2024-05-26T01:05:09.302729951Z [2024-05-26T01:05:09.302+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:05:09.302754329Z 2024-05-26T01:05:09.302764179Z [2024-05-26T01:05:09.302+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:05:09.303219001Z [2024-05-26T01:05:09.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:05:09.303241845Z 2024-05-26T01:05:09.305757375Z [2024-05-26T01:05:09.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:05:09.305899614Z [2024-05-26T01:05:09.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:05:09.359653425Z [2024-05-26T01:05:09.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status queued for try_number 1 2024-05-26T01:05:09.359772622Z [2024-05-26T01:05:09.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:05:09.366831182Z [2024-05-26T01:05:09.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ac722d2-1060-45c5-90f5-5fd593a49e2f 2024-05-26T01:05:09.366902751Z [2024-05-26T01:05:09.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=0, run_start_date=2024-05-26 01:05:08.669720+00:00, run_end_date=2024-05-26 01:05:09.045052+00:00, run_duration=0.375332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:05:06.954441+00:00, queued_by_job_id=1, pid=9372 2024-05-26T01:05:11.542304729Z [2024-05-26T01:05:11.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:05:11.542701323Z [2024-05-26T01:05:11.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:00:00+00:00, run_id=scheduled__2024-05-26T01:00:00+00:00, run_start_date=2024-05-26 01:05:00.623071+00:00, run_end_date=2024-05-26 01:05:11.542104+00:00, run_duration=10.919033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:00:00+00:00, data_interval_end=2024-05-26 01:05:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:05:11.550708971Z [2024-05-26T01:05:11.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:05:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:05:11.598563891Z [2024-05-26T01:05:11.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:00:00+00:00 exited with status success for try_number 1 2024-05-26T01:05:11.606874810Z [2024-05-26T01:05:11.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:00:00+00:00, map_index=-1, run_start_date=2024-05-26 01:05:10.835952+00:00, run_end_date=2024-05-26 01:05:11.267964+00:00, run_duration=0.432012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:05:09.303477+00:00, queued_by_job_id=1, pid=9380 2024-05-26T01:06:00.834637116Z [2024-05-26T01:06:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:06:00.856097245Z [2024-05-26T01:06:00.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:06:00+00:00, run_after=2024-05-26T01:07:00+00:00 2024-05-26T01:06:00.872693316Z [2024-05-26T01:06:00.872+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:06:00.894086679Z [2024-05-26T01:06:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:06:00+00:00, run_after=2024-05-26T01:07:00+00:00 2024-05-26T01:06:00.978519401Z [2024-05-26T01:06:00.977+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:06:00.978577540Z 2024-05-26T01:06:00.978595105Z 2024-05-26T01:06:00.978608601Z 2024-05-26T01:06:00.978618279Z 2024-05-26T01:06:00.979112030Z [2024-05-26T01:06:00.978+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:06:00.980068759Z [2024-05-26T01:06:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:06:00.980531863Z [2024-05-26T01:06:00.980+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:06:00.980914878Z [2024-05-26T01:06:00.980+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:06:00.982309737Z [2024-05-26T01:06:00.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:06:00.982333579Z 2024-05-26T01:06:00.982342417Z 2024-05-26T01:06:00.982350188Z 2024-05-26T01:06:00.982357938Z 2024-05-26T01:06:00.989412661Z [2024-05-26T01:06:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:06:00.989715142Z [2024-05-26T01:06:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:06:00.990199437Z [2024-05-26T01:06:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:06:00.990427447Z [2024-05-26T01:06:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:06:00.990803084Z [2024-05-26T01:06:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:06:00.990914994Z [2024-05-26T01:06:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:06:00.991270586Z [2024-05-26T01:06:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:06:00.991405887Z [2024-05-26T01:06:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:06:01.426017589Z [2024-05-26T01:06:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status queued for try_number 1 2024-05-26T01:06:01.426299807Z [2024-05-26T01:06:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status queued for try_number 1 2024-05-26T01:06:01.426542077Z [2024-05-26T01:06:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status queued for try_number 1 2024-05-26T01:06:01.426737992Z [2024-05-26T01:06:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status queued for try_number 1 2024-05-26T01:06:01.443844240Z [2024-05-26T01:06:01.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16bf2eda-1030-45d2-9154-908ad22544dc 2024-05-26T01:06:01.445577914Z [2024-05-26T01:06:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ae05ebe-901d-410d-bce7-60cff2b8f0c2 2024-05-26T01:06:01.445820667Z [2024-05-26T01:06:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to b10af921-9466-41e0-923e-63c6a69744f3 2024-05-26T01:06:01.446013624Z [2024-05-26T01:06:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65d40108-2716-416d-8749-7045a59ed7bc 2024-05-26T01:06:02.851863788Z [2024-05-26T01:06:02.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:06:02.852344762Z [2024-05-26T01:06:02.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:05:00+00:00, run_id=scheduled__2024-05-26T01:05:00+00:00, run_start_date=2024-05-26 01:06:00.905934+00:00, run_end_date=2024-05-26 01:06:02.851772+00:00, run_duration=1.945838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:05:00+00:00, data_interval_end=2024-05-26 01:06:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:06:02.867997936Z [2024-05-26T01:06:02.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:06:00+00:00, run_after=2024-05-26T01:07:00+00:00 2024-05-26T01:06:02.877176493Z [2024-05-26T01:06:02.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:06:02.877475369Z [2024-05-26T01:06:02.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:04:00+00:00, run_id=scheduled__2024-05-26T01:04:00+00:00, run_start_date=2024-05-26 01:06:00.904658+00:00, run_end_date=2024-05-26 01:06:02.877098+00:00, run_duration=1.97244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:04:00+00:00, data_interval_end=2024-05-26 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:06:02.886963720Z [2024-05-26T01:06:02.886+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:06:00+00:00, run_after=2024-05-26T01:08:00+00:00 2024-05-26T01:06:02.951891427Z [2024-05-26T01:06:02.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:04:00+00:00 exited with status success for try_number 1 2024-05-26T01:06:02.952594972Z [2024-05-26T01:06:02.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status success for try_number 1 2024-05-26T01:06:02.963537388Z [2024-05-26T01:06:02.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:05:00+00:00, map_index=-1, run_start_date=2024-05-26 01:06:01.870620+00:00, run_end_date=2024-05-26 01:06:02.299199+00:00, run_duration=0.428579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:06:00.984309+00:00, queued_by_job_id=1, pid=9404 2024-05-26T01:06:02.963759107Z [2024-05-26T01:06:02.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:04:00+00:00, map_index=-1, run_start_date=2024-05-26 01:06:01.898029+00:00, run_end_date=2024-05-26 01:06:02.290179+00:00, run_duration=0.39215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:06:00.984309+00:00, queued_by_job_id=1, pid=9405 2024-05-26T01:06:05.119994223Z [2024-05-26T01:06:05.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:06:05.120661714Z [2024-05-26T01:06:05.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:05:00+00:00, run_id=scheduled__2024-05-26T01:05:00+00:00, run_start_date=2024-05-26 01:06:00.907941+00:00, run_end_date=2024-05-26 01:06:05.120104+00:00, run_duration=4.212163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:05:00+00:00, data_interval_end=2024-05-26 01:06:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:06:05.129640314Z [2024-05-26T01:06:05.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:06:00+00:00, run_after=2024-05-26T01:07:00+00:00 2024-05-26T01:06:05.136007698Z [2024-05-26T01:06:05.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:06:05.136417571Z [2024-05-26T01:06:05.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:05:00+00:00, run_id=scheduled__2024-05-26T01:05:00+00:00, run_start_date=2024-05-26 01:06:00.906901+00:00, run_end_date=2024-05-26 01:06:05.136121+00:00, run_duration=4.22922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:05:00+00:00, data_interval_end=2024-05-26 01:06:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:06:05.146898066Z [2024-05-26T01:06:05.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:06:00+00:00, run_after=2024-05-26T01:07:00+00:00 2024-05-26T01:06:05.176688707Z [2024-05-26T01:06:05.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status success for try_number 1 2024-05-26T01:06:05.176998486Z [2024-05-26T01:06:05.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status success for try_number 1 2024-05-26T01:06:05.191993080Z [2024-05-26T01:06:05.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:05:00+00:00, map_index=-1, run_start_date=2024-05-26 01:06:02.850537+00:00, run_end_date=2024-05-26 01:06:04.198002+00:00, run_duration=1.347465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:06:00.984309+00:00, queued_by_job_id=1, pid=9428 2024-05-26T01:06:05.192573542Z [2024-05-26T01:06:05.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:05:00+00:00, map_index=-1, run_start_date=2024-05-26 01:06:02.921158+00:00, run_end_date=2024-05-26 01:06:04.795118+00:00, run_duration=1.87396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:06:00.984309+00:00, queued_by_job_id=1, pid=9429 2024-05-26T01:07:00.046458684Z [2024-05-26T01:07:00.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:07:00.062831433Z [2024-05-26T01:07:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:07:00+00:00, run_after=2024-05-26T01:08:00+00:00 2024-05-26T01:07:00.073825523Z [2024-05-26T01:07:00.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:07:00+00:00, run_after=2024-05-26T01:08:00+00:00 2024-05-26T01:07:00.145558527Z [2024-05-26T01:07:00.145+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:07:00.145674038Z 2024-05-26T01:07:00.145684653Z 2024-05-26T01:07:00.145693196Z 2024-05-26T01:07:00.145755943Z [2024-05-26T01:07:00.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:07:00.145881467Z [2024-05-26T01:07:00.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:07:00.146205824Z [2024-05-26T01:07:00.145+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:07:00.147174832Z [2024-05-26T01:07:00.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:07:00.147213880Z 2024-05-26T01:07:00.147221188Z 2024-05-26T01:07:00.147226072Z 2024-05-26T01:07:00.151245998Z [2024-05-26T01:07:00.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:07:00.151649932Z [2024-05-26T01:07:00.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:07:00.152136314Z [2024-05-26T01:07:00.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:07:00.152541396Z [2024-05-26T01:07:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:07:00.152997348Z [2024-05-26T01:07:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:07:00.153285964Z [2024-05-26T01:07:00.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:07:00.326929098Z [2024-05-26T01:07:00.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status queued for try_number 1 2024-05-26T01:07:00.327069191Z [2024-05-26T01:07:00.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status queued for try_number 1 2024-05-26T01:07:00.327251831Z [2024-05-26T01:07:00.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status queued for try_number 1 2024-05-26T01:07:00.334145492Z [2024-05-26T01:07:00.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 746732bd-8e07-4af2-b72d-b78d797c5496 2024-05-26T01:07:00.334272889Z [2024-05-26T01:07:00.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6ac536f-831f-4bb6-a98c-e7c9defea0be 2024-05-26T01:07:00.334387129Z [2024-05-26T01:07:00.334+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a9be30e-8e1a-45ff-b27c-b1d3540bbaa8 2024-05-26T01:07:01.463473044Z [2024-05-26T01:07:01.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:07:01.464287888Z [2024-05-26T01:07:01.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:06:00+00:00, run_id=scheduled__2024-05-26T01:06:00+00:00, run_start_date=2024-05-26 01:07:00.083235+00:00, run_end_date=2024-05-26 01:07:01.463654+00:00, run_duration=1.380419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:06:00+00:00, data_interval_end=2024-05-26 01:07:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:07:01.480436225Z [2024-05-26T01:07:01.480+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:07:00+00:00, run_after=2024-05-26T01:08:00+00:00 2024-05-26T01:07:02.517222367Z [2024-05-26T01:07:02.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status success for try_number 1 2024-05-26T01:07:02.526832456Z [2024-05-26T01:07:02.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:06:00+00:00, map_index=-1, run_start_date=2024-05-26 01:07:00.943765+00:00, run_end_date=2024-05-26 01:07:01.370816+00:00, run_duration=0.427051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:07:00.148256+00:00, queued_by_job_id=1, pid=9461 2024-05-26T01:07:03.591445959Z [2024-05-26T01:07:03.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:07:03.591488942Z [2024-05-26T01:07:03.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:06:00+00:00, run_id=scheduled__2024-05-26T01:06:00+00:00, run_start_date=2024-05-26 01:07:00.084533+00:00, run_end_date=2024-05-26 01:07:03.590240+00:00, run_duration=3.505707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:06:00+00:00, data_interval_end=2024-05-26 01:07:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:07:03.602888675Z [2024-05-26T01:07:03.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:07:00+00:00, run_after=2024-05-26T01:08:00+00:00 2024-05-26T01:07:03.664658419Z [2024-05-26T01:07:03.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status success for try_number 1 2024-05-26T01:07:03.675438100Z [2024-05-26T01:07:03.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:06:00+00:00, map_index=-1, run_start_date=2024-05-26 01:07:01.901563+00:00, run_end_date=2024-05-26 01:07:03.205681+00:00, run_duration=1.304118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:07:00.148256+00:00, queued_by_job_id=1, pid=9479 2024-05-26T01:07:03.838055213Z [2024-05-26T01:07:03.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:07:03.838455345Z [2024-05-26T01:07:03.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:06:00+00:00, run_id=scheduled__2024-05-26T01:06:00+00:00, run_start_date=2024-05-26 01:07:00.085577+00:00, run_end_date=2024-05-26 01:07:03.838030+00:00, run_duration=3.752453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:06:00+00:00, data_interval_end=2024-05-26 01:07:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:07:03.851191148Z [2024-05-26T01:07:03.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:07:00+00:00, run_after=2024-05-26T01:08:00+00:00 2024-05-26T01:07:03.886548332Z [2024-05-26T01:07:03.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status success for try_number 1 2024-05-26T01:07:03.907211617Z [2024-05-26T01:07:03.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:06:00+00:00, map_index=-1, run_start_date=2024-05-26 01:07:01.912628+00:00, run_end_date=2024-05-26 01:07:03.636906+00:00, run_duration=1.724278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:07:00.148256+00:00, queued_by_job_id=1, pid=9480 2024-05-26T01:08:00.523441351Z [2024-05-26T01:08:00.522+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:08:00.535905149Z [2024-05-26T01:08:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:08:00+00:00, run_after=2024-05-26T01:09:00+00:00 2024-05-26T01:08:00.549524173Z [2024-05-26T01:08:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:08:00+00:00, run_after=2024-05-26T01:09:00+00:00 2024-05-26T01:08:00.560913485Z [2024-05-26T01:08:00.560+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:08:00.666714411Z [2024-05-26T01:08:00.666+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:08:00.666749392Z 2024-05-26T01:08:00.666755217Z 2024-05-26T01:08:00.666759158Z 2024-05-26T01:08:00.666763602Z 2024-05-26T01:08:00.666784458Z [2024-05-26T01:08:00.666+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:08:00.667029811Z [2024-05-26T01:08:00.666+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:08:00.667128798Z [2024-05-26T01:08:00.666+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:08:00.667346693Z [2024-05-26T01:08:00.667+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:08:00.668169900Z [2024-05-26T01:08:00.667+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:08:00.668183770Z 2024-05-26T01:08:00.668189664Z 2024-05-26T01:08:00.668194946Z 2024-05-26T01:08:00.668200120Z 2024-05-26T01:08:00.672114155Z [2024-05-26T01:08:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:08:00.672247246Z [2024-05-26T01:08:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:08:00.672495435Z [2024-05-26T01:08:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:08:00.672560178Z [2024-05-26T01:08:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:08:00.672798856Z [2024-05-26T01:08:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:08:00.672893588Z [2024-05-26T01:08:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:08:00.673179249Z [2024-05-26T01:08:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:08:00.673331593Z [2024-05-26T01:08:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:08:00.955839879Z [2024-05-26T01:08:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status queued for try_number 1 2024-05-26T01:08:00.955930615Z [2024-05-26T01:08:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:07:00+00:00 exited with status queued for try_number 1 2024-05-26T01:08:00.956084697Z [2024-05-26T01:08:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:07:00+00:00 exited with status queued for try_number 1 2024-05-26T01:08:00.956231490Z [2024-05-26T01:08:00.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:07:00+00:00 exited with status queued for try_number 1 2024-05-26T01:08:00.966714842Z [2024-05-26T01:08:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to b63706de-bcef-4c39-a32f-4ae1cb17e4ec 2024-05-26T01:08:00.966927696Z [2024-05-26T01:08:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 488b13fb-8100-4f73-941b-1b43766fc516 2024-05-26T01:08:00.967127375Z [2024-05-26T01:08:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c4b30bd-5e4d-4e73-89a8-c479cb126f13 2024-05-26T01:08:00.967340691Z [2024-05-26T01:08:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4194257c-db21-4721-b397-9c41dca4229f 2024-05-26T01:08:02.173589283Z [2024-05-26T01:08:02.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:08:02.173878749Z [2024-05-26T01:08:02.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:06:00+00:00, run_id=scheduled__2024-05-26T01:06:00+00:00, run_start_date=2024-05-26 01:08:00.575976+00:00, run_end_date=2024-05-26 01:08:02.173492+00:00, run_duration=1.597516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:06:00+00:00, data_interval_end=2024-05-26 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:08:02.181980883Z [2024-05-26T01:08:02.181+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:08:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:08:02.189832606Z [2024-05-26T01:08:02.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:08:02.193419452Z [2024-05-26T01:08:02.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:07:00+00:00, run_id=scheduled__2024-05-26T01:07:00+00:00, run_start_date=2024-05-26 01:08:00.577681+00:00, run_end_date=2024-05-26 01:08:02.189905+00:00, run_duration=1.612224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:07:00+00:00, data_interval_end=2024-05-26 01:08:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:08:02.216554053Z [2024-05-26T01:08:02.216+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:08:00+00:00, run_after=2024-05-26T01:09:00+00:00 2024-05-26T01:08:02.303999767Z [2024-05-26T01:08:02.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:06:00+00:00 exited with status success for try_number 1 2024-05-26T01:08:02.304122635Z [2024-05-26T01:08:02.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:07:00+00:00 exited with status success for try_number 1 2024-05-26T01:08:02.327255864Z [2024-05-26T01:08:02.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:06:00+00:00, map_index=-1, run_start_date=2024-05-26 01:08:01.605369+00:00, run_end_date=2024-05-26 01:08:01.966162+00:00, run_duration=0.360793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:08:00.669185+00:00, queued_by_job_id=1, pid=9514 2024-05-26T01:08:02.327713629Z [2024-05-26T01:08:02.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:07:00+00:00, map_index=-1, run_start_date=2024-05-26 01:08:01.585820+00:00, run_end_date=2024-05-26 01:08:01.983684+00:00, run_duration=0.397864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:08:00.669185+00:00, queued_by_job_id=1, pid=9513 2024-05-26T01:08:04.116741751Z [2024-05-26T01:08:04.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:08:04.117061710Z [2024-05-26T01:08:04.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:07:00+00:00, run_id=scheduled__2024-05-26T01:07:00+00:00, run_start_date=2024-05-26 01:08:00.579265+00:00, run_end_date=2024-05-26 01:08:04.116651+00:00, run_duration=3.537386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:07:00+00:00, data_interval_end=2024-05-26 01:08:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:08:04.126815568Z [2024-05-26T01:08:04.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:08:00+00:00, run_after=2024-05-26T01:09:00+00:00 2024-05-26T01:08:04.181626562Z [2024-05-26T01:08:04.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:07:00+00:00 exited with status success for try_number 1 2024-05-26T01:08:04.192201134Z [2024-05-26T01:08:04.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:07:00+00:00, map_index=-1, run_start_date=2024-05-26 01:08:02.590576+00:00, run_end_date=2024-05-26 01:08:03.866447+00:00, run_duration=1.275871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:08:00.669185+00:00, queued_by_job_id=1, pid=9537 2024-05-26T01:08:04.958150315Z [2024-05-26T01:08:04.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:08:04.958336545Z [2024-05-26T01:08:04.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:07:00+00:00, run_id=scheduled__2024-05-26T01:07:00+00:00, run_start_date=2024-05-26 01:08:00.580882+00:00, run_end_date=2024-05-26 01:08:04.958029+00:00, run_duration=4.377147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:07:00+00:00, data_interval_end=2024-05-26 01:08:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:08:04.970131261Z [2024-05-26T01:08:04.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:08:00+00:00, run_after=2024-05-26T01:09:00+00:00 2024-05-26T01:08:05.013141390Z [2024-05-26T01:08:05.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:07:00+00:00 exited with status success for try_number 1 2024-05-26T01:08:05.018700668Z [2024-05-26T01:08:05.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:07:00+00:00, map_index=-1, run_start_date=2024-05-26 01:08:02.595625+00:00, run_end_date=2024-05-26 01:08:04.733559+00:00, run_duration=2.137934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:08:00.669185+00:00, queued_by_job_id=1, pid=9538 2024-05-26T01:08:32.122281091Z [2024-05-26T01:08:32.121+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:09:00.773113227Z [2024-05-26T01:09:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:09:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:09:00.781198192Z [2024-05-26T01:09:00.780+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:09:00.799162450Z [2024-05-26T01:09:00.798+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:09:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:09:00.863691045Z [2024-05-26T01:09:00.863+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:09:00.863723648Z 2024-05-26T01:09:00.863727381Z 2024-05-26T01:09:00.863730625Z 2024-05-26T01:09:00.863841404Z [2024-05-26T01:09:00.863+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:09:00.863846040Z [2024-05-26T01:09:00.863+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:09:00.863962415Z [2024-05-26T01:09:00.863+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:09:00.864568992Z [2024-05-26T01:09:00.864+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:09:00.864583520Z 2024-05-26T01:09:00.864591852Z 2024-05-26T01:09:00.864596073Z 2024-05-26T01:09:00.867769857Z [2024-05-26T01:09:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:09:00.867900001Z [2024-05-26T01:09:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:09:00.868080135Z [2024-05-26T01:09:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:09:00.868199649Z [2024-05-26T01:09:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:09:00.868399925Z [2024-05-26T01:09:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:09:00.868463983Z [2024-05-26T01:09:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:09:01.178864167Z [2024-05-26T01:09:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status queued for try_number 1 2024-05-26T01:09:01.178893817Z [2024-05-26T01:09:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status queued for try_number 1 2024-05-26T01:09:01.178960430Z [2024-05-26T01:09:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status queued for try_number 1 2024-05-26T01:09:01.188280551Z [2024-05-26T01:09:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dd00d5d-ad6e-4f69-8016-58436051185c 2024-05-26T01:09:01.188351860Z [2024-05-26T01:09:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d18de8c-56db-48ee-aeec-403c23f8089e 2024-05-26T01:09:01.188469345Z [2024-05-26T01:09:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59ed27a8-3434-4421-9f2a-59d0e06c59f5 2024-05-26T01:09:02.383189533Z [2024-05-26T01:09:02.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:09:02.383438800Z [2024-05-26T01:09:02.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:08:00+00:00, run_id=scheduled__2024-05-26T01:08:00+00:00, run_start_date=2024-05-26 01:09:00.809873+00:00, run_end_date=2024-05-26 01:09:02.383073+00:00, run_duration=1.5732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:08:00+00:00, data_interval_end=2024-05-26 01:09:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:09:02.393073354Z [2024-05-26T01:09:02.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:09:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:09:02.446010232Z [2024-05-26T01:09:02.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status success for try_number 1 2024-05-26T01:09:02.459956862Z [2024-05-26T01:09:02.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:08:00+00:00, map_index=-1, run_start_date=2024-05-26 01:09:01.746333+00:00, run_end_date=2024-05-26 01:09:02.093479+00:00, run_duration=0.347146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:09:00.865223+00:00, queued_by_job_id=1, pid=9571 2024-05-26T01:09:04.613416004Z [2024-05-26T01:09:04.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:09:04.613644169Z [2024-05-26T01:09:04.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:08:00+00:00, run_id=scheduled__2024-05-26T01:08:00+00:00, run_start_date=2024-05-26 01:09:00.811122+00:00, run_end_date=2024-05-26 01:09:04.613250+00:00, run_duration=3.802128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:08:00+00:00, data_interval_end=2024-05-26 01:09:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:09:04.624777445Z [2024-05-26T01:09:04.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:09:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:09:04.633444362Z [2024-05-26T01:09:04.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:09:04.633760736Z [2024-05-26T01:09:04.633+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:08:00+00:00, run_id=scheduled__2024-05-26T01:08:00+00:00, run_start_date=2024-05-26 01:09:00.814140+00:00, run_end_date=2024-05-26 01:09:04.633434+00:00, run_duration=3.819294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:08:00+00:00, data_interval_end=2024-05-26 01:09:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:09:04.646012125Z [2024-05-26T01:09:04.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:09:00+00:00, run_after=2024-05-26T01:10:00+00:00 2024-05-26T01:09:04.698857446Z [2024-05-26T01:09:04.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status success for try_number 1 2024-05-26T01:09:04.698947683Z [2024-05-26T01:09:04.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status success for try_number 1 2024-05-26T01:09:04.706343426Z [2024-05-26T01:09:04.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:08:00+00:00, map_index=-1, run_start_date=2024-05-26 01:09:02.888171+00:00, run_end_date=2024-05-26 01:09:04.140121+00:00, run_duration=1.25195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:09:00.865223+00:00, queued_by_job_id=1, pid=9590 2024-05-26T01:09:04.706543568Z [2024-05-26T01:09:04.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:08:00+00:00, map_index=-1, run_start_date=2024-05-26 01:09:02.716841+00:00, run_end_date=2024-05-26 01:09:04.391653+00:00, run_duration=1.674812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:09:00.865223+00:00, queued_by_job_id=1, pid=9589 2024-05-26T01:10:00.272605269Z [2024-05-26T01:10:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:15:00+00:00 2024-05-26T01:10:00.289725816Z [2024-05-26T01:10:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:11:00+00:00 2024-05-26T01:10:00.298692795Z [2024-05-26T01:10:00.298+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:10:00.306303832Z [2024-05-26T01:10:00.306+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:10:00.319184808Z [2024-05-26T01:10:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:11:00+00:00 2024-05-26T01:10:00.452249618Z [2024-05-26T01:10:00.451+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T01:10:00.452335520Z 2024-05-26T01:10:00.452391521Z 2024-05-26T01:10:00.452403136Z 2024-05-26T01:10:00.452411644Z 2024-05-26T01:10:00.452420065Z 2024-05-26T01:10:00.452428351Z [2024-05-26T01:10:00.451+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:10:00.452437718Z [2024-05-26T01:10:00.451+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:10:00.452477024Z [2024-05-26T01:10:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:10:00.452486553Z [2024-05-26T01:10:00.452+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:10:00.452503593Z [2024-05-26T01:10:00.452+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:10:00.453305568Z [2024-05-26T01:10:00.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:10:00.453340621Z 2024-05-26T01:10:00.453348608Z 2024-05-26T01:10:00.453356302Z 2024-05-26T01:10:00.453362878Z 2024-05-26T01:10:00.453369366Z 2024-05-26T01:10:00.460005756Z [2024-05-26T01:10:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:10:00.460136646Z [2024-05-26T01:10:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:10:00.460470892Z [2024-05-26T01:10:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:10:00.460654275Z [2024-05-26T01:10:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:10:00.461086065Z [2024-05-26T01:10:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:10:00.461273193Z [2024-05-26T01:10:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:10:00.461576451Z [2024-05-26T01:10:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:10:00.461708105Z [2024-05-26T01:10:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:10:00.462089914Z [2024-05-26T01:10:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:10:00.462312516Z [2024-05-26T01:10:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:10:01.122416834Z [2024-05-26T01:10:01.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:01.122486142Z [2024-05-26T01:10:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:01.122491118Z [2024-05-26T01:10:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:09:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:01.122559379Z [2024-05-26T01:10:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:09:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:01.122629952Z [2024-05-26T01:10:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:09:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:01.150505148Z [2024-05-26T01:10:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 868f7d16-b228-4473-9adc-fa8c38a79492 2024-05-26T01:10:01.150728258Z [2024-05-26T01:10:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bf5db21-c176-4511-b177-28eb4baf222e 2024-05-26T01:10:01.150842138Z [2024-05-26T01:10:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d00de4c-f6d1-46be-95cc-4167f010a738 2024-05-26T01:10:01.150962194Z [2024-05-26T01:10:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39cf6e76-c31c-42a7-a95c-88421c858f0d 2024-05-26T01:10:01.151059491Z [2024-05-26T01:10:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7831adb9-6bae-43c3-bd94-c0f90c5ef72c 2024-05-26T01:10:02.168040556Z [2024-05-26T01:10:02.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:10:02.168175247Z [2024-05-26T01:10:02.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:08:00+00:00, run_id=scheduled__2024-05-26T01:08:00+00:00, run_start_date=2024-05-26 01:10:00.334778+00:00, run_end_date=2024-05-26 01:10:02.167890+00:00, run_duration=1.833112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:08:00+00:00, data_interval_end=2024-05-26 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:10:02.175708912Z [2024-05-26T01:10:02.175+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:12:00+00:00 2024-05-26T01:10:02.249000028Z [2024-05-26T01:10:02.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:08:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:02.253845390Z [2024-05-26T01:10:02.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:08:00+00:00, map_index=-1, run_start_date=2024-05-26 01:10:01.320025+00:00, run_end_date=2024-05-26 01:10:01.687732+00:00, run_duration=0.367707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:00.454934+00:00, queued_by_job_id=1, pid=9619 2024-05-26T01:10:03.305690043Z [2024-05-26T01:10:03.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:10:03.306043917Z [2024-05-26T01:10:03.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:09:00+00:00, run_id=scheduled__2024-05-26T01:09:00+00:00, run_start_date=2024-05-26 01:10:00.336105+00:00, run_end_date=2024-05-26 01:10:03.305575+00:00, run_duration=2.96947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:09:00+00:00, data_interval_end=2024-05-26 01:10:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:10:03.314592832Z [2024-05-26T01:10:03.314+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:11:00+00:00 2024-05-26T01:10:03.370465823Z [2024-05-26T01:10:03.370+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:10:03.370491286Z 2024-05-26T01:10:03.370504840Z [2024-05-26T01:10:03.370+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:10:03.371163593Z [2024-05-26T01:10:03.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:10:03.371169408Z 2024-05-26T01:10:03.373455192Z [2024-05-26T01:10:03.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:10:03.373569347Z [2024-05-26T01:10:03.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:10:03.441757221Z [2024-05-26T01:10:03.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:03.441778649Z [2024-05-26T01:10:03.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:03.441794305Z [2024-05-26T01:10:03.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:09:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:03.455341894Z [2024-05-26T01:10:03.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1330d6e8-7030-4300-8b82-f0024b132292 2024-05-26T01:10:03.455828359Z [2024-05-26T01:10:03.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:05:00+00:00, map_index=-1, run_start_date=2024-05-26 01:10:02.546937+00:00, run_end_date=2024-05-26 01:10:02.919060+00:00, run_duration=0.372123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:00.454934+00:00, queued_by_job_id=1, pid=9649 2024-05-26T01:10:03.456218626Z [2024-05-26T01:10:03.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:09:00+00:00, map_index=-1, run_start_date=2024-05-26 01:10:01.863243+00:00, run_end_date=2024-05-26 01:10:02.270754+00:00, run_duration=0.407511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:00.454934+00:00, queued_by_job_id=1, pid=9632 2024-05-26T01:10:04.013338126Z [2024-05-26T01:10:04.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:10:04.013810390Z [2024-05-26T01:10:04.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:09:00+00:00, run_id=scheduled__2024-05-26T01:09:00+00:00, run_start_date=2024-05-26 01:10:00.337335+00:00, run_end_date=2024-05-26 01:10:04.013501+00:00, run_duration=3.676166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:09:00+00:00, data_interval_end=2024-05-26 01:10:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:10:04.023204475Z [2024-05-26T01:10:04.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:11:00+00:00 2024-05-26T01:10:04.088386473Z [2024-05-26T01:10:04.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:09:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:04.097308375Z [2024-05-26T01:10:04.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:09:00+00:00, map_index=-1, run_start_date=2024-05-26 01:10:02.552411+00:00, run_end_date=2024-05-26 01:10:03.836030+00:00, run_duration=1.283619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:00.454934+00:00, queued_by_job_id=1, pid=9650 2024-05-26T01:10:05.210713562Z [2024-05-26T01:10:05.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:10:05.211137092Z [2024-05-26T01:10:05.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:09:00+00:00, run_id=scheduled__2024-05-26T01:09:00+00:00, run_start_date=2024-05-26 01:10:00.338688+00:00, run_end_date=2024-05-26 01:10:05.210643+00:00, run_duration=4.871955, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:09:00+00:00, data_interval_end=2024-05-26 01:10:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:10:05.221284390Z [2024-05-26T01:10:05.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:11:00+00:00 2024-05-26T01:10:05.315507723Z [2024-05-26T01:10:05.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:09:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:05.322586744Z [2024-05-26T01:10:05.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:09:00+00:00, map_index=-1, run_start_date=2024-05-26 01:10:03.020143+00:00, run_end_date=2024-05-26 01:10:05.022828+00:00, run_duration=2.002685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:00.454934+00:00, queued_by_job_id=1, pid=9666 2024-05-26T01:10:06.389401134Z [2024-05-26T01:10:06.389+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:10:06.389428906Z 2024-05-26T01:10:06.389548820Z [2024-05-26T01:10:06.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:10:06.390220284Z [2024-05-26T01:10:06.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:10:06.390284845Z 2024-05-26T01:10:06.392333295Z [2024-05-26T01:10:06.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:10:06.392490733Z [2024-05-26T01:10:06.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:10:06.468587524Z [2024-05-26T01:10:06.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:06.469051461Z [2024-05-26T01:10:06.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:06.479231581Z [2024-05-26T01:10:06.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18079d3e-784b-4e28-b8e6-82503d59a274 2024-05-26T01:10:06.479825124Z [2024-05-26T01:10:06.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:05:00+00:00, map_index=-1, run_start_date=2024-05-26 01:10:05.183404+00:00, run_end_date=2024-05-26 01:10:05.562208+00:00, run_duration=0.378804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:03.371469+00:00, queued_by_job_id=1, pid=9679 2024-05-26T01:10:08.455951694Z [2024-05-26T01:10:08.455+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:10:08.455988913Z 2024-05-26T01:10:08.455999542Z [2024-05-26T01:10:08.455+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:10:08.456488017Z [2024-05-26T01:10:08.456+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:10:08.456496547Z 2024-05-26T01:10:08.458755122Z [2024-05-26T01:10:08.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:10:08.458808846Z [2024-05-26T01:10:08.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:10:08.521227189Z [2024-05-26T01:10:08.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status queued for try_number 1 2024-05-26T01:10:08.527927238Z [2024-05-26T01:10:08.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 381c2737-e288-4193-943e-e16c0854ee85 2024-05-26T01:10:08.610396307Z [2024-05-26T01:10:08.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:08.617892984Z [2024-05-26T01:10:08.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:05:00+00:00, map_index=0, run_start_date=2024-05-26 01:10:07.952851+00:00, run_end_date=2024-05-26 01:10:08.327208+00:00, run_duration=0.374357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:06.390500+00:00, queued_by_job_id=1, pid=9687 2024-05-26T01:10:10.794530126Z [2024-05-26T01:10:10.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:10:10.794937610Z [2024-05-26T01:10:10.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:05:00+00:00, run_id=scheduled__2024-05-26T01:05:00+00:00, run_start_date=2024-05-26 01:10:00.333268+00:00, run_end_date=2024-05-26 01:10:10.794414+00:00, run_duration=10.461146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:05:00+00:00, data_interval_end=2024-05-26 01:10:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:10:10.800956890Z [2024-05-26T01:10:10.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:10:00+00:00, run_after=2024-05-26T01:15:00+00:00 2024-05-26T01:10:10.852090682Z [2024-05-26T01:10:10.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:05:00+00:00 exited with status success for try_number 1 2024-05-26T01:10:10.869225566Z [2024-05-26T01:10:10.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:05:00+00:00, map_index=-1, run_start_date=2024-05-26 01:10:10.026635+00:00, run_end_date=2024-05-26 01:10:10.383458+00:00, run_duration=0.356823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:10:08.456794+00:00, queued_by_job_id=1, pid=9695 2024-05-26T01:11:00.236757391Z [2024-05-26T01:11:00.236+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:11:00+00:00, run_after=2024-05-26T01:12:00+00:00 2024-05-26T01:11:00.245266228Z [2024-05-26T01:11:00.244+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:11:00.269804479Z [2024-05-26T01:11:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:11:00+00:00, run_after=2024-05-26T01:12:00+00:00 2024-05-26T01:11:00.343325104Z [2024-05-26T01:11:00.342+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:11:00.343362839Z 2024-05-26T01:11:00.343404229Z 2024-05-26T01:11:00.343417145Z 2024-05-26T01:11:00.343424804Z [2024-05-26T01:11:00.343+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:11:00.343444001Z [2024-05-26T01:11:00.343+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:11:00.343453987Z [2024-05-26T01:11:00.343+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:11:00.344170067Z [2024-05-26T01:11:00.343+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:11:00.344188626Z 2024-05-26T01:11:00.344219423Z 2024-05-26T01:11:00.344227020Z 2024-05-26T01:11:00.347925927Z [2024-05-26T01:11:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:11:00.348078705Z [2024-05-26T01:11:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:11:00.348320550Z [2024-05-26T01:11:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:11:00.348344552Z [2024-05-26T01:11:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:11:00.348664720Z [2024-05-26T01:11:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:11:00.348686890Z [2024-05-26T01:11:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:11:00.555769272Z [2024-05-26T01:11:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:11:00.555797088Z [2024-05-26T01:11:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:11:00.555947249Z [2024-05-26T01:11:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:11:00.562141760Z [2024-05-26T01:11:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0076f3c1-1494-466b-9395-0cb94bab989b 2024-05-26T01:11:00.562187839Z [2024-05-26T01:11:00.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79586f51-0846-41b0-ac19-ff7cbc1088e0 2024-05-26T01:11:00.562306711Z [2024-05-26T01:11:00.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cbc1104-8ed8-48dd-8d23-bee58e1b7e0e 2024-05-26T01:11:01.709222298Z [2024-05-26T01:11:01.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:11:01.709617777Z [2024-05-26T01:11:01.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:10:00+00:00, run_id=scheduled__2024-05-26T01:10:00+00:00, run_start_date=2024-05-26 01:11:00.285913+00:00, run_end_date=2024-05-26 01:11:01.709121+00:00, run_duration=1.423208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:10:00+00:00, data_interval_end=2024-05-26 01:11:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:11:01.726501626Z [2024-05-26T01:11:01.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:11:00+00:00, run_after=2024-05-26T01:12:00+00:00 2024-05-26T01:11:01.778676250Z [2024-05-26T01:11:01.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:11:01.788655134Z [2024-05-26T01:11:01.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=-1, run_start_date=2024-05-26 01:11:01.189823+00:00, run_end_date=2024-05-26 01:11:01.567336+00:00, run_duration=0.377513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:11:00.344771+00:00, queued_by_job_id=1, pid=9717 2024-05-26T01:11:04.285571669Z [2024-05-26T01:11:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:11:04.285709378Z [2024-05-26T01:11:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:10:00+00:00, run_id=scheduled__2024-05-26T01:10:00+00:00, run_start_date=2024-05-26 01:11:00.287947+00:00, run_end_date=2024-05-26 01:11:04.285445+00:00, run_duration=3.997498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:10:00+00:00, data_interval_end=2024-05-26 01:11:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:11:04.310771165Z [2024-05-26T01:11:04.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:11:00+00:00, run_after=2024-05-26T01:12:00+00:00 2024-05-26T01:11:04.321968944Z [2024-05-26T01:11:04.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:11:04.322199607Z [2024-05-26T01:11:04.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:10:00+00:00, run_id=scheduled__2024-05-26T01:10:00+00:00, run_start_date=2024-05-26 01:11:00.290214+00:00, run_end_date=2024-05-26 01:11:04.321882+00:00, run_duration=4.031668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:10:00+00:00, data_interval_end=2024-05-26 01:11:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:11:04.332539786Z [2024-05-26T01:11:04.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:11:00+00:00, run_after=2024-05-26T01:12:00+00:00 2024-05-26T01:11:04.379677710Z [2024-05-26T01:11:04.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:11:04.381603494Z [2024-05-26T01:11:04.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:11:04.404937764Z [2024-05-26T01:11:04.404+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=-1, run_start_date=2024-05-26 01:11:02.089695+00:00, run_end_date=2024-05-26 01:11:03.348479+00:00, run_duration=1.258784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:11:00.344771+00:00, queued_by_job_id=1, pid=9735 2024-05-26T01:11:04.405544001Z [2024-05-26T01:11:04.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=-1, run_start_date=2024-05-26 01:11:02.097789+00:00, run_end_date=2024-05-26 01:11:03.649117+00:00, run_duration=1.551328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:11:00.344771+00:00, queued_by_job_id=1, pid=9736 2024-05-26T01:12:00.114992240Z [2024-05-26T01:12:00.114+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:12:00.124901235Z [2024-05-26T01:12:00.124+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:12:00.143199532Z [2024-05-26T01:12:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:12:00+00:00, run_after=2024-05-26T01:13:00+00:00 2024-05-26T01:12:00.159858142Z [2024-05-26T01:12:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:12:00+00:00, run_after=2024-05-26T01:13:00+00:00 2024-05-26T01:12:00.283513715Z [2024-05-26T01:12:00.281+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:12:00.283555157Z 2024-05-26T01:12:00.283559200Z 2024-05-26T01:12:00.283563303Z 2024-05-26T01:12:00.283566329Z 2024-05-26T01:12:00.283581322Z [2024-05-26T01:12:00.281+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:12:00.283584524Z [2024-05-26T01:12:00.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:12:00.283587829Z [2024-05-26T01:12:00.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:12:00.283590763Z [2024-05-26T01:12:00.281+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:12:00.283593662Z [2024-05-26T01:12:00.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:12:00.283596695Z 2024-05-26T01:12:00.283599618Z 2024-05-26T01:12:00.283602431Z 2024-05-26T01:12:00.283605283Z 2024-05-26T01:12:00.288659273Z [2024-05-26T01:12:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:12:00.288676190Z [2024-05-26T01:12:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:12:00.290167724Z [2024-05-26T01:12:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:12:00.290370977Z [2024-05-26T01:12:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:12:00.290744203Z [2024-05-26T01:12:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:12:00.290969913Z [2024-05-26T01:12:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:12:00.291469987Z [2024-05-26T01:12:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:12:00.291682591Z [2024-05-26T01:12:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:12:00.847136581Z [2024-05-26T01:12:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:12:00.847166081Z [2024-05-26T01:12:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:11:00+00:00 exited with status queued for try_number 1 2024-05-26T01:12:00.847244486Z [2024-05-26T01:12:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:11:00+00:00 exited with status queued for try_number 1 2024-05-26T01:12:00.847283867Z [2024-05-26T01:12:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:11:00+00:00 exited with status queued for try_number 1 2024-05-26T01:12:00.877197722Z [2024-05-26T01:12:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40979926-31a1-4b6c-9e8e-3e8fef88c275 2024-05-26T01:12:00.877249200Z [2024-05-26T01:12:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21232bda-fe85-447c-a2f4-2f74be5593eb 2024-05-26T01:12:00.877405107Z [2024-05-26T01:12:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to a96ba326-8bf3-4ba4-bb38-a26603185b41 2024-05-26T01:12:00.877538647Z [2024-05-26T01:12:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f2b5b11-0efb-4723-b751-1672e2fce246 2024-05-26T01:12:02.049191448Z [2024-05-26T01:12:02.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:12:02.049538767Z [2024-05-26T01:12:02.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:10:00+00:00, run_id=scheduled__2024-05-26T01:10:00+00:00, run_start_date=2024-05-26 01:12:00.174239+00:00, run_end_date=2024-05-26 01:12:02.049207+00:00, run_duration=1.874968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:10:00+00:00, data_interval_end=2024-05-26 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:12:02.056477077Z [2024-05-26T01:12:02.056+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:12:00+00:00, run_after=2024-05-26T01:14:00+00:00 2024-05-26T01:12:02.062646337Z [2024-05-26T01:12:02.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:12:02.062967173Z [2024-05-26T01:12:02.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:11:00+00:00, run_id=scheduled__2024-05-26T01:11:00+00:00, run_start_date=2024-05-26 01:12:00.175581+00:00, run_end_date=2024-05-26 01:12:02.062650+00:00, run_duration=1.887069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:11:00+00:00, data_interval_end=2024-05-26 01:12:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:12:02.076193930Z [2024-05-26T01:12:02.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:12:00+00:00, run_after=2024-05-26T01:13:00+00:00 2024-05-26T01:12:02.119250322Z [2024-05-26T01:12:02.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:12:02.119391729Z [2024-05-26T01:12:02.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:11:00+00:00 exited with status success for try_number 1 2024-05-26T01:12:02.125865337Z [2024-05-26T01:12:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=-1, run_start_date=2024-05-26 01:12:01.384599+00:00, run_end_date=2024-05-26 01:12:01.755606+00:00, run_duration=0.371007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:12:00.283302+00:00, queued_by_job_id=1, pid=9768 2024-05-26T01:12:02.126131794Z [2024-05-26T01:12:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:11:00+00:00, map_index=-1, run_start_date=2024-05-26 01:12:01.500093+00:00, run_end_date=2024-05-26 01:12:01.899352+00:00, run_duration=0.399259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:12:00.283302+00:00, queued_by_job_id=1, pid=9769 2024-05-26T01:12:04.147110499Z [2024-05-26T01:12:04.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:12:04.147401957Z [2024-05-26T01:12:04.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:11:00+00:00, run_id=scheduled__2024-05-26T01:11:00+00:00, run_start_date=2024-05-26 01:12:00.176775+00:00, run_end_date=2024-05-26 01:12:04.147013+00:00, run_duration=3.970238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:11:00+00:00, data_interval_end=2024-05-26 01:12:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:12:04.160533870Z [2024-05-26T01:12:04.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:12:00+00:00, run_after=2024-05-26T01:13:00+00:00 2024-05-26T01:12:04.220376500Z [2024-05-26T01:12:04.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:11:00+00:00 exited with status success for try_number 1 2024-05-26T01:12:04.226467797Z [2024-05-26T01:12:04.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:11:00+00:00, map_index=-1, run_start_date=2024-05-26 01:12:02.533083+00:00, run_end_date=2024-05-26 01:12:03.776952+00:00, run_duration=1.243869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:12:00.283302+00:00, queued_by_job_id=1, pid=9792 2024-05-26T01:12:05.934738313Z [2024-05-26T01:12:05.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:12:05.935714602Z [2024-05-26T01:12:05.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:11:00+00:00, run_id=scheduled__2024-05-26T01:11:00+00:00, run_start_date=2024-05-26 01:12:00.177875+00:00, run_end_date=2024-05-26 01:12:05.935007+00:00, run_duration=5.757132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:11:00+00:00, data_interval_end=2024-05-26 01:12:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:12:05.948571401Z [2024-05-26T01:12:05.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:12:00+00:00, run_after=2024-05-26T01:13:00+00:00 2024-05-26T01:12:05.984687277Z [2024-05-26T01:12:05.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:11:00+00:00 exited with status success for try_number 1 2024-05-26T01:12:05.989549151Z [2024-05-26T01:12:05.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:11:00+00:00, map_index=-1, run_start_date=2024-05-26 01:12:02.575945+00:00, run_end_date=2024-05-26 01:12:05.426561+00:00, run_duration=2.850616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:12:00.283302+00:00, queued_by_job_id=1, pid=9793 2024-05-26T01:13:00.063499156Z [2024-05-26T01:13:00.062+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:13:00.078544724Z [2024-05-26T01:13:00.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:13:00+00:00, run_after=2024-05-26T01:14:00+00:00 2024-05-26T01:13:00.094592018Z [2024-05-26T01:13:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:13:00+00:00, run_after=2024-05-26T01:14:00+00:00 2024-05-26T01:13:00.191907629Z [2024-05-26T01:13:00.191+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:13:00.191941787Z 2024-05-26T01:13:00.191947971Z 2024-05-26T01:13:00.191953354Z 2024-05-26T01:13:00.192487568Z [2024-05-26T01:13:00.192+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:13:00.193017652Z [2024-05-26T01:13:00.192+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:13:00.193597774Z [2024-05-26T01:13:00.193+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:13:00.196512433Z [2024-05-26T01:13:00.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:13:00.196537827Z 2024-05-26T01:13:00.196543514Z 2024-05-26T01:13:00.196548453Z 2024-05-26T01:13:00.205924555Z [2024-05-26T01:13:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:13:00.206161966Z [2024-05-26T01:13:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:13:00.206841902Z [2024-05-26T01:13:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:13:00.207156119Z [2024-05-26T01:13:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:13:00.207551802Z [2024-05-26T01:13:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:13:00.207817454Z [2024-05-26T01:13:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:13:00.472532196Z [2024-05-26T01:13:00.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status queued for try_number 1 2024-05-26T01:13:00.472635477Z [2024-05-26T01:13:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status queued for try_number 1 2024-05-26T01:13:00.472822825Z [2024-05-26T01:13:00.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status queued for try_number 1 2024-05-26T01:13:00.480488211Z [2024-05-26T01:13:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15433650-655a-431e-8508-b25369ba5b8e 2024-05-26T01:13:00.480763032Z [2024-05-26T01:13:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9993880d-067b-4f5a-a780-abad2827f337 2024-05-26T01:13:00.480949649Z [2024-05-26T01:13:00.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3cc2301-fc9b-415e-9da6-195703a4bc29 2024-05-26T01:13:01.644474118Z [2024-05-26T01:13:01.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:13:01.645043451Z [2024-05-26T01:13:01.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:12:00+00:00, run_id=scheduled__2024-05-26T01:12:00+00:00, run_start_date=2024-05-26 01:13:00.106108+00:00, run_end_date=2024-05-26 01:13:01.644555+00:00, run_duration=1.538447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:12:00+00:00, data_interval_end=2024-05-26 01:13:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:13:01.657287255Z [2024-05-26T01:13:01.656+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:13:00+00:00, run_after=2024-05-26T01:14:00+00:00 2024-05-26T01:13:01.729565965Z [2024-05-26T01:13:01.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status success for try_number 1 2024-05-26T01:13:01.737458230Z [2024-05-26T01:13:01.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:12:00+00:00, map_index=-1, run_start_date=2024-05-26 01:13:01.053758+00:00, run_end_date=2024-05-26 01:13:01.523669+00:00, run_duration=0.469911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:13:00.199475+00:00, queued_by_job_id=1, pid=9825 2024-05-26T01:13:03.509875920Z [2024-05-26T01:13:03.509+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:13:03.509915726Z [2024-05-26T01:13:03.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:12:00+00:00, run_id=scheduled__2024-05-26T01:12:00+00:00, run_start_date=2024-05-26 01:13:00.108003+00:00, run_end_date=2024-05-26 01:13:03.509452+00:00, run_duration=3.401449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:12:00+00:00, data_interval_end=2024-05-26 01:13:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:13:03.520935654Z [2024-05-26T01:13:03.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:13:00+00:00, run_after=2024-05-26T01:14:00+00:00 2024-05-26T01:13:03.575227973Z [2024-05-26T01:13:03.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status success for try_number 1 2024-05-26T01:13:03.580762346Z [2024-05-26T01:13:03.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:12:00+00:00, map_index=-1, run_start_date=2024-05-26 01:13:02.091926+00:00, run_end_date=2024-05-26 01:13:03.339039+00:00, run_duration=1.247113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:13:00.199475+00:00, queued_by_job_id=1, pid=9843 2024-05-26T01:13:04.629588532Z [2024-05-26T01:13:04.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:13:04.632129139Z [2024-05-26T01:13:04.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:12:00+00:00, run_id=scheduled__2024-05-26T01:12:00+00:00, run_start_date=2024-05-26 01:13:00.109578+00:00, run_end_date=2024-05-26 01:13:04.631746+00:00, run_duration=4.522168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:12:00+00:00, data_interval_end=2024-05-26 01:13:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:13:04.668957108Z [2024-05-26T01:13:04.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:13:00+00:00, run_after=2024-05-26T01:14:00+00:00 2024-05-26T01:13:04.740722769Z [2024-05-26T01:13:04.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status success for try_number 1 2024-05-26T01:13:04.748421817Z [2024-05-26T01:13:04.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:12:00+00:00, map_index=-1, run_start_date=2024-05-26 01:13:02.210554+00:00, run_end_date=2024-05-26 01:13:04.289022+00:00, run_duration=2.078468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:13:00.199475+00:00, queued_by_job_id=1, pid=9844 2024-05-26T01:13:32.212557587Z [2024-05-26T01:13:32.212+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:14:00.689448030Z [2024-05-26T01:14:00.688+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:14:00+00:00, run_after=2024-05-26T01:15:00+00:00 2024-05-26T01:14:00.696963676Z [2024-05-26T01:14:00.696+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:14:00.705191122Z [2024-05-26T01:14:00.704+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:14:00.724276491Z [2024-05-26T01:14:00.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:14:00+00:00, run_after=2024-05-26T01:15:00+00:00 2024-05-26T01:14:00.830192164Z [2024-05-26T01:14:00.829+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:14:00.830223835Z 2024-05-26T01:14:00.830232302Z 2024-05-26T01:14:00.830237004Z 2024-05-26T01:14:00.830241829Z 2024-05-26T01:14:00.831762131Z [2024-05-26T01:14:00.830+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:14:00.831785249Z [2024-05-26T01:14:00.830+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:14:00.831791240Z [2024-05-26T01:14:00.830+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:14:00.831796464Z [2024-05-26T01:14:00.830+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:14:00.832012407Z [2024-05-26T01:14:00.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:14:00.832048200Z 2024-05-26T01:14:00.832056913Z 2024-05-26T01:14:00.832062447Z 2024-05-26T01:14:00.832067826Z 2024-05-26T01:14:00.837810034Z [2024-05-26T01:14:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:14:00.838087775Z [2024-05-26T01:14:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:14:00.838586634Z [2024-05-26T01:14:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:14:00.838895044Z [2024-05-26T01:14:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:14:00.839295064Z [2024-05-26T01:14:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:14:00.839545568Z [2024-05-26T01:14:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:14:00.841249505Z [2024-05-26T01:14:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:14:00.841572669Z [2024-05-26T01:14:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:14:01.304239388Z [2024-05-26T01:14:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status queued for try_number 1 2024-05-26T01:14:01.304575287Z [2024-05-26T01:14:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:13:00+00:00 exited with status queued for try_number 1 2024-05-26T01:14:01.304772709Z [2024-05-26T01:14:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:13:00+00:00 exited with status queued for try_number 1 2024-05-26T01:14:01.304966673Z [2024-05-26T01:14:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:13:00+00:00 exited with status queued for try_number 1 2024-05-26T01:14:01.324987048Z [2024-05-26T01:14:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41b9cbef-5b59-4aa9-a17a-9c9ef5461d5a 2024-05-26T01:14:01.328110770Z [2024-05-26T01:14:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to a297e0a9-61dc-45ea-86ba-dc2086539cf9 2024-05-26T01:14:01.328388491Z [2024-05-26T01:14:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c7f773c-6dd8-4946-95da-61cf896568ee 2024-05-26T01:14:01.328633879Z [2024-05-26T01:14:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea7f962c-e9fe-4c6e-801a-ee263105928a 2024-05-26T01:14:02.581765617Z [2024-05-26T01:14:02.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:14:02.582184760Z [2024-05-26T01:14:02.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:12:00+00:00, run_id=scheduled__2024-05-26T01:12:00+00:00, run_start_date=2024-05-26 01:14:00.729655+00:00, run_end_date=2024-05-26 01:14:02.581756+00:00, run_duration=1.852101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:12:00+00:00, data_interval_end=2024-05-26 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:14:02.591327814Z [2024-05-26T01:14:02.591+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:14:00+00:00, run_after=2024-05-26T01:16:00+00:00 2024-05-26T01:14:02.598651033Z [2024-05-26T01:14:02.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:14:02.598889481Z [2024-05-26T01:14:02.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:13:00+00:00, run_id=scheduled__2024-05-26T01:13:00+00:00, run_start_date=2024-05-26 01:14:00.730876+00:00, run_end_date=2024-05-26 01:14:02.598549+00:00, run_duration=1.867673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:13:00+00:00, data_interval_end=2024-05-26 01:14:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:14:02.611453268Z [2024-05-26T01:14:02.611+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:14:00+00:00, run_after=2024-05-26T01:15:00+00:00 2024-05-26T01:14:02.680233385Z [2024-05-26T01:14:02.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:12:00+00:00 exited with status success for try_number 1 2024-05-26T01:14:02.680331007Z [2024-05-26T01:14:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:13:00+00:00 exited with status success for try_number 1 2024-05-26T01:14:02.690142480Z [2024-05-26T01:14:02.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:13:00+00:00, map_index=-1, run_start_date=2024-05-26 01:14:01.688157+00:00, run_end_date=2024-05-26 01:14:02.071571+00:00, run_duration=0.383414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:14:00.833645+00:00, queued_by_job_id=1, pid=9878 2024-05-26T01:14:02.690335735Z [2024-05-26T01:14:02.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:12:00+00:00, map_index=-1, run_start_date=2024-05-26 01:14:01.551764+00:00, run_end_date=2024-05-26 01:14:01.958268+00:00, run_duration=0.406504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:14:00.833645+00:00, queued_by_job_id=1, pid=9877 2024-05-26T01:14:04.845582572Z [2024-05-26T01:14:04.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:14:04.846105115Z [2024-05-26T01:14:04.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:13:00+00:00, run_id=scheduled__2024-05-26T01:13:00+00:00, run_start_date=2024-05-26 01:14:00.732858+00:00, run_end_date=2024-05-26 01:14:04.845499+00:00, run_duration=4.112641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:13:00+00:00, data_interval_end=2024-05-26 01:14:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:14:04.856529694Z [2024-05-26T01:14:04.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:14:00+00:00, run_after=2024-05-26T01:15:00+00:00 2024-05-26T01:14:04.866157595Z [2024-05-26T01:14:04.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:14:04.866522174Z [2024-05-26T01:14:04.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:13:00+00:00, run_id=scheduled__2024-05-26T01:13:00+00:00, run_start_date=2024-05-26 01:14:00.731869+00:00, run_end_date=2024-05-26 01:14:04.866079+00:00, run_duration=4.13421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:13:00+00:00, data_interval_end=2024-05-26 01:14:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:14:04.880113251Z [2024-05-26T01:14:04.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:14:00+00:00, run_after=2024-05-26T01:15:00+00:00 2024-05-26T01:14:04.932086226Z [2024-05-26T01:14:04.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:13:00+00:00 exited with status success for try_number 1 2024-05-26T01:14:04.932851042Z [2024-05-26T01:14:04.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:13:00+00:00 exited with status success for try_number 1 2024-05-26T01:14:04.950273720Z [2024-05-26T01:14:04.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:13:00+00:00, map_index=-1, run_start_date=2024-05-26 01:14:02.954470+00:00, run_end_date=2024-05-26 01:14:04.383888+00:00, run_duration=1.429418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:14:00.833645+00:00, queued_by_job_id=1, pid=9902 2024-05-26T01:14:04.952982299Z [2024-05-26T01:14:04.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:13:00+00:00, map_index=-1, run_start_date=2024-05-26 01:14:02.733073+00:00, run_end_date=2024-05-26 01:14:04.675164+00:00, run_duration=1.942091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:14:00.833645+00:00, queued_by_job_id=1, pid=9901 2024-05-26T01:15:00.479435790Z [2024-05-26T01:15:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:15:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:15:00.488027093Z [2024-05-26T01:15:00.487+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:15:00.502044804Z [2024-05-26T01:15:00.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:15:00+00:00, run_after=2024-05-26T01:16:00+00:00 2024-05-26T01:15:00.518357332Z [2024-05-26T01:15:00.517+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:15:00+00:00, run_after=2024-05-26T01:16:00+00:00 2024-05-26T01:15:00.649599019Z [2024-05-26T01:15:00.649+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:15:00.649706412Z 2024-05-26T01:15:00.649715931Z 2024-05-26T01:15:00.649723080Z 2024-05-26T01:15:00.649729667Z 2024-05-26T01:15:00.649773537Z [2024-05-26T01:15:00.649+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:15:00.650020635Z [2024-05-26T01:15:00.649+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:15:00.650492849Z [2024-05-26T01:15:00.650+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:15:00.650897761Z [2024-05-26T01:15:00.650+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:15:00.653348238Z [2024-05-26T01:15:00.652+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:15:00.653386466Z 2024-05-26T01:15:00.653402059Z 2024-05-26T01:15:00.653414334Z 2024-05-26T01:15:00.653427222Z 2024-05-26T01:15:00.668645830Z [2024-05-26T01:15:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:15:00.669124646Z [2024-05-26T01:15:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:15:00.669835963Z [2024-05-26T01:15:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:15:00.670200764Z [2024-05-26T01:15:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:15:00.670628193Z [2024-05-26T01:15:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:15:00.670912306Z [2024-05-26T01:15:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:15:00.671399101Z [2024-05-26T01:15:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:15:00.671747822Z [2024-05-26T01:15:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:15:00.962523810Z [2024-05-26T01:15:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:15:00.962595588Z [2024-05-26T01:15:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status queued for try_number 1 2024-05-26T01:15:00.962749273Z [2024-05-26T01:15:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status queued for try_number 1 2024-05-26T01:15:00.962830816Z [2024-05-26T01:15:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status queued for try_number 1 2024-05-26T01:15:00.974449439Z [2024-05-26T01:15:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ee9dad2-93f4-4e56-b93b-8fd9ac42ac0d 2024-05-26T01:15:00.974630409Z [2024-05-26T01:15:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5322114e-8e8a-4f14-8ab7-7855296e1382 2024-05-26T01:15:00.974817453Z [2024-05-26T01:15:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a688820-25fe-4614-b32f-3e95bfade6b8 2024-05-26T01:15:00.974973179Z [2024-05-26T01:15:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb494de1-d1b5-44ee-bee8-dbace3281744 2024-05-26T01:15:02.249608145Z [2024-05-26T01:15:02.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:15:02.250432932Z [2024-05-26T01:15:02.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:14:00+00:00, run_id=scheduled__2024-05-26T01:14:00+00:00, run_start_date=2024-05-26 01:15:00.532473+00:00, run_end_date=2024-05-26 01:15:02.249780+00:00, run_duration=1.717307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:14:00+00:00, data_interval_end=2024-05-26 01:15:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:15:02.271512855Z [2024-05-26T01:15:02.271+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:15:00+00:00, run_after=2024-05-26T01:16:00+00:00 2024-05-26T01:15:02.350835661Z [2024-05-26T01:15:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status success for try_number 1 2024-05-26T01:15:02.357959277Z [2024-05-26T01:15:02.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:14:00+00:00, map_index=-1, run_start_date=2024-05-26 01:15:01.645437+00:00, run_end_date=2024-05-26 01:15:02.099467+00:00, run_duration=0.45403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:15:00.656031+00:00, queued_by_job_id=1, pid=9936 2024-05-26T01:15:04.081959072Z [2024-05-26T01:15:04.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:15:04.082231770Z [2024-05-26T01:15:04.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:14:00+00:00, run_id=scheduled__2024-05-26T01:14:00+00:00, run_start_date=2024-05-26 01:15:00.533955+00:00, run_end_date=2024-05-26 01:15:04.081895+00:00, run_duration=3.54794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:14:00+00:00, data_interval_end=2024-05-26 01:15:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:15:04.092511338Z [2024-05-26T01:15:04.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:15:00+00:00, run_after=2024-05-26T01:16:00+00:00 2024-05-26T01:15:04.129480404Z [2024-05-26T01:15:04.129+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:15:04.129508074Z 2024-05-26T01:15:04.129559801Z [2024-05-26T01:15:04.129+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:15:04.130324674Z [2024-05-26T01:15:04.130+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:15:04.130335101Z 2024-05-26T01:15:04.132688129Z [2024-05-26T01:15:04.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:15:04.132801626Z [2024-05-26T01:15:04.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:15:04.180144238Z [2024-05-26T01:15:04.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:15:04.180249066Z [2024-05-26T01:15:04.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:15:04.180292891Z [2024-05-26T01:15:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status success for try_number 1 2024-05-26T01:15:04.186852975Z [2024-05-26T01:15:04.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to a57d5f81-3460-4b50-9a36-f2263c7be96b 2024-05-26T01:15:04.187129539Z [2024-05-26T01:15:04.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:14:00+00:00, map_index=-1, run_start_date=2024-05-26 01:15:02.550104+00:00, run_end_date=2024-05-26 01:15:03.875418+00:00, run_duration=1.325314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:15:00.656031+00:00, queued_by_job_id=1, pid=9960 2024-05-26T01:15:04.187416852Z [2024-05-26T01:15:04.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=-1, run_start_date=2024-05-26 01:15:02.722859+00:00, run_end_date=2024-05-26 01:15:03.083729+00:00, run_duration=0.36087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:15:00.656031+00:00, queued_by_job_id=1, pid=9962 2024-05-26T01:15:05.380318812Z [2024-05-26T01:15:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:15:05.380353371Z [2024-05-26T01:15:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:14:00+00:00, run_id=scheduled__2024-05-26T01:14:00+00:00, run_start_date=2024-05-26 01:15:00.535375+00:00, run_end_date=2024-05-26 01:15:05.379088+00:00, run_duration=4.843713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:14:00+00:00, data_interval_end=2024-05-26 01:15:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:15:05.389259307Z [2024-05-26T01:15:05.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:15:00+00:00, run_after=2024-05-26T01:16:00+00:00 2024-05-26T01:15:05.527797121Z [2024-05-26T01:15:05.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status success for try_number 1 2024-05-26T01:15:05.546823550Z [2024-05-26T01:15:05.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:14:00+00:00, map_index=-1, run_start_date=2024-05-26 01:15:02.559205+00:00, run_end_date=2024-05-26 01:15:04.226829+00:00, run_duration=1.667624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:15:00.656031+00:00, queued_by_job_id=1, pid=9961 2024-05-26T01:15:07.408038948Z [2024-05-26T01:15:07.407+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:15:07.408089854Z 2024-05-26T01:15:07.408099157Z [2024-05-26T01:15:07.407+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:15:07.409374665Z [2024-05-26T01:15:07.408+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:15:07.409407298Z 2024-05-26T01:15:07.413094877Z [2024-05-26T01:15:07.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:15:07.413218563Z [2024-05-26T01:15:07.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:15:07.500001275Z [2024-05-26T01:15:07.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:15:07.500051527Z [2024-05-26T01:15:07.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:15:07.505923761Z [2024-05-26T01:15:07.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c04a18a-574a-4197-9d01-c80aed9e1f8c 2024-05-26T01:15:07.506210041Z [2024-05-26T01:15:07.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=-1, run_start_date=2024-05-26 01:15:05.974662+00:00, run_end_date=2024-05-26 01:15:06.370662+00:00, run_duration=0.396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:15:04.130661+00:00, queued_by_job_id=1, pid=9985 2024-05-26T01:15:09.819833175Z [2024-05-26T01:15:09.818+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:15:09.819899338Z 2024-05-26T01:15:09.819953658Z [2024-05-26T01:15:09.819+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:15:09.821126634Z [2024-05-26T01:15:09.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:15:09.821216105Z 2024-05-26T01:15:09.826280315Z [2024-05-26T01:15:09.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:15:09.826581133Z [2024-05-26T01:15:09.826+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:15:09.890334171Z [2024-05-26T01:15:09.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status queued for try_number 1 2024-05-26T01:15:09.890964704Z [2024-05-26T01:15:09.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:15:09.897900041Z [2024-05-26T01:15:09.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1686d7c-eb81-488c-b202-d86911572dd2 2024-05-26T01:15:09.898330901Z [2024-05-26T01:15:09.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=0, run_start_date=2024-05-26 01:15:09.012267+00:00, run_end_date=2024-05-26 01:15:09.354285+00:00, run_duration=0.342018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:15:07.409849+00:00, queued_by_job_id=1, pid=9993 2024-05-26T01:15:12.136105309Z [2024-05-26T01:15:12.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:15:12.136484433Z [2024-05-26T01:15:12.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:10:00+00:00, run_id=scheduled__2024-05-26T01:10:00+00:00, run_start_date=2024-05-26 01:15:00.530678+00:00, run_end_date=2024-05-26 01:15:12.136007+00:00, run_duration=11.605329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:10:00+00:00, data_interval_end=2024-05-26 01:15:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:15:12.145000991Z [2024-05-26T01:15:12.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:15:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:15:12.185469647Z [2024-05-26T01:15:12.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:10:00+00:00 exited with status success for try_number 1 2024-05-26T01:15:12.192432804Z [2024-05-26T01:15:12.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:10:00+00:00, map_index=-1, run_start_date=2024-05-26 01:15:11.476056+00:00, run_end_date=2024-05-26 01:15:11.830819+00:00, run_duration=0.354763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:15:09.822314+00:00, queued_by_job_id=1, pid=10001 2024-05-26T01:16:00.417241341Z [2024-05-26T01:16:00.416+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:16:00.429584819Z [2024-05-26T01:16:00.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:16:00+00:00, run_after=2024-05-26T01:17:00+00:00 2024-05-26T01:16:00.442036611Z [2024-05-26T01:16:00.441+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:16:00.455029281Z [2024-05-26T01:16:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:16:00+00:00, run_after=2024-05-26T01:17:00+00:00 2024-05-26T01:16:00.537025673Z [2024-05-26T01:16:00.536+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:16:00.537102069Z 2024-05-26T01:16:00.537111592Z 2024-05-26T01:16:00.537116472Z 2024-05-26T01:16:00.537121027Z 2024-05-26T01:16:00.537129233Z [2024-05-26T01:16:00.536+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:16:00.537165786Z [2024-05-26T01:16:00.536+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:16:00.537171427Z [2024-05-26T01:16:00.537+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:16:00.537176263Z [2024-05-26T01:16:00.537+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:16:00.537741564Z [2024-05-26T01:16:00.537+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:16:00.537750208Z 2024-05-26T01:16:00.537755550Z 2024-05-26T01:16:00.537760325Z 2024-05-26T01:16:00.537765055Z 2024-05-26T01:16:00.541855698Z [2024-05-26T01:16:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:16:00.541989140Z [2024-05-26T01:16:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:16:00.542070089Z [2024-05-26T01:16:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:16:00.542090274Z [2024-05-26T01:16:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:16:00.542227055Z [2024-05-26T01:16:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:16:00.542261601Z [2024-05-26T01:16:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:16:00.542532852Z [2024-05-26T01:16:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:16:00.542597567Z [2024-05-26T01:16:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:16:01.058788290Z [2024-05-26T01:16:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status queued for try_number 1 2024-05-26T01:16:01.059392745Z [2024-05-26T01:16:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status queued for try_number 1 2024-05-26T01:16:01.059557020Z [2024-05-26T01:16:01.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status queued for try_number 1 2024-05-26T01:16:01.060917352Z [2024-05-26T01:16:01.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status queued for try_number 1 2024-05-26T01:16:01.086283793Z [2024-05-26T01:16:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22420852-d299-41fa-8e1e-953001db0eec 2024-05-26T01:16:01.086664547Z [2024-05-26T01:16:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 141a9d21-2463-41c9-9488-40f8511a2d9e 2024-05-26T01:16:01.086875510Z [2024-05-26T01:16:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b81dd66-86cf-4d78-8cd2-0c9b01008347 2024-05-26T01:16:01.087060576Z [2024-05-26T01:16:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43a7fac3-7213-4609-9e14-ad6f53452955 2024-05-26T01:16:02.268552178Z [2024-05-26T01:16:02.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:16:02.269025246Z [2024-05-26T01:16:02.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:14:00+00:00, run_id=scheduled__2024-05-26T01:14:00+00:00, run_start_date=2024-05-26 01:16:00.469705+00:00, run_end_date=2024-05-26 01:16:02.268667+00:00, run_duration=1.798962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:14:00+00:00, data_interval_end=2024-05-26 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:16:02.278132632Z [2024-05-26T01:16:02.277+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:16:00+00:00, run_after=2024-05-26T01:18:00+00:00 2024-05-26T01:16:02.290961167Z [2024-05-26T01:16:02.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:16:02.291284382Z [2024-05-26T01:16:02.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:15:00+00:00, run_id=scheduled__2024-05-26T01:15:00+00:00, run_start_date=2024-05-26 01:16:00.471143+00:00, run_end_date=2024-05-26 01:16:02.290991+00:00, run_duration=1.819848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:15:00+00:00, data_interval_end=2024-05-26 01:16:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:16:02.303093815Z [2024-05-26T01:16:02.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:16:00+00:00, run_after=2024-05-26T01:17:00+00:00 2024-05-26T01:16:02.366334503Z [2024-05-26T01:16:02.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status success for try_number 1 2024-05-26T01:16:02.372806715Z [2024-05-26T01:16:02.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:15:00+00:00, map_index=-1, run_start_date=2024-05-26 01:16:01.704428+00:00, run_end_date=2024-05-26 01:16:02.134701+00:00, run_duration=0.430273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:16:00.538493+00:00, queued_by_job_id=1, pid=10024 2024-05-26T01:16:03.323462770Z [2024-05-26T01:16:03.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:14:00+00:00 exited with status success for try_number 1 2024-05-26T01:16:03.328479876Z [2024-05-26T01:16:03.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:14:00+00:00, map_index=-1, run_start_date=2024-05-26 01:16:01.768873+00:00, run_end_date=2024-05-26 01:16:02.200407+00:00, run_duration=0.431534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:16:00.538493+00:00, queued_by_job_id=1, pid=10025 2024-05-26T01:16:04.386134078Z [2024-05-26T01:16:04.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:16:04.386571665Z [2024-05-26T01:16:04.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:15:00+00:00, run_id=scheduled__2024-05-26T01:15:00+00:00, run_start_date=2024-05-26 01:16:00.472623+00:00, run_end_date=2024-05-26 01:16:04.386138+00:00, run_duration=3.913515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:15:00+00:00, data_interval_end=2024-05-26 01:16:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:16:04.402875802Z [2024-05-26T01:16:04.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:16:00+00:00, run_after=2024-05-26T01:17:00+00:00 2024-05-26T01:16:04.410052260Z [2024-05-26T01:16:04.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:16:04.410389710Z [2024-05-26T01:16:04.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:15:00+00:00, run_id=scheduled__2024-05-26T01:15:00+00:00, run_start_date=2024-05-26 01:16:00.474430+00:00, run_end_date=2024-05-26 01:16:04.409989+00:00, run_duration=3.935559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:15:00+00:00, data_interval_end=2024-05-26 01:16:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:16:04.435839964Z [2024-05-26T01:16:04.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:16:00+00:00, run_after=2024-05-26T01:17:00+00:00 2024-05-26T01:16:04.551772137Z [2024-05-26T01:16:04.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status success for try_number 1 2024-05-26T01:16:04.584535284Z [2024-05-26T01:16:04.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:15:00+00:00, map_index=-1, run_start_date=2024-05-26 01:16:02.805497+00:00, run_end_date=2024-05-26 01:16:04.135776+00:00, run_duration=1.330279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:16:00.538493+00:00, queued_by_job_id=1, pid=10049 2024-05-26T01:16:05.687959531Z [2024-05-26T01:16:05.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status success for try_number 1 2024-05-26T01:16:05.694952152Z [2024-05-26T01:16:05.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:15:00+00:00, map_index=-1, run_start_date=2024-05-26 01:16:02.736664+00:00, run_end_date=2024-05-26 01:16:04.341752+00:00, run_duration=1.605088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:16:00.538493+00:00, queued_by_job_id=1, pid=10048 2024-05-26T01:17:00.209890147Z [2024-05-26T01:17:00.209+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:17:00+00:00, run_after=2024-05-26T01:18:00+00:00 2024-05-26T01:17:00.218150825Z [2024-05-26T01:17:00.217+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:17:00.231326704Z [2024-05-26T01:17:00.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:17:00+00:00, run_after=2024-05-26T01:18:00+00:00 2024-05-26T01:17:00.306054235Z [2024-05-26T01:17:00.305+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:17:00.306082180Z 2024-05-26T01:17:00.306087690Z 2024-05-26T01:17:00.306092118Z 2024-05-26T01:17:00.306102392Z [2024-05-26T01:17:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:17:00.306403318Z [2024-05-26T01:17:00.306+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:17:00.306557262Z [2024-05-26T01:17:00.306+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:17:00.307384310Z [2024-05-26T01:17:00.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:17:00.307403643Z 2024-05-26T01:17:00.307410381Z 2024-05-26T01:17:00.307416345Z 2024-05-26T01:17:00.313524985Z [2024-05-26T01:17:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:17:00.313670699Z [2024-05-26T01:17:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:17:00.314185880Z [2024-05-26T01:17:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:17:00.314537874Z [2024-05-26T01:17:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:17:00.314901987Z [2024-05-26T01:17:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:17:00.315329934Z [2024-05-26T01:17:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:17:00.556921995Z [2024-05-26T01:17:00.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status queued for try_number 1 2024-05-26T01:17:00.557146902Z [2024-05-26T01:17:00.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status queued for try_number 1 2024-05-26T01:17:00.557351346Z [2024-05-26T01:17:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status queued for try_number 1 2024-05-26T01:17:00.564560262Z [2024-05-26T01:17:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbbf7473-0b93-422b-a1ea-789e1226e3c2 2024-05-26T01:17:00.564848405Z [2024-05-26T01:17:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4fcb374-2a86-42d4-b62b-641ed98c52a7 2024-05-26T01:17:00.565070951Z [2024-05-26T01:17:00.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 139c6215-13cc-4bd1-ac66-bdc1269a834b 2024-05-26T01:17:01.686064830Z [2024-05-26T01:17:01.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:17:01.686546482Z [2024-05-26T01:17:01.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:16:00+00:00, run_id=scheduled__2024-05-26T01:16:00+00:00, run_start_date=2024-05-26 01:17:00.241600+00:00, run_end_date=2024-05-26 01:17:01.686180+00:00, run_duration=1.44458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:16:00+00:00, data_interval_end=2024-05-26 01:17:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:17:01.696359075Z [2024-05-26T01:17:01.696+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:17:00+00:00, run_after=2024-05-26T01:18:00+00:00 2024-05-26T01:17:01.756405062Z [2024-05-26T01:17:01.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status success for try_number 1 2024-05-26T01:17:01.763766216Z [2024-05-26T01:17:01.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:16:00+00:00, map_index=-1, run_start_date=2024-05-26 01:17:01.119273+00:00, run_end_date=2024-05-26 01:17:01.510882+00:00, run_duration=0.391609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:17:00.308868+00:00, queued_by_job_id=1, pid=10081 2024-05-26T01:17:04.221151332Z [2024-05-26T01:17:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:17:04.221543174Z [2024-05-26T01:17:04.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:16:00+00:00, run_id=scheduled__2024-05-26T01:16:00+00:00, run_start_date=2024-05-26 01:17:00.242784+00:00, run_end_date=2024-05-26 01:17:04.221069+00:00, run_duration=3.978285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:16:00+00:00, data_interval_end=2024-05-26 01:17:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:17:04.229959700Z [2024-05-26T01:17:04.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:17:00+00:00, run_after=2024-05-26T01:18:00+00:00 2024-05-26T01:17:04.236474734Z [2024-05-26T01:17:04.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:17:04.236899199Z [2024-05-26T01:17:04.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:16:00+00:00, run_id=scheduled__2024-05-26T01:16:00+00:00, run_start_date=2024-05-26 01:17:00.243847+00:00, run_end_date=2024-05-26 01:17:04.236582+00:00, run_duration=3.992735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:16:00+00:00, data_interval_end=2024-05-26 01:17:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:17:04.245955734Z [2024-05-26T01:17:04.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:17:00+00:00, run_after=2024-05-26T01:18:00+00:00 2024-05-26T01:17:04.303121601Z [2024-05-26T01:17:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status success for try_number 1 2024-05-26T01:17:04.305235623Z [2024-05-26T01:17:04.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status success for try_number 1 2024-05-26T01:17:04.311216889Z [2024-05-26T01:17:04.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:16:00+00:00, map_index=-1, run_start_date=2024-05-26 01:17:02.136826+00:00, run_end_date=2024-05-26 01:17:03.474868+00:00, run_duration=1.338042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:17:00.308868+00:00, queued_by_job_id=1, pid=10099 2024-05-26T01:17:04.311499814Z [2024-05-26T01:17:04.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:16:00+00:00, map_index=-1, run_start_date=2024-05-26 01:17:02.144553+00:00, run_end_date=2024-05-26 01:17:03.815207+00:00, run_duration=1.670654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:17:00.308868+00:00, queued_by_job_id=1, pid=10100 2024-05-26T01:18:00.212874094Z [2024-05-26T01:18:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:18:00+00:00, run_after=2024-05-26T01:19:00+00:00 2024-05-26T01:18:00.238175199Z [2024-05-26T01:18:00.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:18:00+00:00, run_after=2024-05-26T01:19:00+00:00 2024-05-26T01:18:00.249326880Z [2024-05-26T01:18:00.248+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:18:00.258491593Z [2024-05-26T01:18:00.258+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:18:00.362099846Z [2024-05-26T01:18:00.361+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:18:00.362156331Z 2024-05-26T01:18:00.362166684Z 2024-05-26T01:18:00.362175776Z 2024-05-26T01:18:00.362184374Z 2024-05-26T01:18:00.362325517Z [2024-05-26T01:18:00.361+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:18:00.362642162Z [2024-05-26T01:18:00.362+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:18:00.362984744Z [2024-05-26T01:18:00.362+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:18:00.363345486Z [2024-05-26T01:18:00.363+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:18:00.364604247Z [2024-05-26T01:18:00.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:18:00.364621616Z 2024-05-26T01:18:00.364645811Z 2024-05-26T01:18:00.364651208Z 2024-05-26T01:18:00.364655766Z 2024-05-26T01:18:00.369092575Z [2024-05-26T01:18:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:18:00.369125891Z [2024-05-26T01:18:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:18:00.369449841Z [2024-05-26T01:18:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:18:00.369557177Z [2024-05-26T01:18:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:18:00.369763507Z [2024-05-26T01:18:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:18:00.369924081Z [2024-05-26T01:18:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:18:00.370223204Z [2024-05-26T01:18:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:18:00.370387350Z [2024-05-26T01:18:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:18:00.745067033Z [2024-05-26T01:18:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status queued for try_number 1 2024-05-26T01:18:00.749518890Z [2024-05-26T01:18:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:17:00+00:00 exited with status queued for try_number 1 2024-05-26T01:18:00.749536526Z [2024-05-26T01:18:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:17:00+00:00 exited with status queued for try_number 1 2024-05-26T01:18:00.749552458Z [2024-05-26T01:18:00.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:17:00+00:00 exited with status queued for try_number 1 2024-05-26T01:18:00.766817601Z [2024-05-26T01:18:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e2617f6-0af8-4bcf-989e-10f47b936b92 2024-05-26T01:18:00.766839522Z [2024-05-26T01:18:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 301a25c6-e18c-414f-815e-ec8b8adc68c8 2024-05-26T01:18:00.766843215Z [2024-05-26T01:18:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to acebd79e-ddf8-44b0-9569-7b24367589f9 2024-05-26T01:18:00.766846464Z [2024-05-26T01:18:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 171ae3c6-0ff6-47ed-afe3-415a1891e9ad 2024-05-26T01:18:02.059012186Z [2024-05-26T01:18:02.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:18:02.059204944Z [2024-05-26T01:18:02.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:16:00+00:00, run_id=scheduled__2024-05-26T01:16:00+00:00, run_start_date=2024-05-26 01:18:00.272081+00:00, run_end_date=2024-05-26 01:18:02.058879+00:00, run_duration=1.786798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:16:00+00:00, data_interval_end=2024-05-26 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:18:02.067188559Z [2024-05-26T01:18:02.066+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:18:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:18:02.073984805Z [2024-05-26T01:18:02.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:18:02.074103817Z [2024-05-26T01:18:02.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:17:00+00:00, run_id=scheduled__2024-05-26T01:17:00+00:00, run_start_date=2024-05-26 01:18:00.273920+00:00, run_end_date=2024-05-26 01:18:02.073855+00:00, run_duration=1.799935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:17:00+00:00, data_interval_end=2024-05-26 01:18:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:18:02.083826989Z [2024-05-26T01:18:02.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:18:00+00:00, run_after=2024-05-26T01:19:00+00:00 2024-05-26T01:18:02.137273316Z [2024-05-26T01:18:02.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:16:00+00:00 exited with status success for try_number 1 2024-05-26T01:18:02.137303146Z [2024-05-26T01:18:02.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:17:00+00:00 exited with status success for try_number 1 2024-05-26T01:18:02.146372685Z [2024-05-26T01:18:02.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:17:00+00:00, map_index=-1, run_start_date=2024-05-26 01:18:01.264709+00:00, run_end_date=2024-05-26 01:18:01.651048+00:00, run_duration=0.386339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:18:00.365791+00:00, queued_by_job_id=1, pid=10133 2024-05-26T01:18:02.147494162Z [2024-05-26T01:18:02.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:16:00+00:00, map_index=-1, run_start_date=2024-05-26 01:18:01.262037+00:00, run_end_date=2024-05-26 01:18:01.677039+00:00, run_duration=0.415002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:18:00.365791+00:00, queued_by_job_id=1, pid=10134 2024-05-26T01:18:03.901040588Z [2024-05-26T01:18:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:18:03.901069091Z [2024-05-26T01:18:03.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:17:00+00:00, run_id=scheduled__2024-05-26T01:17:00+00:00, run_start_date=2024-05-26 01:18:00.275232+00:00, run_end_date=2024-05-26 01:18:03.899552+00:00, run_duration=3.62432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:17:00+00:00, data_interval_end=2024-05-26 01:18:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:18:03.915742276Z [2024-05-26T01:18:03.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:18:00+00:00, run_after=2024-05-26T01:19:00+00:00 2024-05-26T01:18:03.952947386Z [2024-05-26T01:18:03.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:17:00+00:00 exited with status success for try_number 1 2024-05-26T01:18:03.957529320Z [2024-05-26T01:18:03.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:17:00+00:00, map_index=-1, run_start_date=2024-05-26 01:18:02.301020+00:00, run_end_date=2024-05-26 01:18:03.738475+00:00, run_duration=1.437455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:18:00.365791+00:00, queued_by_job_id=1, pid=10157 2024-05-26T01:18:05.006744417Z [2024-05-26T01:18:05.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:18:05.007140295Z [2024-05-26T01:18:05.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:17:00+00:00, run_id=scheduled__2024-05-26T01:17:00+00:00, run_start_date=2024-05-26 01:18:00.276561+00:00, run_end_date=2024-05-26 01:18:05.006803+00:00, run_duration=4.730242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:17:00+00:00, data_interval_end=2024-05-26 01:18:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:18:05.016789968Z [2024-05-26T01:18:05.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:18:00+00:00, run_after=2024-05-26T01:19:00+00:00 2024-05-26T01:18:05.049885169Z [2024-05-26T01:18:05.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:17:00+00:00 exited with status success for try_number 1 2024-05-26T01:18:05.054607490Z [2024-05-26T01:18:05.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:17:00+00:00, map_index=-1, run_start_date=2024-05-26 01:18:02.386314+00:00, run_end_date=2024-05-26 01:18:03.969300+00:00, run_duration=1.582986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:18:00.365791+00:00, queued_by_job_id=1, pid=10158 2024-05-26T01:18:32.280918250Z [2024-05-26T01:18:32.280+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:19:01.015563830Z [2024-05-26T01:19:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:19:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:19:01.025456777Z [2024-05-26T01:19:01.025+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:19:01.039457299Z [2024-05-26T01:19:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:19:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:19:01.128632763Z [2024-05-26T01:19:01.128+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:19:01.128672399Z 2024-05-26T01:19:01.128679260Z 2024-05-26T01:19:01.128684577Z 2024-05-26T01:19:01.129031982Z [2024-05-26T01:19:01.128+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:19:01.129305552Z [2024-05-26T01:19:01.128+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:19:01.129457992Z [2024-05-26T01:19:01.129+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:19:01.130183695Z [2024-05-26T01:19:01.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:19:01.130196130Z 2024-05-26T01:19:01.130199781Z 2024-05-26T01:19:01.130221459Z 2024-05-26T01:19:01.134428956Z [2024-05-26T01:19:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:19:01.134586564Z [2024-05-26T01:19:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:19:01.134834727Z [2024-05-26T01:19:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:19:01.134997669Z [2024-05-26T01:19:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:19:01.135304933Z [2024-05-26T01:19:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:19:01.135582605Z [2024-05-26T01:19:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:19:01.384382466Z [2024-05-26T01:19:01.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status queued for try_number 1 2024-05-26T01:19:01.384470592Z [2024-05-26T01:19:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status queued for try_number 1 2024-05-26T01:19:01.384486141Z [2024-05-26T01:19:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status queued for try_number 1 2024-05-26T01:19:01.395839468Z [2024-05-26T01:19:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f67f940-2bdf-422d-920a-beea6b35e218 2024-05-26T01:19:01.396047421Z [2024-05-26T01:19:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to f61f927e-caa7-4ffc-97fe-907805d9b77d 2024-05-26T01:19:01.396256318Z [2024-05-26T01:19:01.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d95892b-24ba-4c1a-900c-089f56d80ba5 2024-05-26T01:19:02.961084933Z [2024-05-26T01:19:02.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:19:02.961385277Z [2024-05-26T01:19:02.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:18:00+00:00, run_id=scheduled__2024-05-26T01:18:00+00:00, run_start_date=2024-05-26 01:19:01.054481+00:00, run_end_date=2024-05-26 01:19:02.960981+00:00, run_duration=1.9065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:18:00+00:00, data_interval_end=2024-05-26 01:19:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:19:02.974597310Z [2024-05-26T01:19:02.974+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:19:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:19:03.058351519Z [2024-05-26T01:19:03.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status success for try_number 1 2024-05-26T01:19:03.071559831Z [2024-05-26T01:19:03.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:18:00+00:00, map_index=-1, run_start_date=2024-05-26 01:19:01.905706+00:00, run_end_date=2024-05-26 01:19:02.250681+00:00, run_duration=0.344975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:19:01.130955+00:00, queued_by_job_id=1, pid=10190 2024-05-26T01:19:05.330422356Z [2024-05-26T01:19:05.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:19:05.330730118Z [2024-05-26T01:19:05.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:18:00+00:00, run_id=scheduled__2024-05-26T01:18:00+00:00, run_start_date=2024-05-26 01:19:01.056096+00:00, run_end_date=2024-05-26 01:19:05.330307+00:00, run_duration=4.274211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:18:00+00:00, data_interval_end=2024-05-26 01:19:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:19:05.340104908Z [2024-05-26T01:19:05.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:19:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:19:05.405748700Z [2024-05-26T01:19:05.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status success for try_number 1 2024-05-26T01:19:05.412776163Z [2024-05-26T01:19:05.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:18:00+00:00, map_index=-1, run_start_date=2024-05-26 01:19:03.095848+00:00, run_end_date=2024-05-26 01:19:04.703458+00:00, run_duration=1.60761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:19:01.130955+00:00, queued_by_job_id=1, pid=10209 2024-05-26T01:19:06.478600846Z [2024-05-26T01:19:06.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:19:06.479160289Z [2024-05-26T01:19:06.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:18:00+00:00, run_id=scheduled__2024-05-26T01:18:00+00:00, run_start_date=2024-05-26 01:19:01.057579+00:00, run_end_date=2024-05-26 01:19:06.478407+00:00, run_duration=5.420828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:18:00+00:00, data_interval_end=2024-05-26 01:19:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:19:06.498360024Z [2024-05-26T01:19:06.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:19:00+00:00, run_after=2024-05-26T01:20:00+00:00 2024-05-26T01:19:06.569177146Z [2024-05-26T01:19:06.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status success for try_number 1 2024-05-26T01:19:06.578592353Z [2024-05-26T01:19:06.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:18:00+00:00, map_index=-1, run_start_date=2024-05-26 01:19:02.915062+00:00, run_end_date=2024-05-26 01:19:05.793477+00:00, run_duration=2.878415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:19:01.130955+00:00, queued_by_job_id=1, pid=10208 2024-05-26T01:20:00.471279189Z [2024-05-26T01:20:00.470+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:20:00.490637705Z [2024-05-26T01:20:00.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:25:00+00:00 2024-05-26T01:20:00.498618756Z [2024-05-26T01:20:00.498+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:20:00.518188374Z [2024-05-26T01:20:00.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:21:00+00:00 2024-05-26T01:20:00.541488857Z [2024-05-26T01:20:00.540+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:21:00+00:00 2024-05-26T01:20:00.668700349Z [2024-05-26T01:20:00.668+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T01:20:00.668743011Z 2024-05-26T01:20:00.668804325Z 2024-05-26T01:20:00.668813685Z 2024-05-26T01:20:00.668821397Z 2024-05-26T01:20:00.668917255Z 2024-05-26T01:20:00.668924389Z [2024-05-26T01:20:00.668+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:20:00.669004251Z [2024-05-26T01:20:00.668+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:20:00.669044964Z [2024-05-26T01:20:00.668+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:20:00.669057066Z [2024-05-26T01:20:00.668+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:20:00.669067162Z [2024-05-26T01:20:00.668+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:20:00.669478369Z [2024-05-26T01:20:00.669+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:20:00.669493788Z 2024-05-26T01:20:00.669500851Z 2024-05-26T01:20:00.669506624Z 2024-05-26T01:20:00.669512137Z 2024-05-26T01:20:00.669517388Z 2024-05-26T01:20:00.673837390Z [2024-05-26T01:20:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:20:00.673858277Z [2024-05-26T01:20:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:20:00.674092017Z [2024-05-26T01:20:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:20:00.674131061Z [2024-05-26T01:20:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:20:00.674321759Z [2024-05-26T01:20:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:20:00.674359727Z [2024-05-26T01:20:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:20:00.674539492Z [2024-05-26T01:20:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:20:00.674554508Z [2024-05-26T01:20:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:20:00.674702902Z [2024-05-26T01:20:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:20:00.674741677Z [2024-05-26T01:20:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:20:01.180712764Z [2024-05-26T01:20:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:01.181003362Z [2024-05-26T01:20:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:01.181192777Z [2024-05-26T01:20:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:19:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:01.181660423Z [2024-05-26T01:20:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:19:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:01.181857431Z [2024-05-26T01:20:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:19:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:01.190613108Z [2024-05-26T01:20:01.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7035b2a-7744-434c-b4c9-b841e7146bea 2024-05-26T01:20:01.190865455Z [2024-05-26T01:20:01.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69170c5f-3d6a-46f4-9cce-3c5a3fe0f3af 2024-05-26T01:20:01.191092412Z [2024-05-26T01:20:01.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to d67ac418-b2a1-4c91-aa03-98e8935e781b 2024-05-26T01:20:01.191304088Z [2024-05-26T01:20:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e5f5fed-8de9-4a6f-92e6-f15e45ddad46 2024-05-26T01:20:01.191557813Z [2024-05-26T01:20:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 538b9826-22aa-4c33-9a1d-ea0e5fafc0e3 2024-05-26T01:20:02.395559973Z [2024-05-26T01:20:02.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:20:02.396188158Z [2024-05-26T01:20:02.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:18:00+00:00, run_id=scheduled__2024-05-26T01:18:00+00:00, run_start_date=2024-05-26 01:20:00.555455+00:00, run_end_date=2024-05-26 01:20:02.395549+00:00, run_duration=1.840094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:18:00+00:00, data_interval_end=2024-05-26 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:20:02.404492415Z [2024-05-26T01:20:02.404+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:22:00+00:00 2024-05-26T01:20:02.413577815Z [2024-05-26T01:20:02.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:20:02.414053912Z [2024-05-26T01:20:02.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:19:00+00:00, run_id=scheduled__2024-05-26T01:19:00+00:00, run_start_date=2024-05-26 01:20:00.556637+00:00, run_end_date=2024-05-26 01:20:02.413602+00:00, run_duration=1.856965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:19:00+00:00, data_interval_end=2024-05-26 01:20:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:20:02.425989737Z [2024-05-26T01:20:02.425+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:21:00+00:00 2024-05-26T01:20:02.481065921Z [2024-05-26T01:20:02.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:18:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:02.481368426Z [2024-05-26T01:20:02.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:19:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:02.488966081Z [2024-05-26T01:20:02.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:18:00+00:00, map_index=-1, run_start_date=2024-05-26 01:20:01.462634+00:00, run_end_date=2024-05-26 01:20:01.912611+00:00, run_duration=0.449977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:00.670271+00:00, queued_by_job_id=1, pid=10244 2024-05-26T01:20:02.489283729Z [2024-05-26T01:20:02.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:19:00+00:00, map_index=-1, run_start_date=2024-05-26 01:20:01.598077+00:00, run_end_date=2024-05-26 01:20:02.104952+00:00, run_duration=0.506875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:00.670271+00:00, queued_by_job_id=1, pid=10245 2024-05-26T01:20:04.028132533Z [2024-05-26T01:20:04.027+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:20:04.028159800Z 2024-05-26T01:20:04.028189610Z [2024-05-26T01:20:04.028+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:20:04.028900431Z [2024-05-26T01:20:04.028+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:20:04.028912904Z 2024-05-26T01:20:04.032173083Z [2024-05-26T01:20:04.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:20:04.032242970Z [2024-05-26T01:20:04.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:20:04.155981209Z [2024-05-26T01:20:04.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:04.156157485Z [2024-05-26T01:20:04.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:04.176735207Z [2024-05-26T01:20:04.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a63e7b6-2c39-4de4-b300-781eac78ddc0 2024-05-26T01:20:04.176985414Z [2024-05-26T01:20:04.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:15:00+00:00, map_index=-1, run_start_date=2024-05-26 01:20:02.963376+00:00, run_end_date=2024-05-26 01:20:03.418073+00:00, run_duration=0.454697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:00.670271+00:00, queued_by_job_id=1, pid=10275 2024-05-26T01:20:04.258785917Z [2024-05-26T01:20:04.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:20:04.259257129Z [2024-05-26T01:20:04.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:19:00+00:00, run_id=scheduled__2024-05-26T01:19:00+00:00, run_start_date=2024-05-26 01:20:00.558088+00:00, run_end_date=2024-05-26 01:20:04.258694+00:00, run_duration=3.700606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:19:00+00:00, data_interval_end=2024-05-26 01:20:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:20:04.268074508Z [2024-05-26T01:20:04.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:21:00+00:00 2024-05-26T01:20:04.353953960Z [2024-05-26T01:20:04.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:19:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:04.361170861Z [2024-05-26T01:20:04.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:19:00+00:00, map_index=-1, run_start_date=2024-05-26 01:20:02.898430+00:00, run_end_date=2024-05-26 01:20:04.157711+00:00, run_duration=1.259281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:00.670271+00:00, queued_by_job_id=1, pid=10269 2024-05-26T01:20:05.687125527Z [2024-05-26T01:20:05.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:20:05.687679498Z [2024-05-26T01:20:05.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:19:00+00:00, run_id=scheduled__2024-05-26T01:19:00+00:00, run_start_date=2024-05-26 01:20:00.559524+00:00, run_end_date=2024-05-26 01:20:05.687218+00:00, run_duration=5.127694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:19:00+00:00, data_interval_end=2024-05-26 01:20:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:20:05.699766913Z [2024-05-26T01:20:05.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:21:00+00:00 2024-05-26T01:20:05.759714097Z [2024-05-26T01:20:05.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:19:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:05.763642916Z [2024-05-26T01:20:05.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:19:00+00:00, map_index=-1, run_start_date=2024-05-26 01:20:03.112110+00:00, run_end_date=2024-05-26 01:20:04.826293+00:00, run_duration=1.714183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:00.670271+00:00, queued_by_job_id=1, pid=10276 2024-05-26T01:20:06.873566885Z [2024-05-26T01:20:06.873+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:20:06.873608823Z 2024-05-26T01:20:06.873864151Z [2024-05-26T01:20:06.873+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:20:06.874787024Z [2024-05-26T01:20:06.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:20:06.874804921Z 2024-05-26T01:20:06.877673721Z [2024-05-26T01:20:06.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:20:06.877829279Z [2024-05-26T01:20:06.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:20:06.944554123Z [2024-05-26T01:20:06.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:06.944588919Z [2024-05-26T01:20:06.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:06.951952185Z [2024-05-26T01:20:06.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43283f12-c9fa-412e-b074-ac5803b14255 2024-05-26T01:20:06.952267671Z [2024-05-26T01:20:06.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:15:00+00:00, map_index=-1, run_start_date=2024-05-26 01:20:05.777289+00:00, run_end_date=2024-05-26 01:20:06.161983+00:00, run_duration=0.384694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:04.029184+00:00, queued_by_job_id=1, pid=10299 2024-05-26T01:20:09.553205609Z [2024-05-26T01:20:09.552+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:20:09.553256643Z 2024-05-26T01:20:09.553528775Z [2024-05-26T01:20:09.553+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:20:09.554478815Z [2024-05-26T01:20:09.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:20:09.554533038Z 2024-05-26T01:20:09.557677290Z [2024-05-26T01:20:09.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:20:09.557776548Z [2024-05-26T01:20:09.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:20:09.621686849Z [2024-05-26T01:20:09.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status queued for try_number 1 2024-05-26T01:20:09.621979460Z [2024-05-26T01:20:09.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:09.631806199Z [2024-05-26T01:20:09.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5eb10bb2-ec80-48ab-9ffb-5870abe7e46b 2024-05-26T01:20:09.632117156Z [2024-05-26T01:20:09.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:15:00+00:00, map_index=0, run_start_date=2024-05-26 01:20:08.493864+00:00, run_end_date=2024-05-26 01:20:08.812915+00:00, run_duration=0.319051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:06.875321+00:00, queued_by_job_id=1, pid=10307 2024-05-26T01:20:11.872019815Z [2024-05-26T01:20:11.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:20:11.872314725Z [2024-05-26T01:20:11.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:15:00+00:00, run_id=scheduled__2024-05-26T01:15:00+00:00, run_start_date=2024-05-26 01:20:00.554147+00:00, run_end_date=2024-05-26 01:20:11.871823+00:00, run_duration=11.317676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:15:00+00:00, data_interval_end=2024-05-26 01:20:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:20:11.883126215Z [2024-05-26T01:20:11.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:20:00+00:00, run_after=2024-05-26T01:25:00+00:00 2024-05-26T01:20:11.938832982Z [2024-05-26T01:20:11.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:15:00+00:00 exited with status success for try_number 1 2024-05-26T01:20:11.958393856Z [2024-05-26T01:20:11.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:15:00+00:00, map_index=-1, run_start_date=2024-05-26 01:20:11.083728+00:00, run_end_date=2024-05-26 01:20:11.498778+00:00, run_duration=0.41505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:20:09.555062+00:00, queued_by_job_id=1, pid=10315 2024-05-26T01:21:01.043487477Z [2024-05-26T01:21:01.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:21:01.065975266Z [2024-05-26T01:21:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:21:00+00:00, run_after=2024-05-26T01:22:00+00:00 2024-05-26T01:21:01.094208657Z [2024-05-26T01:21:01.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:21:00+00:00, run_after=2024-05-26T01:22:00+00:00 2024-05-26T01:21:01.181994984Z [2024-05-26T01:21:01.181+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:21:01.182028840Z 2024-05-26T01:21:01.182056422Z 2024-05-26T01:21:01.182062953Z 2024-05-26T01:21:01.182080630Z [2024-05-26T01:21:01.181+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:21:01.182248003Z [2024-05-26T01:21:01.182+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:21:01.182392539Z [2024-05-26T01:21:01.182+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:21:01.182939218Z [2024-05-26T01:21:01.182+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:21:01.182948474Z 2024-05-26T01:21:01.182954600Z 2024-05-26T01:21:01.182961005Z 2024-05-26T01:21:01.186465040Z [2024-05-26T01:21:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:21:01.186565366Z [2024-05-26T01:21:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:21:01.186833578Z [2024-05-26T01:21:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:21:01.186955026Z [2024-05-26T01:21:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:21:01.187161003Z [2024-05-26T01:21:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:21:01.187276411Z [2024-05-26T01:21:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:21:01.702741751Z [2024-05-26T01:21:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:21:01.703044544Z [2024-05-26T01:21:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:21:01.703252811Z [2024-05-26T01:21:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:21:01.712662640Z [2024-05-26T01:21:01.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5cd8778-9c2c-4623-bfc5-6c47daaf73af 2024-05-26T01:21:01.715905085Z [2024-05-26T01:21:01.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28e86074-a32d-4a07-83c9-b03f7299e001 2024-05-26T01:21:01.716198198Z [2024-05-26T01:21:01.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to b756e70a-5176-4cf7-92e2-38292f3de141 2024-05-26T01:21:02.929921320Z [2024-05-26T01:21:02.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:21:02.930086371Z [2024-05-26T01:21:02.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:20:00+00:00, run_id=scheduled__2024-05-26T01:20:00+00:00, run_start_date=2024-05-26 01:21:01.105823+00:00, run_end_date=2024-05-26 01:21:02.929757+00:00, run_duration=1.823934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:20:00+00:00, data_interval_end=2024-05-26 01:21:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:21:02.939553237Z [2024-05-26T01:21:02.939+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:21:00+00:00, run_after=2024-05-26T01:22:00+00:00 2024-05-26T01:21:03.014981062Z [2024-05-26T01:21:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:21:03.020029463Z [2024-05-26T01:21:03.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:21:02.166356+00:00, run_end_date=2024-05-26 01:21:02.644823+00:00, run_duration=0.478467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:21:01.183799+00:00, queued_by_job_id=1, pid=10338 2024-05-26T01:21:05.901350433Z [2024-05-26T01:21:05.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:21:05.901818901Z [2024-05-26T01:21:05.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:20:00+00:00, run_id=scheduled__2024-05-26T01:20:00+00:00, run_start_date=2024-05-26 01:21:01.107439+00:00, run_end_date=2024-05-26 01:21:05.901259+00:00, run_duration=4.79382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:20:00+00:00, data_interval_end=2024-05-26 01:21:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:21:05.912796228Z [2024-05-26T01:21:05.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:21:00+00:00, run_after=2024-05-26T01:22:00+00:00 2024-05-26T01:21:05.921658098Z [2024-05-26T01:21:05.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:21:05.922203060Z [2024-05-26T01:21:05.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:20:00+00:00, run_id=scheduled__2024-05-26T01:20:00+00:00, run_start_date=2024-05-26 01:21:01.108698+00:00, run_end_date=2024-05-26 01:21:05.921743+00:00, run_duration=4.813045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:20:00+00:00, data_interval_end=2024-05-26 01:21:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:21:05.934549370Z [2024-05-26T01:21:05.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:21:00+00:00, run_after=2024-05-26T01:22:00+00:00 2024-05-26T01:21:05.979927782Z [2024-05-26T01:21:05.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:21:05.980484771Z [2024-05-26T01:21:05.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:21:05.990067824Z [2024-05-26T01:21:05.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:21:03.468141+00:00, run_end_date=2024-05-26 01:21:05.111434+00:00, run_duration=1.643293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:21:01.183799+00:00, queued_by_job_id=1, pid=10357 2024-05-26T01:21:05.990532684Z [2024-05-26T01:21:05.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:21:03.233983+00:00, run_end_date=2024-05-26 01:21:05.385206+00:00, run_duration=2.151223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:21:01.183799+00:00, queued_by_job_id=1, pid=10351 2024-05-26T01:22:01.066884228Z [2024-05-26T01:22:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:22:00+00:00, run_after=2024-05-26T01:23:00+00:00 2024-05-26T01:22:01.078087760Z [2024-05-26T01:22:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:22:01.087687862Z [2024-05-26T01:22:01.087+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:22:01.102637104Z [2024-05-26T01:22:01.102+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:22:00+00:00, run_after=2024-05-26T01:23:00+00:00 2024-05-26T01:22:01.214677126Z [2024-05-26T01:22:01.214+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:22:01.214702813Z 2024-05-26T01:22:01.214707217Z 2024-05-26T01:22:01.214710439Z 2024-05-26T01:22:01.214713559Z 2024-05-26T01:22:01.214792056Z [2024-05-26T01:22:01.214+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:22:01.214925547Z [2024-05-26T01:22:01.214+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:22:01.215053347Z [2024-05-26T01:22:01.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:22:01.215318417Z [2024-05-26T01:22:01.215+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:22:01.216150222Z [2024-05-26T01:22:01.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:22:01.216161631Z 2024-05-26T01:22:01.216165143Z 2024-05-26T01:22:01.216168874Z 2024-05-26T01:22:01.216172059Z 2024-05-26T01:22:01.220595937Z [2024-05-26T01:22:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:22:01.220724875Z [2024-05-26T01:22:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:22:01.220966396Z [2024-05-26T01:22:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:22:01.221087392Z [2024-05-26T01:22:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:22:01.221307572Z [2024-05-26T01:22:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:22:01.221440784Z [2024-05-26T01:22:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:22:01.221649925Z [2024-05-26T01:22:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:22:01.221781955Z [2024-05-26T01:22:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:22:01.632341614Z [2024-05-26T01:22:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:22:01.632427509Z [2024-05-26T01:22:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:21:00+00:00 exited with status queued for try_number 1 2024-05-26T01:22:01.632587076Z [2024-05-26T01:22:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:21:00+00:00 exited with status queued for try_number 1 2024-05-26T01:22:01.632726324Z [2024-05-26T01:22:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:21:00+00:00 exited with status queued for try_number 1 2024-05-26T01:22:01.653788915Z [2024-05-26T01:22:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3e0ee1b-a5dc-4e93-9e33-e6cf468e70e9 2024-05-26T01:22:01.653898639Z [2024-05-26T01:22:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc26f443-af18-4f92-8b50-f693541f679f 2024-05-26T01:22:01.654062294Z [2024-05-26T01:22:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to db787ad7-fc13-4d83-a930-8da691a42148 2024-05-26T01:22:01.654209684Z [2024-05-26T01:22:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbd325fc-ce12-4f43-b780-d3f3a268367c 2024-05-26T01:22:04.042902043Z [2024-05-26T01:22:04.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:22:04.045693377Z [2024-05-26T01:22:04.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:20:00+00:00, run_id=scheduled__2024-05-26T01:20:00+00:00, run_start_date=2024-05-26 01:22:01.116081+00:00, run_end_date=2024-05-26 01:22:04.042796+00:00, run_duration=2.926715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:20:00+00:00, data_interval_end=2024-05-26 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:22:04.076691537Z [2024-05-26T01:22:04.076+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:22:00+00:00, run_after=2024-05-26T01:24:00+00:00 2024-05-26T01:22:04.090381201Z [2024-05-26T01:22:04.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:22:04.090860073Z [2024-05-26T01:22:04.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:21:00+00:00, run_id=scheduled__2024-05-26T01:21:00+00:00, run_start_date=2024-05-26 01:22:01.117873+00:00, run_end_date=2024-05-26 01:22:04.090455+00:00, run_duration=2.972582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:21:00+00:00, data_interval_end=2024-05-26 01:22:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:22:04.102923718Z [2024-05-26T01:22:04.102+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:22:00+00:00, run_after=2024-05-26T01:23:00+00:00 2024-05-26T01:22:04.148657072Z [2024-05-26T01:22:04.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:22:04.148974507Z [2024-05-26T01:22:04.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:21:00+00:00 exited with status success for try_number 1 2024-05-26T01:22:04.157845379Z [2024-05-26T01:22:04.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:22:02.339154+00:00, run_end_date=2024-05-26 01:22:02.852684+00:00, run_duration=0.51353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:22:01.217011+00:00, queued_by_job_id=1, pid=10390 2024-05-26T01:22:04.158141313Z [2024-05-26T01:22:04.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:21:00+00:00, map_index=-1, run_start_date=2024-05-26 01:22:02.505995+00:00, run_end_date=2024-05-26 01:22:02.981557+00:00, run_duration=0.475562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:22:01.217011+00:00, queued_by_job_id=1, pid=10391 2024-05-26T01:22:06.180821177Z [2024-05-26T01:22:06.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:22:06.181161343Z [2024-05-26T01:22:06.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:21:00+00:00, run_id=scheduled__2024-05-26T01:21:00+00:00, run_start_date=2024-05-26 01:22:01.119089+00:00, run_end_date=2024-05-26 01:22:06.180705+00:00, run_duration=5.061616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:21:00+00:00, data_interval_end=2024-05-26 01:22:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:22:06.190206355Z [2024-05-26T01:22:06.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:22:00+00:00, run_after=2024-05-26T01:23:00+00:00 2024-05-26T01:22:06.200598848Z [2024-05-26T01:22:06.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:22:06.200702775Z [2024-05-26T01:22:06.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:21:00+00:00, run_id=scheduled__2024-05-26T01:21:00+00:00, run_start_date=2024-05-26 01:22:01.120779+00:00, run_end_date=2024-05-26 01:22:06.200446+00:00, run_duration=5.079667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:21:00+00:00, data_interval_end=2024-05-26 01:22:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:22:06.210732326Z [2024-05-26T01:22:06.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:22:00+00:00, run_after=2024-05-26T01:23:00+00:00 2024-05-26T01:22:06.257232311Z [2024-05-26T01:22:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:21:00+00:00 exited with status success for try_number 1 2024-05-26T01:22:06.257367019Z [2024-05-26T01:22:06.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:21:00+00:00 exited with status success for try_number 1 2024-05-26T01:22:06.263381379Z [2024-05-26T01:22:06.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:21:00+00:00, map_index=-1, run_start_date=2024-05-26 01:22:03.716798+00:00, run_end_date=2024-05-26 01:22:05.103944+00:00, run_duration=1.387146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:22:01.217011+00:00, queued_by_job_id=1, pid=10414 2024-05-26T01:22:06.263714535Z [2024-05-26T01:22:06.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:21:00+00:00, map_index=-1, run_start_date=2024-05-26 01:22:03.821918+00:00, run_end_date=2024-05-26 01:22:05.916456+00:00, run_duration=2.094538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:22:01.217011+00:00, queued_by_job_id=1, pid=10415 2024-05-26T01:23:00.679238524Z [2024-05-26T01:23:00.678+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:23:00.691647533Z [2024-05-26T01:23:00.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:23:00+00:00, run_after=2024-05-26T01:24:00+00:00 2024-05-26T01:23:00.704865082Z [2024-05-26T01:23:00.704+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:23:00+00:00, run_after=2024-05-26T01:24:00+00:00 2024-05-26T01:23:00.811416716Z [2024-05-26T01:23:00.811+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:23:00.811438373Z 2024-05-26T01:23:00.811443194Z 2024-05-26T01:23:00.811456862Z 2024-05-26T01:23:00.811468463Z [2024-05-26T01:23:00.811+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:23:00.811705914Z [2024-05-26T01:23:00.811+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:23:00.811719221Z [2024-05-26T01:23:00.811+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:23:00.812193946Z [2024-05-26T01:23:00.812+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:23:00.812204620Z 2024-05-26T01:23:00.812208362Z 2024-05-26T01:23:00.812211589Z 2024-05-26T01:23:00.815182889Z [2024-05-26T01:23:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:23:00.815304134Z [2024-05-26T01:23:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:23:00.815465104Z [2024-05-26T01:23:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:23:00.815562730Z [2024-05-26T01:23:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:23:00.815749563Z [2024-05-26T01:23:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:23:00.815834094Z [2024-05-26T01:23:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:23:01.111020031Z [2024-05-26T01:23:01.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status queued for try_number 1 2024-05-26T01:23:01.111050100Z [2024-05-26T01:23:01.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status queued for try_number 1 2024-05-26T01:23:01.111106984Z [2024-05-26T01:23:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status queued for try_number 1 2024-05-26T01:23:01.117873217Z [2024-05-26T01:23:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a847a7d-b55a-4baf-a480-2b7e27acbec8 2024-05-26T01:23:01.117922657Z [2024-05-26T01:23:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5115bf9-bc3d-43fd-a0da-37fb3bc249a0 2024-05-26T01:23:01.118013079Z [2024-05-26T01:23:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to c16734d6-eeb3-41a0-a4ea-b1869743a347 2024-05-26T01:23:02.259964627Z [2024-05-26T01:23:02.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:23:02.260318658Z [2024-05-26T01:23:02.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:22:00+00:00, run_id=scheduled__2024-05-26T01:22:00+00:00, run_start_date=2024-05-26 01:23:00.723917+00:00, run_end_date=2024-05-26 01:23:02.259899+00:00, run_duration=1.535982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:22:00+00:00, data_interval_end=2024-05-26 01:23:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:23:02.269647609Z [2024-05-26T01:23:02.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:23:00+00:00, run_after=2024-05-26T01:24:00+00:00 2024-05-26T01:23:02.328025727Z [2024-05-26T01:23:02.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status success for try_number 1 2024-05-26T01:23:02.336660340Z [2024-05-26T01:23:02.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:22:00+00:00, map_index=-1, run_start_date=2024-05-26 01:23:01.598337+00:00, run_end_date=2024-05-26 01:23:02.026377+00:00, run_duration=0.42804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:23:00.812796+00:00, queued_by_job_id=1, pid=10447 2024-05-26T01:23:04.531216852Z [2024-05-26T01:23:04.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:23:04.531354219Z [2024-05-26T01:23:04.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:22:00+00:00, run_id=scheduled__2024-05-26T01:22:00+00:00, run_start_date=2024-05-26 01:23:00.727503+00:00, run_end_date=2024-05-26 01:23:04.531118+00:00, run_duration=3.803615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:22:00+00:00, data_interval_end=2024-05-26 01:23:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:23:04.548802328Z [2024-05-26T01:23:04.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:23:00+00:00, run_after=2024-05-26T01:24:00+00:00 2024-05-26T01:23:04.589785646Z [2024-05-26T01:23:04.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status success for try_number 1 2024-05-26T01:23:04.594411975Z [2024-05-26T01:23:04.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:22:00+00:00, map_index=-1, run_start_date=2024-05-26 01:23:02.768926+00:00, run_end_date=2024-05-26 01:23:04.355838+00:00, run_duration=1.586912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:23:00.812796+00:00, queued_by_job_id=1, pid=10465 2024-05-26T01:23:06.191085302Z [2024-05-26T01:23:06.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:23:06.191999462Z [2024-05-26T01:23:06.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:22:00+00:00, run_id=scheduled__2024-05-26T01:22:00+00:00, run_start_date=2024-05-26 01:23:00.730046+00:00, run_end_date=2024-05-26 01:23:06.191447+00:00, run_duration=5.461401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:22:00+00:00, data_interval_end=2024-05-26 01:23:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:23:06.206441958Z [2024-05-26T01:23:06.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:23:00+00:00, run_after=2024-05-26T01:24:00+00:00 2024-05-26T01:23:06.262083905Z [2024-05-26T01:23:06.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status success for try_number 1 2024-05-26T01:23:06.267125274Z [2024-05-26T01:23:06.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:22:00+00:00, map_index=-1, run_start_date=2024-05-26 01:23:02.854464+00:00, run_end_date=2024-05-26 01:23:05.304882+00:00, run_duration=2.450418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:23:00.812796+00:00, queued_by_job_id=1, pid=10466 2024-05-26T01:23:32.389874031Z [2024-05-26T01:23:32.387+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:24:00.103602624Z [2024-05-26T01:24:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:24:00+00:00, run_after=2024-05-26T01:25:00+00:00 2024-05-26T01:24:00.111103352Z [2024-05-26T01:24:00.110+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:24:00.117957468Z [2024-05-26T01:24:00.117+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:24:00.133367663Z [2024-05-26T01:24:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:24:00+00:00, run_after=2024-05-26T01:25:00+00:00 2024-05-26T01:24:00.258710093Z [2024-05-26T01:24:00.258+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:24:00.258746064Z 2024-05-26T01:24:00.258753044Z 2024-05-26T01:24:00.258758705Z 2024-05-26T01:24:00.258763848Z 2024-05-26T01:24:00.259229386Z [2024-05-26T01:24:00.258+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:24:00.259703062Z [2024-05-26T01:24:00.259+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:24:00.260067623Z [2024-05-26T01:24:00.259+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:24:00.260420671Z [2024-05-26T01:24:00.260+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:24:00.261812870Z [2024-05-26T01:24:00.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:24:00.261834343Z 2024-05-26T01:24:00.261844283Z 2024-05-26T01:24:00.261853017Z 2024-05-26T01:24:00.261861911Z 2024-05-26T01:24:00.269048160Z [2024-05-26T01:24:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:24:00.269479225Z [2024-05-26T01:24:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:24:00.270035309Z [2024-05-26T01:24:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:24:00.270304432Z [2024-05-26T01:24:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:24:00.270688914Z [2024-05-26T01:24:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:24:00.270957823Z [2024-05-26T01:24:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:24:00.271333888Z [2024-05-26T01:24:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:24:00.271642910Z [2024-05-26T01:24:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:24:00.847410815Z [2024-05-26T01:24:00.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status queued for try_number 1 2024-05-26T01:24:00.847893040Z [2024-05-26T01:24:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:23:00+00:00 exited with status queued for try_number 1 2024-05-26T01:24:00.848184667Z [2024-05-26T01:24:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:23:00+00:00 exited with status queued for try_number 1 2024-05-26T01:24:00.848757505Z [2024-05-26T01:24:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:23:00+00:00 exited with status queued for try_number 1 2024-05-26T01:24:00.876981421Z [2024-05-26T01:24:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35129c7f-5867-4b9f-9cf5-e44bd9f4e585 2024-05-26T01:24:00.877743977Z [2024-05-26T01:24:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to bab44417-cb72-48ec-a666-b32623a84ae0 2024-05-26T01:24:00.877980523Z [2024-05-26T01:24:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cacd2d9-bb1f-45cb-ad5c-1319eb33eba9 2024-05-26T01:24:00.878230984Z [2024-05-26T01:24:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53a43d7c-895b-4328-8205-b294008d927c 2024-05-26T01:24:02.134103293Z [2024-05-26T01:24:02.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:24:02.134463513Z [2024-05-26T01:24:02.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:22:00+00:00, run_id=scheduled__2024-05-26T01:22:00+00:00, run_start_date=2024-05-26 01:24:00.148691+00:00, run_end_date=2024-05-26 01:24:02.134052+00:00, run_duration=1.985361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:22:00+00:00, data_interval_end=2024-05-26 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:24:02.142050331Z [2024-05-26T01:24:02.141+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:24:00+00:00, run_after=2024-05-26T01:26:00+00:00 2024-05-26T01:24:02.148603017Z [2024-05-26T01:24:02.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:24:02.148885787Z [2024-05-26T01:24:02.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:23:00+00:00, run_id=scheduled__2024-05-26T01:23:00+00:00, run_start_date=2024-05-26 01:24:00.151148+00:00, run_end_date=2024-05-26 01:24:02.148514+00:00, run_duration=1.997366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:23:00+00:00, data_interval_end=2024-05-26 01:24:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:24:02.160275986Z [2024-05-26T01:24:02.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:24:00+00:00, run_after=2024-05-26T01:25:00+00:00 2024-05-26T01:24:02.268840255Z [2024-05-26T01:24:02.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:22:00+00:00 exited with status success for try_number 1 2024-05-26T01:24:02.270832468Z [2024-05-26T01:24:02.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:23:00+00:00 exited with status success for try_number 1 2024-05-26T01:24:02.277601980Z [2024-05-26T01:24:02.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:23:00+00:00, map_index=-1, run_start_date=2024-05-26 01:24:01.244302+00:00, run_end_date=2024-05-26 01:24:01.659017+00:00, run_duration=0.414715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:24:00.263416+00:00, queued_by_job_id=1, pid=10500 2024-05-26T01:24:02.279026067Z [2024-05-26T01:24:02.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:22:00+00:00, map_index=-1, run_start_date=2024-05-26 01:24:01.146814+00:00, run_end_date=2024-05-26 01:24:01.519423+00:00, run_duration=0.372609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:24:00.263416+00:00, queued_by_job_id=1, pid=10499 2024-05-26T01:24:04.467605713Z [2024-05-26T01:24:04.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:24:04.467629772Z [2024-05-26T01:24:04.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:23:00+00:00, run_id=scheduled__2024-05-26T01:23:00+00:00, run_start_date=2024-05-26 01:24:00.153511+00:00, run_end_date=2024-05-26 01:24:04.455842+00:00, run_duration=4.302331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:23:00+00:00, data_interval_end=2024-05-26 01:24:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:24:04.483656925Z [2024-05-26T01:24:04.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:24:00+00:00, run_after=2024-05-26T01:25:00+00:00 2024-05-26T01:24:04.483686240Z [2024-05-26T01:24:04.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:24:04.483692432Z [2024-05-26T01:24:04.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:23:00+00:00, run_id=scheduled__2024-05-26T01:23:00+00:00, run_start_date=2024-05-26 01:24:00.156136+00:00, run_end_date=2024-05-26 01:24:04.479923+00:00, run_duration=4.323787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:23:00+00:00, data_interval_end=2024-05-26 01:24:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:24:04.492044574Z [2024-05-26T01:24:04.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:24:00+00:00, run_after=2024-05-26T01:25:00+00:00 2024-05-26T01:24:04.540475639Z [2024-05-26T01:24:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:23:00+00:00 exited with status success for try_number 1 2024-05-26T01:24:04.540651648Z [2024-05-26T01:24:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:23:00+00:00 exited with status success for try_number 1 2024-05-26T01:24:04.547801935Z [2024-05-26T01:24:04.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:23:00+00:00, map_index=-1, run_start_date=2024-05-26 01:24:02.300826+00:00, run_end_date=2024-05-26 01:24:03.524235+00:00, run_duration=1.223409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:24:00.263416+00:00, queued_by_job_id=1, pid=10524 2024-05-26T01:24:04.549900652Z [2024-05-26T01:24:04.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:23:00+00:00, map_index=-1, run_start_date=2024-05-26 01:24:02.160517+00:00, run_end_date=2024-05-26 01:24:03.711167+00:00, run_duration=1.55065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:24:00.263416+00:00, queued_by_job_id=1, pid=10523 2024-05-26T01:25:00.352724777Z [2024-05-26T01:25:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:26:00+00:00 2024-05-26T01:25:00.364662568Z [2024-05-26T01:25:00.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:26:00+00:00 2024-05-26T01:25:00.370951459Z [2024-05-26T01:25:00.370+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:25:00.381320103Z [2024-05-26T01:25:00.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:25:00.492990834Z [2024-05-26T01:25:00.492+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:25:00.493018201Z 2024-05-26T01:25:00.493038261Z 2024-05-26T01:25:00.493041380Z 2024-05-26T01:25:00.493044719Z 2024-05-26T01:25:00.493156632Z [2024-05-26T01:25:00.492+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:25:00.493535171Z [2024-05-26T01:25:00.493+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:25:00.493803371Z [2024-05-26T01:25:00.493+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:25:00.494113899Z [2024-05-26T01:25:00.493+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:25:00.495661936Z [2024-05-26T01:25:00.495+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:25:00.495673382Z 2024-05-26T01:25:00.495676719Z 2024-05-26T01:25:00.495679776Z 2024-05-26T01:25:00.495683377Z 2024-05-26T01:25:00.502312128Z [2024-05-26T01:25:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:25:00.502618905Z [2024-05-26T01:25:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:25:00.503109312Z [2024-05-26T01:25:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:25:00.503418805Z [2024-05-26T01:25:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:25:00.504007467Z [2024-05-26T01:25:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:25:00.504378299Z [2024-05-26T01:25:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:25:00.508381097Z [2024-05-26T01:25:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:25:00.512689383Z [2024-05-26T01:25:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:25:00.898122041Z [2024-05-26T01:25:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:25:00.898203110Z [2024-05-26T01:25:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status queued for try_number 1 2024-05-26T01:25:00.898320256Z [2024-05-26T01:25:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status queued for try_number 1 2024-05-26T01:25:00.898399396Z [2024-05-26T01:25:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status queued for try_number 1 2024-05-26T01:25:00.917319858Z [2024-05-26T01:25:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe6a7e5c-91df-491b-887a-b6d90c92c6b9 2024-05-26T01:25:00.917618285Z [2024-05-26T01:25:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e7ad945-c205-4edd-b753-d880f5279c1c 2024-05-26T01:25:00.917781657Z [2024-05-26T01:25:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8ccf0bd-ae2c-407f-a2e6-12046d3e607b 2024-05-26T01:25:00.917920393Z [2024-05-26T01:25:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9a216b8-374b-4430-8947-b7fcfbc37046 2024-05-26T01:25:02.598951706Z [2024-05-26T01:25:02.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:25:02.599466221Z [2024-05-26T01:25:02.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:24:00+00:00, run_id=scheduled__2024-05-26T01:24:00+00:00, run_start_date=2024-05-26 01:25:00.391373+00:00, run_end_date=2024-05-26 01:25:02.598858+00:00, run_duration=2.207485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:24:00+00:00, data_interval_end=2024-05-26 01:25:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:25:02.609634364Z [2024-05-26T01:25:02.609+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:26:00+00:00 2024-05-26T01:25:02.677367041Z [2024-05-26T01:25:02.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status success for try_number 1 2024-05-26T01:25:02.684987487Z [2024-05-26T01:25:02.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:24:00+00:00, map_index=-1, run_start_date=2024-05-26 01:25:01.485147+00:00, run_end_date=2024-05-26 01:25:01.838754+00:00, run_duration=0.353607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:25:00.497769+00:00, queued_by_job_id=1, pid=10558 2024-05-26T01:25:03.330427325Z [2024-05-26T01:25:03.330+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:25:03.330456030Z 2024-05-26T01:25:03.330661860Z [2024-05-26T01:25:03.330+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:25:03.331447033Z [2024-05-26T01:25:03.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:25:03.331467802Z 2024-05-26T01:25:03.334284666Z [2024-05-26T01:25:03.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:25:03.334541963Z [2024-05-26T01:25:03.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:25:03.407651410Z [2024-05-26T01:25:03.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:25:03.407681914Z [2024-05-26T01:25:03.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:25:03.415315879Z [2024-05-26T01:25:03.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64577032-93c8-4e1c-88c4-7d21dde5829f 2024-05-26T01:25:03.415336469Z [2024-05-26T01:25:03.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:25:02.420320+00:00, run_end_date=2024-05-26 01:25:02.764423+00:00, run_duration=0.344103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:25:00.497769+00:00, queued_by_job_id=1, pid=10582 2024-05-26T01:25:04.646956806Z [2024-05-26T01:25:04.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:25:04.648306720Z [2024-05-26T01:25:04.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:24:00+00:00, run_id=scheduled__2024-05-26T01:24:00+00:00, run_start_date=2024-05-26 01:25:00.392358+00:00, run_end_date=2024-05-26 01:25:04.646843+00:00, run_duration=4.254485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:24:00+00:00, data_interval_end=2024-05-26 01:25:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:25:04.677850130Z [2024-05-26T01:25:04.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:26:00+00:00 2024-05-26T01:25:04.698978920Z [2024-05-26T01:25:04.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:25:04.699054094Z [2024-05-26T01:25:04.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:24:00+00:00, run_id=scheduled__2024-05-26T01:24:00+00:00, run_start_date=2024-05-26 01:25:00.393251+00:00, run_end_date=2024-05-26 01:25:04.698828+00:00, run_duration=4.305577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:24:00+00:00, data_interval_end=2024-05-26 01:25:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:25:04.711763419Z [2024-05-26T01:25:04.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:26:00+00:00 2024-05-26T01:25:04.767043780Z [2024-05-26T01:25:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status success for try_number 1 2024-05-26T01:25:04.767074871Z [2024-05-26T01:25:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status success for try_number 1 2024-05-26T01:25:04.777198952Z [2024-05-26T01:25:04.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:24:00+00:00, map_index=-1, run_start_date=2024-05-26 01:25:02.492175+00:00, run_end_date=2024-05-26 01:25:03.709763+00:00, run_duration=1.217588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:25:00.497769+00:00, queued_by_job_id=1, pid=10588 2024-05-26T01:25:04.777308290Z [2024-05-26T01:25:04.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:24:00+00:00, map_index=-1, run_start_date=2024-05-26 01:25:02.208499+00:00, run_end_date=2024-05-26 01:25:03.724666+00:00, run_duration=1.516167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:25:00.497769+00:00, queued_by_job_id=1, pid=10571 2024-05-26T01:25:05.838476682Z [2024-05-26T01:25:05.838+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:25:05.838513228Z 2024-05-26T01:25:05.838519113Z [2024-05-26T01:25:05.838+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:25:05.838974016Z [2024-05-26T01:25:05.838+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:25:05.839013601Z 2024-05-26T01:25:05.840913945Z [2024-05-26T01:25:05.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:25:05.840954562Z [2024-05-26T01:25:05.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:25:05.943064665Z [2024-05-26T01:25:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:25:05.943101067Z [2024-05-26T01:25:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:25:05.948322896Z [2024-05-26T01:25:05.947+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9727a10-3b1a-42c0-b805-d9acd7a9438f 2024-05-26T01:25:05.948452297Z [2024-05-26T01:25:05.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:25:05.261314+00:00, run_end_date=2024-05-26 01:25:05.623259+00:00, run_duration=0.361945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:25:03.331918+00:00, queued_by_job_id=1, pid=10606 2024-05-26T01:25:08.192988820Z [2024-05-26T01:25:08.192+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:25:08.193025075Z 2024-05-26T01:25:08.193539526Z [2024-05-26T01:25:08.192+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:25:08.194462829Z [2024-05-26T01:25:08.194+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:25:08.194479042Z 2024-05-26T01:25:08.197375928Z [2024-05-26T01:25:08.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:25:08.197661445Z [2024-05-26T01:25:08.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:25:08.261941403Z [2024-05-26T01:25:08.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:25:08.262262732Z [2024-05-26T01:25:08.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:25:08.268648538Z [2024-05-26T01:25:08.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85c62ef9-2159-4a6b-a0be-7cf291d8c6fa 2024-05-26T01:25:08.268940869Z [2024-05-26T01:25:08.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=0, run_start_date=2024-05-26 01:25:07.470132+00:00, run_end_date=2024-05-26 01:25:07.811638+00:00, run_duration=0.341506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:25:05.839229+00:00, queued_by_job_id=1, pid=10614 2024-05-26T01:25:10.733885034Z [2024-05-26T01:25:10.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:25:10.736853112Z [2024-05-26T01:25:10.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:20:00+00:00, run_id=scheduled__2024-05-26T01:20:00+00:00, run_start_date=2024-05-26 01:25:00.390249+00:00, run_end_date=2024-05-26 01:25:10.733372+00:00, run_duration=10.343123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:20:00+00:00, data_interval_end=2024-05-26 01:25:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:25:10.752288347Z [2024-05-26T01:25:10.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:25:10.801712349Z [2024-05-26T01:25:10.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:25:10.807254109Z [2024-05-26T01:25:10.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:25:09.761786+00:00, run_end_date=2024-05-26 01:25:10.137078+00:00, run_duration=0.375292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:25:08.194984+00:00, queued_by_job_id=1, pid=10622 2024-05-26T01:26:00.374023136Z [2024-05-26T01:26:00.373+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:26:00.393517660Z [2024-05-26T01:26:00.393+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:26:00+00:00, run_after=2024-05-26T01:27:00+00:00 2024-05-26T01:26:00.402720445Z [2024-05-26T01:26:00.402+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:26:00.415492430Z [2024-05-26T01:26:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:26:00+00:00, run_after=2024-05-26T01:27:00+00:00 2024-05-26T01:26:00.486038848Z [2024-05-26T01:26:00.485+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:26:00.486113393Z 2024-05-26T01:26:00.486124654Z 2024-05-26T01:26:00.486132584Z 2024-05-26T01:26:00.486168123Z 2024-05-26T01:26:00.486181892Z [2024-05-26T01:26:00.485+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:26:00.486206535Z [2024-05-26T01:26:00.485+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:26:00.486214644Z [2024-05-26T01:26:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:26:00.486288522Z [2024-05-26T01:26:00.486+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:26:00.486705171Z [2024-05-26T01:26:00.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:26:00.486752726Z 2024-05-26T01:26:00.486783656Z 2024-05-26T01:26:00.486792356Z 2024-05-26T01:26:00.486800483Z 2024-05-26T01:26:00.489789028Z [2024-05-26T01:26:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:26:00.489815036Z [2024-05-26T01:26:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:26:00.489966140Z [2024-05-26T01:26:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:26:00.490025108Z [2024-05-26T01:26:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:26:00.490225219Z [2024-05-26T01:26:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:26:00.490241934Z [2024-05-26T01:26:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:26:00.490465690Z [2024-05-26T01:26:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:26:00.490484067Z [2024-05-26T01:26:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:26:00.731647544Z [2024-05-26T01:26:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status queued for try_number 1 2024-05-26T01:26:00.731747185Z [2024-05-26T01:26:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:26:00.731797624Z [2024-05-26T01:26:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:26:00.731885346Z [2024-05-26T01:26:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:26:00.741885882Z [2024-05-26T01:26:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7be35211-ac4f-4aa0-869c-a5fc4f1aebd1 2024-05-26T01:26:00.743368632Z [2024-05-26T01:26:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbc0c030-de3c-4c14-b7e5-6b88223c2189 2024-05-26T01:26:00.743381206Z [2024-05-26T01:26:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 562367da-7322-4087-9451-89f481c178dd 2024-05-26T01:26:00.743384879Z [2024-05-26T01:26:00.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0bcc495-c38c-421a-81ef-da624cc5d84f 2024-05-26T01:26:01.974198470Z [2024-05-26T01:26:01.973+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:26:01.974346756Z [2024-05-26T01:26:01.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:24:00+00:00, run_id=scheduled__2024-05-26T01:24:00+00:00, run_start_date=2024-05-26 01:26:00.427358+00:00, run_end_date=2024-05-26 01:26:01.974080+00:00, run_duration=1.546722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:24:00+00:00, data_interval_end=2024-05-26 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:26:01.990331859Z [2024-05-26T01:26:01.989+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:26:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:26:02.000204900Z [2024-05-26T01:26:01.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:26:02.000419190Z [2024-05-26T01:26:02.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:25:00+00:00, run_id=scheduled__2024-05-26T01:25:00+00:00, run_start_date=2024-05-26 01:26:00.428646+00:00, run_end_date=2024-05-26 01:26:02.000146+00:00, run_duration=1.5715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:25:00+00:00, data_interval_end=2024-05-26 01:26:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:26:02.011157380Z [2024-05-26T01:26:02.010+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:26:00+00:00, run_after=2024-05-26T01:27:00+00:00 2024-05-26T01:26:02.071275832Z [2024-05-26T01:26:02.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:24:00+00:00 exited with status success for try_number 1 2024-05-26T01:26:02.071408557Z [2024-05-26T01:26:02.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status success for try_number 1 2024-05-26T01:26:02.080618288Z [2024-05-26T01:26:02.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:24:00+00:00, map_index=-1, run_start_date=2024-05-26 01:26:01.192329+00:00, run_end_date=2024-05-26 01:26:01.684464+00:00, run_duration=0.492135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:26:00.487350+00:00, queued_by_job_id=1, pid=10641 2024-05-26T01:26:02.080939838Z [2024-05-26T01:26:02.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=2024-05-26 01:26:01.530878+00:00, run_end_date=2024-05-26 01:26:01.864097+00:00, run_duration=0.333219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:26:00.487350+00:00, queued_by_job_id=1, pid=10647 2024-05-26T01:26:04.298503065Z [2024-05-26T01:26:04.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:26:04.298711093Z [2024-05-26T01:26:04.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:25:00+00:00, run_id=scheduled__2024-05-26T01:25:00+00:00, run_start_date=2024-05-26 01:26:00.429745+00:00, run_end_date=2024-05-26 01:26:04.298418+00:00, run_duration=3.868673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:25:00+00:00, data_interval_end=2024-05-26 01:26:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:26:04.307414081Z [2024-05-26T01:26:04.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:26:00+00:00, run_after=2024-05-26T01:27:00+00:00 2024-05-26T01:26:04.358964339Z [2024-05-26T01:26:04.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status success for try_number 1 2024-05-26T01:26:04.372682054Z [2024-05-26T01:26:04.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=2024-05-26 01:26:02.427336+00:00, run_end_date=2024-05-26 01:26:03.861211+00:00, run_duration=1.433875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:26:00.487350+00:00, queued_by_job_id=1, pid=10670 2024-05-26T01:26:05.444634532Z [2024-05-26T01:26:05.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:26:05.445143523Z [2024-05-26T01:26:05.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:25:00+00:00, run_id=scheduled__2024-05-26T01:25:00+00:00, run_start_date=2024-05-26 01:26:00.430862+00:00, run_end_date=2024-05-26 01:26:05.444861+00:00, run_duration=5.013999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:25:00+00:00, data_interval_end=2024-05-26 01:26:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:26:05.459358412Z [2024-05-26T01:26:05.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:26:00+00:00, run_after=2024-05-26T01:27:00+00:00 2024-05-26T01:26:05.495618551Z [2024-05-26T01:26:05.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status success for try_number 1 2024-05-26T01:26:05.497261741Z [2024-05-26T01:26:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=2024-05-26 01:26:02.508143+00:00, run_end_date=2024-05-26 01:26:04.502970+00:00, run_duration=1.994827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:26:00.487350+00:00, queued_by_job_id=1, pid=10671 2024-05-26T01:26:09.412346870Z [2024-05-26T01:26:09.411+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:26:09.412379707Z 2024-05-26T01:26:09.412386867Z [2024-05-26T01:26:09.412+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-26T01:26:09.412830101Z [2024-05-26T01:26:09.412+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:26:09.412840957Z 2024-05-26T01:26:09.415299578Z [2024-05-26T01:26:09.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240526012607_907234', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:26:09.415375127Z [2024-05-26T01:26:09.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240526012607_907234', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-26T01:26:09.464482412Z [2024-05-26T01:26:09.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240526012607_907234 exited with status queued for try_number 1 2024-05-26T01:26:09.470817654Z [2024-05-26T01:26:09.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d88acbe-ef48-4ec7-b681-b2657b7662a8 2024-05-26T01:26:11.663552891Z [2024-05-26T01:26:11.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:26:11.663993608Z [2024-05-26T01:26:11.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-26 01:26:07.981477+00:00, run_id=vdu_down_20240526012607_907234, run_start_date=2024-05-26 01:26:09.374809+00:00, run_end_date=2024-05-26 01:26:11.663663+00:00, run_duration=2.288854, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-26 01:26:07.981477+00:00, data_interval_end=2024-05-26 01:26:07.981477+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-26T01:26:11.666963203Z [2024-05-26T01:26:11.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-26T01:26:11.698155348Z [2024-05-26T01:26:11.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240526012607_907234 exited with status success for try_number 1 2024-05-26T01:26:11.704272715Z [2024-05-26T01:26:11.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240526012607_907234, map_index=-1, run_start_date=2024-05-26 01:26:10.058012+00:00, run_end_date=2024-05-26 01:26:10.490685+00:00, run_duration=0.432673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:26:09.413152+00:00, queued_by_job_id=1, pid=10683 2024-05-26T01:27:00.239418364Z [2024-05-26T01:27:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:00.251857408Z [2024-05-26T01:27:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:00.258388343Z [2024-05-26T01:27:00.258+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:27:00.326325293Z [2024-05-26T01:27:00.325+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:27:00.326363175Z 2024-05-26T01:27:00.326369379Z 2024-05-26T01:27:00.326375050Z 2024-05-26T01:27:00.326494490Z [2024-05-26T01:27:00.326+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:27:00.326672956Z [2024-05-26T01:27:00.326+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:27:00.326838057Z [2024-05-26T01:27:00.326+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:27:00.327751664Z [2024-05-26T01:27:00.327+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:27:00.327770561Z 2024-05-26T01:27:00.327775784Z 2024-05-26T01:27:00.327780856Z 2024-05-26T01:27:00.331397560Z [2024-05-26T01:27:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:27:00.331682850Z [2024-05-26T01:27:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:27:00.332095461Z [2024-05-26T01:27:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:27:00.332256536Z [2024-05-26T01:27:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:27:00.332545043Z [2024-05-26T01:27:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:27:00.332725370Z [2024-05-26T01:27:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:27:00.620777318Z [2024-05-26T01:27:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:00.620867819Z [2024-05-26T01:27:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:00.620883265Z [2024-05-26T01:27:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:00.634041459Z [2024-05-26T01:27:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 032d0875-8b36-4d28-908f-e4f1b43240db 2024-05-26T01:27:00.634075748Z [2024-05-26T01:27:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94304e19-5904-4aff-8650-bc1cc15ef0fb 2024-05-26T01:27:00.634163887Z [2024-05-26T01:27:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7337d333-616b-4a16-a543-dc1701a3f092 2024-05-26T01:27:01.865181531Z [2024-05-26T01:27:01.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:27:01.865510556Z [2024-05-26T01:27:01.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:26:00+00:00, run_id=scheduled__2024-05-26T01:26:00+00:00, run_start_date=2024-05-26 01:27:00.267247+00:00, run_end_date=2024-05-26 01:27:01.864881+00:00, run_duration=1.597634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:26:00+00:00, data_interval_end=2024-05-26 01:27:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:27:01.877746406Z [2024-05-26T01:27:01.877+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:01.948425537Z [2024-05-26T01:27:01.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status success for try_number 1 2024-05-26T01:27:01.953757798Z [2024-05-26T01:27:01.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:26:00+00:00, map_index=-1, run_start_date=2024-05-26 01:27:01.149255+00:00, run_end_date=2024-05-26 01:27:01.554063+00:00, run_duration=0.404808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:00.328492+00:00, queued_by_job_id=1, pid=10711 2024-05-26T01:27:03.573501572Z [2024-05-26T01:27:03.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:27:03.573888187Z [2024-05-26T01:27:03.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:26:00+00:00, run_id=scheduled__2024-05-26T01:26:00+00:00, run_start_date=2024-05-26 01:27:00.268562+00:00, run_end_date=2024-05-26 01:27:03.573376+00:00, run_duration=3.304814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:26:00+00:00, data_interval_end=2024-05-26 01:27:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:27:03.583685406Z [2024-05-26T01:27:03.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:03.624894384Z [2024-05-26T01:27:03.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status success for try_number 1 2024-05-26T01:27:03.630493099Z [2024-05-26T01:27:03.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:26:00+00:00, map_index=-1, run_start_date=2024-05-26 01:27:02.118566+00:00, run_end_date=2024-05-26 01:27:03.395382+00:00, run_duration=1.276816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:00.328492+00:00, queued_by_job_id=1, pid=10729 2024-05-26T01:27:04.681078537Z [2024-05-26T01:27:04.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:27:04.681668769Z [2024-05-26T01:27:04.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:26:00+00:00, run_id=scheduled__2024-05-26T01:26:00+00:00, run_start_date=2024-05-26 01:27:00.269468+00:00, run_end_date=2024-05-26 01:27:04.681365+00:00, run_duration=4.411897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:26:00+00:00, data_interval_end=2024-05-26 01:27:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:27:04.690535496Z [2024-05-26T01:27:04.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:04.724396629Z [2024-05-26T01:27:04.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status success for try_number 1 2024-05-26T01:27:04.731856800Z [2024-05-26T01:27:04.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:26:00+00:00, map_index=-1, run_start_date=2024-05-26 01:27:02.309656+00:00, run_end_date=2024-05-26 01:27:03.857068+00:00, run_duration=1.547412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:00.328492+00:00, queued_by_job_id=1, pid=10730 2024-05-26T01:27:53.961751761Z [2024-05-26T01:27:53.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:27:54.013582694Z [2024-05-26T01:27:54.013+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:27:54.013620481Z 2024-05-26T01:27:54.014037475Z [2024-05-26T01:27:54.013+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:27:54.015204006Z [2024-05-26T01:27:54.014+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:27:54.015219086Z 2024-05-26T01:27:54.018942409Z [2024-05-26T01:27:54.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:27:54.019257163Z [2024-05-26T01:27:54.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:27:54.085618974Z [2024-05-26T01:27:54.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:54.089653627Z [2024-05-26T01:27:54.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to 690b5999-212e-4397-99c9-d44a6c10fee9 2024-05-26T01:27:54.126489417Z [2024-05-26T01:27:54.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:54.172362122Z [2024-05-26T01:27:54.172+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:27:54.172386904Z 2024-05-26T01:27:54.172397034Z [2024-05-26T01:27:54.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:27:54.173417498Z [2024-05-26T01:27:54.173+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:27:54.173428575Z 2024-05-26T01:27:54.175397720Z [2024-05-26T01:27:54.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:27:54.175498374Z [2024-05-26T01:27:54.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:27:54.226269709Z [2024-05-26T01:27:54.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:54.230622544Z [2024-05-26T01:27:54.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca2b8a77-11aa-4b3d-b6c4-f7cff4e31ca1 2024-05-26T01:27:55.348146465Z [2024-05-26T01:27:55.347+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:27:55.429762767Z [2024-05-26T01:27:55.429+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:27:55.429788500Z 2024-05-26T01:27:55.429933508Z [2024-05-26T01:27:55.429+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:27:55.430505633Z [2024-05-26T01:27:55.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:27:55.430516453Z 2024-05-26T01:27:55.432620519Z [2024-05-26T01:27:55.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:27:55.432810449Z [2024-05-26T01:27:55.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:27:55.520847846Z [2024-05-26T01:27:55.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:55.527038227Z [2024-05-26T01:27:55.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7bf8308-68ab-41d7-aec4-79ef3bfded62 2024-05-26T01:27:56.478244900Z [2024-05-26T01:27:56.477+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:27:56.478291414Z 2024-05-26T01:27:56.478670725Z [2024-05-26T01:27:56.478+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:27:56.479959212Z [2024-05-26T01:27:56.479+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:27:56.479977651Z 2024-05-26T01:27:56.483424732Z [2024-05-26T01:27:56.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='split_metrics', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:27:56.484040726Z [2024-05-26T01:27:56.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'split_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:27:56.543103526Z [2024-05-26T01:27:56.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.split_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:56.543664330Z [2024-05-26T01:27:56.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:27:56.550910949Z [2024-05-26T01:27:56.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:27:55.700844+00:00, run_end_date=2024-05-26 01:27:56.022914+00:00, run_duration=0.32207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:54.016217+00:00, queued_by_job_id=1, pid=10764 2024-05-26T01:27:56.551214645Z [2024-05-26T01:27:56.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d347fef-3e8d-4ce5-90e0-bb464deab188 2024-05-26T01:27:57.695962207Z [2024-05-26T01:27:57.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:27:57.696070051Z [2024-05-26T01:27:57.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:26:00+00:00, run_id=scheduled__2024-05-26T01:26:00+00:00, run_start_date=2024-05-26 01:27:54.136330+00:00, run_end_date=2024-05-26 01:27:57.695775+00:00, run_duration=3.559445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:26:00+00:00, data_interval_end=2024-05-26 01:27:00+00:00, dag_hash=81c70710dce1bba7b0da9402cf491ea7 2024-05-26T01:27:57.703483407Z [2024-05-26T01:27:57.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:57.756038142Z [2024-05-26T01:27:57.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status success for try_number 1 2024-05-26T01:27:57.760766703Z [2024-05-26T01:27:57.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:26:00+00:00, map_index=-1, run_start_date=2024-05-26 01:27:55.969915+00:00, run_end_date=2024-05-26 01:27:57.145063+00:00, run_duration=1.175148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:54.173678+00:00, queued_by_job_id=1, pid=10775 2024-05-26T01:27:58.846925988Z [2024-05-26T01:27:58.846+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:27:58.846984747Z 2024-05-26T01:27:58.846990395Z [2024-05-26T01:27:58.846+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:27:58.847870441Z [2024-05-26T01:27:58.847+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:27:58.847877469Z 2024-05-26T01:27:58.853067168Z [2024-05-26T01:27:58.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:27:58.853208651Z [2024-05-26T01:27:58.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'collect_metrics', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:27:58.922114294Z [2024-05-26T01:27:58.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.collect_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:27:58.922185787Z [2024-05-26T01:27:58.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.split_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:27:58.926676557Z [2024-05-26T01:27:58.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bfcda8f-9373-4280-8cbc-872c6a046eb3 2024-05-26T01:27:58.926781330Z [2024-05-26T01:27:58.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=split_metrics, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:27:58.135892+00:00, run_end_date=2024-05-26 01:27:58.531729+00:00, run_duration=0.395837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:56.480646+00:00, queued_by_job_id=1, pid=10800 2024-05-26T01:27:58.958965598Z [2024-05-26T01:27:58.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:27:58.959139774Z [2024-05-26T01:27:58.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:26:00+00:00, run_id=scheduled__2024-05-26T01:26:00+00:00, run_start_date=2024-05-26 01:27:55.357661+00:00, run_end_date=2024-05-26 01:27:58.958847+00:00, run_duration=3.601186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:26:00+00:00, data_interval_end=2024-05-26 01:27:00+00:00, dag_hash=187a211aa4842d4763bc278f12d8463e 2024-05-26T01:27:58.967022871Z [2024-05-26T01:27:58.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:27:00+00:00, run_after=2024-05-26T01:28:00+00:00 2024-05-26T01:27:59.018728014Z [2024-05-26T01:27:59.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status success for try_number 1 2024-05-26T01:27:59.025157611Z [2024-05-26T01:27:59.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:26:00+00:00, map_index=-1, run_start_date=2024-05-26 01:27:57.240940+00:00, run_end_date=2024-05-26 01:27:58.793530+00:00, run_duration=1.55259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:55.430873+00:00, queued_by_job_id=1, pid=10788 2024-05-26T01:28:00.067641492Z [2024-05-26T01:28:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:28:00.086060629Z [2024-05-26T01:28:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:00.096380382Z [2024-05-26T01:28:00.096+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:28:00.110716418Z [2024-05-26T01:28:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:00.127386529Z [2024-05-26T01:28:00.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:00.136020708Z [2024-05-26T01:28:00.135+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:28:00.270508835Z [2024-05-26T01:28:00.270+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-05-26T01:28:00.270535543Z 2024-05-26T01:28:00.270556985Z 2024-05-26T01:28:00.270561004Z 2024-05-26T01:28:00.270564421Z 2024-05-26T01:28:00.270567747Z 2024-05-26T01:28:00.270570966Z 2024-05-26T01:28:00.270714968Z [2024-05-26T01:28:00.270+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:28:00.270919907Z [2024-05-26T01:28:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:28:00.271161158Z [2024-05-26T01:28:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:28:00.271383563Z [2024-05-26T01:28:00.271+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:28:00.271715141Z [2024-05-26T01:28:00.271+0000] {scheduler_job.py:425} INFO - DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:28:00.271977674Z [2024-05-26T01:28:00.271+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:28:00.273034943Z [2024-05-26T01:28:00.272+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:28:00.273057598Z 2024-05-26T01:28:00.273064524Z 2024-05-26T01:28:00.273070593Z 2024-05-26T01:28:00.273076425Z 2024-05-26T01:28:00.273082594Z 2024-05-26T01:28:00.273088594Z 2024-05-26T01:28:00.277253614Z [2024-05-26T01:28:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:28:00.277388844Z [2024-05-26T01:28:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:28:00.277635604Z [2024-05-26T01:28:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:28:00.277777746Z [2024-05-26T01:28:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:28:00.277985869Z [2024-05-26T01:28:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:28:00.278199288Z [2024-05-26T01:28:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:28:00.278413881Z [2024-05-26T01:28:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:28:00.278591425Z [2024-05-26T01:28:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:28:00.278915190Z [2024-05-26T01:28:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:28:00.279070611Z [2024-05-26T01:28:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:28:00.279441356Z [2024-05-26T01:28:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:28:00.279788719Z [2024-05-26T01:28:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:28:01.103083411Z [2024-05-26T01:28:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status queued for try_number 1 2024-05-26T01:28:01.107506907Z [2024-05-26T01:28:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status queued for try_number 1 2024-05-26T01:28:01.107765898Z [2024-05-26T01:28:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status queued for try_number 1 2024-05-26T01:28:01.107890094Z [2024-05-26T01:28:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status queued for try_number 1 2024-05-26T01:28:01.107992103Z [2024-05-26T01:28:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status queued for try_number 1 2024-05-26T01:28:01.108093044Z [2024-05-26T01:28:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status queued for try_number 1 2024-05-26T01:28:01.132914916Z [2024-05-26T01:28:01.132+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24b90658-d837-439b-81d3-29bbd7acb05b 2024-05-26T01:28:01.133230958Z [2024-05-26T01:28:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c434689-ec72-40ff-aca1-7f2ae2ed61bb 2024-05-26T01:28:01.133511050Z [2024-05-26T01:28:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb00d7f7-0ff3-4619-a3e0-5db459f6a16c 2024-05-26T01:28:01.133755120Z [2024-05-26T01:28:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7805eb3a-8ffa-4ae8-8df6-28f45591ed2a 2024-05-26T01:28:01.134010960Z [2024-05-26T01:28:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 691a3ec2-5800-4a24-9869-0684fc71672c 2024-05-26T01:28:01.134249883Z [2024-05-26T01:28:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to d02e3670-9d8b-48b6-97f7-05c15f6d31c0 2024-05-26T01:28:01.383859426Z [2024-05-26T01:28:01.383+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:28:01.383915136Z 2024-05-26T01:28:01.384606927Z [2024-05-26T01:28:01.384+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:28:01.385613894Z [2024-05-26T01:28:01.385+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:28:01.385629094Z 2024-05-26T01:28:01.390095803Z [2024-05-26T01:28:01.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:28:01.390404052Z [2024-05-26T01:28:01.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'send_prometheus', 'scheduled__2024-05-26T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:28:01.511988007Z [2024-05-26T01:28:01.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.send_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status queued for try_number 1 2024-05-26T01:28:01.514066554Z [2024-05-26T01:28:01.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.collect_metrics run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:01.528571162Z [2024-05-26T01:28:01.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=0, run_start_date=2024-05-26 01:28:00.359510+00:00, run_end_date=2024-05-26 01:28:00.884945+00:00, run_duration=0.525435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:27:58.848388+00:00, queued_by_job_id=1, pid=10812 2024-05-26T01:28:01.528972407Z [2024-05-26T01:28:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1cee992-42f8-4f8c-ba52-637078ff2ab0 2024-05-26T01:28:02.960950174Z [2024-05-26T01:28:02.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:28:02.961394070Z [2024-05-26T01:28:02.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:26:00+00:00, run_id=scheduled__2024-05-26T01:26:00+00:00, run_start_date=2024-05-26 01:28:00.149605+00:00, run_end_date=2024-05-26 01:28:02.961049+00:00, run_duration=2.811444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:26:00+00:00, data_interval_end=2024-05-26 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:28:02.984874757Z [2024-05-26T01:28:02.984+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:28:03.001072010Z [2024-05-26T01:28:03.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:28:03.004279150Z [2024-05-26T01:28:03.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:27:00+00:00, run_id=scheduled__2024-05-26T01:27:00+00:00, run_start_date=2024-05-26 01:28:00.150917+00:00, run_end_date=2024-05-26 01:28:03.003804+00:00, run_duration=2.852887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:27:00+00:00, data_interval_end=2024-05-26 01:28:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:28:03.022049651Z [2024-05-26T01:28:03.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:03.147954352Z [2024-05-26T01:28:03.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:26:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:03.148073214Z [2024-05-26T01:28:03.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:03.169379781Z [2024-05-26T01:28:03.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:27:00+00:00, map_index=-1, run_start_date=2024-05-26 01:28:01.912078+00:00, run_end_date=2024-05-26 01:28:02.305634+00:00, run_duration=0.393556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:28:00.274253+00:00, queued_by_job_id=1, pid=10823 2024-05-26T01:28:03.169406941Z [2024-05-26T01:28:03.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:26:00+00:00, map_index=-1, run_start_date=2024-05-26 01:28:01.912376+00:00, run_end_date=2024-05-26 01:28:02.351190+00:00, run_duration=0.438814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:28:00.274253+00:00, queued_by_job_id=1, pid=10822 2024-05-26T01:28:05.409130681Z [2024-05-26T01:28:05.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:28:05.409555115Z [2024-05-26T01:28:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:27:00+00:00, run_id=scheduled__2024-05-26T01:27:00+00:00, run_start_date=2024-05-26 01:28:00.152483+00:00, run_end_date=2024-05-26 01:28:05.409253+00:00, run_duration=5.25677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:27:00+00:00, data_interval_end=2024-05-26 01:28:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:28:05.424039030Z [2024-05-26T01:28:05.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:05.464125921Z [2024-05-26T01:28:05.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:28:05.464514905Z [2024-05-26T01:28:05.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:20:00+00:00, run_id=scheduled__2024-05-26T01:20:00+00:00, run_start_date=2024-05-26 01:27:53.969912+00:00, run_end_date=2024-05-26 01:28:05.464224+00:00, run_duration=11.494312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:20:00+00:00, data_interval_end=2024-05-26 01:25:00+00:00, dag_hash=e3e0b69853c6b56ab83240eca5a9619c 2024-05-26T01:28:05.477840346Z [2024-05-26T01:28:05.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:25:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:28:05.593561626Z [2024-05-26T01:28:05.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.send_prometheus run_id=scheduled__2024-05-26T01:20:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:05.607641618Z [2024-05-26T01:28:05.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:20:00+00:00, map_index=-1, run_start_date=2024-05-26 01:28:04.447486+00:00, run_end_date=2024-05-26 01:28:04.998669+00:00, run_duration=0.551183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:28:01.386973+00:00, queued_by_job_id=1, pid=10882 2024-05-26T01:28:06.655006950Z [2024-05-26T01:28:06.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:28:06.655367271Z [2024-05-26T01:28:06.655+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:27:00+00:00, run_id=scheduled__2024-05-26T01:27:00+00:00, run_start_date=2024-05-26 01:28:00.152806+00:00, run_end_date=2024-05-26 01:28:06.655109+00:00, run_duration=6.502303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:27:00+00:00, data_interval_end=2024-05-26 01:28:00+00:00, dag_hash=187a211aa4842d4763bc278f12d8463e 2024-05-26T01:28:06.665259207Z [2024-05-26T01:28:06.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:06.671406504Z [2024-05-26T01:28:06.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:28:06.671933745Z [2024-05-26T01:28:06.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:27:00+00:00, run_id=scheduled__2024-05-26T01:27:00+00:00, run_start_date=2024-05-26 01:28:00.151252+00:00, run_end_date=2024-05-26 01:28:06.671489+00:00, run_duration=6.520237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:27:00+00:00, data_interval_end=2024-05-26 01:28:00+00:00, dag_hash=81c70710dce1bba7b0da9402cf491ea7 2024-05-26T01:28:06.680846316Z [2024-05-26T01:28:06.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:06.687140557Z [2024-05-26T01:28:06.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:28:06.687476204Z [2024-05-26T01:28:06.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:27:00+00:00, run_id=scheduled__2024-05-26T01:27:00+00:00, run_start_date=2024-05-26 01:28:00.153935+00:00, run_end_date=2024-05-26 01:28:06.687225+00:00, run_duration=6.53329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:27:00+00:00, data_interval_end=2024-05-26 01:28:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:28:06.696047783Z [2024-05-26T01:28:06.695+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:28:00+00:00, run_after=2024-05-26T01:29:00+00:00 2024-05-26T01:28:06.740180068Z [2024-05-26T01:28:06.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:06.740346764Z [2024-05-26T01:28:06.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:06.740501755Z [2024-05-26T01:28:06.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:06.740629416Z [2024-05-26T01:28:06.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:27:00+00:00 exited with status success for try_number 1 2024-05-26T01:28:06.749628222Z [2024-05-26T01:28:06.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:27:00+00:00, map_index=-1, run_start_date=2024-05-26 01:28:04.404598+00:00, run_end_date=2024-05-26 01:28:06.325395+00:00, run_duration=1.920797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:28:00.274253+00:00, queued_by_job_id=1, pid=10881 2024-05-26T01:28:06.750207521Z [2024-05-26T01:28:06.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:27:00+00:00, map_index=-1, run_start_date=2024-05-26 01:28:03.140506+00:00, run_end_date=2024-05-26 01:28:05.359131+00:00, run_duration=2.218625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:28:00.274253+00:00, queued_by_job_id=1, pid=10848 2024-05-26T01:28:06.750580553Z [2024-05-26T01:28:06.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:27:00+00:00, map_index=-1, run_start_date=2024-05-26 01:28:03.283164+00:00, run_end_date=2024-05-26 01:28:05.822306+00:00, run_duration=2.539142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:28:00.274253+00:00, queued_by_job_id=1, pid=10851 2024-05-26T01:28:06.751014160Z [2024-05-26T01:28:06.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:27:00+00:00, map_index=-1, run_start_date=2024-05-26 01:28:03.658027+00:00, run_end_date=2024-05-26 01:28:05.841099+00:00, run_duration=2.183072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:28:00.274253+00:00, queued_by_job_id=1, pid=10860 2024-05-26T01:28:32.478088308Z [2024-05-26T01:28:32.477+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:29:00.978253463Z [2024-05-26T01:29:00.977+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:29:00.998369076Z [2024-05-26T01:29:00.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:29:01.009086960Z [2024-05-26T01:29:01.008+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:29:01.023593224Z [2024-05-26T01:29:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:29:01.036452855Z [2024-05-26T01:29:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:29:01.155354036Z [2024-05-26T01:29:01.154+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T01:29:01.155370569Z 2024-05-26T01:29:01.155376569Z 2024-05-26T01:29:01.155382199Z 2024-05-26T01:29:01.155387902Z 2024-05-26T01:29:01.155393784Z 2024-05-26T01:29:01.155406905Z [2024-05-26T01:29:01.155+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:29:01.155593360Z [2024-05-26T01:29:01.155+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:29:01.155754905Z [2024-05-26T01:29:01.155+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:29:01.155884459Z [2024-05-26T01:29:01.155+0000] {scheduler_job.py:425} INFO - DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:29:01.155992648Z [2024-05-26T01:29:01.155+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:29:01.156707321Z [2024-05-26T01:29:01.156+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:29:01.156714147Z 2024-05-26T01:29:01.156719004Z 2024-05-26T01:29:01.156736109Z 2024-05-26T01:29:01.156740947Z 2024-05-26T01:29:01.156757725Z 2024-05-26T01:29:01.160845531Z [2024-05-26T01:29:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:29:01.160868346Z [2024-05-26T01:29:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:29:01.160992458Z [2024-05-26T01:29:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:29:01.161005577Z [2024-05-26T01:29:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:29:01.161218569Z [2024-05-26T01:29:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:29:01.161255871Z [2024-05-26T01:29:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:29:01.161426878Z [2024-05-26T01:29:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:29:01.161483802Z [2024-05-26T01:29:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:29:01.161660075Z [2024-05-26T01:29:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:29:01.161710085Z [2024-05-26T01:29:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:29:01.738004470Z [2024-05-26T01:29:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 1 2024-05-26T01:29:01.738168837Z [2024-05-26T01:29:01.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 1 2024-05-26T01:29:01.738215973Z [2024-05-26T01:29:01.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 1 2024-05-26T01:29:01.738289393Z [2024-05-26T01:29:01.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 1 2024-05-26T01:29:01.738337979Z [2024-05-26T01:29:01.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 1 2024-05-26T01:29:01.755191262Z [2024-05-26T01:29:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58b44cd6-e8be-4596-9ca2-7e4caf74e32e 2024-05-26T01:29:01.755218421Z [2024-05-26T01:29:01.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75d73903-c067-4485-a20a-57ee15d02a75 2024-05-26T01:29:01.755359001Z [2024-05-26T01:29:01.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef437cd1-290f-4d1f-becb-8618739124b0 2024-05-26T01:29:01.755534598Z [2024-05-26T01:29:01.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86f2ff77-5c24-4042-ac42-d553c8566205 2024-05-26T01:29:01.755815456Z [2024-05-26T01:29:01.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10ed788b-9cfa-486b-b2c7-637222326a86 2024-05-26T01:29:02.867403993Z [2024-05-26T01:29:02.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:29:02.870661184Z [2024-05-26T01:29:02.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:28:00+00:00, run_id=scheduled__2024-05-26T01:28:00+00:00, run_start_date=2024-05-26 01:29:01.051668+00:00, run_end_date=2024-05-26 01:29:02.867321+00:00, run_duration=1.815653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:28:00+00:00, data_interval_end=2024-05-26 01:29:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:29:02.887660943Z [2024-05-26T01:29:02.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:29:03.032170326Z [2024-05-26T01:29:03.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status success for try_number 1 2024-05-26T01:29:03.042384111Z [2024-05-26T01:29:03.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=2024-05-26 01:29:02.089451+00:00, run_end_date=2024-05-26 01:29:02.496979+00:00, run_duration=0.407528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:29:01.157526+00:00, queued_by_job_id=1, pid=10911 2024-05-26T01:29:03.727556460Z [2024-05-26T01:29:03.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status failed for try_number 1 2024-05-26T01:29:03.727606135Z [2024-05-26T01:29:03.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status failed for try_number 1 2024-05-26T01:29:03.733719176Z [2024-05-26T01:29:03.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:29:01.157526+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:29:03.734183213Z [2024-05-26T01:29:03.733+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:03.736254704Z [2024-05-26T01:29:03.736+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:03.751250797Z [2024-05-26T01:29:03.751+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240526T012800, start_date=, end_date=20240526T012903 2024-05-26T01:29:03.760735639Z [2024-05-26T01:29:03.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:29:01.157526+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:29:03.761180450Z [2024-05-26T01:29:03.760+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:03.766860869Z [2024-05-26T01:29:03.766+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:03.784622442Z [2024-05-26T01:29:03.784+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240526T012800, start_date=, end_date=20240526T012903 2024-05-26T01:29:05.975162334Z [2024-05-26T01:29:05.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:29:05.975280774Z [2024-05-26T01:29:05.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:28:00+00:00, run_id=scheduled__2024-05-26T01:28:00+00:00, run_start_date=2024-05-26 01:29:01.056728+00:00, run_end_date=2024-05-26 01:29:05.975028+00:00, run_duration=4.9183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:28:00+00:00, data_interval_end=2024-05-26 01:29:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:29:05.984880758Z [2024-05-26T01:29:05.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:29:05.991864923Z [2024-05-26T01:29:05.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:29:05.992002774Z [2024-05-26T01:29:05.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:28:00+00:00, run_id=scheduled__2024-05-26T01:28:00+00:00, run_start_date=2024-05-26 01:29:01.054204+00:00, run_end_date=2024-05-26 01:29:05.991736+00:00, run_duration=4.937532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:28:00+00:00, data_interval_end=2024-05-26 01:29:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:29:06.001847681Z [2024-05-26T01:29:06.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:29:06.065985709Z [2024-05-26T01:29:06.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status success for try_number 1 2024-05-26T01:29:06.066309077Z [2024-05-26T01:29:06.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status success for try_number 1 2024-05-26T01:29:06.075742741Z [2024-05-26T01:29:06.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=2024-05-26 01:29:03.635669+00:00, run_end_date=2024-05-26 01:29:05.041271+00:00, run_duration=1.405602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:29:01.157526+00:00, queued_by_job_id=1, pid=10951 2024-05-26T01:29:06.076251587Z [2024-05-26T01:29:06.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=2024-05-26 01:29:03.706651+00:00, run_end_date=2024-05-26 01:29:05.489664+00:00, run_duration=1.783013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:29:01.157526+00:00, queued_by_job_id=1, pid=10952 2024-05-26T01:29:13.898108210Z [2024-05-26T01:29:13.897+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-26T01:29:13.898131697Z 2024-05-26T01:29:13.898135322Z 2024-05-26T01:29:13.898159140Z [2024-05-26T01:29:13.897+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:29:13.898206577Z [2024-05-26T01:29:13.898+0000] {scheduler_job.py:425} INFO - DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:29:13.898892959Z [2024-05-26T01:29:13.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:29:13.898906025Z 2024-05-26T01:29:13.898909454Z 2024-05-26T01:29:13.902377315Z [2024-05-26T01:29:13.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:29:13.902496795Z [2024-05-26T01:29:13.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:29:13.902756830Z [2024-05-26T01:29:13.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:29:13.902866196Z [2024-05-26T01:29:13.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:29:14.127760631Z [2024-05-26T01:29:14.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 2 2024-05-26T01:29:14.127919270Z [2024-05-26T01:29:14.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 2 2024-05-26T01:29:14.141171229Z [2024-05-26T01:29:14.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to da584aac-c13c-4a18-bd73-932aff9f314f 2024-05-26T01:29:14.141323725Z [2024-05-26T01:29:14.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4797a98-3850-44a5-9f6b-32b40513b0e1 2024-05-26T01:29:16.493096440Z [2024-05-26T01:29:16.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status failed for try_number 2 2024-05-26T01:29:16.493124670Z [2024-05-26T01:29:16.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status failed for try_number 2 2024-05-26T01:29:16.502239471Z [2024-05-26T01:29:16.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-26 01:29:03.738435+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:29:13.899947+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:29:16.502689871Z [2024-05-26T01:29:16.502+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:16.505421870Z [2024-05-26T01:29:16.505+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:16.522531499Z [2024-05-26T01:29:16.521+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240526T012800, start_date=, end_date=20240526T012916 2024-05-26T01:29:16.532957058Z [2024-05-26T01:29:16.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-26 01:29:03.769214+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:29:13.899947+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:29:16.533234178Z [2024-05-26T01:29:16.532+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:16.535849863Z [2024-05-26T01:29:16.535+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:29:16.554276714Z [2024-05-26T01:29:16.553+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240526T012800, start_date=, end_date=20240526T012916 2024-05-26T01:29:17.615298071Z [2024-05-26T01:29:17.614+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-26T01:29:17.615784444Z [2024-05-26T01:29:17.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:28:00+00:00, run_id=scheduled__2024-05-26T01:28:00+00:00, run_start_date=2024-05-26 01:29:01.053096+00:00, run_end_date=2024-05-26 01:29:17.615200+00:00, run_duration=16.562104, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:28:00+00:00, data_interval_end=2024-05-26 01:29:00+00:00, dag_hash=81c70710dce1bba7b0da9402cf491ea7 2024-05-26T01:29:17.624612002Z [2024-05-26T01:29:17.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:29:17.632136572Z [2024-05-26T01:29:17.631+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-26T01:29:17.632401817Z [2024-05-26T01:29:17.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:28:00+00:00, run_id=scheduled__2024-05-26T01:28:00+00:00, run_start_date=2024-05-26 01:29:01.055472+00:00, run_end_date=2024-05-26 01:29:17.632046+00:00, run_duration=16.576574, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:28:00+00:00, data_interval_end=2024-05-26 01:29:00+00:00, dag_hash=187a211aa4842d4763bc278f12d8463e 2024-05-26T01:29:17.653706409Z [2024-05-26T01:29:17.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:29:00+00:00, run_after=2024-05-26T01:30:00+00:00 2024-05-26T01:30:00.126989125Z [2024-05-26T01:30:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:31:00+00:00 2024-05-26T01:30:00.135778693Z [2024-05-26T01:30:00.135+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:30:00.147532106Z [2024-05-26T01:30:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:30:00.159213171Z [2024-05-26T01:30:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:31:00+00:00 2024-05-26T01:30:00.166438207Z [2024-05-26T01:30:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:30:00.186229893Z [2024-05-26T01:30:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:30:00.200551701Z [2024-05-26T01:30:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:31:00+00:00 2024-05-26T01:30:00.374234192Z [2024-05-26T01:30:00.373+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-05-26T01:30:00.374261548Z 2024-05-26T01:30:00.374267142Z 2024-05-26T01:30:00.374271511Z 2024-05-26T01:30:00.374282133Z 2024-05-26T01:30:00.374286485Z 2024-05-26T01:30:00.374290780Z 2024-05-26T01:30:00.374295257Z 2024-05-26T01:30:00.374444398Z [2024-05-26T01:30:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:30:00.374775949Z [2024-05-26T01:30:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:30:00.375024573Z [2024-05-26T01:30:00.374+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:30:00.375304662Z [2024-05-26T01:30:00.375+0000] {scheduler_job.py:425} INFO - DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:30:00.375547708Z [2024-05-26T01:30:00.375+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:30:00.375993414Z [2024-05-26T01:30:00.375+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:30:00.376185171Z [2024-05-26T01:30:00.376+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:30:00.377132200Z [2024-05-26T01:30:00.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:30:00.377146815Z 2024-05-26T01:30:00.377151472Z 2024-05-26T01:30:00.377158183Z 2024-05-26T01:30:00.377162826Z 2024-05-26T01:30:00.377167031Z 2024-05-26T01:30:00.377186102Z 2024-05-26T01:30:00.377191075Z 2024-05-26T01:30:00.382420221Z [2024-05-26T01:30:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:30:00.382596826Z [2024-05-26T01:30:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:00.382867321Z [2024-05-26T01:30:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:30:00.383024068Z [2024-05-26T01:30:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:00.383288002Z [2024-05-26T01:30:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:00.384296742Z [2024-05-26T01:30:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:30:00.384616952Z [2024-05-26T01:30:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:00.384771915Z [2024-05-26T01:30:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:30:00.385043236Z [2024-05-26T01:30:00.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:00.385197680Z [2024-05-26T01:30:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:30:00.385450517Z [2024-05-26T01:30:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:00.385598062Z [2024-05-26T01:30:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:30:00.385842243Z [2024-05-26T01:30:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:00.385990717Z [2024-05-26T01:30:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:30:01.219340200Z [2024-05-26T01:30:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:01.221997524Z [2024-05-26T01:30:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:01.222225558Z [2024-05-26T01:30:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:01.222430921Z [2024-05-26T01:30:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:01.222597981Z [2024-05-26T01:30:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:01.222733887Z [2024-05-26T01:30:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:01.222981275Z [2024-05-26T01:30:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:01.246592286Z [2024-05-26T01:30:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b939261-8d25-4dc0-98a6-ccda971dfc87 2024-05-26T01:30:01.246944176Z [2024-05-26T01:30:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to f39dab68-b2dc-4ded-8671-bda687fdbdf9 2024-05-26T01:30:01.247140361Z [2024-05-26T01:30:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4d309c3-c0f8-44ad-8d95-6732144185e6 2024-05-26T01:30:01.247336527Z [2024-05-26T01:30:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f275b07-3129-451b-807e-9f2b3f6cf6d2 2024-05-26T01:30:01.247644322Z [2024-05-26T01:30:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2452dd1-c52b-4467-b07f-b196baa89ce1 2024-05-26T01:30:01.247930857Z [2024-05-26T01:30:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dea1c92-1213-4a1c-8468-cf3991991cb0 2024-05-26T01:30:01.248128814Z [2024-05-26T01:30:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to 827e15d6-2387-4993-a332-c7a3a9a4b355 2024-05-26T01:30:02.811358046Z [2024-05-26T01:30:02.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:30:02.811813953Z [2024-05-26T01:30:02.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:29:00+00:00, run_id=scheduled__2024-05-26T01:29:00+00:00, run_start_date=2024-05-26 01:30:00.230103+00:00, run_end_date=2024-05-26 01:30:02.811279+00:00, run_duration=2.581176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:29:00+00:00, data_interval_end=2024-05-26 01:30:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:30:02.829942747Z [2024-05-26T01:30:02.829+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:31:00+00:00 2024-05-26T01:30:04.022171440Z [2024-05-26T01:30:04.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:30:04.023068413Z [2024-05-26T01:30:04.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:28:00+00:00, run_id=scheduled__2024-05-26T01:28:00+00:00, run_start_date=2024-05-26 01:30:00.225463+00:00, run_end_date=2024-05-26 01:30:04.022133+00:00, run_duration=3.79667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:28:00+00:00, data_interval_end=2024-05-26 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:30:04.073041223Z [2024-05-26T01:30:04.072+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:32:00+00:00 2024-05-26T01:30:04.340071718Z [2024-05-26T01:30:04.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status failed for try_number 1 2024-05-26T01:30:04.340270800Z [2024-05-26T01:30:04.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:28:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:04.340422710Z [2024-05-26T01:30:04.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:04.348182024Z [2024-05-26T01:30:04.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:28:00+00:00, map_index=-1, run_start_date=2024-05-26 01:30:01.873498+00:00, run_end_date=2024-05-26 01:30:02.943896+00:00, run_duration=1.070398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:00.379025+00:00, queued_by_job_id=1, pid=11012 2024-05-26T01:30:04.348514232Z [2024-05-26T01:30:04.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:29:00+00:00, map_index=-1, run_start_date=2024-05-26 01:30:02.148572+00:00, run_end_date=2024-05-26 01:30:02.590990+00:00, run_duration=0.442418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:00.379025+00:00, queued_by_job_id=1, pid=11013 2024-05-26T01:30:04.348870304Z [2024-05-26T01:30:04.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:00.379025+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:30:04.349446650Z [2024-05-26T01:30:04.349+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:04.351834589Z [2024-05-26T01:30:04.351+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:04.366824668Z [2024-05-26T01:30:04.366+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=extract_metrics_from_vnfrs, execution_date=20240526T012500, start_date=, end_date=20240526T013004 2024-05-26T01:30:05.816179388Z [2024-05-26T01:30:05.815+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:30:05.816229177Z 2024-05-26T01:30:05.816369415Z [2024-05-26T01:30:05.816+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:30:05.817029882Z [2024-05-26T01:30:05.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:30:05.817043944Z 2024-05-26T01:30:05.819288592Z [2024-05-26T01:30:05.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:30:05.819551632Z [2024-05-26T01:30:05.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:05.900303155Z [2024-05-26T01:30:05.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:05.903915632Z [2024-05-26T01:30:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:05.904050745Z [2024-05-26T01:30:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status failed for try_number 1 2024-05-26T01:30:05.925181359Z [2024-05-26T01:30:05.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:29:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:00.379025+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:30:05.932345971Z [2024-05-26T01:30:05.932+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:05.984151590Z [2024-05-26T01:30:05.983+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:06.037086403Z [2024-05-26T01:30:06.036+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240526T012900, start_date=, end_date=20240526T013005 2024-05-26T01:30:06.067082609Z [2024-05-26T01:30:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=2024-05-26 01:30:03.822422+00:00, run_end_date=2024-05-26 01:30:04.816503+00:00, run_duration=0.994081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:00.379025+00:00, queued_by_job_id=1, pid=11044 2024-05-26T01:30:06.067219634Z [2024-05-26T01:30:06.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to f10c4536-2316-4db9-9522-b2b5a5dffdd6 2024-05-26T01:30:06.416378395Z [2024-05-26T01:30:06.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:06.434477322Z [2024-05-26T01:30:06.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:29:00+00:00, map_index=-1, run_start_date=2024-05-26 01:30:04.192252+00:00, run_end_date=2024-05-26 01:30:06.103108+00:00, run_duration=1.910856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:00.379025+00:00, queued_by_job_id=1, pid=11050 2024-05-26T01:30:07.327196925Z [2024-05-26T01:30:07.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:30:07.327704648Z [2024-05-26T01:30:07.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:29:00+00:00, run_id=scheduled__2024-05-26T01:29:00+00:00, run_start_date=2024-05-26 01:30:00.227329+00:00, run_end_date=2024-05-26 01:30:07.327110+00:00, run_duration=7.099781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:29:00+00:00, data_interval_end=2024-05-26 01:30:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:30:07.336760816Z [2024-05-26T01:30:07.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:31:00+00:00 2024-05-26T01:30:07.343045811Z [2024-05-26T01:30:07.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:30:07.343384664Z [2024-05-26T01:30:07.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:29:00+00:00, run_id=scheduled__2024-05-26T01:29:00+00:00, run_start_date=2024-05-26 01:30:00.228847+00:00, run_end_date=2024-05-26 01:30:07.342837+00:00, run_duration=7.11399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:29:00+00:00, data_interval_end=2024-05-26 01:30:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:30:07.352493562Z [2024-05-26T01:30:07.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:31:00+00:00 2024-05-26T01:30:07.427660016Z [2024-05-26T01:30:07.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:07.434609159Z [2024-05-26T01:30:07.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:29:00+00:00, map_index=-1, run_start_date=2024-05-26 01:30:04.864667+00:00, run_end_date=2024-05-26 01:30:06.251155+00:00, run_duration=1.386488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:00.379025+00:00, queued_by_job_id=1, pid=11076 2024-05-26T01:30:08.524164586Z [2024-05-26T01:30:08.523+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:30:08.524205145Z 2024-05-26T01:30:08.524219060Z [2024-05-26T01:30:08.524+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:30:08.524653992Z [2024-05-26T01:30:08.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:30:08.524659892Z 2024-05-26T01:30:08.526708181Z [2024-05-26T01:30:08.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:30:08.526771657Z [2024-05-26T01:30:08.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:30:08.591260526Z [2024-05-26T01:30:08.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:08.591575220Z [2024-05-26T01:30:08.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:08.601394892Z [2024-05-26T01:30:08.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 200ed808-49e1-4e3e-903d-64216a903de1 2024-05-26T01:30:08.601678712Z [2024-05-26T01:30:08.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=2024-05-26 01:30:07.686408+00:00, run_end_date=2024-05-26 01:30:08.068087+00:00, run_duration=0.381679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:05.817422+00:00, queued_by_job_id=1, pid=11089 2024-05-26T01:30:08.713905339Z [2024-05-26T01:30:08.713+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:30:08.713940777Z 2024-05-26T01:30:08.713953461Z [2024-05-26T01:30:08.713+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-05-26T01:30:08.714751173Z [2024-05-26T01:30:08.714+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:30:08.714759995Z 2024-05-26T01:30:08.718169497Z [2024-05-26T01:30:08.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240526013007_378503', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:08.718326820Z [2024-05-26T01:30:08.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240526013007_378503', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-26T01:30:08.783102684Z [2024-05-26T01:30:08.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240526013007_378503 exited with status queued for try_number 1 2024-05-26T01:30:08.788166502Z [2024-05-26T01:30:08.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5479c48-7916-4ac2-bdc7-49d97be34253 2024-05-26T01:30:10.692144304Z [2024-05-26T01:30:10.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:30:10.693316431Z [2024-05-26T01:30:10.692+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-05-26 01:30:07.991626+00:00, run_id=vdu_down_20240526013007_378503, run_start_date=2024-05-26 01:30:08.642041+00:00, run_end_date=2024-05-26 01:30:10.692044+00:00, run_duration=2.050003, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-26 01:30:07.991626+00:00, data_interval_end=2024-05-26 01:30:07.991626+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-05-26T01:30:10.696864330Z [2024-05-26T01:30:10.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-05-26T01:30:10.792529489Z [2024-05-26T01:30:10.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240526013007_378503 exited with status success for try_number 1 2024-05-26T01:30:10.796543879Z [2024-05-26T01:30:10.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240526013007_378503, map_index=-1, run_start_date=2024-05-26 01:30:09.410566+00:00, run_end_date=2024-05-26 01:30:09.838221+00:00, run_duration=0.427655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:08.715229+00:00, queued_by_job_id=1, pid=11092 2024-05-26T01:30:11.885634913Z [2024-05-26T01:30:11.885+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:30:11.885673066Z 2024-05-26T01:30:11.885684577Z [2024-05-26T01:30:11.885+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:30:11.886131396Z [2024-05-26T01:30:11.885+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:30:11.886159577Z 2024-05-26T01:30:11.888694647Z [2024-05-26T01:30:11.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:11.888780061Z [2024-05-26T01:30:11.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:11.940408804Z [2024-05-26T01:30:11.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 1 2024-05-26T01:30:11.940434680Z [2024-05-26T01:30:11.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:11.946698188Z [2024-05-26T01:30:11.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to db528017-8a36-423e-ac3e-c8a0404ada82 2024-05-26T01:30:11.946775776Z [2024-05-26T01:30:11.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=0, run_start_date=2024-05-26 01:30:10.371019+00:00, run_end_date=2024-05-26 01:30:10.744559+00:00, run_duration=0.37354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:08.524948+00:00, queued_by_job_id=1, pid=11104 2024-05-26T01:30:14.221591537Z [2024-05-26T01:30:14.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:30:14.222166583Z [2024-05-26T01:30:14.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:25:00+00:00, run_id=scheduled__2024-05-26T01:25:00+00:00, run_start_date=2024-05-26 01:30:00.223490+00:00, run_end_date=2024-05-26 01:30:14.221707+00:00, run_duration=13.998217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:25:00+00:00, data_interval_end=2024-05-26 01:30:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:30:14.228893013Z [2024-05-26T01:30:14.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:30:14.275078196Z [2024-05-26T01:30:14.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status success for try_number 1 2024-05-26T01:30:14.280679708Z [2024-05-26T01:30:14.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=2024-05-26 01:30:13.581284+00:00, run_end_date=2024-05-26 01:30:14.015707+00:00, run_duration=0.434423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:11.886409+00:00, queued_by_job_id=1, pid=11112 2024-05-26T01:30:14.717195127Z [2024-05-26T01:30:14.716+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:30:14.717240681Z 2024-05-26T01:30:14.717267034Z [2024-05-26T01:30:14.717+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:30:14.718016005Z [2024-05-26T01:30:14.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:30:14.718035235Z 2024-05-26T01:30:14.720178411Z [2024-05-26T01:30:14.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:25:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:30:14.720347816Z [2024-05-26T01:30:14.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:30:14.778510498Z [2024-05-26T01:30:14.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status queued for try_number 2 2024-05-26T01:30:14.787722665Z [2024-05-26T01:30:14.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dc5fa2f-347c-4e46-965e-a31ac67f07bd 2024-05-26T01:30:17.075749437Z [2024-05-26T01:30:17.075+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:30:17.075803101Z 2024-05-26T01:30:17.075846939Z [2024-05-26T01:30:17.075+0000] {scheduler_job.py:425} INFO - DAG vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 has 0/16 running and queued tasks 2024-05-26T01:30:17.077194533Z [2024-05-26T01:30:17.076+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:30:17.077223323Z 2024-05-26T01:30:17.082724195Z [2024-05-26T01:30:17.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:29:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:30:17.083042430Z [2024-05-26T01:30:17.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:30:17.136319746Z [2024-05-26T01:30:17.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status queued for try_number 2 2024-05-26T01:30:17.136530909Z [2024-05-26T01:30:17.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:25:00+00:00 exited with status failed for try_number 2 2024-05-26T01:30:17.143211663Z [2024-05-26T01:30:17.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e6abc34-4866-4af7-9130-cf6afb5c78ac 2024-05-26T01:30:17.143419492Z [2024-05-26T01:30:17.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:25:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-26 01:30:04.354186+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:14.718359+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:30:17.143951272Z [2024-05-26T01:30:17.143+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:17.147752351Z [2024-05-26T01:30:17.147+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:17.164370570Z [2024-05-26T01:30:17.164+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=extract_metrics_from_vnfrs, execution_date=20240526T012500, start_date=, end_date=20240526T013017 2024-05-26T01:30:19.505261639Z [2024-05-26T01:30:19.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:29:00+00:00 exited with status failed for try_number 2 2024-05-26T01:30:19.512696021Z [2024-05-26T01:30:19.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:29:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-05-26 01:30:05.992938+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:30:17.078605+00:00, queued_by_job_id=1, pid=None 2024-05-26T01:30:19.513291432Z [2024-05-26T01:30:19.512+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:19.515385082Z [2024-05-26T01:30:19.515+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-05-26T01:30:19.538081692Z [2024-05-26T01:30:19.537+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240526T012900, start_date=, end_date=20240526T013019 2024-05-26T01:30:19.848516900Z [2024-05-26T01:30:19.848+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-26T01:30:19.848893831Z [2024-05-26T01:30:19.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:25:00+00:00, run_id=scheduled__2024-05-26T01:25:00+00:00, run_start_date=2024-05-26 01:30:00.220959+00:00, run_end_date=2024-05-26 01:30:19.848598+00:00, run_duration=19.627639, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:25:00+00:00, data_interval_end=2024-05-26 01:30:00+00:00, dag_hash=e3e0b69853c6b56ab83240eca5a9619c 2024-05-26T01:30:19.854864178Z [2024-05-26T01:30:19.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:30:19.864195486Z [2024-05-26T01:30:19.863+0000] {dagrun.py:586} ERROR - Marking run failed 2024-05-26T01:30:19.864490777Z [2024-05-26T01:30:19.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6, execution_date=2024-05-26 01:29:00+00:00, run_id=scheduled__2024-05-26T01:29:00+00:00, run_start_date=2024-05-26 01:30:00.231371+00:00, run_end_date=2024-05-26 01:30:19.864175+00:00, run_duration=19.632804, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:29:00+00:00, data_interval_end=2024-05-26 01:30:00+00:00, dag_hash=81c70710dce1bba7b0da9402cf491ea7 2024-05-26T01:30:19.874096767Z [2024-05-26T01:30:19.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_1c5e6c00-103b-4c0a-ae4f-0a75d96df2d6 to 2024-05-26T01:30:00+00:00, run_after=2024-05-26T01:31:00+00:00 2024-05-26T01:31:00.425842641Z [2024-05-26T01:31:00.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:31:00+00:00, run_after=2024-05-26T01:32:00+00:00 2024-05-26T01:31:00.434115539Z [2024-05-26T01:31:00.433+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:31:00.446090246Z [2024-05-26T01:31:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:31:00+00:00, run_after=2024-05-26T01:32:00+00:00 2024-05-26T01:31:00.810198309Z [2024-05-26T01:31:00.809+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:31:00.810239492Z 2024-05-26T01:31:00.810245138Z 2024-05-26T01:31:00.810254428Z 2024-05-26T01:31:00.810258992Z [2024-05-26T01:31:00.809+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:31:00.810553864Z [2024-05-26T01:31:00.810+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:31:00.810840850Z [2024-05-26T01:31:00.810+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:31:00.811650588Z [2024-05-26T01:31:00.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:31:00.811688780Z 2024-05-26T01:31:00.811694802Z 2024-05-26T01:31:00.811699235Z 2024-05-26T01:31:00.815781523Z [2024-05-26T01:31:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:31:00.816156496Z [2024-05-26T01:31:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:31:00.816587764Z [2024-05-26T01:31:00.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:31:00.816836919Z [2024-05-26T01:31:00.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:31:00.817241489Z [2024-05-26T01:31:00.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:31:00.817503701Z [2024-05-26T01:31:00.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:31:01.073612643Z [2024-05-26T01:31:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:31:01.073642451Z [2024-05-26T01:31:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:31:01.073654841Z [2024-05-26T01:31:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:31:01.080741162Z [2024-05-26T01:31:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37db8514-a860-41cf-b1e3-635f522cafca 2024-05-26T01:31:01.080788831Z [2024-05-26T01:31:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6029ede8-e103-4a6e-9f27-515d13602f36 2024-05-26T01:31:01.080891994Z [2024-05-26T01:31:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51483db9-3b0c-4d9c-9231-80731d85bef3 2024-05-26T01:31:02.300135317Z [2024-05-26T01:31:02.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:31:02.300290545Z [2024-05-26T01:31:02.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:30:00+00:00, run_id=scheduled__2024-05-26T01:30:00+00:00, run_start_date=2024-05-26 01:31:00.461748+00:00, run_end_date=2024-05-26 01:31:02.299958+00:00, run_duration=1.83821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:30:00+00:00, data_interval_end=2024-05-26 01:31:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:31:02.310827924Z [2024-05-26T01:31:02.310+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:31:00+00:00, run_after=2024-05-26T01:32:00+00:00 2024-05-26T01:31:02.408352485Z [2024-05-26T01:31:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:31:02.425991278Z [2024-05-26T01:31:02.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=-1, run_start_date=2024-05-26 01:31:01.643654+00:00, run_end_date=2024-05-26 01:31:02.089178+00:00, run_duration=0.445524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:31:00.812591+00:00, queued_by_job_id=1, pid=11158 2024-05-26T01:31:04.580294525Z [2024-05-26T01:31:04.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:31:04.580415042Z [2024-05-26T01:31:04.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:30:00+00:00, run_id=scheduled__2024-05-26T01:30:00+00:00, run_start_date=2024-05-26 01:31:00.467793+00:00, run_end_date=2024-05-26 01:31:04.580165+00:00, run_duration=4.112372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:30:00+00:00, data_interval_end=2024-05-26 01:31:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:31:04.593896786Z [2024-05-26T01:31:04.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:31:00+00:00, run_after=2024-05-26T01:32:00+00:00 2024-05-26T01:31:04.632799876Z [2024-05-26T01:31:04.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:31:04.637752128Z [2024-05-26T01:31:04.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=-1, run_start_date=2024-05-26 01:31:02.536739+00:00, run_end_date=2024-05-26 01:31:04.329315+00:00, run_duration=1.792576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:31:00.812591+00:00, queued_by_job_id=1, pid=11176 2024-05-26T01:31:05.144870168Z [2024-05-26T01:31:05.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:31:05.145605360Z [2024-05-26T01:31:05.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:30:00+00:00, run_id=scheduled__2024-05-26T01:30:00+00:00, run_start_date=2024-05-26 01:31:00.469956+00:00, run_end_date=2024-05-26 01:31:05.145033+00:00, run_duration=4.675077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:30:00+00:00, data_interval_end=2024-05-26 01:31:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:31:05.162502541Z [2024-05-26T01:31:05.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:31:00+00:00, run_after=2024-05-26T01:32:00+00:00 2024-05-26T01:31:05.206403954Z [2024-05-26T01:31:05.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:31:05.211230399Z [2024-05-26T01:31:05.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=-1, run_start_date=2024-05-26 01:31:02.600862+00:00, run_end_date=2024-05-26 01:31:04.806703+00:00, run_duration=2.205841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:31:00.812591+00:00, queued_by_job_id=1, pid=11177 2024-05-26T01:32:00.073036698Z [2024-05-26T01:32:00.072+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:32:00.092038713Z [2024-05-26T01:32:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:32:00+00:00, run_after=2024-05-26T01:33:00+00:00 2024-05-26T01:32:00.101900044Z [2024-05-26T01:32:00.101+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:32:00.117439498Z [2024-05-26T01:32:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:32:00+00:00, run_after=2024-05-26T01:33:00+00:00 2024-05-26T01:32:00.225383388Z [2024-05-26T01:32:00.224+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:32:00.225430702Z 2024-05-26T01:32:00.225442040Z 2024-05-26T01:32:00.225463605Z 2024-05-26T01:32:00.225472886Z 2024-05-26T01:32:00.226272331Z [2024-05-26T01:32:00.225+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:32:00.226857078Z [2024-05-26T01:32:00.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:32:00.227331237Z [2024-05-26T01:32:00.227+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:32:00.227862587Z [2024-05-26T01:32:00.227+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:32:00.229656760Z [2024-05-26T01:32:00.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:32:00.229672310Z 2024-05-26T01:32:00.229676186Z 2024-05-26T01:32:00.229679250Z 2024-05-26T01:32:00.229682452Z 2024-05-26T01:32:00.236380157Z [2024-05-26T01:32:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:32:00.236692866Z [2024-05-26T01:32:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:32:00.237336755Z [2024-05-26T01:32:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:32:00.237605346Z [2024-05-26T01:32:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:32:00.238052022Z [2024-05-26T01:32:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:32:00.238364758Z [2024-05-26T01:32:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:32:00.238869393Z [2024-05-26T01:32:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:32:00.239146220Z [2024-05-26T01:32:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:32:00.813378817Z [2024-05-26T01:32:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:32:00.813400423Z [2024-05-26T01:32:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:31:00+00:00 exited with status queued for try_number 1 2024-05-26T01:32:00.813416644Z [2024-05-26T01:32:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:31:00+00:00 exited with status queued for try_number 1 2024-05-26T01:32:00.813419896Z [2024-05-26T01:32:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:31:00+00:00 exited with status queued for try_number 1 2024-05-26T01:32:00.819652294Z [2024-05-26T01:32:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 225fb8ca-d698-4a49-8bab-49b92a761613 2024-05-26T01:32:00.819677147Z [2024-05-26T01:32:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to b584988a-fe32-4740-87b3-5022151e0976 2024-05-26T01:32:00.819681132Z [2024-05-26T01:32:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c4d739b-d795-44b9-aadf-8f398787e5cd 2024-05-26T01:32:00.819684278Z [2024-05-26T01:32:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b64abfb-c8cc-42e2-a043-d8b5406560ab 2024-05-26T01:32:01.972445842Z [2024-05-26T01:32:01.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:32:01.973058672Z [2024-05-26T01:32:01.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:30:00+00:00, run_id=scheduled__2024-05-26T01:30:00+00:00, run_start_date=2024-05-26 01:32:00.131907+00:00, run_end_date=2024-05-26 01:32:01.972343+00:00, run_duration=1.840436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:30:00+00:00, data_interval_end=2024-05-26 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:32:01.983387589Z [2024-05-26T01:32:01.983+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:32:00+00:00, run_after=2024-05-26T01:34:00+00:00 2024-05-26T01:32:01.992251822Z [2024-05-26T01:32:01.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:32:01.992406522Z [2024-05-26T01:32:01.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:31:00+00:00, run_id=scheduled__2024-05-26T01:31:00+00:00, run_start_date=2024-05-26 01:32:00.133608+00:00, run_end_date=2024-05-26 01:32:01.992165+00:00, run_duration=1.858557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:31:00+00:00, data_interval_end=2024-05-26 01:32:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:32:02.003187562Z [2024-05-26T01:32:02.002+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:32:00+00:00, run_after=2024-05-26T01:33:00+00:00 2024-05-26T01:32:02.074715490Z [2024-05-26T01:32:02.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:32:02.074921936Z [2024-05-26T01:32:02.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:31:00+00:00 exited with status success for try_number 1 2024-05-26T01:32:02.088199152Z [2024-05-26T01:32:02.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=-1, run_start_date=2024-05-26 01:32:01.106161+00:00, run_end_date=2024-05-26 01:32:01.599287+00:00, run_duration=0.493126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:32:00.232264+00:00, queued_by_job_id=1, pid=11210 2024-05-26T01:32:02.088743298Z [2024-05-26T01:32:02.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:31:00+00:00, map_index=-1, run_start_date=2024-05-26 01:32:01.240774+00:00, run_end_date=2024-05-26 01:32:01.721712+00:00, run_duration=0.480938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:32:00.232264+00:00, queued_by_job_id=1, pid=11211 2024-05-26T01:32:04.270501472Z [2024-05-26T01:32:04.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:32:04.270620624Z [2024-05-26T01:32:04.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:31:00+00:00, run_id=scheduled__2024-05-26T01:31:00+00:00, run_start_date=2024-05-26 01:32:00.134838+00:00, run_end_date=2024-05-26 01:32:04.270363+00:00, run_duration=4.135525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:31:00+00:00, data_interval_end=2024-05-26 01:32:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:32:04.280483613Z [2024-05-26T01:32:04.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:32:00+00:00, run_after=2024-05-26T01:33:00+00:00 2024-05-26T01:32:04.300976165Z [2024-05-26T01:32:04.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:32:04.301721611Z [2024-05-26T01:32:04.301+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:31:00+00:00, run_id=scheduled__2024-05-26T01:31:00+00:00, run_start_date=2024-05-26 01:32:00.136366+00:00, run_end_date=2024-05-26 01:32:04.301226+00:00, run_duration=4.16486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:31:00+00:00, data_interval_end=2024-05-26 01:32:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:32:04.322300573Z [2024-05-26T01:32:04.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:32:00+00:00, run_after=2024-05-26T01:33:00+00:00 2024-05-26T01:32:04.361593988Z [2024-05-26T01:32:04.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:31:00+00:00 exited with status success for try_number 1 2024-05-26T01:32:04.361688461Z [2024-05-26T01:32:04.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:31:00+00:00 exited with status success for try_number 1 2024-05-26T01:32:04.369559936Z [2024-05-26T01:32:04.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:31:00+00:00, map_index=-1, run_start_date=2024-05-26 01:32:02.490018+00:00, run_end_date=2024-05-26 01:32:03.829948+00:00, run_duration=1.33993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:32:00.232264+00:00, queued_by_job_id=1, pid=11235 2024-05-26T01:32:04.369686029Z [2024-05-26T01:32:04.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:31:00+00:00, map_index=-1, run_start_date=2024-05-26 01:32:02.412781+00:00, run_end_date=2024-05-26 01:32:04.013236+00:00, run_duration=1.600455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:32:00.232264+00:00, queued_by_job_id=1, pid=11234 2024-05-26T01:33:00.150149653Z [2024-05-26T01:33:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:33:00+00:00, run_after=2024-05-26T01:34:00+00:00 2024-05-26T01:33:00.160445537Z [2024-05-26T01:33:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:33:00.175452201Z [2024-05-26T01:33:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:33:00+00:00, run_after=2024-05-26T01:34:00+00:00 2024-05-26T01:33:00.247393793Z [2024-05-26T01:33:00.246+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:33:00.247502252Z 2024-05-26T01:33:00.247545120Z 2024-05-26T01:33:00.247557894Z 2024-05-26T01:33:00.247566586Z [2024-05-26T01:33:00.247+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:33:00.247680139Z [2024-05-26T01:33:00.247+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:33:00.247776980Z [2024-05-26T01:33:00.247+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:33:00.248500447Z [2024-05-26T01:33:00.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:33:00.248520774Z 2024-05-26T01:33:00.248555883Z 2024-05-26T01:33:00.248564785Z 2024-05-26T01:33:00.253096829Z [2024-05-26T01:33:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:33:00.253135181Z [2024-05-26T01:33:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:33:00.253289380Z [2024-05-26T01:33:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:33:00.253418681Z [2024-05-26T01:33:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:33:00.253630140Z [2024-05-26T01:33:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:33:00.253743973Z [2024-05-26T01:33:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:33:00.482157920Z [2024-05-26T01:33:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status queued for try_number 1 2024-05-26T01:33:00.482216791Z [2024-05-26T01:33:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status queued for try_number 1 2024-05-26T01:33:00.482251960Z [2024-05-26T01:33:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status queued for try_number 1 2024-05-26T01:33:00.492196196Z [2024-05-26T01:33:00.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ea01081-e9d3-4974-80b9-05f18efdfb8c 2024-05-26T01:33:00.492250538Z [2024-05-26T01:33:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f4e7edb-89bc-4350-b3b4-9f578a6aa422 2024-05-26T01:33:00.492344748Z [2024-05-26T01:33:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 350f51eb-3208-4e39-8d6b-e8d3b19f2e48 2024-05-26T01:33:01.649896595Z [2024-05-26T01:33:01.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:33:01.650181001Z [2024-05-26T01:33:01.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:32:00+00:00, run_id=scheduled__2024-05-26T01:32:00+00:00, run_start_date=2024-05-26 01:33:00.185761+00:00, run_end_date=2024-05-26 01:33:01.649761+00:00, run_duration=1.464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:32:00+00:00, data_interval_end=2024-05-26 01:33:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:33:01.666172090Z [2024-05-26T01:33:01.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:33:00+00:00, run_after=2024-05-26T01:34:00+00:00 2024-05-26T01:33:01.722448499Z [2024-05-26T01:33:01.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status success for try_number 1 2024-05-26T01:33:01.732447024Z [2024-05-26T01:33:01.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:32:00+00:00, map_index=-1, run_start_date=2024-05-26 01:33:01.073606+00:00, run_end_date=2024-05-26 01:33:01.472096+00:00, run_duration=0.39849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:33:00.249332+00:00, queued_by_job_id=1, pid=11267 2024-05-26T01:33:04.235628450Z [2024-05-26T01:33:04.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:33:04.235995766Z [2024-05-26T01:33:04.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:32:00+00:00, run_id=scheduled__2024-05-26T01:32:00+00:00, run_start_date=2024-05-26 01:33:00.187059+00:00, run_end_date=2024-05-26 01:33:04.235468+00:00, run_duration=4.048409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:32:00+00:00, data_interval_end=2024-05-26 01:33:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:33:04.249474556Z [2024-05-26T01:33:04.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:33:00+00:00, run_after=2024-05-26T01:34:00+00:00 2024-05-26T01:33:04.257550949Z [2024-05-26T01:33:04.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:33:04.257967978Z [2024-05-26T01:33:04.257+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:32:00+00:00, run_id=scheduled__2024-05-26T01:32:00+00:00, run_start_date=2024-05-26 01:33:00.188041+00:00, run_end_date=2024-05-26 01:33:04.257459+00:00, run_duration=4.069418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:32:00+00:00, data_interval_end=2024-05-26 01:33:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:33:04.269574504Z [2024-05-26T01:33:04.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:33:00+00:00, run_after=2024-05-26T01:34:00+00:00 2024-05-26T01:33:04.302540421Z [2024-05-26T01:33:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status success for try_number 1 2024-05-26T01:33:04.302804780Z [2024-05-26T01:33:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status success for try_number 1 2024-05-26T01:33:04.309072683Z [2024-05-26T01:33:04.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:32:00+00:00, map_index=-1, run_start_date=2024-05-26 01:33:02.068569+00:00, run_end_date=2024-05-26 01:33:03.747006+00:00, run_duration=1.678437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:33:00.249332+00:00, queued_by_job_id=1, pid=11285 2024-05-26T01:33:04.309305643Z [2024-05-26T01:33:04.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:32:00+00:00, map_index=-1, run_start_date=2024-05-26 01:33:02.171761+00:00, run_end_date=2024-05-26 01:33:03.696679+00:00, run_duration=1.524918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:33:00.249332+00:00, queued_by_job_id=1, pid=11286 2024-05-26T01:33:32.566261615Z [2024-05-26T01:33:32.565+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:34:00.100700685Z [2024-05-26T01:34:00.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:34:00.123266358Z [2024-05-26T01:34:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:34:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:34:00.141528153Z [2024-05-26T01:34:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:34:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:34:00.151319653Z [2024-05-26T01:34:00.150+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:34:00.245231766Z [2024-05-26T01:34:00.244+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:34:00.245269244Z 2024-05-26T01:34:00.245278346Z 2024-05-26T01:34:00.245285685Z 2024-05-26T01:34:00.245292810Z 2024-05-26T01:34:00.245618974Z [2024-05-26T01:34:00.245+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:34:00.245992251Z [2024-05-26T01:34:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:34:00.246308260Z [2024-05-26T01:34:00.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:34:00.246722055Z [2024-05-26T01:34:00.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:34:00.247969612Z [2024-05-26T01:34:00.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:34:00.247987847Z 2024-05-26T01:34:00.247994395Z 2024-05-26T01:34:00.248000060Z 2024-05-26T01:34:00.248005630Z 2024-05-26T01:34:00.257019378Z [2024-05-26T01:34:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:34:00.257289640Z [2024-05-26T01:34:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:34:00.257757752Z [2024-05-26T01:34:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:34:00.257980636Z [2024-05-26T01:34:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:34:00.258473337Z [2024-05-26T01:34:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:34:00.258644569Z [2024-05-26T01:34:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:34:00.259108462Z [2024-05-26T01:34:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:34:00.259290585Z [2024-05-26T01:34:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:34:00.548430432Z [2024-05-26T01:34:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status queued for try_number 1 2024-05-26T01:34:00.548468599Z [2024-05-26T01:34:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:33:00+00:00 exited with status queued for try_number 1 2024-05-26T01:34:00.548498536Z [2024-05-26T01:34:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:33:00+00:00 exited with status queued for try_number 1 2024-05-26T01:34:00.548654448Z [2024-05-26T01:34:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:33:00+00:00 exited with status queued for try_number 1 2024-05-26T01:34:00.557477773Z [2024-05-26T01:34:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cf20705-20d3-4bb8-8195-ad769520c390 2024-05-26T01:34:00.557505001Z [2024-05-26T01:34:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dc660d1-405b-4627-8df9-8d2480c382b1 2024-05-26T01:34:00.557591247Z [2024-05-26T01:34:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to add48f5b-51eb-49e8-9987-34223044bc00 2024-05-26T01:34:00.557686723Z [2024-05-26T01:34:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2834b5c-9f1f-4a2d-898d-109e7f4d37a8 2024-05-26T01:34:01.735858394Z [2024-05-26T01:34:01.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:34:01.736063958Z [2024-05-26T01:34:01.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:32:00+00:00, run_id=scheduled__2024-05-26T01:32:00+00:00, run_start_date=2024-05-26 01:34:00.163212+00:00, run_end_date=2024-05-26 01:34:01.735749+00:00, run_duration=1.572537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:32:00+00:00, data_interval_end=2024-05-26 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:34:01.747259771Z [2024-05-26T01:34:01.746+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:34:00+00:00, run_after=2024-05-26T01:36:00+00:00 2024-05-26T01:34:01.758227131Z [2024-05-26T01:34:01.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:34:01.758320452Z [2024-05-26T01:34:01.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:33:00+00:00, run_id=scheduled__2024-05-26T01:33:00+00:00, run_start_date=2024-05-26 01:34:00.164533+00:00, run_end_date=2024-05-26 01:34:01.758100+00:00, run_duration=1.593567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:33:00+00:00, data_interval_end=2024-05-26 01:34:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:34:01.774916934Z [2024-05-26T01:34:01.774+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:34:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:34:01.836942045Z [2024-05-26T01:34:01.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:32:00+00:00 exited with status success for try_number 1 2024-05-26T01:34:01.842432539Z [2024-05-26T01:34:01.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:32:00+00:00, map_index=-1, run_start_date=2024-05-26 01:34:01.079544+00:00, run_end_date=2024-05-26 01:34:01.447736+00:00, run_duration=0.368192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:34:00.249680+00:00, queued_by_job_id=1, pid=11319 2024-05-26T01:34:02.950903294Z [2024-05-26T01:34:02.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:33:00+00:00 exited with status success for try_number 1 2024-05-26T01:34:02.956235366Z [2024-05-26T01:34:02.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:33:00+00:00, map_index=-1, run_start_date=2024-05-26 01:34:01.295119+00:00, run_end_date=2024-05-26 01:34:01.725910+00:00, run_duration=0.430791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:34:00.249680+00:00, queued_by_job_id=1, pid=11320 2024-05-26T01:34:04.030935472Z [2024-05-26T01:34:04.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:34:04.031641501Z [2024-05-26T01:34:04.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:33:00+00:00, run_id=scheduled__2024-05-26T01:33:00+00:00, run_start_date=2024-05-26 01:34:00.165947+00:00, run_end_date=2024-05-26 01:34:04.030834+00:00, run_duration=3.864887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:33:00+00:00, data_interval_end=2024-05-26 01:34:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:34:04.045921900Z [2024-05-26T01:34:04.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:34:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:34:04.085052727Z [2024-05-26T01:34:04.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:34:04.085519231Z [2024-05-26T01:34:04.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:33:00+00:00, run_id=scheduled__2024-05-26T01:33:00+00:00, run_start_date=2024-05-26 01:34:00.167469+00:00, run_end_date=2024-05-26 01:34:04.085216+00:00, run_duration=3.917747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:33:00+00:00, data_interval_end=2024-05-26 01:34:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:34:04.101852920Z [2024-05-26T01:34:04.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:34:00+00:00, run_after=2024-05-26T01:35:00+00:00 2024-05-26T01:34:04.158827999Z [2024-05-26T01:34:04.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:33:00+00:00 exited with status success for try_number 1 2024-05-26T01:34:04.159490494Z [2024-05-26T01:34:04.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:33:00+00:00 exited with status success for try_number 1 2024-05-26T01:34:04.176413614Z [2024-05-26T01:34:04.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:33:00+00:00, map_index=-1, run_start_date=2024-05-26 01:34:02.112720+00:00, run_end_date=2024-05-26 01:34:03.896982+00:00, run_duration=1.784262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:34:00.249680+00:00, queued_by_job_id=1, pid=11343 2024-05-26T01:34:04.177273413Z [2024-05-26T01:34:04.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:33:00+00:00, map_index=-1, run_start_date=2024-05-26 01:34:02.158339+00:00, run_end_date=2024-05-26 01:34:03.477030+00:00, run_duration=1.318691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:34:00.249680+00:00, queued_by_job_id=1, pid=11344 2024-05-26T01:35:00.115170256Z [2024-05-26T01:35:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:35:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:35:00.133343691Z [2024-05-26T01:35:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:35:00+00:00, run_after=2024-05-26T01:36:00+00:00 2024-05-26T01:35:00.147972912Z [2024-05-26T01:35:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:35:00+00:00, run_after=2024-05-26T01:36:00+00:00 2024-05-26T01:35:00.156302253Z [2024-05-26T01:35:00.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:35:00.251200192Z [2024-05-26T01:35:00.250+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:35:00.251236853Z 2024-05-26T01:35:00.251244807Z 2024-05-26T01:35:00.251252127Z 2024-05-26T01:35:00.251282745Z 2024-05-26T01:35:00.251344709Z [2024-05-26T01:35:00.250+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:35:00.251497696Z [2024-05-26T01:35:00.251+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:35:00.251806336Z [2024-05-26T01:35:00.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:35:00.252071713Z [2024-05-26T01:35:00.251+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:35:00.252940540Z [2024-05-26T01:35:00.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:35:00.252955859Z 2024-05-26T01:35:00.252961302Z 2024-05-26T01:35:00.252965928Z 2024-05-26T01:35:00.252970432Z 2024-05-26T01:35:00.258025605Z [2024-05-26T01:35:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:35:00.258390914Z [2024-05-26T01:35:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:35:00.259038418Z [2024-05-26T01:35:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:35:00.259371554Z [2024-05-26T01:35:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:35:00.259892869Z [2024-05-26T01:35:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:35:00.261918739Z [2024-05-26T01:35:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:35:00.262510905Z [2024-05-26T01:35:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:35:00.262895467Z [2024-05-26T01:35:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:35:00.529434939Z [2024-05-26T01:35:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:35:00.529659138Z [2024-05-26T01:35:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status queued for try_number 1 2024-05-26T01:35:00.529839091Z [2024-05-26T01:35:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status queued for try_number 1 2024-05-26T01:35:00.530020884Z [2024-05-26T01:35:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status queued for try_number 1 2024-05-26T01:35:00.539031647Z [2024-05-26T01:35:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05c020d3-8a90-4ae7-8065-c23ef15a2a00 2024-05-26T01:35:00.539254668Z [2024-05-26T01:35:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc851187-06dd-42a9-ac7d-a8749e787f1e 2024-05-26T01:35:00.539441304Z [2024-05-26T01:35:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8099d4a3-3fe2-4239-b99e-f98320a2eae9 2024-05-26T01:35:00.539706050Z [2024-05-26T01:35:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c5ddb4a-aaae-4434-81c0-f0c14883a703 2024-05-26T01:35:01.706995298Z [2024-05-26T01:35:01.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:35:01.707495739Z [2024-05-26T01:35:01.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:34:00+00:00, run_id=scheduled__2024-05-26T01:34:00+00:00, run_start_date=2024-05-26 01:35:00.170108+00:00, run_end_date=2024-05-26 01:35:01.706885+00:00, run_duration=1.536777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:34:00+00:00, data_interval_end=2024-05-26 01:35:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:35:01.720729516Z [2024-05-26T01:35:01.720+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:35:00+00:00, run_after=2024-05-26T01:36:00+00:00 2024-05-26T01:35:02.881953985Z [2024-05-26T01:35:02.881+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:35:02.881985414Z 2024-05-26T01:35:02.881998000Z [2024-05-26T01:35:02.881+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:35:02.882504292Z [2024-05-26T01:35:02.882+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:35:02.882523271Z 2024-05-26T01:35:02.885119590Z [2024-05-26T01:35:02.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:35:02.885152412Z [2024-05-26T01:35:02.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:35:02.953731120Z [2024-05-26T01:35:02.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:35:02.953772306Z [2024-05-26T01:35:02.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:35:02.953840917Z [2024-05-26T01:35:02.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status success for try_number 1 2024-05-26T01:35:02.962483756Z [2024-05-26T01:35:02.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:34:00+00:00, map_index=-1, run_start_date=2024-05-26 01:35:01.135170+00:00, run_end_date=2024-05-26 01:35:01.620058+00:00, run_duration=0.484888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:35:00.254172+00:00, queued_by_job_id=1, pid=11377 2024-05-26T01:35:02.963924867Z [2024-05-26T01:35:02.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=-1, run_start_date=2024-05-26 01:35:02.191000+00:00, run_end_date=2024-05-26 01:35:02.545714+00:00, run_duration=0.354714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:35:00.254172+00:00, queued_by_job_id=1, pid=11397 2024-05-26T01:35:02.964156839Z [2024-05-26T01:35:02.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to 204cf279-88a1-4c06-9df6-f55e6cff4242 2024-05-26T01:35:04.141473584Z [2024-05-26T01:35:04.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:35:04.142013252Z [2024-05-26T01:35:04.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:34:00+00:00, run_id=scheduled__2024-05-26T01:34:00+00:00, run_start_date=2024-05-26 01:35:00.171260+00:00, run_end_date=2024-05-26 01:35:04.141393+00:00, run_duration=3.970133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:34:00+00:00, data_interval_end=2024-05-26 01:35:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:35:04.162231356Z [2024-05-26T01:35:04.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:35:00+00:00, run_after=2024-05-26T01:36:00+00:00 2024-05-26T01:35:04.270819862Z [2024-05-26T01:35:04.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status success for try_number 1 2024-05-26T01:35:04.279985343Z [2024-05-26T01:35:04.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:34:00+00:00, map_index=-1, run_start_date=2024-05-26 01:35:02.143596+00:00, run_end_date=2024-05-26 01:35:03.356123+00:00, run_duration=1.212527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:35:00.254172+00:00, queued_by_job_id=1, pid=11396 2024-05-26T01:35:05.333515252Z [2024-05-26T01:35:05.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:35:05.333987235Z [2024-05-26T01:35:05.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:34:00+00:00, run_id=scheduled__2024-05-26T01:34:00+00:00, run_start_date=2024-05-26 01:35:00.172484+00:00, run_end_date=2024-05-26 01:35:05.333386+00:00, run_duration=5.160902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:34:00+00:00, data_interval_end=2024-05-26 01:35:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:35:05.344262695Z [2024-05-26T01:35:05.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:35:00+00:00, run_after=2024-05-26T01:36:00+00:00 2024-05-26T01:35:05.389935982Z [2024-05-26T01:35:05.389+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:35:05.389961303Z 2024-05-26T01:35:05.390168580Z [2024-05-26T01:35:05.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:35:05.390707670Z [2024-05-26T01:35:05.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:35:05.390718817Z 2024-05-26T01:35:05.392969133Z [2024-05-26T01:35:05.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:35:05.393241295Z [2024-05-26T01:35:05.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:35:05.510738687Z [2024-05-26T01:35:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:35:05.510964189Z [2024-05-26T01:35:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status success for try_number 1 2024-05-26T01:35:05.523330843Z [2024-05-26T01:35:05.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 123896ac-9cd1-4e84-a7b7-5ec8710f4d96 2024-05-26T01:35:05.523597798Z [2024-05-26T01:35:05.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:34:00+00:00, map_index=-1, run_start_date=2024-05-26 01:35:02.536393+00:00, run_end_date=2024-05-26 01:35:04.109795+00:00, run_duration=1.573402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:35:00.254172+00:00, queued_by_job_id=1, pid=11413 2024-05-26T01:35:05.716429262Z [2024-05-26T01:35:05.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:35:05.728639400Z [2024-05-26T01:35:05.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=-1, run_start_date=2024-05-26 01:35:04.786939+00:00, run_end_date=2024-05-26 01:35:05.209763+00:00, run_duration=0.422824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:35:02.882725+00:00, queued_by_job_id=1, pid=11426 2024-05-26T01:35:08.060990279Z [2024-05-26T01:35:08.060+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:35:08.061028737Z 2024-05-26T01:35:08.061395934Z [2024-05-26T01:35:08.060+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:35:08.062386943Z [2024-05-26T01:35:08.062+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:35:08.062406249Z 2024-05-26T01:35:08.065674867Z [2024-05-26T01:35:08.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:35:08.065732915Z [2024-05-26T01:35:08.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:35:08.131185799Z [2024-05-26T01:35:08.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status queued for try_number 1 2024-05-26T01:35:08.131635710Z [2024-05-26T01:35:08.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:35:08.139295187Z [2024-05-26T01:35:08.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc4bf1b7-e2a9-4a07-9a4a-370397f0ccf0 2024-05-26T01:35:08.139848552Z [2024-05-26T01:35:08.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=0, run_start_date=2024-05-26 01:35:07.321224+00:00, run_end_date=2024-05-26 01:35:07.733094+00:00, run_duration=0.41187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:35:05.391090+00:00, queued_by_job_id=1, pid=11434 2024-05-26T01:35:10.801094308Z [2024-05-26T01:35:10.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:35:10.801309543Z [2024-05-26T01:35:10.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:30:00+00:00, run_id=scheduled__2024-05-26T01:30:00+00:00, run_start_date=2024-05-26 01:35:00.168537+00:00, run_end_date=2024-05-26 01:35:10.801006+00:00, run_duration=10.632469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:30:00+00:00, data_interval_end=2024-05-26 01:35:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:35:10.809527126Z [2024-05-26T01:35:10.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:35:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:35:10.876566640Z [2024-05-26T01:35:10.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:30:00+00:00 exited with status success for try_number 1 2024-05-26T01:35:10.889149564Z [2024-05-26T01:35:10.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:30:00+00:00, map_index=-1, run_start_date=2024-05-26 01:35:09.721767+00:00, run_end_date=2024-05-26 01:35:10.141476+00:00, run_duration=0.419709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:35:08.063070+00:00, queued_by_job_id=1, pid=11442 2024-05-26T01:36:00.481351170Z [2024-05-26T01:36:00.480+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:36:00.502419568Z [2024-05-26T01:36:00.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:36:00+00:00, run_after=2024-05-26T01:37:00+00:00 2024-05-26T01:36:00.522633170Z [2024-05-26T01:36:00.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:36:00+00:00, run_after=2024-05-26T01:37:00+00:00 2024-05-26T01:36:00.534171360Z [2024-05-26T01:36:00.533+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:36:00.631217353Z [2024-05-26T01:36:00.630+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:36:00.631264034Z 2024-05-26T01:36:00.631271644Z 2024-05-26T01:36:00.631278347Z 2024-05-26T01:36:00.631284722Z 2024-05-26T01:36:00.631295089Z [2024-05-26T01:36:00.631+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:36:00.633046383Z [2024-05-26T01:36:00.631+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:36:00.633244064Z [2024-05-26T01:36:00.632+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:36:00.633487837Z [2024-05-26T01:36:00.633+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:36:00.634290022Z [2024-05-26T01:36:00.634+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:36:00.634311366Z 2024-05-26T01:36:00.634318679Z 2024-05-26T01:36:00.634324910Z 2024-05-26T01:36:00.634331226Z 2024-05-26T01:36:00.640121202Z [2024-05-26T01:36:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:36:00.640351654Z [2024-05-26T01:36:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:36:00.640688651Z [2024-05-26T01:36:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:36:00.640881886Z [2024-05-26T01:36:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:36:00.641244663Z [2024-05-26T01:36:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:36:00.641422884Z [2024-05-26T01:36:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:36:00.641720510Z [2024-05-26T01:36:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:36:00.641902152Z [2024-05-26T01:36:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:36:01.166999309Z [2024-05-26T01:36:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status queued for try_number 1 2024-05-26T01:36:01.167370449Z [2024-05-26T01:36:01.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status queued for try_number 1 2024-05-26T01:36:01.167737502Z [2024-05-26T01:36:01.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status queued for try_number 1 2024-05-26T01:36:01.167993055Z [2024-05-26T01:36:01.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status queued for try_number 1 2024-05-26T01:36:01.180710213Z [2024-05-26T01:36:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12be6a6e-87b4-41f3-92a2-030bf350ab50 2024-05-26T01:36:01.181219994Z [2024-05-26T01:36:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 703fbfbb-e51f-44c7-8be4-0db61e776ed8 2024-05-26T01:36:01.181738220Z [2024-05-26T01:36:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cb5cad0-3256-4433-9aa0-6da503470952 2024-05-26T01:36:01.182149336Z [2024-05-26T01:36:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2ef5971-b632-4354-87f8-94dd139c7160 2024-05-26T01:36:02.951092462Z [2024-05-26T01:36:02.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:36:02.951644544Z [2024-05-26T01:36:02.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:35:00+00:00, run_id=scheduled__2024-05-26T01:35:00+00:00, run_start_date=2024-05-26 01:36:00.546032+00:00, run_end_date=2024-05-26 01:36:02.950999+00:00, run_duration=2.404967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:35:00+00:00, data_interval_end=2024-05-26 01:36:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:36:02.966824428Z [2024-05-26T01:36:02.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:36:00+00:00, run_after=2024-05-26T01:37:00+00:00 2024-05-26T01:36:02.981673084Z [2024-05-26T01:36:02.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:36:02.982255541Z [2024-05-26T01:36:02.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:34:00+00:00, run_id=scheduled__2024-05-26T01:34:00+00:00, run_start_date=2024-05-26 01:36:00.544509+00:00, run_end_date=2024-05-26 01:36:02.981596+00:00, run_duration=2.437087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:34:00+00:00, data_interval_end=2024-05-26 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:36:02.990318953Z [2024-05-26T01:36:02.990+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:36:00+00:00, run_after=2024-05-26T01:38:00+00:00 2024-05-26T01:36:03.057590753Z [2024-05-26T01:36:03.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:34:00+00:00 exited with status success for try_number 1 2024-05-26T01:36:03.057811363Z [2024-05-26T01:36:03.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status success for try_number 1 2024-05-26T01:36:03.072025079Z [2024-05-26T01:36:03.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:35:00+00:00, map_index=-1, run_start_date=2024-05-26 01:36:01.707717+00:00, run_end_date=2024-05-26 01:36:02.135011+00:00, run_duration=0.427294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:36:00.635773+00:00, queued_by_job_id=1, pid=11466 2024-05-26T01:36:03.072356124Z [2024-05-26T01:36:03.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:34:00+00:00, map_index=-1, run_start_date=2024-05-26 01:36:01.690398+00:00, run_end_date=2024-05-26 01:36:02.108454+00:00, run_duration=0.418056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:36:00.635773+00:00, queued_by_job_id=1, pid=11465 2024-05-26T01:36:05.234535704Z [2024-05-26T01:36:05.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:36:05.234681216Z [2024-05-26T01:36:05.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:35:00+00:00, run_id=scheduled__2024-05-26T01:35:00+00:00, run_start_date=2024-05-26 01:36:00.547054+00:00, run_end_date=2024-05-26 01:36:05.234434+00:00, run_duration=4.68738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:35:00+00:00, data_interval_end=2024-05-26 01:36:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:36:05.243653900Z [2024-05-26T01:36:05.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:36:00+00:00, run_after=2024-05-26T01:37:00+00:00 2024-05-26T01:36:05.278443699Z [2024-05-26T01:36:05.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status success for try_number 1 2024-05-26T01:36:05.282867034Z [2024-05-26T01:36:05.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:35:00+00:00, map_index=-1, run_start_date=2024-05-26 01:36:03.043377+00:00, run_end_date=2024-05-26 01:36:04.959595+00:00, run_duration=1.916218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:36:00.635773+00:00, queued_by_job_id=1, pid=11490 2024-05-26T01:36:06.321949722Z [2024-05-26T01:36:06.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:36:06.322210595Z [2024-05-26T01:36:06.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:35:00+00:00, run_id=scheduled__2024-05-26T01:35:00+00:00, run_start_date=2024-05-26 01:36:00.548205+00:00, run_end_date=2024-05-26 01:36:06.321799+00:00, run_duration=5.773594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:35:00+00:00, data_interval_end=2024-05-26 01:36:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:36:06.331912713Z [2024-05-26T01:36:06.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:36:00+00:00, run_after=2024-05-26T01:37:00+00:00 2024-05-26T01:36:06.366168510Z [2024-05-26T01:36:06.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status success for try_number 1 2024-05-26T01:36:06.371861294Z [2024-05-26T01:36:06.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:35:00+00:00, map_index=-1, run_start_date=2024-05-26 01:36:03.009850+00:00, run_end_date=2024-05-26 01:36:05.464447+00:00, run_duration=2.454597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:36:00.635773+00:00, queued_by_job_id=1, pid=11489 2024-05-26T01:37:00.898178997Z [2024-05-26T01:37:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:37:00+00:00, run_after=2024-05-26T01:38:00+00:00 2024-05-26T01:37:00.908103614Z [2024-05-26T01:37:00.907+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:37:00.923875664Z [2024-05-26T01:37:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:37:00+00:00, run_after=2024-05-26T01:38:00+00:00 2024-05-26T01:37:01.008436259Z [2024-05-26T01:37:01.008+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:37:01.008481443Z 2024-05-26T01:37:01.008489856Z 2024-05-26T01:37:01.008497299Z 2024-05-26T01:37:01.008531403Z [2024-05-26T01:37:01.008+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:37:01.008666547Z [2024-05-26T01:37:01.008+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:37:01.008816154Z [2024-05-26T01:37:01.008+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:37:01.009641771Z [2024-05-26T01:37:01.009+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:37:01.009676287Z 2024-05-26T01:37:01.009691248Z 2024-05-26T01:37:01.009699318Z 2024-05-26T01:37:01.016773880Z [2024-05-26T01:37:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:37:01.017020239Z [2024-05-26T01:37:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:37:01.017276880Z [2024-05-26T01:37:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:37:01.017414614Z [2024-05-26T01:37:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:37:01.017688294Z [2024-05-26T01:37:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:37:01.017846383Z [2024-05-26T01:37:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:37:01.230775255Z [2024-05-26T01:37:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status queued for try_number 1 2024-05-26T01:37:01.230910077Z [2024-05-26T01:37:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status queued for try_number 1 2024-05-26T01:37:01.230991401Z [2024-05-26T01:37:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status queued for try_number 1 2024-05-26T01:37:01.238408947Z [2024-05-26T01:37:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 969e0828-f98a-41dc-a1aa-79451de76b3e 2024-05-26T01:37:01.238569583Z [2024-05-26T01:37:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 223cc58f-9d52-480a-a6e8-2e1921a7b9b1 2024-05-26T01:37:01.238727661Z [2024-05-26T01:37:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61ce0ccf-b02b-4f3d-ad33-c29dfd84732f 2024-05-26T01:37:02.358809469Z [2024-05-26T01:37:02.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:37:02.359292794Z [2024-05-26T01:37:02.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:36:00+00:00, run_id=scheduled__2024-05-26T01:36:00+00:00, run_start_date=2024-05-26 01:37:00.939773+00:00, run_end_date=2024-05-26 01:37:02.358712+00:00, run_duration=1.418939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:36:00+00:00, data_interval_end=2024-05-26 01:37:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:37:02.368867210Z [2024-05-26T01:37:02.368+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:37:00+00:00, run_after=2024-05-26T01:38:00+00:00 2024-05-26T01:37:02.424387698Z [2024-05-26T01:37:02.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status success for try_number 1 2024-05-26T01:37:02.430543798Z [2024-05-26T01:37:02.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:36:00+00:00, map_index=-1, run_start_date=2024-05-26 01:37:01.774324+00:00, run_end_date=2024-05-26 01:37:02.144166+00:00, run_duration=0.369842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:37:01.010929+00:00, queued_by_job_id=1, pid=11522 2024-05-26T01:37:04.982839025Z [2024-05-26T01:37:04.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:37:04.983269179Z [2024-05-26T01:37:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:36:00+00:00, run_id=scheduled__2024-05-26T01:36:00+00:00, run_start_date=2024-05-26 01:37:00.941149+00:00, run_end_date=2024-05-26 01:37:04.982736+00:00, run_duration=4.041587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:36:00+00:00, data_interval_end=2024-05-26 01:37:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:37:04.994004849Z [2024-05-26T01:37:04.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:37:00+00:00, run_after=2024-05-26T01:38:00+00:00 2024-05-26T01:37:05.005840300Z [2024-05-26T01:37:05.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:37:05.006219947Z [2024-05-26T01:37:05.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:36:00+00:00, run_id=scheduled__2024-05-26T01:36:00+00:00, run_start_date=2024-05-26 01:37:00.942290+00:00, run_end_date=2024-05-26 01:37:05.005760+00:00, run_duration=4.06347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:36:00+00:00, data_interval_end=2024-05-26 01:37:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:37:05.017794206Z [2024-05-26T01:37:05.017+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:37:00+00:00, run_after=2024-05-26T01:38:00+00:00 2024-05-26T01:37:05.050578090Z [2024-05-26T01:37:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status success for try_number 1 2024-05-26T01:37:05.050807972Z [2024-05-26T01:37:05.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status success for try_number 1 2024-05-26T01:37:05.057027248Z [2024-05-26T01:37:05.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:36:00+00:00, map_index=-1, run_start_date=2024-05-26 01:37:02.780648+00:00, run_end_date=2024-05-26 01:37:04.073201+00:00, run_duration=1.292553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:37:01.010929+00:00, queued_by_job_id=1, pid=11540 2024-05-26T01:37:05.057313544Z [2024-05-26T01:37:05.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:36:00+00:00, map_index=-1, run_start_date=2024-05-26 01:37:02.855751+00:00, run_end_date=2024-05-26 01:37:04.388355+00:00, run_duration=1.532604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:37:01.010929+00:00, queued_by_job_id=1, pid=11541 2024-05-26T01:38:00.820984835Z [2024-05-26T01:38:00.820+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:38:00.832196248Z [2024-05-26T01:38:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:38:00+00:00, run_after=2024-05-26T01:39:00+00:00 2024-05-26T01:38:00.842150870Z [2024-05-26T01:38:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:38:00+00:00, run_after=2024-05-26T01:39:00+00:00 2024-05-26T01:38:00.847298700Z [2024-05-26T01:38:00.846+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:38:00.909329842Z [2024-05-26T01:38:00.908+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:38:00.909369817Z 2024-05-26T01:38:00.909380239Z 2024-05-26T01:38:00.909388974Z 2024-05-26T01:38:00.909397415Z 2024-05-26T01:38:00.909420955Z [2024-05-26T01:38:00.909+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:38:00.909728285Z [2024-05-26T01:38:00.909+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:38:00.909927969Z [2024-05-26T01:38:00.909+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:38:00.910127083Z [2024-05-26T01:38:00.909+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:38:00.911569340Z [2024-05-26T01:38:00.911+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:38:00.911583864Z 2024-05-26T01:38:00.911591563Z 2024-05-26T01:38:00.911595104Z 2024-05-26T01:38:00.911598068Z 2024-05-26T01:38:00.918353918Z [2024-05-26T01:38:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:38:00.918531702Z [2024-05-26T01:38:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:38:00.918847158Z [2024-05-26T01:38:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:38:00.919008828Z [2024-05-26T01:38:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:38:00.919303409Z [2024-05-26T01:38:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:38:00.919442334Z [2024-05-26T01:38:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:38:00.919818842Z [2024-05-26T01:38:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:38:00.919963698Z [2024-05-26T01:38:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:38:01.360645162Z [2024-05-26T01:38:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status queued for try_number 1 2024-05-26T01:38:01.360815326Z [2024-05-26T01:38:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:37:00+00:00 exited with status queued for try_number 1 2024-05-26T01:38:01.360974353Z [2024-05-26T01:38:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:37:00+00:00 exited with status queued for try_number 1 2024-05-26T01:38:01.361086991Z [2024-05-26T01:38:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:37:00+00:00 exited with status queued for try_number 1 2024-05-26T01:38:01.379310841Z [2024-05-26T01:38:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 406c27df-6003-4826-b8bd-6beff192079b 2024-05-26T01:38:01.379386468Z [2024-05-26T01:38:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ec79709-058f-47ee-bd03-95eccf765bb0 2024-05-26T01:38:01.379512367Z [2024-05-26T01:38:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to c66e24da-81a7-4621-9e4b-37143f94db07 2024-05-26T01:38:01.379643388Z [2024-05-26T01:38:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77154f9a-b43e-449c-83f4-efb4976f56a9 2024-05-26T01:38:02.662395647Z [2024-05-26T01:38:02.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:38:02.663584277Z [2024-05-26T01:38:02.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:36:00+00:00, run_id=scheduled__2024-05-26T01:36:00+00:00, run_start_date=2024-05-26 01:38:00.855223+00:00, run_end_date=2024-05-26 01:38:02.662360+00:00, run_duration=1.807137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:36:00+00:00, data_interval_end=2024-05-26 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:38:02.675489649Z [2024-05-26T01:38:02.675+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:38:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:38:02.682824392Z [2024-05-26T01:38:02.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:38:02.683099219Z [2024-05-26T01:38:02.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:37:00+00:00, run_id=scheduled__2024-05-26T01:37:00+00:00, run_start_date=2024-05-26 01:38:00.856498+00:00, run_end_date=2024-05-26 01:38:02.682767+00:00, run_duration=1.826269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:37:00+00:00, data_interval_end=2024-05-26 01:38:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:38:02.697346296Z [2024-05-26T01:38:02.696+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:38:00+00:00, run_after=2024-05-26T01:39:00+00:00 2024-05-26T01:38:02.765550337Z [2024-05-26T01:38:02.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:36:00+00:00 exited with status success for try_number 1 2024-05-26T01:38:02.766266753Z [2024-05-26T01:38:02.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:37:00+00:00 exited with status success for try_number 1 2024-05-26T01:38:02.775147121Z [2024-05-26T01:38:02.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:37:00+00:00, map_index=-1, run_start_date=2024-05-26 01:38:01.721653+00:00, run_end_date=2024-05-26 01:38:02.087379+00:00, run_duration=0.365726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:38:00.914416+00:00, queued_by_job_id=1, pid=11574 2024-05-26T01:38:02.775363275Z [2024-05-26T01:38:02.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:36:00+00:00, map_index=-1, run_start_date=2024-05-26 01:38:01.851929+00:00, run_end_date=2024-05-26 01:38:02.196617+00:00, run_duration=0.344688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:38:00.914416+00:00, queued_by_job_id=1, pid=11575 2024-05-26T01:38:04.866499817Z [2024-05-26T01:38:04.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:38:04.866659282Z [2024-05-26T01:38:04.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:37:00+00:00, run_id=scheduled__2024-05-26T01:37:00+00:00, run_start_date=2024-05-26 01:38:00.857435+00:00, run_end_date=2024-05-26 01:38:04.866408+00:00, run_duration=4.008973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:37:00+00:00, data_interval_end=2024-05-26 01:38:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:38:04.891131068Z [2024-05-26T01:38:04.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:38:00+00:00, run_after=2024-05-26T01:39:00+00:00 2024-05-26T01:38:04.948094970Z [2024-05-26T01:38:04.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:37:00+00:00 exited with status success for try_number 1 2024-05-26T01:38:04.953162644Z [2024-05-26T01:38:04.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:37:00+00:00, map_index=-1, run_start_date=2024-05-26 01:38:02.918034+00:00, run_end_date=2024-05-26 01:38:04.678813+00:00, run_duration=1.760779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:38:00.914416+00:00, queued_by_job_id=1, pid=11599 2024-05-26T01:38:05.998967406Z [2024-05-26T01:38:05.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:38:05.999284070Z [2024-05-26T01:38:05.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:37:00+00:00, run_id=scheduled__2024-05-26T01:37:00+00:00, run_start_date=2024-05-26 01:38:00.858388+00:00, run_end_date=2024-05-26 01:38:05.998864+00:00, run_duration=5.140476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:37:00+00:00, data_interval_end=2024-05-26 01:38:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:38:06.008436392Z [2024-05-26T01:38:06.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:38:00+00:00, run_after=2024-05-26T01:39:00+00:00 2024-05-26T01:38:06.037585385Z [2024-05-26T01:38:06.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:37:00+00:00 exited with status success for try_number 1 2024-05-26T01:38:06.042303576Z [2024-05-26T01:38:06.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:37:00+00:00, map_index=-1, run_start_date=2024-05-26 01:38:02.862967+00:00, run_end_date=2024-05-26 01:38:04.990973+00:00, run_duration=2.128006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:38:00.914416+00:00, queued_by_job_id=1, pid=11598 2024-05-26T01:38:32.642000684Z [2024-05-26T01:38:32.641+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:39:00.617614450Z [2024-05-26T01:39:00.617+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:39:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:39:00.624248084Z [2024-05-26T01:39:00.623+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:39:00.635985376Z [2024-05-26T01:39:00.635+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:39:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:39:00.743341607Z [2024-05-26T01:39:00.743+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:39:00.743407305Z 2024-05-26T01:39:00.743413942Z 2024-05-26T01:39:00.743417151Z 2024-05-26T01:39:00.743429264Z [2024-05-26T01:39:00.743+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:39:00.743464285Z [2024-05-26T01:39:00.743+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:39:00.743530269Z [2024-05-26T01:39:00.743+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:39:00.744388529Z [2024-05-26T01:39:00.744+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:39:00.744407059Z 2024-05-26T01:39:00.744410832Z 2024-05-26T01:39:00.744413834Z 2024-05-26T01:39:00.747396610Z [2024-05-26T01:39:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:39:00.747493816Z [2024-05-26T01:39:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:39:00.747711143Z [2024-05-26T01:39:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:39:00.747786400Z [2024-05-26T01:39:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:39:00.747936316Z [2024-05-26T01:39:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:39:00.748020547Z [2024-05-26T01:39:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:39:01.012278096Z [2024-05-26T01:39:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status queued for try_number 1 2024-05-26T01:39:01.012305874Z [2024-05-26T01:39:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status queued for try_number 1 2024-05-26T01:39:01.012361677Z [2024-05-26T01:39:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status queued for try_number 1 2024-05-26T01:39:01.021587837Z [2024-05-26T01:39:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to c28ac7b6-7119-4c5f-9d4b-6c9fb6caa576 2024-05-26T01:39:01.021637956Z [2024-05-26T01:39:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9955022-7787-4328-a403-8e3c2c737933 2024-05-26T01:39:01.021779847Z [2024-05-26T01:39:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to a58fe6f4-a4a0-4324-b473-eb45f5eee8d0 2024-05-26T01:39:02.208799232Z [2024-05-26T01:39:02.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:39:02.209016561Z [2024-05-26T01:39:02.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:38:00+00:00, run_id=scheduled__2024-05-26T01:38:00+00:00, run_start_date=2024-05-26 01:39:00.655231+00:00, run_end_date=2024-05-26 01:39:02.208721+00:00, run_duration=1.55349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:38:00+00:00, data_interval_end=2024-05-26 01:39:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:39:02.225292849Z [2024-05-26T01:39:02.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:39:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:39:03.395686235Z [2024-05-26T01:39:03.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status success for try_number 1 2024-05-26T01:39:03.417193548Z [2024-05-26T01:39:03.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:38:00+00:00, map_index=-1, run_start_date=2024-05-26 01:39:01.727899+00:00, run_end_date=2024-05-26 01:39:02.192468+00:00, run_duration=0.464569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:39:00.744800+00:00, queued_by_job_id=1, pid=11631 2024-05-26T01:39:04.480820001Z [2024-05-26T01:39:04.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:39:04.481121196Z [2024-05-26T01:39:04.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:38:00+00:00, run_id=scheduled__2024-05-26T01:38:00+00:00, run_start_date=2024-05-26 01:39:00.657984+00:00, run_end_date=2024-05-26 01:39:04.480756+00:00, run_duration=3.822772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:38:00+00:00, data_interval_end=2024-05-26 01:39:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:39:04.542972022Z [2024-05-26T01:39:04.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:39:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:39:04.591713908Z [2024-05-26T01:39:04.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status success for try_number 1 2024-05-26T01:39:04.596693954Z [2024-05-26T01:39:04.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:38:00+00:00, map_index=-1, run_start_date=2024-05-26 01:39:02.777623+00:00, run_end_date=2024-05-26 01:39:04.011995+00:00, run_duration=1.234372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:39:00.744800+00:00, queued_by_job_id=1, pid=11649 2024-05-26T01:39:05.665369216Z [2024-05-26T01:39:05.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:39:05.665905688Z [2024-05-26T01:39:05.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:38:00+00:00, run_id=scheduled__2024-05-26T01:38:00+00:00, run_start_date=2024-05-26 01:39:00.663427+00:00, run_end_date=2024-05-26 01:39:05.665288+00:00, run_duration=5.001861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:38:00+00:00, data_interval_end=2024-05-26 01:39:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:39:05.675066473Z [2024-05-26T01:39:05.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:39:00+00:00, run_after=2024-05-26T01:40:00+00:00 2024-05-26T01:39:05.708747170Z [2024-05-26T01:39:05.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status success for try_number 1 2024-05-26T01:39:05.715006676Z [2024-05-26T01:39:05.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:38:00+00:00, map_index=-1, run_start_date=2024-05-26 01:39:02.871341+00:00, run_end_date=2024-05-26 01:39:04.576874+00:00, run_duration=1.705533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:39:00.744800+00:00, queued_by_job_id=1, pid=11650 2024-05-26T01:40:00.499850370Z [2024-05-26T01:40:00.499+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:40:00.527958428Z [2024-05-26T01:40:00.527+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:41:00+00:00 2024-05-26T01:40:00.539732369Z [2024-05-26T01:40:00.539+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:40:00.569538788Z [2024-05-26T01:40:00.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:45:00+00:00 2024-05-26T01:40:00.582375736Z [2024-05-26T01:40:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:41:00+00:00 2024-05-26T01:40:00.709167304Z [2024-05-26T01:40:00.708+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T01:40:00.709326711Z 2024-05-26T01:40:00.709395126Z 2024-05-26T01:40:00.709404967Z 2024-05-26T01:40:00.709413778Z 2024-05-26T01:40:00.709422019Z 2024-05-26T01:40:00.709430484Z [2024-05-26T01:40:00.708+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:40:00.709471646Z [2024-05-26T01:40:00.709+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:40:00.709481224Z [2024-05-26T01:40:00.709+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:40:00.709578843Z [2024-05-26T01:40:00.709+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:40:00.709604930Z [2024-05-26T01:40:00.709+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:40:00.709956502Z [2024-05-26T01:40:00.709+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:40:00.709969577Z 2024-05-26T01:40:00.709975796Z 2024-05-26T01:40:00.710005613Z 2024-05-26T01:40:00.710011553Z 2024-05-26T01:40:00.710016650Z 2024-05-26T01:40:00.713830524Z [2024-05-26T01:40:00.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:40:00.713912070Z [2024-05-26T01:40:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:40:00.714075071Z [2024-05-26T01:40:00.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:40:00.714141517Z [2024-05-26T01:40:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:40:00.714343936Z [2024-05-26T01:40:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:40:00.714410225Z [2024-05-26T01:40:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:40:00.714646403Z [2024-05-26T01:40:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:40:00.714819765Z [2024-05-26T01:40:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:40:00.714981803Z [2024-05-26T01:40:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:40:00.715007484Z [2024-05-26T01:40:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:40:01.224744413Z [2024-05-26T01:40:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:01.224906818Z [2024-05-26T01:40:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:01.225040773Z [2024-05-26T01:40:01.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:39:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:01.225142308Z [2024-05-26T01:40:01.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:39:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:01.225249750Z [2024-05-26T01:40:01.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:39:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:01.243096679Z [2024-05-26T01:40:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35ba5363-2769-4bf6-ad62-1ec0208cd577 2024-05-26T01:40:01.248583906Z [2024-05-26T01:40:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed321f75-77b3-4ea1-ae7b-24714aa0cbea 2024-05-26T01:40:01.248757734Z [2024-05-26T01:40:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to f534196e-acc2-4216-ac39-030622fa9026 2024-05-26T01:40:01.248947246Z [2024-05-26T01:40:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83ebead4-c298-4656-805f-1e357ed5e3d7 2024-05-26T01:40:01.249085285Z [2024-05-26T01:40:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80f20b11-d303-460a-a39a-fcf9ccf148ad 2024-05-26T01:40:02.769130887Z [2024-05-26T01:40:02.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:40:02.772333086Z [2024-05-26T01:40:02.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:38:00+00:00, run_id=scheduled__2024-05-26T01:38:00+00:00, run_start_date=2024-05-26 01:40:00.600776+00:00, run_end_date=2024-05-26 01:40:02.769051+00:00, run_duration=2.168275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:38:00+00:00, data_interval_end=2024-05-26 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:40:02.806346818Z [2024-05-26T01:40:02.806+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:42:00+00:00 2024-05-26T01:40:03.017039350Z [2024-05-26T01:40:03.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:38:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:03.019191973Z [2024-05-26T01:40:03.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:39:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:03.025604856Z [2024-05-26T01:40:03.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:38:00+00:00, map_index=-1, run_start_date=2024-05-26 01:40:02.128639+00:00, run_end_date=2024-05-26 01:40:02.477284+00:00, run_duration=0.348645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:00.710809+00:00, queued_by_job_id=1, pid=11684 2024-05-26T01:40:03.026031270Z [2024-05-26T01:40:03.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:39:00+00:00, map_index=-1, run_start_date=2024-05-26 01:40:02.177740+00:00, run_end_date=2024-05-26 01:40:02.795224+00:00, run_duration=0.617484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:00.710809+00:00, queued_by_job_id=1, pid=11685 2024-05-26T01:40:04.156728192Z [2024-05-26T01:40:04.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:40:04.157144009Z [2024-05-26T01:40:04.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:39:00+00:00, run_id=scheduled__2024-05-26T01:39:00+00:00, run_start_date=2024-05-26 01:40:00.603161+00:00, run_end_date=2024-05-26 01:40:04.156767+00:00, run_duration=3.553606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:39:00+00:00, data_interval_end=2024-05-26 01:40:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:40:04.166971607Z [2024-05-26T01:40:04.166+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:41:00+00:00 2024-05-26T01:40:05.332236373Z [2024-05-26T01:40:05.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:40:05.332451462Z [2024-05-26T01:40:05.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:39:00+00:00, run_id=scheduled__2024-05-26T01:39:00+00:00, run_start_date=2024-05-26 01:40:00.605532+00:00, run_end_date=2024-05-26 01:40:05.332157+00:00, run_duration=4.726625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:39:00+00:00, data_interval_end=2024-05-26 01:40:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:40:05.343177748Z [2024-05-26T01:40:05.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:41:00+00:00 2024-05-26T01:40:05.369965124Z [2024-05-26T01:40:05.369+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:40:05.369991189Z 2024-05-26T01:40:05.370034932Z [2024-05-26T01:40:05.369+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:40:05.370507210Z [2024-05-26T01:40:05.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:40:05.370518378Z 2024-05-26T01:40:05.373933739Z [2024-05-26T01:40:05.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:40:05.374024833Z [2024-05-26T01:40:05.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:40:05.450943883Z [2024-05-26T01:40:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:05.451021393Z [2024-05-26T01:40:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:05.451026469Z [2024-05-26T01:40:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:39:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:05.457689331Z [2024-05-26T01:40:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:39:00+00:00, map_index=-1, run_start_date=2024-05-26 01:40:03.462653+00:00, run_end_date=2024-05-26 01:40:05.007390+00:00, run_duration=1.544737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:00.710809+00:00, queued_by_job_id=1, pid=11708 2024-05-26T01:40:05.457853207Z [2024-05-26T01:40:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:35:00+00:00, map_index=-1, run_start_date=2024-05-26 01:40:03.816608+00:00, run_end_date=2024-05-26 01:40:04.261349+00:00, run_duration=0.444741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:00.710809+00:00, queued_by_job_id=1, pid=11714 2024-05-26T01:40:05.457996155Z [2024-05-26T01:40:05.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 140fccfb-b723-4cfc-b0df-3716163c8f47 2024-05-26T01:40:06.376381953Z [2024-05-26T01:40:06.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:40:06.376528722Z [2024-05-26T01:40:06.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:39:00+00:00, run_id=scheduled__2024-05-26T01:39:00+00:00, run_start_date=2024-05-26 01:40:00.607379+00:00, run_end_date=2024-05-26 01:40:06.376300+00:00, run_duration=5.768921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:39:00+00:00, data_interval_end=2024-05-26 01:40:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:40:06.394439951Z [2024-05-26T01:40:06.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:41:00+00:00 2024-05-26T01:40:07.572362655Z [2024-05-26T01:40:07.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:39:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:07.580032322Z [2024-05-26T01:40:07.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:39:00+00:00, map_index=-1, run_start_date=2024-05-26 01:40:04.725214+00:00, run_end_date=2024-05-26 01:40:06.305810+00:00, run_duration=1.580596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:00.710809+00:00, queued_by_job_id=1, pid=11726 2024-05-26T01:40:08.636902770Z [2024-05-26T01:40:08.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:40:08.636952993Z 2024-05-26T01:40:08.636971358Z [2024-05-26T01:40:08.636+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:40:08.637478009Z [2024-05-26T01:40:08.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:40:08.637506128Z 2024-05-26T01:40:08.639796022Z [2024-05-26T01:40:08.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:40:08.639811523Z [2024-05-26T01:40:08.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:40:08.712154219Z [2024-05-26T01:40:08.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:08.712200229Z [2024-05-26T01:40:08.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:08.725050006Z [2024-05-26T01:40:08.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 333e70c6-aa5e-47d6-80c2-4bc158ea9264 2024-05-26T01:40:08.725072462Z [2024-05-26T01:40:08.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:35:00+00:00, map_index=-1, run_start_date=2024-05-26 01:40:07.337288+00:00, run_end_date=2024-05-26 01:40:07.678390+00:00, run_duration=0.341102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:05.370782+00:00, queued_by_job_id=1, pid=11739 2024-05-26T01:40:11.078883735Z [2024-05-26T01:40:11.078+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:40:11.078927514Z 2024-05-26T01:40:11.078938239Z [2024-05-26T01:40:11.078+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:40:11.079337997Z [2024-05-26T01:40:11.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:40:11.079438203Z 2024-05-26T01:40:11.081444152Z [2024-05-26T01:40:11.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:40:11.081472758Z [2024-05-26T01:40:11.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:40:11.133059779Z [2024-05-26T01:40:11.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status queued for try_number 1 2024-05-26T01:40:11.133128241Z [2024-05-26T01:40:11.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:11.139858350Z [2024-05-26T01:40:11.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14222c93-d8af-48f4-9fdf-71b06ac626ae 2024-05-26T01:40:11.140024987Z [2024-05-26T01:40:11.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:35:00+00:00, map_index=0, run_start_date=2024-05-26 01:40:10.205063+00:00, run_end_date=2024-05-26 01:40:10.626121+00:00, run_duration=0.421058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:08.637834+00:00, queued_by_job_id=1, pid=11747 2024-05-26T01:40:13.739966739Z [2024-05-26T01:40:13.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:40:13.740381665Z [2024-05-26T01:40:13.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:35:00+00:00, run_id=scheduled__2024-05-26T01:35:00+00:00, run_start_date=2024-05-26 01:40:00.597418+00:00, run_end_date=2024-05-26 01:40:13.739841+00:00, run_duration=13.142423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:35:00+00:00, data_interval_end=2024-05-26 01:40:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:40:13.751169302Z [2024-05-26T01:40:13.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:40:00+00:00, run_after=2024-05-26T01:45:00+00:00 2024-05-26T01:40:13.818884991Z [2024-05-26T01:40:13.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:35:00+00:00 exited with status success for try_number 1 2024-05-26T01:40:13.826193394Z [2024-05-26T01:40:13.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:35:00+00:00, map_index=-1, run_start_date=2024-05-26 01:40:12.647854+00:00, run_end_date=2024-05-26 01:40:13.013447+00:00, run_duration=0.365593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:40:11.079534+00:00, queued_by_job_id=1, pid=11755 2024-05-26T01:41:00.379374513Z [2024-05-26T01:41:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:41:00+00:00, run_after=2024-05-26T01:42:00+00:00 2024-05-26T01:41:00.388068321Z [2024-05-26T01:41:00.387+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:41:00.402314327Z [2024-05-26T01:41:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:41:00+00:00, run_after=2024-05-26T01:42:00+00:00 2024-05-26T01:41:00.508796447Z [2024-05-26T01:41:00.508+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:41:00.508823550Z 2024-05-26T01:41:00.508827359Z 2024-05-26T01:41:00.508830640Z 2024-05-26T01:41:00.508841016Z [2024-05-26T01:41:00.508+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:41:00.508916153Z [2024-05-26T01:41:00.508+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:41:00.509113415Z [2024-05-26T01:41:00.508+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:41:00.509932083Z [2024-05-26T01:41:00.509+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:41:00.509945217Z 2024-05-26T01:41:00.509976231Z 2024-05-26T01:41:00.509982773Z 2024-05-26T01:41:00.513748312Z [2024-05-26T01:41:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:41:00.513781059Z [2024-05-26T01:41:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:41:00.514027490Z [2024-05-26T01:41:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:41:00.514122511Z [2024-05-26T01:41:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:41:00.514313876Z [2024-05-26T01:41:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:41:00.514381831Z [2024-05-26T01:41:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:41:00.818335741Z [2024-05-26T01:41:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:41:00.818362814Z [2024-05-26T01:41:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:41:00.818397477Z [2024-05-26T01:41:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:41:00.833288742Z [2024-05-26T01:41:00.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45af254b-0dd3-4fc5-ac78-65dc6d05097a 2024-05-26T01:41:00.833416400Z [2024-05-26T01:41:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71487d22-05a4-439e-8a07-b1874ddbaa67 2024-05-26T01:41:00.833518204Z [2024-05-26T01:41:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95e12da0-0e5f-4755-9616-8dec7345f200 2024-05-26T01:41:02.001192863Z [2024-05-26T01:41:02.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:41:02.001441302Z [2024-05-26T01:41:02.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:40:00+00:00, run_id=scheduled__2024-05-26T01:40:00+00:00, run_start_date=2024-05-26 01:41:00.415960+00:00, run_end_date=2024-05-26 01:41:02.001110+00:00, run_duration=1.58515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:40:00+00:00, data_interval_end=2024-05-26 01:41:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:41:02.017777687Z [2024-05-26T01:41:02.017+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:41:00+00:00, run_after=2024-05-26T01:42:00+00:00 2024-05-26T01:41:02.360120773Z [2024-05-26T01:41:02.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:41:02.365235864Z [2024-05-26T01:41:02.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=-1, run_start_date=2024-05-26 01:41:01.532099+00:00, run_end_date=2024-05-26 01:41:01.966085+00:00, run_duration=0.433986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:41:00.510712+00:00, queued_by_job_id=1, pid=11777 2024-05-26T01:41:05.699370754Z [2024-05-26T01:41:05.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:41:05.699408087Z [2024-05-26T01:41:05.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:40:00+00:00, run_id=scheduled__2024-05-26T01:40:00+00:00, run_start_date=2024-05-26 01:41:00.417390+00:00, run_end_date=2024-05-26 01:41:05.698437+00:00, run_duration=5.281047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:40:00+00:00, data_interval_end=2024-05-26 01:41:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:41:05.707571769Z [2024-05-26T01:41:05.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:41:00+00:00, run_after=2024-05-26T01:42:00+00:00 2024-05-26T01:41:05.714295025Z [2024-05-26T01:41:05.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:41:05.714807177Z [2024-05-26T01:41:05.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:40:00+00:00, run_id=scheduled__2024-05-26T01:40:00+00:00, run_start_date=2024-05-26 01:41:00.418550+00:00, run_end_date=2024-05-26 01:41:05.714226+00:00, run_duration=5.295676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:40:00+00:00, data_interval_end=2024-05-26 01:41:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:41:05.724642126Z [2024-05-26T01:41:05.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:41:00+00:00, run_after=2024-05-26T01:42:00+00:00 2024-05-26T01:41:05.753525774Z [2024-05-26T01:41:05.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:41:05.753834708Z [2024-05-26T01:41:05.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:41:05.760965293Z [2024-05-26T01:41:05.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=-1, run_start_date=2024-05-26 01:41:02.606061+00:00, run_end_date=2024-05-26 01:41:05.137990+00:00, run_duration=2.531929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:41:00.510712+00:00, queued_by_job_id=1, pid=11795 2024-05-26T01:41:05.761496001Z [2024-05-26T01:41:05.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=-1, run_start_date=2024-05-26 01:41:02.615209+00:00, run_end_date=2024-05-26 01:41:04.880484+00:00, run_duration=2.265275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:41:00.510712+00:00, queued_by_job_id=1, pid=11796 2024-05-26T01:42:00.865484930Z [2024-05-26T01:42:00.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:42:00+00:00, run_after=2024-05-26T01:43:00+00:00 2024-05-26T01:42:00.876408707Z [2024-05-26T01:42:00.875+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:42:00.894157239Z [2024-05-26T01:42:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:42:00+00:00, run_after=2024-05-26T01:43:00+00:00 2024-05-26T01:42:00.908447417Z [2024-05-26T01:42:00.908+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:42:01.031898751Z [2024-05-26T01:42:01.031+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:42:01.031934460Z 2024-05-26T01:42:01.031940793Z 2024-05-26T01:42:01.031965061Z 2024-05-26T01:42:01.031970971Z 2024-05-26T01:42:01.031987307Z [2024-05-26T01:42:01.031+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:42:01.032044142Z [2024-05-26T01:42:01.031+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:42:01.032146948Z [2024-05-26T01:42:01.031+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:42:01.032285226Z [2024-05-26T01:42:01.032+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:42:01.033035582Z [2024-05-26T01:42:01.032+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:42:01.033049804Z 2024-05-26T01:42:01.033055979Z 2024-05-26T01:42:01.033060844Z 2024-05-26T01:42:01.033065509Z 2024-05-26T01:42:01.039617409Z [2024-05-26T01:42:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:42:01.039640254Z [2024-05-26T01:42:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:42:01.039644728Z [2024-05-26T01:42:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:42:01.039648256Z [2024-05-26T01:42:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:42:01.039651906Z [2024-05-26T01:42:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:42:01.039668544Z [2024-05-26T01:42:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:42:01.040059929Z [2024-05-26T01:42:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:42:01.040227181Z [2024-05-26T01:42:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:42:01.526086844Z [2024-05-26T01:42:01.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:42:01.526357571Z [2024-05-26T01:42:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:41:00+00:00 exited with status queued for try_number 1 2024-05-26T01:42:01.526553139Z [2024-05-26T01:42:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:41:00+00:00 exited with status queued for try_number 1 2024-05-26T01:42:01.526740956Z [2024-05-26T01:42:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:41:00+00:00 exited with status queued for try_number 1 2024-05-26T01:42:01.551544335Z [2024-05-26T01:42:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to a921168e-290d-4bd7-b066-dab6f4f992db 2024-05-26T01:42:01.551980610Z [2024-05-26T01:42:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37191917-3a42-40e2-8eb0-74d2e4bda3b2 2024-05-26T01:42:01.552175516Z [2024-05-26T01:42:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71164ec4-b14f-488e-b7b2-1038816a243e 2024-05-26T01:42:01.552333150Z [2024-05-26T01:42:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to c99d0665-9fd7-4813-b050-24aa7d3edbf4 2024-05-26T01:42:02.886429733Z [2024-05-26T01:42:02.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:42:02.886857107Z [2024-05-26T01:42:02.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:41:00+00:00, run_id=scheduled__2024-05-26T01:41:00+00:00, run_start_date=2024-05-26 01:42:00.930898+00:00, run_end_date=2024-05-26 01:42:02.886523+00:00, run_duration=1.955625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:41:00+00:00, data_interval_end=2024-05-26 01:42:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:42:02.896252600Z [2024-05-26T01:42:02.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:42:00+00:00, run_after=2024-05-26T01:43:00+00:00 2024-05-26T01:42:02.903394260Z [2024-05-26T01:42:02.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:42:02.904054228Z [2024-05-26T01:42:02.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:40:00+00:00, run_id=scheduled__2024-05-26T01:40:00+00:00, run_start_date=2024-05-26 01:42:00.928974+00:00, run_end_date=2024-05-26 01:42:02.903691+00:00, run_duration=1.974717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:40:00+00:00, data_interval_end=2024-05-26 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:42:02.911307101Z [2024-05-26T01:42:02.911+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:42:00+00:00, run_after=2024-05-26T01:44:00+00:00 2024-05-26T01:42:02.973175354Z [2024-05-26T01:42:02.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:42:02.973447164Z [2024-05-26T01:42:02.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:41:00+00:00 exited with status success for try_number 1 2024-05-26T01:42:02.988335345Z [2024-05-26T01:42:02.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=-1, run_start_date=2024-05-26 01:42:01.968391+00:00, run_end_date=2024-05-26 01:42:02.444440+00:00, run_duration=0.476049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:42:01.034039+00:00, queued_by_job_id=1, pid=11830 2024-05-26T01:42:02.988638530Z [2024-05-26T01:42:02.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:41:00+00:00, map_index=-1, run_start_date=2024-05-26 01:42:01.848038+00:00, run_end_date=2024-05-26 01:42:02.317835+00:00, run_duration=0.469797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:42:01.034039+00:00, queued_by_job_id=1, pid=11829 2024-05-26T01:42:05.628991605Z [2024-05-26T01:42:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:42:05.629271245Z [2024-05-26T01:42:05.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:41:00+00:00, run_id=scheduled__2024-05-26T01:41:00+00:00, run_start_date=2024-05-26 01:42:00.932512+00:00, run_end_date=2024-05-26 01:42:05.628974+00:00, run_duration=4.696462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:41:00+00:00, data_interval_end=2024-05-26 01:42:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:42:05.637948276Z [2024-05-26T01:42:05.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:42:00+00:00, run_after=2024-05-26T01:43:00+00:00 2024-05-26T01:42:05.644487393Z [2024-05-26T01:42:05.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:42:05.644735891Z [2024-05-26T01:42:05.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:41:00+00:00, run_id=scheduled__2024-05-26T01:41:00+00:00, run_start_date=2024-05-26 01:42:00.934181+00:00, run_end_date=2024-05-26 01:42:05.644462+00:00, run_duration=4.710281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:41:00+00:00, data_interval_end=2024-05-26 01:42:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:42:05.655974809Z [2024-05-26T01:42:05.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:42:00+00:00, run_after=2024-05-26T01:43:00+00:00 2024-05-26T01:42:05.688482092Z [2024-05-26T01:42:05.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:41:00+00:00 exited with status success for try_number 1 2024-05-26T01:42:05.688602888Z [2024-05-26T01:42:05.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:41:00+00:00 exited with status success for try_number 1 2024-05-26T01:42:05.694785777Z [2024-05-26T01:42:05.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:41:00+00:00, map_index=-1, run_start_date=2024-05-26 01:42:03.180037+00:00, run_end_date=2024-05-26 01:42:05.034566+00:00, run_duration=1.854529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:42:01.034039+00:00, queued_by_job_id=1, pid=11853 2024-05-26T01:42:05.695062562Z [2024-05-26T01:42:05.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:41:00+00:00, map_index=-1, run_start_date=2024-05-26 01:42:03.166634+00:00, run_end_date=2024-05-26 01:42:04.729146+00:00, run_duration=1.562512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:42:01.034039+00:00, queued_by_job_id=1, pid=11854 2024-05-26T01:43:00.169939178Z [2024-05-26T01:43:00.169+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:43:00.191698782Z [2024-05-26T01:43:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:43:00+00:00, run_after=2024-05-26T01:44:00+00:00 2024-05-26T01:43:00.207171022Z [2024-05-26T01:43:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:43:00+00:00, run_after=2024-05-26T01:44:00+00:00 2024-05-26T01:43:00.328503731Z [2024-05-26T01:43:00.327+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:43:00.328546809Z 2024-05-26T01:43:00.328554172Z 2024-05-26T01:43:00.328582762Z 2024-05-26T01:43:00.328856751Z [2024-05-26T01:43:00.328+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:43:00.329215102Z [2024-05-26T01:43:00.328+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:43:00.329531975Z [2024-05-26T01:43:00.329+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:43:00.331060589Z [2024-05-26T01:43:00.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:43:00.331090832Z 2024-05-26T01:43:00.331100778Z 2024-05-26T01:43:00.331109480Z 2024-05-26T01:43:00.337390684Z [2024-05-26T01:43:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:43:00.337706829Z [2024-05-26T01:43:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:43:00.338165673Z [2024-05-26T01:43:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:43:00.338391252Z [2024-05-26T01:43:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:43:00.338766948Z [2024-05-26T01:43:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:43:00.339102720Z [2024-05-26T01:43:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:43:00.537424772Z [2024-05-26T01:43:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status queued for try_number 1 2024-05-26T01:43:00.537551588Z [2024-05-26T01:43:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status queued for try_number 1 2024-05-26T01:43:00.537656257Z [2024-05-26T01:43:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status queued for try_number 1 2024-05-26T01:43:00.546475980Z [2024-05-26T01:43:00.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to e30846b0-07c5-4e19-806b-b2bdfd1e6139 2024-05-26T01:43:00.546645816Z [2024-05-26T01:43:00.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81a80305-0a6c-4791-9575-6d502fdee3d2 2024-05-26T01:43:00.546895039Z [2024-05-26T01:43:00.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97ae8a1b-1e43-4906-bdab-5d34ae91e0c7 2024-05-26T01:43:02.805779628Z [2024-05-26T01:43:02.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:43:02.806621750Z [2024-05-26T01:43:02.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:42:00+00:00, run_id=scheduled__2024-05-26T01:42:00+00:00, run_start_date=2024-05-26 01:43:00.230664+00:00, run_end_date=2024-05-26 01:43:02.805910+00:00, run_duration=2.575246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:42:00+00:00, data_interval_end=2024-05-26 01:43:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:43:02.821738027Z [2024-05-26T01:43:02.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:43:00+00:00, run_after=2024-05-26T01:44:00+00:00 2024-05-26T01:43:02.890835780Z [2024-05-26T01:43:02.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status success for try_number 1 2024-05-26T01:43:02.898592834Z [2024-05-26T01:43:02.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:42:00+00:00, map_index=-1, run_start_date=2024-05-26 01:43:01.415119+00:00, run_end_date=2024-05-26 01:43:01.838510+00:00, run_duration=0.423391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:43:00.332849+00:00, queued_by_job_id=1, pid=11886 2024-05-26T01:43:03.950715947Z [2024-05-26T01:43:03.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:43:03.951031393Z [2024-05-26T01:43:03.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:42:00+00:00, run_id=scheduled__2024-05-26T01:42:00+00:00, run_start_date=2024-05-26 01:43:00.232985+00:00, run_end_date=2024-05-26 01:43:03.950750+00:00, run_duration=3.717765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:42:00+00:00, data_interval_end=2024-05-26 01:43:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:43:03.959319642Z [2024-05-26T01:43:03.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:43:00+00:00, run_after=2024-05-26T01:44:00+00:00 2024-05-26T01:43:04.032882643Z [2024-05-26T01:43:04.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status success for try_number 1 2024-05-26T01:43:04.040577763Z [2024-05-26T01:43:04.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:42:00+00:00, map_index=-1, run_start_date=2024-05-26 01:43:02.190637+00:00, run_end_date=2024-05-26 01:43:03.511468+00:00, run_duration=1.320831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:43:00.332849+00:00, queued_by_job_id=1, pid=11903 2024-05-26T01:43:04.383819185Z [2024-05-26T01:43:04.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:43:04.384474283Z [2024-05-26T01:43:04.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:42:00+00:00, run_id=scheduled__2024-05-26T01:42:00+00:00, run_start_date=2024-05-26 01:43:00.234999+00:00, run_end_date=2024-05-26 01:43:04.383892+00:00, run_duration=4.148893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:42:00+00:00, data_interval_end=2024-05-26 01:43:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:43:04.398470968Z [2024-05-26T01:43:04.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:43:00+00:00, run_after=2024-05-26T01:44:00+00:00 2024-05-26T01:43:04.444380990Z [2024-05-26T01:43:04.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status success for try_number 1 2024-05-26T01:43:04.463681370Z [2024-05-26T01:43:04.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:42:00+00:00, map_index=-1, run_start_date=2024-05-26 01:43:02.301230+00:00, run_end_date=2024-05-26 01:43:04.006766+00:00, run_duration=1.705536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:43:00.332849+00:00, queued_by_job_id=1, pid=11904 2024-05-26T01:43:32.718396261Z [2024-05-26T01:43:32.718+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:44:00.282673092Z [2024-05-26T01:44:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:44:00+00:00, run_after=2024-05-26T01:45:00+00:00 2024-05-26T01:44:00.298810019Z [2024-05-26T01:44:00.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:44:00+00:00, run_after=2024-05-26T01:45:00+00:00 2024-05-26T01:44:00.306826715Z [2024-05-26T01:44:00.306+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:44:00.316590791Z [2024-05-26T01:44:00.316+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:44:00.393520909Z [2024-05-26T01:44:00.392+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:44:00.393561849Z 2024-05-26T01:44:00.393581546Z 2024-05-26T01:44:00.393590735Z 2024-05-26T01:44:00.393600062Z 2024-05-26T01:44:00.394549795Z [2024-05-26T01:44:00.393+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:44:00.394981303Z [2024-05-26T01:44:00.394+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:44:00.395587849Z [2024-05-26T01:44:00.395+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:44:00.396069012Z [2024-05-26T01:44:00.395+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:44:00.397383746Z [2024-05-26T01:44:00.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:44:00.397393804Z 2024-05-26T01:44:00.397399306Z 2024-05-26T01:44:00.397404515Z 2024-05-26T01:44:00.397410119Z 2024-05-26T01:44:00.404333907Z [2024-05-26T01:44:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:44:00.404681724Z [2024-05-26T01:44:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:44:00.405282466Z [2024-05-26T01:44:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:44:00.405654079Z [2024-05-26T01:44:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:44:00.406139205Z [2024-05-26T01:44:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:44:00.406407116Z [2024-05-26T01:44:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:44:00.406727701Z [2024-05-26T01:44:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:44:00.406924993Z [2024-05-26T01:44:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:44:00.748336393Z [2024-05-26T01:44:00.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status queued for try_number 1 2024-05-26T01:44:00.751975571Z [2024-05-26T01:44:00.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:43:00+00:00 exited with status queued for try_number 1 2024-05-26T01:44:00.752352026Z [2024-05-26T01:44:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:43:00+00:00 exited with status queued for try_number 1 2024-05-26T01:44:00.752537448Z [2024-05-26T01:44:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:43:00+00:00 exited with status queued for try_number 1 2024-05-26T01:44:00.767855572Z [2024-05-26T01:44:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19836dc4-1489-4419-9b3e-f7d662613cda 2024-05-26T01:44:00.768111743Z [2024-05-26T01:44:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a1e8af6-bacc-4c90-b3fc-3d95ae3b1441 2024-05-26T01:44:00.768242573Z [2024-05-26T01:44:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to efa61b6b-41c5-41f4-aadd-b0e5991539b6 2024-05-26T01:44:00.768344029Z [2024-05-26T01:44:00.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3cb194d-b29b-4589-8cf1-8bff14f5173c 2024-05-26T01:44:02.113810318Z [2024-05-26T01:44:02.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:44:02.114423602Z [2024-05-26T01:44:02.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:42:00+00:00, run_id=scheduled__2024-05-26T01:42:00+00:00, run_start_date=2024-05-26 01:44:00.328351+00:00, run_end_date=2024-05-26 01:44:02.114019+00:00, run_duration=1.785668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:42:00+00:00, data_interval_end=2024-05-26 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:44:02.123366196Z [2024-05-26T01:44:02.123+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:44:00+00:00, run_after=2024-05-26T01:46:00+00:00 2024-05-26T01:44:02.131429806Z [2024-05-26T01:44:02.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:44:02.132115512Z [2024-05-26T01:44:02.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:43:00+00:00, run_id=scheduled__2024-05-26T01:43:00+00:00, run_start_date=2024-05-26 01:44:00.329480+00:00, run_end_date=2024-05-26 01:44:02.131754+00:00, run_duration=1.802274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:43:00+00:00, data_interval_end=2024-05-26 01:44:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:44:02.150463434Z [2024-05-26T01:44:02.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:44:00+00:00, run_after=2024-05-26T01:45:00+00:00 2024-05-26T01:44:02.224707824Z [2024-05-26T01:44:02.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:42:00+00:00 exited with status success for try_number 1 2024-05-26T01:44:02.224739283Z [2024-05-26T01:44:02.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:43:00+00:00 exited with status success for try_number 1 2024-05-26T01:44:02.237469413Z [2024-05-26T01:44:02.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:43:00+00:00, map_index=-1, run_start_date=2024-05-26 01:44:01.412242+00:00, run_end_date=2024-05-26 01:44:01.815773+00:00, run_duration=0.403531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:44:00.399022+00:00, queued_by_job_id=1, pid=11944 2024-05-26T01:44:02.237570598Z [2024-05-26T01:44:02.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:42:00+00:00, map_index=-1, run_start_date=2024-05-26 01:44:01.083089+00:00, run_end_date=2024-05-26 01:44:01.467367+00:00, run_duration=0.384278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:44:00.399022+00:00, queued_by_job_id=1, pid=11933 2024-05-26T01:44:04.444908375Z [2024-05-26T01:44:04.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:44:04.445161258Z [2024-05-26T01:44:04.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:43:00+00:00, run_id=scheduled__2024-05-26T01:43:00+00:00, run_start_date=2024-05-26 01:44:00.330402+00:00, run_end_date=2024-05-26 01:44:04.444836+00:00, run_duration=4.114434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:43:00+00:00, data_interval_end=2024-05-26 01:44:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:44:04.473687948Z [2024-05-26T01:44:04.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:44:00+00:00, run_after=2024-05-26T01:45:00+00:00 2024-05-26T01:44:04.563644498Z [2024-05-26T01:44:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:43:00+00:00 exited with status success for try_number 1 2024-05-26T01:44:04.564817088Z [2024-05-26T01:44:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:43:00+00:00, map_index=-1, run_start_date=2024-05-26 01:44:02.382542+00:00, run_end_date=2024-05-26 01:44:04.083189+00:00, run_duration=1.700647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:44:00.399022+00:00, queued_by_job_id=1, pid=11963 2024-05-26T01:44:05.635173387Z [2024-05-26T01:44:05.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:44:05.635575650Z [2024-05-26T01:44:05.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:43:00+00:00, run_id=scheduled__2024-05-26T01:43:00+00:00, run_start_date=2024-05-26 01:44:00.331291+00:00, run_end_date=2024-05-26 01:44:05.635111+00:00, run_duration=5.30382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:43:00+00:00, data_interval_end=2024-05-26 01:44:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:44:05.647147745Z [2024-05-26T01:44:05.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:44:00+00:00, run_after=2024-05-26T01:45:00+00:00 2024-05-26T01:44:05.724531693Z [2024-05-26T01:44:05.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:43:00+00:00 exited with status success for try_number 1 2024-05-26T01:44:05.733238728Z [2024-05-26T01:44:05.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:43:00+00:00, map_index=-1, run_start_date=2024-05-26 01:44:02.362930+00:00, run_end_date=2024-05-26 01:44:04.631352+00:00, run_duration=2.268422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:44:00.399022+00:00, queued_by_job_id=1, pid=11962 2024-05-26T01:45:00.949261475Z [2024-05-26T01:45:00.948+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:45:00.966581906Z [2024-05-26T01:45:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:45:00+00:00, run_after=2024-05-26T01:46:00+00:00 2024-05-26T01:45:00.981723378Z [2024-05-26T01:45:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:45:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:45:00.993366232Z [2024-05-26T01:45:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:45:00+00:00, run_after=2024-05-26T01:46:00+00:00 2024-05-26T01:45:01.104400908Z [2024-05-26T01:45:01.103+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:45:01.104445106Z 2024-05-26T01:45:01.104454622Z 2024-05-26T01:45:01.104461828Z 2024-05-26T01:45:01.104468866Z 2024-05-26T01:45:01.104475900Z [2024-05-26T01:45:01.104+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:45:01.104560835Z [2024-05-26T01:45:01.104+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:45:01.104785487Z [2024-05-26T01:45:01.104+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:45:01.104922814Z [2024-05-26T01:45:01.104+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:45:01.105774415Z [2024-05-26T01:45:01.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:45:01.105795711Z 2024-05-26T01:45:01.105807390Z 2024-05-26T01:45:01.105817917Z 2024-05-26T01:45:01.105828249Z 2024-05-26T01:45:01.111864292Z [2024-05-26T01:45:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:45:01.111920253Z [2024-05-26T01:45:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:45:01.112191855Z [2024-05-26T01:45:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:45:01.112238161Z [2024-05-26T01:45:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:45:01.112572076Z [2024-05-26T01:45:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:45:01.112607887Z [2024-05-26T01:45:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:45:01.112943150Z [2024-05-26T01:45:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:45:01.113009470Z [2024-05-26T01:45:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:45:01.502048520Z [2024-05-26T01:45:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:45:01.502164035Z [2024-05-26T01:45:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status queued for try_number 1 2024-05-26T01:45:01.502282602Z [2024-05-26T01:45:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status queued for try_number 1 2024-05-26T01:45:01.502404458Z [2024-05-26T01:45:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status queued for try_number 1 2024-05-26T01:45:01.510750395Z [2024-05-26T01:45:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4941c21-97ce-44a1-a373-d67fed0480b0 2024-05-26T01:45:01.510886299Z [2024-05-26T01:45:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc6fb8e1-f32a-4452-97ec-f67a9ee25166 2024-05-26T01:45:01.511050910Z [2024-05-26T01:45:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b029e7b-b797-45d1-97ec-b2eda9cfd4ae 2024-05-26T01:45:01.511201710Z [2024-05-26T01:45:01.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03a3e84c-2d94-4880-a6fe-09e98cbd4d48 2024-05-26T01:45:03.000469292Z [2024-05-26T01:45:03.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:45:03.003888242Z [2024-05-26T01:45:03.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:44:00+00:00, run_id=scheduled__2024-05-26T01:44:00+00:00, run_start_date=2024-05-26 01:45:01.010108+00:00, run_end_date=2024-05-26 01:45:03.000351+00:00, run_duration=1.990243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:44:00+00:00, data_interval_end=2024-05-26 01:45:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:45:03.013999948Z [2024-05-26T01:45:03.013+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:45:00+00:00, run_after=2024-05-26T01:46:00+00:00 2024-05-26T01:45:03.084305457Z [2024-05-26T01:45:03.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status success for try_number 1 2024-05-26T01:45:03.091753681Z [2024-05-26T01:45:03.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:44:00+00:00, map_index=-1, run_start_date=2024-05-26 01:45:02.223179+00:00, run_end_date=2024-05-26 01:45:02.636548+00:00, run_duration=0.413369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:45:01.106685+00:00, queued_by_job_id=1, pid=11995 2024-05-26T01:45:05.729320182Z [2024-05-26T01:45:05.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:45:05.732686940Z [2024-05-26T01:45:05.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:44:00+00:00, run_id=scheduled__2024-05-26T01:44:00+00:00, run_start_date=2024-05-26 01:45:01.011304+00:00, run_end_date=2024-05-26 01:45:05.730837+00:00, run_duration=4.719533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:44:00+00:00, data_interval_end=2024-05-26 01:45:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:45:05.744224078Z [2024-05-26T01:45:05.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:45:00+00:00, run_after=2024-05-26T01:46:00+00:00 2024-05-26T01:45:05.775840142Z [2024-05-26T01:45:05.774+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:45:05.775927947Z 2024-05-26T01:45:05.775933947Z [2024-05-26T01:45:05.774+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:45:05.775938001Z [2024-05-26T01:45:05.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:45:05.775941120Z 2024-05-26T01:45:05.780183834Z [2024-05-26T01:45:05.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:45:05.780575190Z [2024-05-26T01:45:05.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:45:05.869144731Z [2024-05-26T01:45:05.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:45:05.869284998Z [2024-05-26T01:45:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:45:05.869435722Z [2024-05-26T01:45:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status success for try_number 1 2024-05-26T01:45:05.882794300Z [2024-05-26T01:45:05.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:44:00+00:00, map_index=-1, run_start_date=2024-05-26 01:45:03.478886+00:00, run_end_date=2024-05-26 01:45:05.360056+00:00, run_duration=1.88117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:45:01.106685+00:00, queued_by_job_id=1, pid=12019 2024-05-26T01:45:05.882823802Z [2024-05-26T01:45:05.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 110b0062-452b-4f86-9feb-e15b103bae7c 2024-05-26T01:45:05.882827892Z [2024-05-26T01:45:05.881+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=-1, run_start_date=2024-05-26 01:45:03.818258+00:00, run_end_date=2024-05-26 01:45:04.769664+00:00, run_duration=0.951406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:45:01.106685+00:00, queued_by_job_id=1, pid=12021 2024-05-26T01:45:08.078327878Z [2024-05-26T01:45:08.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:45:08.078807932Z [2024-05-26T01:45:08.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:44:00+00:00, run_id=scheduled__2024-05-26T01:44:00+00:00, run_start_date=2024-05-26 01:45:01.012868+00:00, run_end_date=2024-05-26 01:45:08.078485+00:00, run_duration=7.065617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:44:00+00:00, data_interval_end=2024-05-26 01:45:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:45:08.087037304Z [2024-05-26T01:45:08.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:45:00+00:00, run_after=2024-05-26T01:46:00+00:00 2024-05-26T01:45:08.114527542Z [2024-05-26T01:45:08.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status success for try_number 1 2024-05-26T01:45:08.119132260Z [2024-05-26T01:45:08.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:44:00+00:00, map_index=-1, run_start_date=2024-05-26 01:45:03.584267+00:00, run_end_date=2024-05-26 01:45:07.124566+00:00, run_duration=3.540299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:45:01.106685+00:00, queued_by_job_id=1, pid=12020 2024-05-26T01:45:09.215348946Z [2024-05-26T01:45:09.214+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:45:09.215381994Z 2024-05-26T01:45:09.215858662Z [2024-05-26T01:45:09.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:45:09.216783009Z [2024-05-26T01:45:09.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:45:09.216796652Z 2024-05-26T01:45:09.223825048Z [2024-05-26T01:45:09.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:45:09.224105198Z [2024-05-26T01:45:09.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:45:09.316333958Z [2024-05-26T01:45:09.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:45:09.316624351Z [2024-05-26T01:45:09.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:45:09.324802720Z [2024-05-26T01:45:09.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79542a67-b848-4919-99ac-4d3cb3b609fe 2024-05-26T01:45:09.324874637Z [2024-05-26T01:45:09.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=-1, run_start_date=2024-05-26 01:45:07.573410+00:00, run_end_date=2024-05-26 01:45:07.924524+00:00, run_duration=0.351114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:45:05.776307+00:00, queued_by_job_id=1, pid=12044 2024-05-26T01:45:11.513483333Z [2024-05-26T01:45:11.512+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:45:11.513504006Z 2024-05-26T01:45:11.513647868Z [2024-05-26T01:45:11.513+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:45:11.514203805Z [2024-05-26T01:45:11.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:45:11.514214431Z 2024-05-26T01:45:11.520822121Z [2024-05-26T01:45:11.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:45:11.521273887Z [2024-05-26T01:45:11.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:45:11.679580526Z [2024-05-26T01:45:11.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status queued for try_number 1 2024-05-26T01:45:11.683128108Z [2024-05-26T01:45:11.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:45:11.706845229Z [2024-05-26T01:45:11.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95f68034-8136-476c-933a-17cefa0ab0f0 2024-05-26T01:45:11.707237032Z [2024-05-26T01:45:11.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=0, run_start_date=2024-05-26 01:45:11.037898+00:00, run_end_date=2024-05-26 01:45:11.475774+00:00, run_duration=0.437876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:45:09.217378+00:00, queued_by_job_id=1, pid=12052 2024-05-26T01:45:14.300700866Z [2024-05-26T01:45:14.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:45:14.301090558Z [2024-05-26T01:45:14.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:40:00+00:00, run_id=scheduled__2024-05-26T01:40:00+00:00, run_start_date=2024-05-26 01:45:01.008467+00:00, run_end_date=2024-05-26 01:45:14.300597+00:00, run_duration=13.29213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:40:00+00:00, data_interval_end=2024-05-26 01:45:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:45:14.308853325Z [2024-05-26T01:45:14.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:45:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:45:14.355778516Z [2024-05-26T01:45:14.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:40:00+00:00 exited with status success for try_number 1 2024-05-26T01:45:14.361845850Z [2024-05-26T01:45:14.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:40:00+00:00, map_index=-1, run_start_date=2024-05-26 01:45:13.516394+00:00, run_end_date=2024-05-26 01:45:13.929730+00:00, run_duration=0.413336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:45:11.516001+00:00, queued_by_job_id=1, pid=12060 2024-05-26T01:46:01.010541778Z [2024-05-26T01:46:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:46:00+00:00, run_after=2024-05-26T01:47:00+00:00 2024-05-26T01:46:01.018231397Z [2024-05-26T01:46:01.017+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:46:01.041114388Z [2024-05-26T01:46:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:46:00+00:00, run_after=2024-05-26T01:47:00+00:00 2024-05-26T01:46:01.053612729Z [2024-05-26T01:46:01.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:46:01.142552287Z [2024-05-26T01:46:01.141+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:46:01.142601322Z 2024-05-26T01:46:01.142614233Z 2024-05-26T01:46:01.142624414Z 2024-05-26T01:46:01.142634448Z 2024-05-26T01:46:01.142909004Z [2024-05-26T01:46:01.142+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:46:01.143449595Z [2024-05-26T01:46:01.142+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:46:01.143939297Z [2024-05-26T01:46:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:46:01.144337176Z [2024-05-26T01:46:01.143+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:46:01.146294423Z [2024-05-26T01:46:01.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:46:01.146319482Z 2024-05-26T01:46:01.146330605Z 2024-05-26T01:46:01.146340201Z 2024-05-26T01:46:01.146381354Z 2024-05-26T01:46:01.155595107Z [2024-05-26T01:46:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:46:01.155684161Z [2024-05-26T01:46:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:46:01.156235956Z [2024-05-26T01:46:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:46:01.156464453Z [2024-05-26T01:46:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:46:01.156932144Z [2024-05-26T01:46:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:46:01.157201552Z [2024-05-26T01:46:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:46:01.157669038Z [2024-05-26T01:46:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:46:01.157844661Z [2024-05-26T01:46:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:46:01.772362580Z [2024-05-26T01:46:01.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status queued for try_number 1 2024-05-26T01:46:01.772474008Z [2024-05-26T01:46:01.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status queued for try_number 1 2024-05-26T01:46:01.772574717Z [2024-05-26T01:46:01.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status queued for try_number 1 2024-05-26T01:46:01.772658021Z [2024-05-26T01:46:01.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status queued for try_number 1 2024-05-26T01:46:01.792912960Z [2024-05-26T01:46:01.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cfd923c-6e75-44c2-8b7c-1aa68f921b09 2024-05-26T01:46:01.793074909Z [2024-05-26T01:46:01.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to c061b6b9-e22b-46b1-a415-3205cdb16afe 2024-05-26T01:46:01.793230696Z [2024-05-26T01:46:01.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to e477a513-cf5a-44fb-817f-ba6f66f5b27f 2024-05-26T01:46:01.793386984Z [2024-05-26T01:46:01.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7061c60-431b-43c3-8d62-337ca4a5238d 2024-05-26T01:46:04.087591308Z [2024-05-26T01:46:04.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:46:04.088188184Z [2024-05-26T01:46:04.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:45:00+00:00, run_id=scheduled__2024-05-26T01:45:00+00:00, run_start_date=2024-05-26 01:46:01.071863+00:00, run_end_date=2024-05-26 01:46:04.087799+00:00, run_duration=3.015936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:45:00+00:00, data_interval_end=2024-05-26 01:46:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:46:04.105765296Z [2024-05-26T01:46:04.105+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:46:00+00:00, run_after=2024-05-26T01:47:00+00:00 2024-05-26T01:46:04.119257713Z [2024-05-26T01:46:04.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:46:04.119841477Z [2024-05-26T01:46:04.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:44:00+00:00, run_id=scheduled__2024-05-26T01:44:00+00:00, run_start_date=2024-05-26 01:46:01.067821+00:00, run_end_date=2024-05-26 01:46:04.119395+00:00, run_duration=3.051574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:44:00+00:00, data_interval_end=2024-05-26 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:46:04.145618319Z [2024-05-26T01:46:04.145+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:46:00+00:00, run_after=2024-05-26T01:48:00+00:00 2024-05-26T01:46:04.222541835Z [2024-05-26T01:46:04.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:44:00+00:00 exited with status success for try_number 1 2024-05-26T01:46:04.222692896Z [2024-05-26T01:46:04.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status success for try_number 1 2024-05-26T01:46:04.229605660Z [2024-05-26T01:46:04.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:44:00+00:00, map_index=-1, run_start_date=2024-05-26 01:46:02.373936+00:00, run_end_date=2024-05-26 01:46:02.910535+00:00, run_duration=0.536599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:46:01.149542+00:00, queued_by_job_id=1, pid=12083 2024-05-26T01:46:04.229869535Z [2024-05-26T01:46:04.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:45:00+00:00, map_index=-1, run_start_date=2024-05-26 01:46:02.537155+00:00, run_end_date=2024-05-26 01:46:03.170774+00:00, run_duration=0.633619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:46:01.149542+00:00, queued_by_job_id=1, pid=12085 2024-05-26T01:46:06.400875730Z [2024-05-26T01:46:06.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:46:06.400930739Z [2024-05-26T01:46:06.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:45:00+00:00, run_id=scheduled__2024-05-26T01:45:00+00:00, run_start_date=2024-05-26 01:46:01.073104+00:00, run_end_date=2024-05-26 01:46:06.400680+00:00, run_duration=5.327576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:45:00+00:00, data_interval_end=2024-05-26 01:46:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:46:06.410371154Z [2024-05-26T01:46:06.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:46:00+00:00, run_after=2024-05-26T01:47:00+00:00 2024-05-26T01:46:06.417237919Z [2024-05-26T01:46:06.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:46:06.417427944Z [2024-05-26T01:46:06.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:45:00+00:00, run_id=scheduled__2024-05-26T01:45:00+00:00, run_start_date=2024-05-26 01:46:01.074108+00:00, run_end_date=2024-05-26 01:46:06.417105+00:00, run_duration=5.342997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:45:00+00:00, data_interval_end=2024-05-26 01:46:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:46:06.428777509Z [2024-05-26T01:46:06.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:46:00+00:00, run_after=2024-05-26T01:47:00+00:00 2024-05-26T01:46:06.479488853Z [2024-05-26T01:46:06.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status success for try_number 1 2024-05-26T01:46:06.479594175Z [2024-05-26T01:46:06.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status success for try_number 1 2024-05-26T01:46:06.489761558Z [2024-05-26T01:46:06.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:45:00+00:00, map_index=-1, run_start_date=2024-05-26 01:46:03.646109+00:00, run_end_date=2024-05-26 01:46:05.329201+00:00, run_duration=1.683092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:46:01.149542+00:00, queued_by_job_id=1, pid=12102 2024-05-26T01:46:06.490404342Z [2024-05-26T01:46:06.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:45:00+00:00, map_index=-1, run_start_date=2024-05-26 01:46:03.906164+00:00, run_end_date=2024-05-26 01:46:05.707010+00:00, run_duration=1.800846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:46:01.149542+00:00, queued_by_job_id=1, pid=12108 2024-05-26T01:47:00.963217723Z [2024-05-26T01:47:00.962+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:47:00.984514138Z [2024-05-26T01:47:00.983+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:47:00+00:00, run_after=2024-05-26T01:48:00+00:00 2024-05-26T01:47:01.007012632Z [2024-05-26T01:47:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:47:00+00:00, run_after=2024-05-26T01:48:00+00:00 2024-05-26T01:47:01.095179997Z [2024-05-26T01:47:01.094+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:47:01.095217560Z 2024-05-26T01:47:01.095222832Z 2024-05-26T01:47:01.095228223Z 2024-05-26T01:47:01.095845288Z [2024-05-26T01:47:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:47:01.096184836Z [2024-05-26T01:47:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:47:01.096493605Z [2024-05-26T01:47:01.096+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:47:01.097340422Z [2024-05-26T01:47:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:47:01.097351392Z 2024-05-26T01:47:01.097354959Z 2024-05-26T01:47:01.097358343Z 2024-05-26T01:47:01.101165823Z [2024-05-26T01:47:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:47:01.101430555Z [2024-05-26T01:47:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:47:01.101876354Z [2024-05-26T01:47:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:47:01.102149559Z [2024-05-26T01:47:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:47:01.102626533Z [2024-05-26T01:47:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:47:01.102990816Z [2024-05-26T01:47:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:47:01.319581967Z [2024-05-26T01:47:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status queued for try_number 1 2024-05-26T01:47:01.322188083Z [2024-05-26T01:47:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status queued for try_number 1 2024-05-26T01:47:01.322430203Z [2024-05-26T01:47:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status queued for try_number 1 2024-05-26T01:47:01.332627676Z [2024-05-26T01:47:01.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to 514e75ae-c338-4e5c-8e8e-c889c25485c9 2024-05-26T01:47:01.332924561Z [2024-05-26T01:47:01.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a36822f-b0fa-4eae-84bc-99220e1b7250 2024-05-26T01:47:01.333165025Z [2024-05-26T01:47:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ea6b804-d865-4f8d-a733-37ee146daffa 2024-05-26T01:47:02.552066682Z [2024-05-26T01:47:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:47:02.552528183Z [2024-05-26T01:47:02.552+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:46:00+00:00, run_id=scheduled__2024-05-26T01:46:00+00:00, run_start_date=2024-05-26 01:47:01.020490+00:00, run_end_date=2024-05-26 01:47:02.551963+00:00, run_duration=1.531473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:46:00+00:00, data_interval_end=2024-05-26 01:47:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:47:02.565411753Z [2024-05-26T01:47:02.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:47:00+00:00, run_after=2024-05-26T01:48:00+00:00 2024-05-26T01:47:02.633637265Z [2024-05-26T01:47:02.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status success for try_number 1 2024-05-26T01:47:02.642029563Z [2024-05-26T01:47:02.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:46:00+00:00, map_index=-1, run_start_date=2024-05-26 01:47:01.900651+00:00, run_end_date=2024-05-26 01:47:02.336209+00:00, run_duration=0.435558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:47:01.098249+00:00, queued_by_job_id=1, pid=12140 2024-05-26T01:47:04.997469488Z [2024-05-26T01:47:04.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:47:04.999857805Z [2024-05-26T01:47:04.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:46:00+00:00, run_id=scheduled__2024-05-26T01:46:00+00:00, run_start_date=2024-05-26 01:47:01.021909+00:00, run_end_date=2024-05-26 01:47:04.999422+00:00, run_duration=3.977513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:46:00+00:00, data_interval_end=2024-05-26 01:47:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:47:05.029554852Z [2024-05-26T01:47:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:47:00+00:00, run_after=2024-05-26T01:48:00+00:00 2024-05-26T01:47:05.094064835Z [2024-05-26T01:47:05.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status success for try_number 1 2024-05-26T01:47:05.101074655Z [2024-05-26T01:47:05.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:46:00+00:00, map_index=-1, run_start_date=2024-05-26 01:47:02.999648+00:00, run_end_date=2024-05-26 01:47:04.517496+00:00, run_duration=1.517848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:47:01.098249+00:00, queued_by_job_id=1, pid=12159 2024-05-26T01:47:06.167197621Z [2024-05-26T01:47:06.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:47:06.168334155Z [2024-05-26T01:47:06.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:46:00+00:00, run_id=scheduled__2024-05-26T01:46:00+00:00, run_start_date=2024-05-26 01:47:01.022986+00:00, run_end_date=2024-05-26 01:47:06.167078+00:00, run_duration=5.144092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:46:00+00:00, data_interval_end=2024-05-26 01:47:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:47:06.179678121Z [2024-05-26T01:47:06.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:47:00+00:00, run_after=2024-05-26T01:48:00+00:00 2024-05-26T01:47:06.234167098Z [2024-05-26T01:47:06.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status success for try_number 1 2024-05-26T01:47:06.250567176Z [2024-05-26T01:47:06.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:46:00+00:00, map_index=-1, run_start_date=2024-05-26 01:47:02.849571+00:00, run_end_date=2024-05-26 01:47:05.044970+00:00, run_duration=2.195399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:47:01.098249+00:00, queued_by_job_id=1, pid=12158 2024-05-26T01:48:00.923956804Z [2024-05-26T01:48:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:48:00+00:00, run_after=2024-05-26T01:49:00+00:00 2024-05-26T01:48:00.939836956Z [2024-05-26T01:48:00.939+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:48:00.956899144Z [2024-05-26T01:48:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:48:00+00:00, run_after=2024-05-26T01:49:00+00:00 2024-05-26T01:48:00.964285721Z [2024-05-26T01:48:00.963+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:48:01.064248521Z [2024-05-26T01:48:01.063+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:48:01.064283314Z 2024-05-26T01:48:01.064289207Z 2024-05-26T01:48:01.064294122Z 2024-05-26T01:48:01.064298619Z 2024-05-26T01:48:01.064544412Z [2024-05-26T01:48:01.064+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:48:01.064827958Z [2024-05-26T01:48:01.064+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:48:01.064875795Z [2024-05-26T01:48:01.064+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:48:01.065114841Z [2024-05-26T01:48:01.064+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:48:01.065985459Z [2024-05-26T01:48:01.065+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:48:01.066009349Z 2024-05-26T01:48:01.066018911Z 2024-05-26T01:48:01.066026510Z 2024-05-26T01:48:01.066033274Z 2024-05-26T01:48:01.072239720Z [2024-05-26T01:48:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:48:01.072388374Z [2024-05-26T01:48:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:48:01.072812971Z [2024-05-26T01:48:01.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:48:01.072966924Z [2024-05-26T01:48:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:48:01.073364489Z [2024-05-26T01:48:01.073+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:48:01.073690903Z [2024-05-26T01:48:01.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:48:01.073997190Z [2024-05-26T01:48:01.073+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:48:01.074213717Z [2024-05-26T01:48:01.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:48:01.547727460Z [2024-05-26T01:48:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status queued for try_number 1 2024-05-26T01:48:01.549067647Z [2024-05-26T01:48:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:47:00+00:00 exited with status queued for try_number 1 2024-05-26T01:48:01.549306262Z [2024-05-26T01:48:01.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:47:00+00:00 exited with status queued for try_number 1 2024-05-26T01:48:01.549517035Z [2024-05-26T01:48:01.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:47:00+00:00 exited with status queued for try_number 1 2024-05-26T01:48:01.568999943Z [2024-05-26T01:48:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdb039ca-e7c0-4c1c-a99b-de531d2c046b 2024-05-26T01:48:01.569269635Z [2024-05-26T01:48:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60928454-2341-4847-9373-cbc759fdc15e 2024-05-26T01:48:01.569490093Z [2024-05-26T01:48:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to b79d93d4-20be-4549-8983-1bf0f4f9ba5f 2024-05-26T01:48:01.569687776Z [2024-05-26T01:48:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to d038ac5a-25d8-44b9-a92e-91bfb4eeaa68 2024-05-26T01:48:03.020985506Z [2024-05-26T01:48:03.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:48:03.021484691Z [2024-05-26T01:48:03.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:46:00+00:00, run_id=scheduled__2024-05-26T01:46:00+00:00, run_start_date=2024-05-26 01:48:00.974491+00:00, run_end_date=2024-05-26 01:48:03.020941+00:00, run_duration=2.04645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:46:00+00:00, data_interval_end=2024-05-26 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:48:03.031198797Z [2024-05-26T01:48:03.030+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:48:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:48:03.094617993Z [2024-05-26T01:48:03.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:46:00+00:00 exited with status success for try_number 1 2024-05-26T01:48:03.100200832Z [2024-05-26T01:48:03.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:46:00+00:00, map_index=-1, run_start_date=2024-05-26 01:48:02.054143+00:00, run_end_date=2024-05-26 01:48:02.664745+00:00, run_duration=0.610602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:48:01.067342+00:00, queued_by_job_id=1, pid=12187 2024-05-26T01:48:04.148443127Z [2024-05-26T01:48:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:48:04.148903741Z [2024-05-26T01:48:04.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:47:00+00:00, run_id=scheduled__2024-05-26T01:47:00+00:00, run_start_date=2024-05-26 01:48:00.975703+00:00, run_end_date=2024-05-26 01:48:04.148342+00:00, run_duration=3.172639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:47:00+00:00, data_interval_end=2024-05-26 01:48:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:48:04.158556526Z [2024-05-26T01:48:04.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:48:00+00:00, run_after=2024-05-26T01:49:00+00:00 2024-05-26T01:48:04.203589568Z [2024-05-26T01:48:04.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:47:00+00:00 exited with status success for try_number 1 2024-05-26T01:48:04.211312887Z [2024-05-26T01:48:04.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:47:00+00:00, map_index=-1, run_start_date=2024-05-26 01:48:02.839941+00:00, run_end_date=2024-05-26 01:48:03.314269+00:00, run_duration=0.474328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:48:01.067342+00:00, queued_by_job_id=1, pid=12200 2024-05-26T01:48:06.068082847Z [2024-05-26T01:48:06.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:48:06.068300193Z [2024-05-26T01:48:06.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:47:00+00:00, run_id=scheduled__2024-05-26T01:47:00+00:00, run_start_date=2024-05-26 01:48:00.976714+00:00, run_end_date=2024-05-26 01:48:06.067948+00:00, run_duration=5.091234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:47:00+00:00, data_interval_end=2024-05-26 01:48:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:48:06.077516598Z [2024-05-26T01:48:06.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:48:00+00:00, run_after=2024-05-26T01:49:00+00:00 2024-05-26T01:48:06.085632037Z [2024-05-26T01:48:06.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:48:06.085739319Z [2024-05-26T01:48:06.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:47:00+00:00, run_id=scheduled__2024-05-26T01:47:00+00:00, run_start_date=2024-05-26 01:48:00.977697+00:00, run_end_date=2024-05-26 01:48:06.085493+00:00, run_duration=5.107796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:47:00+00:00, data_interval_end=2024-05-26 01:48:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:48:06.098744406Z [2024-05-26T01:48:06.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:48:00+00:00, run_after=2024-05-26T01:49:00+00:00 2024-05-26T01:48:06.157590606Z [2024-05-26T01:48:06.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:47:00+00:00 exited with status success for try_number 1 2024-05-26T01:48:06.158000320Z [2024-05-26T01:48:06.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:47:00+00:00 exited with status success for try_number 1 2024-05-26T01:48:06.169262503Z [2024-05-26T01:48:06.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:47:00+00:00, map_index=-1, run_start_date=2024-05-26 01:48:03.652867+00:00, run_end_date=2024-05-26 01:48:05.098160+00:00, run_duration=1.445293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:48:01.067342+00:00, queued_by_job_id=1, pid=12217 2024-05-26T01:48:06.169446692Z [2024-05-26T01:48:06.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:47:00+00:00, map_index=-1, run_start_date=2024-05-26 01:48:03.620880+00:00, run_end_date=2024-05-26 01:48:05.689100+00:00, run_duration=2.06822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:48:01.067342+00:00, queued_by_job_id=1, pid=12216 2024-05-26T01:48:32.803029009Z [2024-05-26T01:48:32.801+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:49:00.811228165Z [2024-05-26T01:49:00.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:49:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:49:00.819188770Z [2024-05-26T01:49:00.818+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:49:00.830534570Z [2024-05-26T01:49:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:49:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:49:00.890962004Z [2024-05-26T01:49:00.890+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:49:00.890988286Z 2024-05-26T01:49:00.890991872Z 2024-05-26T01:49:00.890995625Z 2024-05-26T01:49:00.891149400Z [2024-05-26T01:49:00.890+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:49:00.891305943Z [2024-05-26T01:49:00.891+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:49:00.891462637Z [2024-05-26T01:49:00.891+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:49:00.892090005Z [2024-05-26T01:49:00.891+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:49:00.892124672Z 2024-05-26T01:49:00.892138640Z 2024-05-26T01:49:00.892143920Z 2024-05-26T01:49:00.895129746Z [2024-05-26T01:49:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:49:00.895392930Z [2024-05-26T01:49:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:49:00.895722777Z [2024-05-26T01:49:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:49:00.895918321Z [2024-05-26T01:49:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:49:00.896173928Z [2024-05-26T01:49:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:49:00.896380331Z [2024-05-26T01:49:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:49:01.094988391Z [2024-05-26T01:49:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status queued for try_number 1 2024-05-26T01:49:01.095147062Z [2024-05-26T01:49:01.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status queued for try_number 1 2024-05-26T01:49:01.095284529Z [2024-05-26T01:49:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status queued for try_number 1 2024-05-26T01:49:01.102071738Z [2024-05-26T01:49:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6503134b-243a-4f77-bab4-59861107af5a 2024-05-26T01:49:01.102298927Z [2024-05-26T01:49:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf8072a-a4b4-491c-982a-0202a7fb429a 2024-05-26T01:49:01.102492613Z [2024-05-26T01:49:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2ec7924-8c3c-4281-a3e8-dc8484b84fdd 2024-05-26T01:49:02.241421235Z [2024-05-26T01:49:02.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:49:02.241868061Z [2024-05-26T01:49:02.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:48:00+00:00, run_id=scheduled__2024-05-26T01:48:00+00:00, run_start_date=2024-05-26 01:49:00.839885+00:00, run_end_date=2024-05-26 01:49:02.241499+00:00, run_duration=1.401614, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:48:00+00:00, data_interval_end=2024-05-26 01:49:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:49:02.254614069Z [2024-05-26T01:49:02.254+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:49:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:49:02.321443609Z [2024-05-26T01:49:02.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status success for try_number 1 2024-05-26T01:49:02.327887921Z [2024-05-26T01:49:02.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:48:00+00:00, map_index=-1, run_start_date=2024-05-26 01:49:01.703403+00:00, run_end_date=2024-05-26 01:49:02.122724+00:00, run_duration=0.419321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:49:00.892716+00:00, queued_by_job_id=1, pid=12250 2024-05-26T01:49:04.603821389Z [2024-05-26T01:49:04.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:49:04.604315810Z [2024-05-26T01:49:04.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:48:00+00:00, run_id=scheduled__2024-05-26T01:48:00+00:00, run_start_date=2024-05-26 01:49:00.841092+00:00, run_end_date=2024-05-26 01:49:04.603751+00:00, run_duration=3.762659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:48:00+00:00, data_interval_end=2024-05-26 01:49:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:49:04.630325117Z [2024-05-26T01:49:04.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:49:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:49:04.715399618Z [2024-05-26T01:49:04.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status success for try_number 1 2024-05-26T01:49:04.723606447Z [2024-05-26T01:49:04.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:48:00+00:00, map_index=-1, run_start_date=2024-05-26 01:49:02.604470+00:00, run_end_date=2024-05-26 01:49:04.229366+00:00, run_duration=1.624896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:49:00.892716+00:00, queued_by_job_id=1, pid=12268 2024-05-26T01:49:05.797804623Z [2024-05-26T01:49:05.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:49:05.798282176Z [2024-05-26T01:49:05.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:48:00+00:00, run_id=scheduled__2024-05-26T01:48:00+00:00, run_start_date=2024-05-26 01:49:00.842141+00:00, run_end_date=2024-05-26 01:49:05.797962+00:00, run_duration=4.955821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:48:00+00:00, data_interval_end=2024-05-26 01:49:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:49:05.809552865Z [2024-05-26T01:49:05.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:49:00+00:00, run_after=2024-05-26T01:50:00+00:00 2024-05-26T01:49:05.846361337Z [2024-05-26T01:49:05.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status success for try_number 1 2024-05-26T01:49:05.861323550Z [2024-05-26T01:49:05.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:48:00+00:00, map_index=-1, run_start_date=2024-05-26 01:49:02.626305+00:00, run_end_date=2024-05-26 01:49:04.878592+00:00, run_duration=2.252287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:49:00.892716+00:00, queued_by_job_id=1, pid=12269 2024-05-26T01:50:00.126451780Z [2024-05-26T01:50:00.125+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:50:00.143894172Z [2024-05-26T01:50:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:55:00+00:00 2024-05-26T01:50:00.155403562Z [2024-05-26T01:50:00.154+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:50:00.184463641Z [2024-05-26T01:50:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:51:00+00:00 2024-05-26T01:50:00.206122990Z [2024-05-26T01:50:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:51:00+00:00 2024-05-26T01:50:00.320059414Z [2024-05-26T01:50:00.319+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T01:50:00.320185955Z 2024-05-26T01:50:00.320216383Z 2024-05-26T01:50:00.320241992Z 2024-05-26T01:50:00.320248084Z 2024-05-26T01:50:00.320253628Z 2024-05-26T01:50:00.320259916Z [2024-05-26T01:50:00.319+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:50:00.320266344Z [2024-05-26T01:50:00.319+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:50:00.320313507Z [2024-05-26T01:50:00.319+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:50:00.320320331Z [2024-05-26T01:50:00.320+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:50:00.320326028Z [2024-05-26T01:50:00.320+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:50:00.321114923Z [2024-05-26T01:50:00.320+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:50:00.321162625Z 2024-05-26T01:50:00.321180509Z 2024-05-26T01:50:00.321195311Z 2024-05-26T01:50:00.321208782Z 2024-05-26T01:50:00.321221089Z 2024-05-26T01:50:00.327730034Z [2024-05-26T01:50:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:50:00.328369407Z [2024-05-26T01:50:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:50:00.329200676Z [2024-05-26T01:50:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:50:00.329283404Z [2024-05-26T01:50:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:50:00.329643010Z [2024-05-26T01:50:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:50:00.329933597Z [2024-05-26T01:50:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:50:00.330657076Z [2024-05-26T01:50:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:50:00.330875742Z [2024-05-26T01:50:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:50:00.331328116Z [2024-05-26T01:50:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:50:00.331495989Z [2024-05-26T01:50:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:50:00.989739656Z [2024-05-26T01:50:00.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:00.990181112Z [2024-05-26T01:50:00.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:00.990292661Z [2024-05-26T01:50:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:49:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:00.990451176Z [2024-05-26T01:50:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:49:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:00.990533679Z [2024-05-26T01:50:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:49:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:01.010760347Z [2024-05-26T01:50:01.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f9a22c1-7a68-4e42-98b9-d27481067b99 2024-05-26T01:50:01.010774280Z [2024-05-26T01:50:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82a6822d-285d-4a7a-a63d-d599afbb53ad 2024-05-26T01:50:01.010777782Z [2024-05-26T01:50:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 432edbf3-8769-420a-adeb-4549cbeed90f 2024-05-26T01:50:01.010795324Z [2024-05-26T01:50:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a684287-841f-4cc9-8efc-c0562c7277e5 2024-05-26T01:50:01.010799062Z [2024-05-26T01:50:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to e204b8bc-128f-44e3-bbac-cdd862bcf00c 2024-05-26T01:50:03.204992641Z [2024-05-26T01:50:03.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:50:03.205033608Z [2024-05-26T01:50:03.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:48:00+00:00, run_id=scheduled__2024-05-26T01:48:00+00:00, run_start_date=2024-05-26 01:50:00.222845+00:00, run_end_date=2024-05-26 01:50:03.204624+00:00, run_duration=2.981779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:48:00+00:00, data_interval_end=2024-05-26 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:50:03.215346493Z [2024-05-26T01:50:03.215+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:52:00+00:00 2024-05-26T01:50:03.234523822Z [2024-05-26T01:50:03.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:50:03.234893155Z [2024-05-26T01:50:03.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:49:00+00:00, run_id=scheduled__2024-05-26T01:49:00+00:00, run_start_date=2024-05-26 01:50:00.224056+00:00, run_end_date=2024-05-26 01:50:03.234446+00:00, run_duration=3.01039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:49:00+00:00, data_interval_end=2024-05-26 01:50:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:50:03.247031432Z [2024-05-26T01:50:03.246+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:51:00+00:00 2024-05-26T01:50:03.296947796Z [2024-05-26T01:50:03.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:48:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:03.299037519Z [2024-05-26T01:50:03.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:49:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:03.305186495Z [2024-05-26T01:50:03.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:49:00+00:00, map_index=-1, run_start_date=2024-05-26 01:50:01.994664+00:00, run_end_date=2024-05-26 01:50:02.443326+00:00, run_duration=0.448662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:00.322041+00:00, queued_by_job_id=1, pid=12310 2024-05-26T01:50:03.306935783Z [2024-05-26T01:50:03.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:48:00+00:00, map_index=-1, run_start_date=2024-05-26 01:50:01.358618+00:00, run_end_date=2024-05-26 01:50:02.062538+00:00, run_duration=0.70392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:00.322041+00:00, queued_by_job_id=1, pid=12298 2024-05-26T01:50:03.939418167Z [2024-05-26T01:50:03.938+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:50:03.939450941Z 2024-05-26T01:50:03.940071850Z [2024-05-26T01:50:03.939+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:50:03.941380434Z [2024-05-26T01:50:03.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:50:03.941392699Z 2024-05-26T01:50:03.947031325Z [2024-05-26T01:50:03.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:50:03.947399851Z [2024-05-26T01:50:03.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:50:04.088336899Z [2024-05-26T01:50:04.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:04.088730324Z [2024-05-26T01:50:04.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:04.104797375Z [2024-05-26T01:50:04.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffdc976e-ee4a-4def-9124-0f834a068db5 2024-05-26T01:50:04.105236746Z [2024-05-26T01:50:04.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:45:00+00:00, map_index=-1, run_start_date=2024-05-26 01:50:02.977701+00:00, run_end_date=2024-05-26 01:50:03.566251+00:00, run_duration=0.58855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:00.322041+00:00, queued_by_job_id=1, pid=12333 2024-05-26T01:50:05.297215897Z [2024-05-26T01:50:05.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:50:05.297669445Z [2024-05-26T01:50:05.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:49:00+00:00, run_id=scheduled__2024-05-26T01:49:00+00:00, run_start_date=2024-05-26 01:50:00.226596+00:00, run_end_date=2024-05-26 01:50:05.297382+00:00, run_duration=5.070786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:49:00+00:00, data_interval_end=2024-05-26 01:50:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:50:05.312384560Z [2024-05-26T01:50:05.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:51:00+00:00 2024-05-26T01:50:05.324659386Z [2024-05-26T01:50:05.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:50:05.325106451Z [2024-05-26T01:50:05.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:49:00+00:00, run_id=scheduled__2024-05-26T01:49:00+00:00, run_start_date=2024-05-26 01:50:00.225177+00:00, run_end_date=2024-05-26 01:50:05.324812+00:00, run_duration=5.099635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:49:00+00:00, data_interval_end=2024-05-26 01:50:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:50:05.363680380Z [2024-05-26T01:50:05.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:51:00+00:00 2024-05-26T01:50:05.451496462Z [2024-05-26T01:50:05.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:49:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:05.451790062Z [2024-05-26T01:50:05.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:49:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:05.469387417Z [2024-05-26T01:50:05.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:49:00+00:00, map_index=-1, run_start_date=2024-05-26 01:50:03.091910+00:00, run_end_date=2024-05-26 01:50:04.678763+00:00, run_duration=1.586853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:00.322041+00:00, queued_by_job_id=1, pid=12335 2024-05-26T01:50:05.469770159Z [2024-05-26T01:50:05.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:49:00+00:00, map_index=-1, run_start_date=2024-05-26 01:50:03.038827+00:00, run_end_date=2024-05-26 01:50:04.989571+00:00, run_duration=1.950744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:00.322041+00:00, queued_by_job_id=1, pid=12334 2024-05-26T01:50:07.249055040Z [2024-05-26T01:50:07.248+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:50:07.249123279Z 2024-05-26T01:50:07.249145974Z [2024-05-26T01:50:07.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:50:07.249907181Z [2024-05-26T01:50:07.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:50:07.249922471Z 2024-05-26T01:50:07.253015281Z [2024-05-26T01:50:07.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:50:07.253540404Z [2024-05-26T01:50:07.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:50:07.356415299Z [2024-05-26T01:50:07.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:07.356715941Z [2024-05-26T01:50:07.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:07.362995709Z [2024-05-26T01:50:07.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed0664cd-bda9-4d28-a84c-93f5327010e6 2024-05-26T01:50:07.363366027Z [2024-05-26T01:50:07.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:45:00+00:00, map_index=-1, run_start_date=2024-05-26 01:50:06.174447+00:00, run_end_date=2024-05-26 01:50:06.623367+00:00, run_duration=0.44892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:03.942496+00:00, queued_by_job_id=1, pid=12358 2024-05-26T01:50:09.639689684Z [2024-05-26T01:50:09.639+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:50:09.639729640Z 2024-05-26T01:50:09.640031693Z [2024-05-26T01:50:09.639+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:50:09.641471300Z [2024-05-26T01:50:09.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:50:09.641483497Z 2024-05-26T01:50:09.645875166Z [2024-05-26T01:50:09.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:50:09.645949494Z [2024-05-26T01:50:09.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:50:09.729373690Z [2024-05-26T01:50:09.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status queued for try_number 1 2024-05-26T01:50:09.729453533Z [2024-05-26T01:50:09.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:09.735213971Z [2024-05-26T01:50:09.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to c754c2f7-f4a5-42b5-98ea-b6c366aa151b 2024-05-26T01:50:09.735323172Z [2024-05-26T01:50:09.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:45:00+00:00, map_index=0, run_start_date=2024-05-26 01:50:09.072010+00:00, run_end_date=2024-05-26 01:50:09.413580+00:00, run_duration=0.34157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:07.250394+00:00, queued_by_job_id=1, pid=12366 2024-05-26T01:50:12.030372610Z [2024-05-26T01:50:12.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:50:12.030745623Z [2024-05-26T01:50:12.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:45:00+00:00, run_id=scheduled__2024-05-26T01:45:00+00:00, run_start_date=2024-05-26 01:50:00.221164+00:00, run_end_date=2024-05-26 01:50:12.030096+00:00, run_duration=11.808932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:45:00+00:00, data_interval_end=2024-05-26 01:50:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:50:12.038120211Z [2024-05-26T01:50:12.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:50:00+00:00, run_after=2024-05-26T01:55:00+00:00 2024-05-26T01:50:12.080907061Z [2024-05-26T01:50:12.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:45:00+00:00 exited with status success for try_number 1 2024-05-26T01:50:12.091387046Z [2024-05-26T01:50:12.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:45:00+00:00, map_index=-1, run_start_date=2024-05-26 01:50:11.293879+00:00, run_end_date=2024-05-26 01:50:11.676698+00:00, run_duration=0.382819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:50:09.642459+00:00, queued_by_job_id=1, pid=12374 2024-05-26T01:51:00.437370101Z [2024-05-26T01:51:00.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:51:00+00:00, run_after=2024-05-26T01:52:00+00:00 2024-05-26T01:51:00.451801498Z [2024-05-26T01:51:00.451+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:51:00.482719268Z [2024-05-26T01:51:00.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:51:00+00:00, run_after=2024-05-26T01:52:00+00:00 2024-05-26T01:51:00.586986366Z [2024-05-26T01:51:00.586+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:51:00.587029064Z 2024-05-26T01:51:00.587038475Z 2024-05-26T01:51:00.587047078Z 2024-05-26T01:51:00.587365273Z [2024-05-26T01:51:00.586+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:51:00.587864592Z [2024-05-26T01:51:00.587+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:51:00.588229529Z [2024-05-26T01:51:00.588+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:51:00.589340502Z [2024-05-26T01:51:00.589+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:51:00.589357209Z 2024-05-26T01:51:00.589363051Z 2024-05-26T01:51:00.589368463Z 2024-05-26T01:51:00.594712625Z [2024-05-26T01:51:00.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:51:00.595054914Z [2024-05-26T01:51:00.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:51:00.595497649Z [2024-05-26T01:51:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:51:00.595867787Z [2024-05-26T01:51:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:51:00.596375868Z [2024-05-26T01:51:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:51:00.596663963Z [2024-05-26T01:51:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:51:00.857249327Z [2024-05-26T01:51:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:51:00.857428795Z [2024-05-26T01:51:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:51:00.857567607Z [2024-05-26T01:51:00.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:51:00.866434924Z [2024-05-26T01:51:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63113af4-239f-4874-9299-0ac36541faa2 2024-05-26T01:51:00.866590000Z [2024-05-26T01:51:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c2e957e-12a8-4575-aaad-d164aec06dec 2024-05-26T01:51:00.866735888Z [2024-05-26T01:51:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55770048-341d-45bf-b7e0-d80558f04a40 2024-05-26T01:51:02.104286985Z [2024-05-26T01:51:02.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:51:02.118459690Z [2024-05-26T01:51:02.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=-1, run_start_date=2024-05-26 01:51:01.557393+00:00, run_end_date=2024-05-26 01:51:01.952893+00:00, run_duration=0.3955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:51:00.590517+00:00, queued_by_job_id=1, pid=12397 2024-05-26T01:51:03.165479729Z [2024-05-26T01:51:03.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:51:03.171578475Z [2024-05-26T01:51:03.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:50:00+00:00, run_id=scheduled__2024-05-26T01:50:00+00:00, run_start_date=2024-05-26 01:51:00.497764+00:00, run_end_date=2024-05-26 01:51:03.165380+00:00, run_duration=2.667616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:50:00+00:00, data_interval_end=2024-05-26 01:51:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:51:03.191124617Z [2024-05-26T01:51:03.181+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:51:00+00:00, run_after=2024-05-26T01:52:00+00:00 2024-05-26T01:51:04.440339146Z [2024-05-26T01:51:04.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:51:04.440379198Z [2024-05-26T01:51:04.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:50:00+00:00, run_id=scheduled__2024-05-26T01:50:00+00:00, run_start_date=2024-05-26 01:51:00.500216+00:00, run_end_date=2024-05-26 01:51:04.439361+00:00, run_duration=3.939145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:50:00+00:00, data_interval_end=2024-05-26 01:51:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:51:04.451683425Z [2024-05-26T01:51:04.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:51:00+00:00, run_after=2024-05-26T01:52:00+00:00 2024-05-26T01:51:04.471656042Z [2024-05-26T01:51:04.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:51:04.471681356Z [2024-05-26T01:51:04.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:50:00+00:00, run_id=scheduled__2024-05-26T01:50:00+00:00, run_start_date=2024-05-26 01:51:00.502045+00:00, run_end_date=2024-05-26 01:51:04.461070+00:00, run_duration=3.959025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:50:00+00:00, data_interval_end=2024-05-26 01:51:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:51:04.475601921Z [2024-05-26T01:51:04.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:51:00+00:00, run_after=2024-05-26T01:52:00+00:00 2024-05-26T01:51:04.593477404Z [2024-05-26T01:51:04.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:51:04.593721048Z [2024-05-26T01:51:04.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:51:04.600366502Z [2024-05-26T01:51:04.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=-1, run_start_date=2024-05-26 01:51:02.326350+00:00, run_end_date=2024-05-26 01:51:03.916264+00:00, run_duration=1.589914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:51:00.590517+00:00, queued_by_job_id=1, pid=12415 2024-05-26T01:51:04.601513267Z [2024-05-26T01:51:04.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=-1, run_start_date=2024-05-26 01:51:02.239552+00:00, run_end_date=2024-05-26 01:51:04.226615+00:00, run_duration=1.987063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:51:00.590517+00:00, queued_by_job_id=1, pid=12414 2024-05-26T01:52:00.327165419Z [2024-05-26T01:52:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:52:00+00:00, run_after=2024-05-26T01:53:00+00:00 2024-05-26T01:52:00.337189250Z [2024-05-26T01:52:00.336+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:52:00.352218423Z [2024-05-26T01:52:00.351+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:52:00.381601195Z [2024-05-26T01:52:00.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:52:00+00:00, run_after=2024-05-26T01:53:00+00:00 2024-05-26T01:52:00.501137376Z [2024-05-26T01:52:00.500+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:52:00.501180883Z 2024-05-26T01:52:00.501190695Z 2024-05-26T01:52:00.501198866Z 2024-05-26T01:52:00.501207409Z 2024-05-26T01:52:00.501409829Z [2024-05-26T01:52:00.501+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:52:00.501818499Z [2024-05-26T01:52:00.501+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:52:00.502329940Z [2024-05-26T01:52:00.501+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:52:00.502982009Z [2024-05-26T01:52:00.502+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:52:00.511821961Z [2024-05-26T01:52:00.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:52:00.511855740Z 2024-05-26T01:52:00.511865323Z 2024-05-26T01:52:00.511873331Z 2024-05-26T01:52:00.511881068Z 2024-05-26T01:52:00.520765933Z [2024-05-26T01:52:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:52:00.523879132Z [2024-05-26T01:52:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:52:00.527156560Z [2024-05-26T01:52:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:52:00.528121465Z [2024-05-26T01:52:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:52:00.528949520Z [2024-05-26T01:52:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:52:00.529489275Z [2024-05-26T01:52:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:52:00.530160708Z [2024-05-26T01:52:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:52:00.530647516Z [2024-05-26T01:52:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:52:01.070225376Z [2024-05-26T01:52:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:52:01.072843627Z [2024-05-26T01:52:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:51:00+00:00 exited with status queued for try_number 1 2024-05-26T01:52:01.072943329Z [2024-05-26T01:52:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:51:00+00:00 exited with status queued for try_number 1 2024-05-26T01:52:01.073053367Z [2024-05-26T01:52:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:51:00+00:00 exited with status queued for try_number 1 2024-05-26T01:52:01.092907940Z [2024-05-26T01:52:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6f69a60-a8f7-451b-bb0b-dc7b91858de0 2024-05-26T01:52:01.093077748Z [2024-05-26T01:52:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to e12c1e77-d446-4ea3-a8af-872458a0a63d 2024-05-26T01:52:01.093221041Z [2024-05-26T01:52:01.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to bebd8295-866c-4763-8859-afa4d0290c59 2024-05-26T01:52:01.093366241Z [2024-05-26T01:52:01.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0350d8b-3a5f-4c1d-ac46-5e2be2ab05e3 2024-05-26T01:52:02.365010957Z [2024-05-26T01:52:02.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:52:02.365491713Z [2024-05-26T01:52:02.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:50:00+00:00, run_id=scheduled__2024-05-26T01:50:00+00:00, run_start_date=2024-05-26 01:52:00.398708+00:00, run_end_date=2024-05-26 01:52:02.364946+00:00, run_duration=1.966238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:50:00+00:00, data_interval_end=2024-05-26 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:52:02.376845928Z [2024-05-26T01:52:02.376+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:52:00+00:00, run_after=2024-05-26T01:54:00+00:00 2024-05-26T01:52:02.394061137Z [2024-05-26T01:52:02.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:52:02.394512200Z [2024-05-26T01:52:02.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:51:00+00:00, run_id=scheduled__2024-05-26T01:51:00+00:00, run_start_date=2024-05-26 01:52:00.400613+00:00, run_end_date=2024-05-26 01:52:02.393943+00:00, run_duration=1.99333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:51:00+00:00, data_interval_end=2024-05-26 01:52:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:52:02.407711489Z [2024-05-26T01:52:02.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:52:00+00:00, run_after=2024-05-26T01:53:00+00:00 2024-05-26T01:52:02.467214735Z [2024-05-26T01:52:02.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:52:02.467406108Z [2024-05-26T01:52:02.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:51:00+00:00 exited with status success for try_number 1 2024-05-26T01:52:02.473618387Z [2024-05-26T01:52:02.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:51:00+00:00, map_index=-1, run_start_date=2024-05-26 01:52:01.457089+00:00, run_end_date=2024-05-26 01:52:01.907368+00:00, run_duration=0.450279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:52:00.514162+00:00, queued_by_job_id=1, pid=12448 2024-05-26T01:52:02.473833468Z [2024-05-26T01:52:02.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=-1, run_start_date=2024-05-26 01:52:01.482867+00:00, run_end_date=2024-05-26 01:52:01.953968+00:00, run_duration=0.471101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:52:00.514162+00:00, queued_by_job_id=1, pid=12449 2024-05-26T01:52:04.307973332Z [2024-05-26T01:52:04.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:52:04.308083024Z [2024-05-26T01:52:04.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:51:00+00:00, run_id=scheduled__2024-05-26T01:51:00+00:00, run_start_date=2024-05-26 01:52:00.402401+00:00, run_end_date=2024-05-26 01:52:04.307849+00:00, run_duration=3.905448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:51:00+00:00, data_interval_end=2024-05-26 01:52:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:52:04.318040448Z [2024-05-26T01:52:04.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:52:00+00:00, run_after=2024-05-26T01:53:00+00:00 2024-05-26T01:52:04.384570830Z [2024-05-26T01:52:04.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:51:00+00:00 exited with status success for try_number 1 2024-05-26T01:52:04.403347445Z [2024-05-26T01:52:04.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:51:00+00:00, map_index=-1, run_start_date=2024-05-26 01:52:02.729602+00:00, run_end_date=2024-05-26 01:52:04.143211+00:00, run_duration=1.413609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:52:00.514162+00:00, queued_by_job_id=1, pid=12473 2024-05-26T01:52:04.948411002Z [2024-05-26T01:52:04.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:52:04.948866872Z [2024-05-26T01:52:04.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:51:00+00:00, run_id=scheduled__2024-05-26T01:51:00+00:00, run_start_date=2024-05-26 01:52:00.403861+00:00, run_end_date=2024-05-26 01:52:04.948323+00:00, run_duration=4.544462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:51:00+00:00, data_interval_end=2024-05-26 01:52:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:52:04.961624728Z [2024-05-26T01:52:04.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:52:00+00:00, run_after=2024-05-26T01:53:00+00:00 2024-05-26T01:52:05.065012958Z [2024-05-26T01:52:05.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:51:00+00:00 exited with status success for try_number 1 2024-05-26T01:52:05.088486807Z [2024-05-26T01:52:05.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:51:00+00:00, map_index=-1, run_start_date=2024-05-26 01:52:02.618437+00:00, run_end_date=2024-05-26 01:52:04.530541+00:00, run_duration=1.912104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:52:00.514162+00:00, queued_by_job_id=1, pid=12472 2024-05-26T01:53:00.366371775Z [2024-05-26T01:53:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:53:00+00:00, run_after=2024-05-26T01:54:00+00:00 2024-05-26T01:53:00.375176984Z [2024-05-26T01:53:00.374+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:53:00.398121942Z [2024-05-26T01:53:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:53:00+00:00, run_after=2024-05-26T01:54:00+00:00 2024-05-26T01:53:00.483964774Z [2024-05-26T01:53:00.483+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:53:00.484026741Z 2024-05-26T01:53:00.484039605Z 2024-05-26T01:53:00.484049610Z 2024-05-26T01:53:00.484059320Z [2024-05-26T01:53:00.483+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:53:00.484108646Z [2024-05-26T01:53:00.483+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:53:00.484147024Z [2024-05-26T01:53:00.483+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:53:00.484919101Z [2024-05-26T01:53:00.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:53:00.484946364Z 2024-05-26T01:53:00.484956749Z 2024-05-26T01:53:00.484966302Z 2024-05-26T01:53:00.491655414Z [2024-05-26T01:53:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:53:00.492449554Z [2024-05-26T01:53:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:53:00.493398830Z [2024-05-26T01:53:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:53:00.493867660Z [2024-05-26T01:53:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:53:00.494480993Z [2024-05-26T01:53:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:53:00.494992817Z [2024-05-26T01:53:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:53:00.793557615Z [2024-05-26T01:53:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status queued for try_number 1 2024-05-26T01:53:00.793610558Z [2024-05-26T01:53:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status queued for try_number 1 2024-05-26T01:53:00.793637718Z [2024-05-26T01:53:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status queued for try_number 1 2024-05-26T01:53:00.803765656Z [2024-05-26T01:53:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc901abb-14af-48c9-85b8-028cc60a5ec4 2024-05-26T01:53:00.803939887Z [2024-05-26T01:53:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to 438fbe04-3851-49b8-81cd-fe6190e20cc1 2024-05-26T01:53:00.804116326Z [2024-05-26T01:53:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72bd3705-21d5-4e0d-a29b-04d7712e8ba9 2024-05-26T01:53:01.972982703Z [2024-05-26T01:53:01.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:53:01.973424581Z [2024-05-26T01:53:01.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:52:00+00:00, run_id=scheduled__2024-05-26T01:52:00+00:00, run_start_date=2024-05-26 01:53:00.410414+00:00, run_end_date=2024-05-26 01:53:01.972885+00:00, run_duration=1.562471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:52:00+00:00, data_interval_end=2024-05-26 01:53:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:53:01.990755934Z [2024-05-26T01:53:01.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:53:00+00:00, run_after=2024-05-26T01:54:00+00:00 2024-05-26T01:53:02.054251732Z [2024-05-26T01:53:02.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status success for try_number 1 2024-05-26T01:53:02.060372900Z [2024-05-26T01:53:02.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:52:00+00:00, map_index=-1, run_start_date=2024-05-26 01:53:01.323657+00:00, run_end_date=2024-05-26 01:53:01.748694+00:00, run_duration=0.425037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:53:00.485763+00:00, queued_by_job_id=1, pid=12505 2024-05-26T01:53:04.286678839Z [2024-05-26T01:53:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:53:04.287331353Z [2024-05-26T01:53:04.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:52:00+00:00, run_id=scheduled__2024-05-26T01:52:00+00:00, run_start_date=2024-05-26 01:53:00.411862+00:00, run_end_date=2024-05-26 01:53:04.286649+00:00, run_duration=3.874787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:52:00+00:00, data_interval_end=2024-05-26 01:53:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:53:04.309450847Z [2024-05-26T01:53:04.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:53:00+00:00, run_after=2024-05-26T01:54:00+00:00 2024-05-26T01:53:04.319012290Z [2024-05-26T01:53:04.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:53:04.319455476Z [2024-05-26T01:53:04.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:52:00+00:00, run_id=scheduled__2024-05-26T01:52:00+00:00, run_start_date=2024-05-26 01:53:00.414968+00:00, run_end_date=2024-05-26 01:53:04.318808+00:00, run_duration=3.90384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:52:00+00:00, data_interval_end=2024-05-26 01:53:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:53:04.328908915Z [2024-05-26T01:53:04.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:53:00+00:00, run_after=2024-05-26T01:54:00+00:00 2024-05-26T01:53:04.365752576Z [2024-05-26T01:53:04.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status success for try_number 1 2024-05-26T01:53:04.372661921Z [2024-05-26T01:53:04.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:52:00+00:00, map_index=-1, run_start_date=2024-05-26 01:53:02.205219+00:00, run_end_date=2024-05-26 01:53:03.540535+00:00, run_duration=1.335316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:53:00.485763+00:00, queued_by_job_id=1, pid=12523 2024-05-26T01:53:05.463204707Z [2024-05-26T01:53:05.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status success for try_number 1 2024-05-26T01:53:05.469910759Z [2024-05-26T01:53:05.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:52:00+00:00, map_index=-1, run_start_date=2024-05-26 01:53:02.388637+00:00, run_end_date=2024-05-26 01:53:04.134866+00:00, run_duration=1.746229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:53:00.485763+00:00, queued_by_job_id=1, pid=12524 2024-05-26T01:53:32.880047513Z [2024-05-26T01:53:32.879+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:54:00.189316489Z [2024-05-26T01:54:00.188+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:54:00+00:00, run_after=2024-05-26T01:55:00+00:00 2024-05-26T01:54:00.203596833Z [2024-05-26T01:54:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:54:00+00:00, run_after=2024-05-26T01:55:00+00:00 2024-05-26T01:54:00.212033445Z [2024-05-26T01:54:00.211+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:54:00.219683677Z [2024-05-26T01:54:00.219+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:54:00.351588106Z [2024-05-26T01:54:00.351+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:54:00.351624812Z 2024-05-26T01:54:00.351633173Z 2024-05-26T01:54:00.351640055Z 2024-05-26T01:54:00.351646869Z 2024-05-26T01:54:00.352182722Z [2024-05-26T01:54:00.351+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:54:00.352562434Z [2024-05-26T01:54:00.352+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:54:00.352936377Z [2024-05-26T01:54:00.352+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:54:00.353268327Z [2024-05-26T01:54:00.353+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:54:00.354438681Z [2024-05-26T01:54:00.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:54:00.354460514Z 2024-05-26T01:54:00.354468236Z 2024-05-26T01:54:00.354475580Z 2024-05-26T01:54:00.354482304Z 2024-05-26T01:54:00.362061918Z [2024-05-26T01:54:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:54:00.362667037Z [2024-05-26T01:54:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:54:00.363826077Z [2024-05-26T01:54:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:54:00.364204979Z [2024-05-26T01:54:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:54:00.364617582Z [2024-05-26T01:54:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:54:00.364827233Z [2024-05-26T01:54:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:54:00.365165059Z [2024-05-26T01:54:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:54:00.365323483Z [2024-05-26T01:54:00.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:54:00.816506520Z [2024-05-26T01:54:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status queued for try_number 1 2024-05-26T01:54:00.816532004Z [2024-05-26T01:54:00.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:53:00+00:00 exited with status queued for try_number 1 2024-05-26T01:54:00.817117537Z [2024-05-26T01:54:00.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:53:00+00:00 exited with status queued for try_number 1 2024-05-26T01:54:00.817341869Z [2024-05-26T01:54:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:53:00+00:00 exited with status queued for try_number 1 2024-05-26T01:54:00.836931505Z [2024-05-26T01:54:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f69f08d-51af-4024-b927-bb500fb351d2 2024-05-26T01:54:00.837221403Z [2024-05-26T01:54:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4eec52a3-6036-4ecf-842d-790e16afedce 2024-05-26T01:54:00.837439167Z [2024-05-26T01:54:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to c79afae7-c5c4-477c-bf9f-bb841c961feb 2024-05-26T01:54:00.837642725Z [2024-05-26T01:54:00.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5de1458d-3f14-4351-868e-ffea861eb434 2024-05-26T01:54:01.766550489Z [2024-05-26T01:54:01.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:54:01.766975536Z [2024-05-26T01:54:01.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:52:00+00:00, run_id=scheduled__2024-05-26T01:52:00+00:00, run_start_date=2024-05-26 01:54:00.237283+00:00, run_end_date=2024-05-26 01:54:01.766567+00:00, run_duration=1.529284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:52:00+00:00, data_interval_end=2024-05-26 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:54:01.776103376Z [2024-05-26T01:54:01.775+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:54:00+00:00, run_after=2024-05-26T01:56:00+00:00 2024-05-26T01:54:01.782684870Z [2024-05-26T01:54:01.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:54:01.782957551Z [2024-05-26T01:54:01.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:53:00+00:00, run_id=scheduled__2024-05-26T01:53:00+00:00, run_start_date=2024-05-26 01:54:00.240435+00:00, run_end_date=2024-05-26 01:54:01.782594+00:00, run_duration=1.542159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:53:00+00:00, data_interval_end=2024-05-26 01:54:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:54:01.798192943Z [2024-05-26T01:54:01.797+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:54:00+00:00, run_after=2024-05-26T01:55:00+00:00 2024-05-26T01:54:01.847962508Z [2024-05-26T01:54:01.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:52:00+00:00 exited with status success for try_number 1 2024-05-26T01:54:01.855614396Z [2024-05-26T01:54:01.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:52:00+00:00, map_index=-1, run_start_date=2024-05-26 01:54:01.177802+00:00, run_end_date=2024-05-26 01:54:01.522749+00:00, run_duration=0.344947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:54:00.356365+00:00, queued_by_job_id=1, pid=12558 2024-05-26T01:54:02.957859229Z [2024-05-26T01:54:02.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:53:00+00:00 exited with status success for try_number 1 2024-05-26T01:54:02.962436020Z [2024-05-26T01:54:02.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:53:00+00:00, map_index=-1, run_start_date=2024-05-26 01:54:01.283222+00:00, run_end_date=2024-05-26 01:54:01.735057+00:00, run_duration=0.451835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:54:00.356365+00:00, queued_by_job_id=1, pid=12559 2024-05-26T01:54:04.020787740Z [2024-05-26T01:54:04.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:54:04.021457026Z [2024-05-26T01:54:04.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:53:00+00:00, run_id=scheduled__2024-05-26T01:53:00+00:00, run_start_date=2024-05-26 01:54:00.242647+00:00, run_end_date=2024-05-26 01:54:04.020790+00:00, run_duration=3.778143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:53:00+00:00, data_interval_end=2024-05-26 01:54:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:54:04.032635587Z [2024-05-26T01:54:04.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:54:00+00:00, run_after=2024-05-26T01:55:00+00:00 2024-05-26T01:54:04.080225217Z [2024-05-26T01:54:04.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:53:00+00:00 exited with status success for try_number 1 2024-05-26T01:54:04.089144776Z [2024-05-26T01:54:04.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:53:00+00:00, map_index=-1, run_start_date=2024-05-26 01:54:02.463351+00:00, run_end_date=2024-05-26 01:54:03.799361+00:00, run_duration=1.33601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:54:00.356365+00:00, queued_by_job_id=1, pid=12582 2024-05-26T01:54:05.132755652Z [2024-05-26T01:54:05.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:54:05.133064898Z [2024-05-26T01:54:05.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:53:00+00:00, run_id=scheduled__2024-05-26T01:53:00+00:00, run_start_date=2024-05-26 01:54:00.246394+00:00, run_end_date=2024-05-26 01:54:05.132671+00:00, run_duration=4.886277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:53:00+00:00, data_interval_end=2024-05-26 01:54:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:54:05.143667209Z [2024-05-26T01:54:05.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:54:00+00:00, run_after=2024-05-26T01:55:00+00:00 2024-05-26T01:54:05.198874560Z [2024-05-26T01:54:05.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:53:00+00:00 exited with status success for try_number 1 2024-05-26T01:54:05.206808891Z [2024-05-26T01:54:05.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:53:00+00:00, map_index=-1, run_start_date=2024-05-26 01:54:02.544409+00:00, run_end_date=2024-05-26 01:54:04.280336+00:00, run_duration=1.735927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:54:00.356365+00:00, queued_by_job_id=1, pid=12583 2024-05-26T01:55:00.428011640Z [2024-05-26T01:55:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:55:00+00:00, run_after=2024-05-26T01:56:00+00:00 2024-05-26T01:55:00.437333077Z [2024-05-26T01:55:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:55:00.453728696Z [2024-05-26T01:55:00.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:55:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:55:00.472088899Z [2024-05-26T01:55:00.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:55:00+00:00, run_after=2024-05-26T01:56:00+00:00 2024-05-26T01:55:00.588469063Z [2024-05-26T01:55:00.587+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:55:00.588513470Z 2024-05-26T01:55:00.588524215Z 2024-05-26T01:55:00.588532966Z 2024-05-26T01:55:00.588541808Z 2024-05-26T01:55:00.588564625Z [2024-05-26T01:55:00.588+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:55:00.588752351Z [2024-05-26T01:55:00.588+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:55:00.588915608Z [2024-05-26T01:55:00.588+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:55:00.589071626Z [2024-05-26T01:55:00.588+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:55:00.589949069Z [2024-05-26T01:55:00.589+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:55:00.589965551Z 2024-05-26T01:55:00.589974693Z 2024-05-26T01:55:00.589997196Z 2024-05-26T01:55:00.590050070Z 2024-05-26T01:55:00.595470803Z [2024-05-26T01:55:00.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T01:55:00.595635778Z [2024-05-26T01:55:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:55:00.595970416Z [2024-05-26T01:55:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:55:00.595999467Z [2024-05-26T01:55:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:55:00.596262531Z [2024-05-26T01:55:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:55:00.596284110Z [2024-05-26T01:55:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:55:00.596524055Z [2024-05-26T01:55:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:55:00.596547886Z [2024-05-26T01:55:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:55:01.054440811Z [2024-05-26T01:55:01.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:55:01.054638077Z [2024-05-26T01:55:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status queued for try_number 1 2024-05-26T01:55:01.054784140Z [2024-05-26T01:55:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status queued for try_number 1 2024-05-26T01:55:01.054925139Z [2024-05-26T01:55:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status queued for try_number 1 2024-05-26T01:55:01.077047252Z [2024-05-26T01:55:01.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f64b74a-d50e-4ecc-af6a-2173a806f6b6 2024-05-26T01:55:01.077332469Z [2024-05-26T01:55:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd82001b-7055-40f2-a6e8-9b5443f279b3 2024-05-26T01:55:01.077532390Z [2024-05-26T01:55:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to d34711ec-93b1-4fdf-9cc6-1d622c2ea34d 2024-05-26T01:55:01.077712934Z [2024-05-26T01:55:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8085643a-bff7-47ef-9fa4-d0dac957e360 2024-05-26T01:55:02.427892532Z [2024-05-26T01:55:02.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:55:02.428654797Z [2024-05-26T01:55:02.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:54:00+00:00, run_id=scheduled__2024-05-26T01:54:00+00:00, run_start_date=2024-05-26 01:55:00.490309+00:00, run_end_date=2024-05-26 01:55:02.428013+00:00, run_duration=1.937704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:54:00+00:00, data_interval_end=2024-05-26 01:55:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:55:02.446262588Z [2024-05-26T01:55:02.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:55:00+00:00, run_after=2024-05-26T01:56:00+00:00 2024-05-26T01:55:02.541688784Z [2024-05-26T01:55:02.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status success for try_number 1 2024-05-26T01:55:02.553768375Z [2024-05-26T01:55:02.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:54:00+00:00, map_index=-1, run_start_date=2024-05-26 01:55:01.432845+00:00, run_end_date=2024-05-26 01:55:01.832525+00:00, run_duration=0.39968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:55:00.590766+00:00, queued_by_job_id=1, pid=12615 2024-05-26T01:55:04.057133543Z [2024-05-26T01:55:04.056+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:55:04.057149649Z 2024-05-26T01:55:04.057250722Z [2024-05-26T01:55:04.057+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:55:04.058006065Z [2024-05-26T01:55:04.057+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:55:04.058035912Z 2024-05-26T01:55:04.061184269Z [2024-05-26T01:55:04.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T01:55:04.061497211Z [2024-05-26T01:55:04.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:55:04.189869151Z [2024-05-26T01:55:04.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:55:04.190059842Z [2024-05-26T01:55:04.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:55:04.197472180Z [2024-05-26T01:55:04.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to c298a291-e774-47e2-a20e-d77ab321bd89 2024-05-26T01:55:04.197787929Z [2024-05-26T01:55:04.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=-1, run_start_date=2024-05-26 01:55:02.613276+00:00, run_end_date=2024-05-26 01:55:03.116989+00:00, run_duration=0.503713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:55:00.590766+00:00, queued_by_job_id=1, pid=12641 2024-05-26T01:55:04.234326128Z [2024-05-26T01:55:04.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:55:04.234747045Z [2024-05-26T01:55:04.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:54:00+00:00, run_id=scheduled__2024-05-26T01:54:00+00:00, run_start_date=2024-05-26 01:55:00.491756+00:00, run_end_date=2024-05-26 01:55:04.234206+00:00, run_duration=3.74245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:54:00+00:00, data_interval_end=2024-05-26 01:55:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:55:04.244760496Z [2024-05-26T01:55:04.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:55:00+00:00, run_after=2024-05-26T01:56:00+00:00 2024-05-26T01:55:04.322188743Z [2024-05-26T01:55:04.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status success for try_number 1 2024-05-26T01:55:04.330349284Z [2024-05-26T01:55:04.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:54:00+00:00, map_index=-1, run_start_date=2024-05-26 01:55:02.591715+00:00, run_end_date=2024-05-26 01:55:03.951057+00:00, run_duration=1.359342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:55:00.590766+00:00, queued_by_job_id=1, pid=12639 2024-05-26T01:55:05.398594574Z [2024-05-26T01:55:05.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:55:05.399026166Z [2024-05-26T01:55:05.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:54:00+00:00, run_id=scheduled__2024-05-26T01:54:00+00:00, run_start_date=2024-05-26 01:55:00.493075+00:00, run_end_date=2024-05-26 01:55:05.398697+00:00, run_duration=4.905622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:54:00+00:00, data_interval_end=2024-05-26 01:55:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:55:05.408335380Z [2024-05-26T01:55:05.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:55:00+00:00, run_after=2024-05-26T01:56:00+00:00 2024-05-26T01:55:05.453255078Z [2024-05-26T01:55:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status success for try_number 1 2024-05-26T01:55:05.458187959Z [2024-05-26T01:55:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:54:00+00:00, map_index=-1, run_start_date=2024-05-26 01:55:02.611311+00:00, run_end_date=2024-05-26 01:55:04.385427+00:00, run_duration=1.774116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:55:00.590766+00:00, queued_by_job_id=1, pid=12640 2024-05-26T01:55:07.589007371Z [2024-05-26T01:55:07.588+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:55:07.589067817Z 2024-05-26T01:55:07.589079295Z [2024-05-26T01:55:07.588+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:55:07.589791921Z [2024-05-26T01:55:07.589+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:55:07.589825794Z 2024-05-26T01:55:07.592700473Z [2024-05-26T01:55:07.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T01:55:07.593034018Z [2024-05-26T01:55:07.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T01:55:07.678113861Z [2024-05-26T01:55:07.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:55:07.678337301Z [2024-05-26T01:55:07.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:55:07.684946666Z [2024-05-26T01:55:07.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed7dda42-0ff4-4b4e-aac7-6a240a3fb197 2024-05-26T01:55:07.685252404Z [2024-05-26T01:55:07.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=-1, run_start_date=2024-05-26 01:55:06.341491+00:00, run_end_date=2024-05-26 01:55:06.774318+00:00, run_duration=0.432827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:55:04.058485+00:00, queued_by_job_id=1, pid=12664 2024-05-26T01:55:10.219652002Z [2024-05-26T01:55:10.219+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T01:55:10.219789668Z 2024-05-26T01:55:10.219875833Z [2024-05-26T01:55:10.219+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:55:10.220437653Z [2024-05-26T01:55:10.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:55:10.220453435Z 2024-05-26T01:55:10.223037766Z [2024-05-26T01:55:10.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:55:10.223137142Z [2024-05-26T01:55:10.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T01:55:10.290440422Z [2024-05-26T01:55:10.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status queued for try_number 1 2024-05-26T01:55:10.292442935Z [2024-05-26T01:55:10.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:55:10.297573876Z [2024-05-26T01:55:10.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5263e190-dc3d-4ed5-9fd2-a0fab15176d4 2024-05-26T01:55:10.297772064Z [2024-05-26T01:55:10.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=0, run_start_date=2024-05-26 01:55:09.373502+00:00, run_end_date=2024-05-26 01:55:09.785681+00:00, run_duration=0.412179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:55:07.590271+00:00, queued_by_job_id=1, pid=12672 2024-05-26T01:55:12.550646550Z [2024-05-26T01:55:12.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:55:12.551049746Z [2024-05-26T01:55:12.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:50:00+00:00, run_id=scheduled__2024-05-26T01:50:00+00:00, run_start_date=2024-05-26 01:55:00.488431+00:00, run_end_date=2024-05-26 01:55:12.550373+00:00, run_duration=12.061942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:50:00+00:00, data_interval_end=2024-05-26 01:55:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T01:55:12.568004705Z [2024-05-26T01:55:12.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:55:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:55:12.607352695Z [2024-05-26T01:55:12.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:50:00+00:00 exited with status success for try_number 1 2024-05-26T01:55:12.616910710Z [2024-05-26T01:55:12.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:50:00+00:00, map_index=-1, run_start_date=2024-05-26 01:55:11.953052+00:00, run_end_date=2024-05-26 01:55:12.370688+00:00, run_duration=0.417636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:55:10.220795+00:00, queued_by_job_id=1, pid=12680 2024-05-26T01:56:00.750479875Z [2024-05-26T01:56:00.747+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:56:00.767563288Z [2024-05-26T01:56:00.766+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:56:00+00:00, run_after=2024-05-26T01:57:00+00:00 2024-05-26T01:56:00.779166331Z [2024-05-26T01:56:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:56:00+00:00, run_after=2024-05-26T01:57:00+00:00 2024-05-26T01:56:00.785883398Z [2024-05-26T01:56:00.785+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:56:00.908239472Z [2024-05-26T01:56:00.907+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:56:00.908268343Z 2024-05-26T01:56:00.908273429Z 2024-05-26T01:56:00.908277050Z 2024-05-26T01:56:00.908280237Z 2024-05-26T01:56:00.908284227Z [2024-05-26T01:56:00.908+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:56:00.908363791Z [2024-05-26T01:56:00.908+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:56:00.908368357Z [2024-05-26T01:56:00.908+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:56:00.908444104Z [2024-05-26T01:56:00.908+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:56:00.909012775Z [2024-05-26T01:56:00.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:56:00.909026190Z 2024-05-26T01:56:00.909032568Z 2024-05-26T01:56:00.909037173Z 2024-05-26T01:56:00.909041359Z 2024-05-26T01:56:00.913170334Z [2024-05-26T01:56:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:56:00.913268838Z [2024-05-26T01:56:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:56:00.913490177Z [2024-05-26T01:56:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:56:00.913552409Z [2024-05-26T01:56:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:56:00.913724331Z [2024-05-26T01:56:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:56:00.913790133Z [2024-05-26T01:56:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:56:00.913952843Z [2024-05-26T01:56:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:56:00.914004716Z [2024-05-26T01:56:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:56:01.385403578Z [2024-05-26T01:56:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status queued for try_number 1 2024-05-26T01:56:01.387750475Z [2024-05-26T01:56:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status queued for try_number 1 2024-05-26T01:56:01.387953709Z [2024-05-26T01:56:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status queued for try_number 1 2024-05-26T01:56:01.388161417Z [2024-05-26T01:56:01.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status queued for try_number 1 2024-05-26T01:56:01.401486553Z [2024-05-26T01:56:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to d492a786-44c7-411a-94f7-c738f37746f6 2024-05-26T01:56:01.401771290Z [2024-05-26T01:56:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e436454-9e4a-4b05-a7bb-667d7bbb9fcf 2024-05-26T01:56:01.402302771Z [2024-05-26T01:56:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1522e3df-9620-4a94-b0e7-ed01138f65fe 2024-05-26T01:56:01.402545199Z [2024-05-26T01:56:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to c07981ba-4b98-4a17-abaf-c2ac17e8d5aa 2024-05-26T01:56:02.588121241Z [2024-05-26T01:56:02.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:56:02.588636384Z [2024-05-26T01:56:02.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:54:00+00:00, run_id=scheduled__2024-05-26T01:54:00+00:00, run_start_date=2024-05-26 01:56:00.800178+00:00, run_end_date=2024-05-26 01:56:02.588237+00:00, run_duration=1.788059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:54:00+00:00, data_interval_end=2024-05-26 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:56:02.596580029Z [2024-05-26T01:56:02.596+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:56:00+00:00, run_after=2024-05-26T01:58:00+00:00 2024-05-26T01:56:02.604937106Z [2024-05-26T01:56:02.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:56:02.605433430Z [2024-05-26T01:56:02.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:55:00+00:00, run_id=scheduled__2024-05-26T01:55:00+00:00, run_start_date=2024-05-26 01:56:00.805466+00:00, run_end_date=2024-05-26 01:56:02.605015+00:00, run_duration=1.799549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:55:00+00:00, data_interval_end=2024-05-26 01:56:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:56:02.615315539Z [2024-05-26T01:56:02.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:56:00+00:00, run_after=2024-05-26T01:57:00+00:00 2024-05-26T01:56:02.685452543Z [2024-05-26T01:56:02.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:54:00+00:00 exited with status success for try_number 1 2024-05-26T01:56:02.685508406Z [2024-05-26T01:56:02.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status success for try_number 1 2024-05-26T01:56:02.692194646Z [2024-05-26T01:56:02.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:54:00+00:00, map_index=-1, run_start_date=2024-05-26 01:56:01.793239+00:00, run_end_date=2024-05-26 01:56:02.255059+00:00, run_duration=0.46182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:56:00.910662+00:00, queued_by_job_id=1, pid=12703 2024-05-26T01:56:02.692724404Z [2024-05-26T01:56:02.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:55:00+00:00, map_index=-1, run_start_date=2024-05-26 01:56:02.042617+00:00, run_end_date=2024-05-26 01:56:02.430291+00:00, run_duration=0.387674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:56:00.910662+00:00, queued_by_job_id=1, pid=12704 2024-05-26T01:56:06.394333913Z [2024-05-26T01:56:06.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:56:06.394367234Z [2024-05-26T01:56:06.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:55:00+00:00, run_id=scheduled__2024-05-26T01:55:00+00:00, run_start_date=2024-05-26 01:56:00.808413+00:00, run_end_date=2024-05-26 01:56:06.392683+00:00, run_duration=5.58427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:55:00+00:00, data_interval_end=2024-05-26 01:56:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:56:06.402889866Z [2024-05-26T01:56:06.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:56:00+00:00, run_after=2024-05-26T01:57:00+00:00 2024-05-26T01:56:06.410901282Z [2024-05-26T01:56:06.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:56:06.411020365Z [2024-05-26T01:56:06.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:55:00+00:00, run_id=scheduled__2024-05-26T01:55:00+00:00, run_start_date=2024-05-26 01:56:00.810270+00:00, run_end_date=2024-05-26 01:56:06.410799+00:00, run_duration=5.600529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:55:00+00:00, data_interval_end=2024-05-26 01:56:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:56:06.420750140Z [2024-05-26T01:56:06.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:56:00+00:00, run_after=2024-05-26T01:57:00+00:00 2024-05-26T01:56:06.466692518Z [2024-05-26T01:56:06.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status success for try_number 1 2024-05-26T01:56:06.466725000Z [2024-05-26T01:56:06.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status success for try_number 1 2024-05-26T01:56:06.483329317Z [2024-05-26T01:56:06.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:55:00+00:00, map_index=-1, run_start_date=2024-05-26 01:56:03.564944+00:00, run_end_date=2024-05-26 01:56:05.449327+00:00, run_duration=1.884383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:56:00.910662+00:00, queued_by_job_id=1, pid=12727 2024-05-26T01:56:06.483418059Z [2024-05-26T01:56:06.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:55:00+00:00, map_index=-1, run_start_date=2024-05-26 01:56:03.792742+00:00, run_end_date=2024-05-26 01:56:05.412225+00:00, run_duration=1.619483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:56:00.910662+00:00, queued_by_job_id=1, pid=12728 2024-05-26T01:57:00.103238655Z [2024-05-26T01:57:00.102+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:57:00.119138333Z [2024-05-26T01:57:00.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:57:00+00:00, run_after=2024-05-26T01:58:00+00:00 2024-05-26T01:57:00.133011461Z [2024-05-26T01:57:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:57:00+00:00, run_after=2024-05-26T01:58:00+00:00 2024-05-26T01:57:00.228543008Z [2024-05-26T01:57:00.228+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:57:00.228579781Z 2024-05-26T01:57:00.228585907Z 2024-05-26T01:57:00.228590872Z 2024-05-26T01:57:00.228659193Z [2024-05-26T01:57:00.228+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:57:00.228872336Z [2024-05-26T01:57:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:57:00.229099425Z [2024-05-26T01:57:00.228+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:57:00.229784335Z [2024-05-26T01:57:00.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:57:00.229796574Z 2024-05-26T01:57:00.229800045Z 2024-05-26T01:57:00.229808722Z 2024-05-26T01:57:00.233905245Z [2024-05-26T01:57:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:57:00.234263691Z [2024-05-26T01:57:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:57:00.234609170Z [2024-05-26T01:57:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:57:00.234757560Z [2024-05-26T01:57:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:57:00.235009517Z [2024-05-26T01:57:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:57:00.235163900Z [2024-05-26T01:57:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:57:00.500609966Z [2024-05-26T01:57:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status queued for try_number 1 2024-05-26T01:57:00.500639056Z [2024-05-26T01:57:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status queued for try_number 1 2024-05-26T01:57:00.500664969Z [2024-05-26T01:57:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status queued for try_number 1 2024-05-26T01:57:00.513117881Z [2024-05-26T01:57:00.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0f04219-c4a0-4e30-ab85-9099100fe853 2024-05-26T01:57:00.513157630Z [2024-05-26T01:57:00.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to b40db6a7-34ff-4952-93f2-f8ad4cf0471f 2024-05-26T01:57:00.513255116Z [2024-05-26T01:57:00.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6eab50a5-f3b2-4474-bada-b534189f909a 2024-05-26T01:57:02.885903249Z [2024-05-26T01:57:02.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:57:02.886208373Z [2024-05-26T01:57:02.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:56:00+00:00, run_id=scheduled__2024-05-26T01:56:00+00:00, run_start_date=2024-05-26 01:57:00.148632+00:00, run_end_date=2024-05-26 01:57:02.885891+00:00, run_duration=2.737259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:56:00+00:00, data_interval_end=2024-05-26 01:57:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:57:02.895920010Z [2024-05-26T01:57:02.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:57:00+00:00, run_after=2024-05-26T01:58:00+00:00 2024-05-26T01:57:02.955243774Z [2024-05-26T01:57:02.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status success for try_number 1 2024-05-26T01:57:02.960198030Z [2024-05-26T01:57:02.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:56:00+00:00, map_index=-1, run_start_date=2024-05-26 01:57:01.458295+00:00, run_end_date=2024-05-26 01:57:01.805082+00:00, run_duration=0.346787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:57:00.230584+00:00, queued_by_job_id=1, pid=12761 2024-05-26T01:57:04.005060479Z [2024-05-26T01:57:04.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:57:04.005515996Z [2024-05-26T01:57:04.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:56:00+00:00, run_id=scheduled__2024-05-26T01:56:00+00:00, run_start_date=2024-05-26 01:57:00.150230+00:00, run_end_date=2024-05-26 01:57:04.005212+00:00, run_duration=3.854982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:56:00+00:00, data_interval_end=2024-05-26 01:57:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:57:04.014309277Z [2024-05-26T01:57:04.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:57:00+00:00, run_after=2024-05-26T01:58:00+00:00 2024-05-26T01:57:04.073719644Z [2024-05-26T01:57:04.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status success for try_number 1 2024-05-26T01:57:04.080279702Z [2024-05-26T01:57:04.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:56:00+00:00, map_index=-1, run_start_date=2024-05-26 01:57:02.497177+00:00, run_end_date=2024-05-26 01:57:03.906720+00:00, run_duration=1.409543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:57:00.230584+00:00, queued_by_job_id=1, pid=12779 2024-05-26T01:57:05.142404733Z [2024-05-26T01:57:05.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:57:05.142858031Z [2024-05-26T01:57:05.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:56:00+00:00, run_id=scheduled__2024-05-26T01:56:00+00:00, run_start_date=2024-05-26 01:57:00.151293+00:00, run_end_date=2024-05-26 01:57:05.142520+00:00, run_duration=4.991227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:56:00+00:00, data_interval_end=2024-05-26 01:57:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:57:05.152773631Z [2024-05-26T01:57:05.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:57:00+00:00, run_after=2024-05-26T01:58:00+00:00 2024-05-26T01:57:05.189708617Z [2024-05-26T01:57:05.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status success for try_number 1 2024-05-26T01:57:05.195403192Z [2024-05-26T01:57:05.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:56:00+00:00, map_index=-1, run_start_date=2024-05-26 01:57:02.256575+00:00, run_end_date=2024-05-26 01:57:04.055029+00:00, run_duration=1.798454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:57:00.230584+00:00, queued_by_job_id=1, pid=12773 2024-05-26T01:58:00.033287665Z [2024-05-26T01:58:00.032+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:58:00+00:00, run_after=2024-05-26T01:59:00+00:00 2024-05-26T01:58:00.047557072Z [2024-05-26T01:58:00.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:58:00+00:00, run_after=2024-05-26T01:59:00+00:00 2024-05-26T01:58:00.054499967Z [2024-05-26T01:58:00.054+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:58:00.067437115Z [2024-05-26T01:58:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:58:00.170480775Z [2024-05-26T01:58:00.169+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T01:58:00.170513157Z 2024-05-26T01:58:00.170548560Z 2024-05-26T01:58:00.170575914Z 2024-05-26T01:58:00.170581031Z 2024-05-26T01:58:00.170586392Z [2024-05-26T01:58:00.170+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T01:58:00.170621198Z [2024-05-26T01:58:00.170+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:58:00.170819265Z [2024-05-26T01:58:00.170+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:58:00.170950330Z [2024-05-26T01:58:00.170+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:58:00.172210072Z [2024-05-26T01:58:00.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:58:00.172247538Z 2024-05-26T01:58:00.172259850Z 2024-05-26T01:58:00.172269880Z 2024-05-26T01:58:00.172279384Z 2024-05-26T01:58:00.176087997Z [2024-05-26T01:58:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:58:00.176126187Z [2024-05-26T01:58:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T01:58:00.176278625Z [2024-05-26T01:58:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:58:00.176351664Z [2024-05-26T01:58:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:58:00.176676119Z [2024-05-26T01:58:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:58:00.176756420Z [2024-05-26T01:58:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:58:00.176993317Z [2024-05-26T01:58:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:58:00.177011832Z [2024-05-26T01:58:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:58:00.564850912Z [2024-05-26T01:58:00.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status queued for try_number 1 2024-05-26T01:58:00.565216427Z [2024-05-26T01:58:00.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:57:00+00:00 exited with status queued for try_number 1 2024-05-26T01:58:00.565424676Z [2024-05-26T01:58:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:57:00+00:00 exited with status queued for try_number 1 2024-05-26T01:58:00.565631141Z [2024-05-26T01:58:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:57:00+00:00 exited with status queued for try_number 1 2024-05-26T01:58:00.586304601Z [2024-05-26T01:58:00.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 062f807d-5d6f-4413-a1e4-bc1a1efae7f1 2024-05-26T01:58:00.586596627Z [2024-05-26T01:58:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to e642b3d0-dd18-4b5d-89f4-288ee7ec20de 2024-05-26T01:58:00.586817994Z [2024-05-26T01:58:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ddf463e-8285-4a8c-8fc2-279ade5b1de4 2024-05-26T01:58:00.586997145Z [2024-05-26T01:58:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c75e4a3-4f42-4e9c-825e-34cc51800a32 2024-05-26T01:58:02.638684657Z [2024-05-26T01:58:02.638+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:58:02.639016763Z [2024-05-26T01:58:02.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:56:00+00:00, run_id=scheduled__2024-05-26T01:56:00+00:00, run_start_date=2024-05-26 01:58:00.084780+00:00, run_end_date=2024-05-26 01:58:02.638589+00:00, run_duration=2.553809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:56:00+00:00, data_interval_end=2024-05-26 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T01:58:02.653637606Z [2024-05-26T01:58:02.647+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T01:58:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:58:02.655211343Z [2024-05-26T01:58:02.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:58:02.655410265Z [2024-05-26T01:58:02.655+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:57:00+00:00, run_id=scheduled__2024-05-26T01:57:00+00:00, run_start_date=2024-05-26 01:58:00.086697+00:00, run_end_date=2024-05-26 01:58:02.655158+00:00, run_duration=2.568461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:57:00+00:00, data_interval_end=2024-05-26 01:58:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:58:02.667737412Z [2024-05-26T01:58:02.667+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:58:00+00:00, run_after=2024-05-26T01:59:00+00:00 2024-05-26T01:58:02.752558097Z [2024-05-26T01:58:02.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:56:00+00:00 exited with status success for try_number 1 2024-05-26T01:58:02.752580562Z [2024-05-26T01:58:02.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:57:00+00:00 exited with status success for try_number 1 2024-05-26T01:58:02.762734307Z [2024-05-26T01:58:02.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:57:00+00:00, map_index=-1, run_start_date=2024-05-26 01:58:01.117111+00:00, run_end_date=2024-05-26 01:58:01.506766+00:00, run_duration=0.389655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:58:00.173089+00:00, queued_by_job_id=1, pid=12813 2024-05-26T01:58:02.763105716Z [2024-05-26T01:58:02.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:56:00+00:00, map_index=-1, run_start_date=2024-05-26 01:58:01.017994+00:00, run_end_date=2024-05-26 01:58:01.520253+00:00, run_duration=0.502259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:58:00.173089+00:00, queued_by_job_id=1, pid=12812 2024-05-26T01:58:04.994207140Z [2024-05-26T01:58:04.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:58:04.994481442Z [2024-05-26T01:58:04.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:57:00+00:00, run_id=scheduled__2024-05-26T01:57:00+00:00, run_start_date=2024-05-26 01:58:00.088459+00:00, run_end_date=2024-05-26 01:58:04.994092+00:00, run_duration=4.905633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:57:00+00:00, data_interval_end=2024-05-26 01:58:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:58:05.003385764Z [2024-05-26T01:58:05.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:58:00+00:00, run_after=2024-05-26T01:59:00+00:00 2024-05-26T01:58:05.010468586Z [2024-05-26T01:58:05.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:58:05.010814710Z [2024-05-26T01:58:05.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:57:00+00:00, run_id=scheduled__2024-05-26T01:57:00+00:00, run_start_date=2024-05-26 01:58:00.090000+00:00, run_end_date=2024-05-26 01:58:05.010375+00:00, run_duration=4.920375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:57:00+00:00, data_interval_end=2024-05-26 01:58:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:58:05.019010143Z [2024-05-26T01:58:05.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:58:00+00:00, run_after=2024-05-26T01:59:00+00:00 2024-05-26T01:58:05.053127391Z [2024-05-26T01:58:05.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:57:00+00:00 exited with status success for try_number 1 2024-05-26T01:58:05.053265816Z [2024-05-26T01:58:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:57:00+00:00 exited with status success for try_number 1 2024-05-26T01:58:05.061113810Z [2024-05-26T01:58:05.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:57:00+00:00, map_index=-1, run_start_date=2024-05-26 01:58:02.355979+00:00, run_end_date=2024-05-26 01:58:03.860136+00:00, run_duration=1.504157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:58:00.173089+00:00, queued_by_job_id=1, pid=12837 2024-05-26T01:58:05.061316052Z [2024-05-26T01:58:05.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:57:00+00:00, map_index=-1, run_start_date=2024-05-26 01:58:02.158443+00:00, run_end_date=2024-05-26 01:58:03.858669+00:00, run_duration=1.700226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:58:00.173089+00:00, queued_by_job_id=1, pid=12833 2024-05-26T01:58:32.956733460Z [2024-05-26T01:58:32.955+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T01:59:00.492860944Z [2024-05-26T01:59:00.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:59:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:59:00.506859124Z [2024-05-26T01:59:00.506+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:59:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:59:00.513311866Z [2024-05-26T01:59:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T01:59:00.569264960Z [2024-05-26T01:59:00.568+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T01:59:00.569316971Z 2024-05-26T01:59:00.569357590Z 2024-05-26T01:59:00.569366919Z 2024-05-26T01:59:00.569446799Z [2024-05-26T01:59:00.569+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:59:00.569851428Z [2024-05-26T01:59:00.569+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T01:59:00.570167568Z [2024-05-26T01:59:00.569+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T01:59:00.571620885Z [2024-05-26T01:59:00.571+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T01:59:00.571662613Z 2024-05-26T01:59:00.571668446Z 2024-05-26T01:59:00.571672629Z 2024-05-26T01:59:00.580389188Z [2024-05-26T01:59:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:59:00.580826403Z [2024-05-26T01:59:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T01:59:00.581566397Z [2024-05-26T01:59:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:59:00.582065967Z [2024-05-26T01:59:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T01:59:00.582842234Z [2024-05-26T01:59:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T01:59:00.583446149Z [2024-05-26T01:59:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T01:59:00.931518653Z [2024-05-26T01:59:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status queued for try_number 1 2024-05-26T01:59:00.931625471Z [2024-05-26T01:59:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status queued for try_number 1 2024-05-26T01:59:00.931721416Z [2024-05-26T01:59:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status queued for try_number 1 2024-05-26T01:59:00.942903847Z [2024-05-26T01:59:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0719d947-2143-4978-9754-7b1f81bccf38 2024-05-26T01:59:00.942957594Z [2024-05-26T01:59:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to a00302d6-aa41-4630-893e-099a1fb13aaa 2024-05-26T01:59:00.942987984Z [2024-05-26T01:59:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to fce5a0de-58cc-4fb7-8541-def3bcece7de 2024-05-26T01:59:02.113345199Z [2024-05-26T01:59:02.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:59:02.114019078Z [2024-05-26T01:59:02.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:58:00+00:00, run_id=scheduled__2024-05-26T01:58:00+00:00, run_start_date=2024-05-26 01:59:00.521898+00:00, run_end_date=2024-05-26 01:59:02.113446+00:00, run_duration=1.591548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:58:00+00:00, data_interval_end=2024-05-26 01:59:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T01:59:02.129652126Z [2024-05-26T01:59:02.129+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T01:59:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:59:02.182769705Z [2024-05-26T01:59:02.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status success for try_number 1 2024-05-26T01:59:02.188357282Z [2024-05-26T01:59:02.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:58:00+00:00, map_index=-1, run_start_date=2024-05-26 01:59:01.380596+00:00, run_end_date=2024-05-26 01:59:01.759569+00:00, run_duration=0.378973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:59:00.574379+00:00, queued_by_job_id=1, pid=12869 2024-05-26T01:59:04.694823948Z [2024-05-26T01:59:04.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:59:04.695380513Z [2024-05-26T01:59:04.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:58:00+00:00, run_id=scheduled__2024-05-26T01:58:00+00:00, run_start_date=2024-05-26 01:59:00.523086+00:00, run_end_date=2024-05-26 01:59:04.694920+00:00, run_duration=4.171834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:58:00+00:00, data_interval_end=2024-05-26 01:59:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T01:59:04.715270215Z [2024-05-26T01:59:04.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:59:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:59:04.728342106Z [2024-05-26T01:59:04.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T01:59:04.728699730Z [2024-05-26T01:59:04.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:58:00+00:00, run_id=scheduled__2024-05-26T01:58:00+00:00, run_start_date=2024-05-26 01:59:00.524110+00:00, run_end_date=2024-05-26 01:59:04.728263+00:00, run_duration=4.204153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:58:00+00:00, data_interval_end=2024-05-26 01:59:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T01:59:04.738019266Z [2024-05-26T01:59:04.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T01:59:00+00:00, run_after=2024-05-26T02:00:00+00:00 2024-05-26T01:59:04.767572625Z [2024-05-26T01:59:04.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status success for try_number 1 2024-05-26T01:59:04.767799739Z [2024-05-26T01:59:04.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status success for try_number 1 2024-05-26T01:59:04.774433769Z [2024-05-26T01:59:04.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:58:00+00:00, map_index=-1, run_start_date=2024-05-26 01:59:02.380143+00:00, run_end_date=2024-05-26 01:59:03.670430+00:00, run_duration=1.290287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:59:00.574379+00:00, queued_by_job_id=1, pid=12887 2024-05-26T01:59:04.774775383Z [2024-05-26T01:59:04.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:58:00+00:00, map_index=-1, run_start_date=2024-05-26 01:59:02.442774+00:00, run_end_date=2024-05-26 01:59:04.193742+00:00, run_duration=1.750968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 01:59:00.574379+00:00, queued_by_job_id=1, pid=12888 2024-05-26T02:00:00.914156550Z [2024-05-26T02:00:00.913+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:00:00.937512360Z [2024-05-26T02:00:00.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:01:00+00:00 2024-05-26T02:00:00.947259255Z [2024-05-26T02:00:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:00:00.961791757Z [2024-05-26T02:00:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:01:00+00:00 2024-05-26T02:00:00.978148599Z [2024-05-26T02:00:00.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:05:00+00:00 2024-05-26T02:00:01.078315010Z [2024-05-26T02:00:01.077+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T02:00:01.078340195Z 2024-05-26T02:00:01.078343968Z 2024-05-26T02:00:01.078347612Z 2024-05-26T02:00:01.078351026Z 2024-05-26T02:00:01.078354455Z 2024-05-26T02:00:01.078587548Z [2024-05-26T02:00:01.078+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:00:01.078870716Z [2024-05-26T02:00:01.078+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:00:01.079008448Z [2024-05-26T02:00:01.078+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:00:01.079204978Z [2024-05-26T02:00:01.078+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:00:01.079503714Z [2024-05-26T02:00:01.079+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:00:01.080589690Z [2024-05-26T02:00:01.080+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:00:01.080607293Z 2024-05-26T02:00:01.080614263Z 2024-05-26T02:00:01.080620098Z 2024-05-26T02:00:01.080626022Z 2024-05-26T02:00:01.080631619Z 2024-05-26T02:00:01.086239969Z [2024-05-26T02:00:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:00:01.086430350Z [2024-05-26T02:00:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:00:01.086740162Z [2024-05-26T02:00:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:00:01.086895382Z [2024-05-26T02:00:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:00:01.087157721Z [2024-05-26T02:00:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:00:01.087288762Z [2024-05-26T02:00:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:00:01.087544451Z [2024-05-26T02:00:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:00:01.087687573Z [2024-05-26T02:00:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:00:01.088001807Z [2024-05-26T02:00:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:00:01.088175189Z [2024-05-26T02:00:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:00:01.484503190Z [2024-05-26T02:00:01.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:01.484739219Z [2024-05-26T02:00:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:01.484916749Z [2024-05-26T02:00:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:59:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:01.485070727Z [2024-05-26T02:00:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:59:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:01.485221412Z [2024-05-26T02:00:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:59:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:01.494261894Z [2024-05-26T02:00:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to b36112d8-7895-4ed2-853f-777b44bd5ee5 2024-05-26T02:00:01.494505106Z [2024-05-26T02:00:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52021101-d496-49ea-8c38-7c62f11c5d04 2024-05-26T02:00:01.494820086Z [2024-05-26T02:00:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06274c5f-7249-4a7d-8853-f4ec0990d1e4 2024-05-26T02:00:01.495104577Z [2024-05-26T02:00:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5cce100-d2a6-42b5-89a3-a6d07c8fe9bd 2024-05-26T02:00:01.495351815Z [2024-05-26T02:00:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fdcd94e-1240-4154-a312-84669b17d26c 2024-05-26T02:00:02.866251110Z [2024-05-26T02:00:02.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:00:02.866585189Z [2024-05-26T02:00:02.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 01:59:00+00:00, run_id=scheduled__2024-05-26T01:59:00+00:00, run_start_date=2024-05-26 02:00:00.994466+00:00, run_end_date=2024-05-26 02:00:02.866200+00:00, run_duration=1.871734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:59:00+00:00, data_interval_end=2024-05-26 02:00:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:00:02.882409870Z [2024-05-26T02:00:02.880+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:01:00+00:00 2024-05-26T02:00:02.959241071Z [2024-05-26T02:00:02.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:59:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:02.965647871Z [2024-05-26T02:00:02.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:59:00+00:00, map_index=-1, run_start_date=2024-05-26 02:00:02.299004+00:00, run_end_date=2024-05-26 02:00:02.778456+00:00, run_duration=0.479452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:01.081565+00:00, queued_by_job_id=1, pid=12922 2024-05-26T02:00:03.427686142Z [2024-05-26T02:00:03.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:00:03.427728376Z [2024-05-26T02:00:03.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 01:58:00+00:00, run_id=scheduled__2024-05-26T01:58:00+00:00, run_start_date=2024-05-26 02:00:00.992652+00:00, run_end_date=2024-05-26 02:00:03.420783+00:00, run_duration=2.428131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:58:00+00:00, data_interval_end=2024-05-26 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:00:03.435670313Z [2024-05-26T02:00:03.431+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:02:00+00:00 2024-05-26T02:00:03.517034231Z [2024-05-26T02:00:03.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T01:58:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:03.523816668Z [2024-05-26T02:00:03.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T01:58:00+00:00, map_index=-1, run_start_date=2024-05-26 02:00:02.375055+00:00, run_end_date=2024-05-26 02:00:02.930736+00:00, run_duration=0.555681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:01.081565+00:00, queued_by_job_id=1, pid=12923 2024-05-26T02:00:04.664261228Z [2024-05-26T02:00:04.663+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:00:04.664288062Z 2024-05-26T02:00:04.664532055Z [2024-05-26T02:00:04.664+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:00:04.665450294Z [2024-05-26T02:00:04.665+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:00:04.665464049Z 2024-05-26T02:00:04.668198119Z [2024-05-26T02:00:04.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:00:04.668427003Z [2024-05-26T02:00:04.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:00:04.734395780Z [2024-05-26T02:00:04.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:04.739132748Z [2024-05-26T02:00:04.738+0000] {scheduler_job.py:635} INFO - Setting external_id for to e46b8232-4742-4776-b96a-271de9c5bf2b 2024-05-26T02:00:04.876271127Z [2024-05-26T02:00:04.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:04.881525741Z [2024-05-26T02:00:04.881+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T01:55:00+00:00, map_index=-1, run_start_date=2024-05-26 02:00:03.768133+00:00, run_end_date=2024-05-26 02:00:04.541915+00:00, run_duration=0.773782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:01.081565+00:00, queued_by_job_id=1, pid=12954 2024-05-26T02:00:05.960172297Z [2024-05-26T02:00:05.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:00:05.960540607Z [2024-05-26T02:00:05.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:59:00+00:00, run_id=scheduled__2024-05-26T01:59:00+00:00, run_start_date=2024-05-26 02:00:00.995702+00:00, run_end_date=2024-05-26 02:00:05.960195+00:00, run_duration=4.964493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:59:00+00:00, data_interval_end=2024-05-26 02:00:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:00:05.999560481Z [2024-05-26T02:00:05.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:01:00+00:00 2024-05-26T02:00:06.019683655Z [2024-05-26T02:00:06.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:00:06.020083283Z [2024-05-26T02:00:06.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:59:00+00:00, run_id=scheduled__2024-05-26T01:59:00+00:00, run_start_date=2024-05-26 02:00:00.996935+00:00, run_end_date=2024-05-26 02:00:06.019773+00:00, run_duration=5.022838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:59:00+00:00, data_interval_end=2024-05-26 02:00:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:00:06.029965775Z [2024-05-26T02:00:06.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:01:00+00:00 2024-05-26T02:00:06.096106759Z [2024-05-26T02:00:06.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:59:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:06.096428706Z [2024-05-26T02:00:06.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T01:59:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:06.104931846Z [2024-05-26T02:00:06.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:59:00+00:00, map_index=-1, run_start_date=2024-05-26 02:00:03.717381+00:00, run_end_date=2024-05-26 02:00:05.558848+00:00, run_duration=1.841467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:01.081565+00:00, queued_by_job_id=1, pid=12953 2024-05-26T02:00:06.105225766Z [2024-05-26T02:00:06.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T01:59:00+00:00, map_index=-1, run_start_date=2024-05-26 02:00:03.601300+00:00, run_end_date=2024-05-26 02:00:05.354989+00:00, run_duration=1.753689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:01.081565+00:00, queued_by_job_id=1, pid=12952 2024-05-26T02:00:08.309947841Z [2024-05-26T02:00:08.309+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:00:08.309979660Z 2024-05-26T02:00:08.310196901Z [2024-05-26T02:00:08.309+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:00:08.311533741Z [2024-05-26T02:00:08.311+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:00:08.311554764Z 2024-05-26T02:00:08.317036392Z [2024-05-26T02:00:08.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:00:08.317136357Z [2024-05-26T02:00:08.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:00:08.424419321Z [2024-05-26T02:00:08.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:08.426482042Z [2024-05-26T02:00:08.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:08.479382776Z [2024-05-26T02:00:08.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f274fca-33cf-4b5e-b11c-4c3c76e07414 2024-05-26T02:00:08.480283220Z [2024-05-26T02:00:08.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T01:55:00+00:00, map_index=-1, run_start_date=2024-05-26 02:00:06.787937+00:00, run_end_date=2024-05-26 02:00:07.223073+00:00, run_duration=0.435136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:04.665949+00:00, queued_by_job_id=1, pid=12977 2024-05-26T02:00:11.064235445Z [2024-05-26T02:00:11.063+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:00:11.064266685Z 2024-05-26T02:00:11.064280811Z [2024-05-26T02:00:11.064+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:00:11.064759869Z [2024-05-26T02:00:11.064+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:00:11.064769935Z 2024-05-26T02:00:11.066906597Z [2024-05-26T02:00:11.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:00:11.066969559Z [2024-05-26T02:00:11.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:00:11.124148951Z [2024-05-26T02:00:11.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status queued for try_number 1 2024-05-26T02:00:11.124413282Z [2024-05-26T02:00:11.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:11.130031744Z [2024-05-26T02:00:11.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3584926-5727-40b4-944c-4ff82b6f6bab 2024-05-26T02:00:11.130646033Z [2024-05-26T02:00:11.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T01:55:00+00:00, map_index=0, run_start_date=2024-05-26 02:00:09.979129+00:00, run_end_date=2024-05-26 02:00:10.328631+00:00, run_duration=0.349502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:08.312404+00:00, queued_by_job_id=1, pid=12985 2024-05-26T02:00:13.337860369Z [2024-05-26T02:00:13.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:00:13.338383999Z [2024-05-26T02:00:13.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 01:55:00+00:00, run_id=scheduled__2024-05-26T01:55:00+00:00, run_start_date=2024-05-26 02:00:00.991128+00:00, run_end_date=2024-05-26 02:00:13.337740+00:00, run_duration=12.346612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 01:55:00+00:00, data_interval_end=2024-05-26 02:00:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:00:13.346370067Z [2024-05-26T02:00:13.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:00:00+00:00, run_after=2024-05-26T02:05:00+00:00 2024-05-26T02:00:13.386969816Z [2024-05-26T02:00:13.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T01:55:00+00:00 exited with status success for try_number 1 2024-05-26T02:00:13.396671689Z [2024-05-26T02:00:13.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T01:55:00+00:00, map_index=-1, run_start_date=2024-05-26 02:00:12.776097+00:00, run_end_date=2024-05-26 02:00:13.158345+00:00, run_duration=0.382248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:00:11.065057+00:00, queued_by_job_id=1, pid=12993 2024-05-26T02:01:00.342291649Z [2024-05-26T02:01:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:01:00+00:00, run_after=2024-05-26T02:02:00+00:00 2024-05-26T02:01:00.348388669Z [2024-05-26T02:01:00.347+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:01:00.358316729Z [2024-05-26T02:01:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:01:00+00:00, run_after=2024-05-26T02:02:00+00:00 2024-05-26T02:01:00.411316856Z [2024-05-26T02:01:00.410+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:01:00.411395071Z 2024-05-26T02:01:00.411407056Z 2024-05-26T02:01:00.411415591Z 2024-05-26T02:01:00.411424162Z [2024-05-26T02:01:00.411+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:01:00.411447691Z [2024-05-26T02:01:00.411+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:01:00.411456627Z [2024-05-26T02:01:00.411+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:01:00.412106624Z [2024-05-26T02:01:00.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:01:00.412132028Z 2024-05-26T02:01:00.412140839Z 2024-05-26T02:01:00.412149324Z 2024-05-26T02:01:00.414920561Z [2024-05-26T02:01:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:01:00.414945145Z [2024-05-26T02:01:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:01:00.415153204Z [2024-05-26T02:01:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:01:00.415201743Z [2024-05-26T02:01:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:01:00.415554322Z [2024-05-26T02:01:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:01:00.415617667Z [2024-05-26T02:01:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:01:00.845462315Z [2024-05-26T02:01:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:01:00.845661737Z [2024-05-26T02:01:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:01:00.845798690Z [2024-05-26T02:01:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:01:00.862381596Z [2024-05-26T02:01:00.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9da1f68a-3357-448a-9771-32e8fb600b12 2024-05-26T02:01:00.863996946Z [2024-05-26T02:01:00.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a732de0-c703-4d11-a8f9-74f7136b7bed 2024-05-26T02:01:00.864153415Z [2024-05-26T02:01:00.864+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79be5567-0609-42a4-a433-13d8f98eee03 2024-05-26T02:01:03.031505384Z [2024-05-26T02:01:03.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:01:03.033305858Z [2024-05-26T02:01:03.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:00:00+00:00, run_id=scheduled__2024-05-26T02:00:00+00:00, run_start_date=2024-05-26 02:01:00.366934+00:00, run_end_date=2024-05-26 02:01:03.031353+00:00, run_duration=2.664419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:00:00+00:00, data_interval_end=2024-05-26 02:01:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:01:03.044127290Z [2024-05-26T02:01:03.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:01:00+00:00, run_after=2024-05-26T02:02:00+00:00 2024-05-26T02:01:03.096646193Z [2024-05-26T02:01:03.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:01:03.103061069Z [2024-05-26T02:01:03.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=-1, run_start_date=2024-05-26 02:01:01.438046+00:00, run_end_date=2024-05-26 02:01:01.836078+00:00, run_duration=0.398032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:01:00.412505+00:00, queued_by_job_id=1, pid=13014 2024-05-26T02:01:04.206374699Z [2024-05-26T02:01:04.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:01:04.206513623Z [2024-05-26T02:01:04.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:00:00+00:00, run_id=scheduled__2024-05-26T02:00:00+00:00, run_start_date=2024-05-26 02:01:00.368150+00:00, run_end_date=2024-05-26 02:01:04.206294+00:00, run_duration=3.838144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:00:00+00:00, data_interval_end=2024-05-26 02:01:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:01:04.214752384Z [2024-05-26T02:01:04.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:01:00+00:00, run_after=2024-05-26T02:02:00+00:00 2024-05-26T02:01:04.259071988Z [2024-05-26T02:01:04.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:01:04.267063465Z [2024-05-26T02:01:04.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=-1, run_start_date=2024-05-26 02:01:02.470361+00:00, run_end_date=2024-05-26 02:01:04.015840+00:00, run_duration=1.545479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:01:00.412505+00:00, queued_by_job_id=1, pid=13033 2024-05-26T02:01:05.462286227Z [2024-05-26T02:01:05.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:01:05.462311612Z [2024-05-26T02:01:05.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:00:00+00:00, run_id=scheduled__2024-05-26T02:00:00+00:00, run_start_date=2024-05-26 02:01:00.369292+00:00, run_end_date=2024-05-26 02:01:05.461953+00:00, run_duration=5.092661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:00:00+00:00, data_interval_end=2024-05-26 02:01:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:01:05.473402274Z [2024-05-26T02:01:05.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:01:00+00:00, run_after=2024-05-26T02:02:00+00:00 2024-05-26T02:01:06.636757976Z [2024-05-26T02:01:06.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:01:06.645833054Z [2024-05-26T02:01:06.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=-1, run_start_date=2024-05-26 02:01:02.432218+00:00, run_end_date=2024-05-26 02:01:05.378943+00:00, run_duration=2.946725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:01:00.412505+00:00, queued_by_job_id=1, pid=13032 2024-05-26T02:02:00.190958697Z [2024-05-26T02:02:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:02:00+00:00, run_after=2024-05-26T02:03:00+00:00 2024-05-26T02:02:00.203755149Z [2024-05-26T02:02:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:02:00+00:00, run_after=2024-05-26T02:03:00+00:00 2024-05-26T02:02:00.211399236Z [2024-05-26T02:02:00.211+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:02:00.223065068Z [2024-05-26T02:02:00.222+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:02:00.317618014Z [2024-05-26T02:02:00.317+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:02:00.317665503Z 2024-05-26T02:02:00.317672717Z 2024-05-26T02:02:00.317678096Z 2024-05-26T02:02:00.317683030Z 2024-05-26T02:02:00.317773710Z [2024-05-26T02:02:00.317+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:02:00.318001719Z [2024-05-26T02:02:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:02:00.318081720Z [2024-05-26T02:02:00.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:02:00.318251776Z [2024-05-26T02:02:00.318+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:02:00.318860574Z [2024-05-26T02:02:00.318+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:02:00.318869918Z 2024-05-26T02:02:00.318874430Z 2024-05-26T02:02:00.318877939Z 2024-05-26T02:02:00.318900676Z 2024-05-26T02:02:00.322814366Z [2024-05-26T02:02:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:02:00.322975116Z [2024-05-26T02:02:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:02:00.323252609Z [2024-05-26T02:02:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:02:00.323419295Z [2024-05-26T02:02:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:02:00.323724596Z [2024-05-26T02:02:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:02:00.323848869Z [2024-05-26T02:02:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:02:00.324101612Z [2024-05-26T02:02:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:02:00.324310676Z [2024-05-26T02:02:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:02:00.792606978Z [2024-05-26T02:02:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:02:00.792626262Z [2024-05-26T02:02:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:01:00+00:00 exited with status queued for try_number 1 2024-05-26T02:02:00.792629804Z [2024-05-26T02:02:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:01:00+00:00 exited with status queued for try_number 1 2024-05-26T02:02:00.792633019Z [2024-05-26T02:02:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:01:00+00:00 exited with status queued for try_number 1 2024-05-26T02:02:00.807645230Z [2024-05-26T02:02:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b62fafc-6eba-40af-9ced-ea767511ad95 2024-05-26T02:02:00.807668846Z [2024-05-26T02:02:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15c503ec-c4da-446a-8779-45d660c00c5b 2024-05-26T02:02:00.807672449Z [2024-05-26T02:02:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b1d86f5-4c41-4eea-a62c-b5380063472e 2024-05-26T02:02:00.807675736Z [2024-05-26T02:02:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4b8c742-ef20-49fa-8951-05542ab49e9b 2024-05-26T02:02:02.067560898Z [2024-05-26T02:02:02.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:02:02.067808758Z [2024-05-26T02:02:02.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:00:00+00:00, run_id=scheduled__2024-05-26T02:00:00+00:00, run_start_date=2024-05-26 02:02:00.240663+00:00, run_end_date=2024-05-26 02:02:02.067458+00:00, run_duration=1.826795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:00:00+00:00, data_interval_end=2024-05-26 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:02:02.076486328Z [2024-05-26T02:02:02.076+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:02:00+00:00, run_after=2024-05-26T02:04:00+00:00 2024-05-26T02:02:02.094860145Z [2024-05-26T02:02:02.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:02:02.095621239Z [2024-05-26T02:02:02.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:01:00+00:00, run_id=scheduled__2024-05-26T02:01:00+00:00, run_start_date=2024-05-26 02:02:00.242348+00:00, run_end_date=2024-05-26 02:02:02.095039+00:00, run_duration=1.852691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:01:00+00:00, data_interval_end=2024-05-26 02:02:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:02:02.115254674Z [2024-05-26T02:02:02.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:02:00+00:00, run_after=2024-05-26T02:03:00+00:00 2024-05-26T02:02:02.171701907Z [2024-05-26T02:02:02.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:02:02.171852662Z [2024-05-26T02:02:02.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:01:00+00:00 exited with status success for try_number 1 2024-05-26T02:02:02.180028029Z [2024-05-26T02:02:02.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=-1, run_start_date=2024-05-26 02:02:01.249702+00:00, run_end_date=2024-05-26 02:02:01.663451+00:00, run_duration=0.413749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:02:00.319785+00:00, queued_by_job_id=1, pid=13066 2024-05-26T02:02:02.180392385Z [2024-05-26T02:02:02.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:01:00+00:00, map_index=-1, run_start_date=2024-05-26 02:02:01.382304+00:00, run_end_date=2024-05-26 02:02:01.776538+00:00, run_duration=0.394234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:02:00.319785+00:00, queued_by_job_id=1, pid=13067 2024-05-26T02:02:04.316788859Z [2024-05-26T02:02:04.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:02:04.317294318Z [2024-05-26T02:02:04.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:01:00+00:00, run_id=scheduled__2024-05-26T02:01:00+00:00, run_start_date=2024-05-26 02:02:00.243431+00:00, run_end_date=2024-05-26 02:02:04.316922+00:00, run_duration=4.073491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:01:00+00:00, data_interval_end=2024-05-26 02:02:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:02:04.328622796Z [2024-05-26T02:02:04.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:02:00+00:00, run_after=2024-05-26T02:03:00+00:00 2024-05-26T02:02:05.507672469Z [2024-05-26T02:02:05.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:02:05.508342028Z [2024-05-26T02:02:05.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:01:00+00:00, run_id=scheduled__2024-05-26T02:01:00+00:00, run_start_date=2024-05-26 02:02:00.244663+00:00, run_end_date=2024-05-26 02:02:05.507984+00:00, run_duration=5.263321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:01:00+00:00, data_interval_end=2024-05-26 02:02:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:02:05.521092932Z [2024-05-26T02:02:05.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:02:00+00:00, run_after=2024-05-26T02:03:00+00:00 2024-05-26T02:02:05.564453602Z [2024-05-26T02:02:05.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:01:00+00:00 exited with status success for try_number 1 2024-05-26T02:02:05.564511035Z [2024-05-26T02:02:05.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:01:00+00:00 exited with status success for try_number 1 2024-05-26T02:02:05.576036904Z [2024-05-26T02:02:05.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:01:00+00:00, map_index=-1, run_start_date=2024-05-26 02:02:02.604582+00:00, run_end_date=2024-05-26 02:02:04.247594+00:00, run_duration=1.643012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:02:00.319785+00:00, queued_by_job_id=1, pid=13091 2024-05-26T02:02:05.576509948Z [2024-05-26T02:02:05.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:01:00+00:00, map_index=-1, run_start_date=2024-05-26 02:02:02.571939+00:00, run_end_date=2024-05-26 02:02:04.768994+00:00, run_duration=2.197055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:02:00.319785+00:00, queued_by_job_id=1, pid=13090 2024-05-26T02:03:00.145995204Z [2024-05-26T02:03:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:03:00+00:00, run_after=2024-05-26T02:04:00+00:00 2024-05-26T02:03:00.163421229Z [2024-05-26T02:03:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:03:00+00:00, run_after=2024-05-26T02:04:00+00:00 2024-05-26T02:03:00.173589003Z [2024-05-26T02:03:00.173+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:03:00.240273241Z [2024-05-26T02:03:00.239+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:03:00.240378799Z 2024-05-26T02:03:00.240384688Z 2024-05-26T02:03:00.240389071Z 2024-05-26T02:03:00.240432831Z [2024-05-26T02:03:00.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:03:00.240600286Z [2024-05-26T02:03:00.240+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:03:00.240862782Z [2024-05-26T02:03:00.240+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:03:00.242201726Z [2024-05-26T02:03:00.241+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:03:00.242215237Z 2024-05-26T02:03:00.242220340Z 2024-05-26T02:03:00.242235598Z 2024-05-26T02:03:00.248796226Z [2024-05-26T02:03:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:03:00.249037802Z [2024-05-26T02:03:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:03:00.249543866Z [2024-05-26T02:03:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:03:00.249702081Z [2024-05-26T02:03:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:03:00.249859195Z [2024-05-26T02:03:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:03:00.249943428Z [2024-05-26T02:03:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:03:00.483589503Z [2024-05-26T02:03:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status queued for try_number 1 2024-05-26T02:03:00.483760608Z [2024-05-26T02:03:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status queued for try_number 1 2024-05-26T02:03:00.483871330Z [2024-05-26T02:03:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status queued for try_number 1 2024-05-26T02:03:00.492001318Z [2024-05-26T02:03:00.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6dc1751c-90ea-4f16-93e1-e0c674f474ad 2024-05-26T02:03:00.492238967Z [2024-05-26T02:03:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to a219c110-f6d8-4755-af2b-49f701f287c9 2024-05-26T02:03:00.492420807Z [2024-05-26T02:03:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93b750d6-e94a-4720-8e6a-d042bd3cb416 2024-05-26T02:03:01.640923816Z [2024-05-26T02:03:01.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:03:01.641258065Z [2024-05-26T02:03:01.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:02:00+00:00, run_id=scheduled__2024-05-26T02:02:00+00:00, run_start_date=2024-05-26 02:03:00.185432+00:00, run_end_date=2024-05-26 02:03:01.640911+00:00, run_duration=1.455479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:02:00+00:00, data_interval_end=2024-05-26 02:03:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:03:01.658572748Z [2024-05-26T02:03:01.658+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:03:00+00:00, run_after=2024-05-26T02:04:00+00:00 2024-05-26T02:03:01.717534005Z [2024-05-26T02:03:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status success for try_number 1 2024-05-26T02:03:01.732718507Z [2024-05-26T02:03:01.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:02:00+00:00, map_index=-1, run_start_date=2024-05-26 02:03:01.098502+00:00, run_end_date=2024-05-26 02:03:01.476888+00:00, run_duration=0.378386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:03:00.243960+00:00, queued_by_job_id=1, pid=13124 2024-05-26T02:03:04.595204650Z [2024-05-26T02:03:04.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:03:04.595562765Z [2024-05-26T02:03:04.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:02:00+00:00, run_id=scheduled__2024-05-26T02:02:00+00:00, run_start_date=2024-05-26 02:03:00.186710+00:00, run_end_date=2024-05-26 02:03:04.595102+00:00, run_duration=4.408392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:02:00+00:00, data_interval_end=2024-05-26 02:03:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:03:04.604914524Z [2024-05-26T02:03:04.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:03:00+00:00, run_after=2024-05-26T02:04:00+00:00 2024-05-26T02:03:04.614185708Z [2024-05-26T02:03:04.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:03:04.614571159Z [2024-05-26T02:03:04.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:02:00+00:00, run_id=scheduled__2024-05-26T02:02:00+00:00, run_start_date=2024-05-26 02:03:00.187809+00:00, run_end_date=2024-05-26 02:03:04.614138+00:00, run_duration=4.426329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:02:00+00:00, data_interval_end=2024-05-26 02:03:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:03:04.624056620Z [2024-05-26T02:03:04.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:03:00+00:00, run_after=2024-05-26T02:04:00+00:00 2024-05-26T02:03:04.676884686Z [2024-05-26T02:03:04.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status success for try_number 1 2024-05-26T02:03:04.677197819Z [2024-05-26T02:03:04.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status success for try_number 1 2024-05-26T02:03:04.684079711Z [2024-05-26T02:03:04.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:02:00+00:00, map_index=-1, run_start_date=2024-05-26 02:03:02.081256+00:00, run_end_date=2024-05-26 02:03:03.492466+00:00, run_duration=1.41121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:03:00.243960+00:00, queued_by_job_id=1, pid=13142 2024-05-26T02:03:04.684619589Z [2024-05-26T02:03:04.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:02:00+00:00, map_index=-1, run_start_date=2024-05-26 02:03:02.162600+00:00, run_end_date=2024-05-26 02:03:03.965962+00:00, run_duration=1.803362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:03:00.243960+00:00, queued_by_job_id=1, pid=13143 2024-05-26T02:03:33.057020548Z [2024-05-26T02:03:33.056+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:04:00.926197177Z [2024-05-26T02:04:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:04:00+00:00, run_after=2024-05-26T02:05:00+00:00 2024-05-26T02:04:00.942300155Z [2024-05-26T02:04:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:04:00+00:00, run_after=2024-05-26T02:05:00+00:00 2024-05-26T02:04:00.952028133Z [2024-05-26T02:04:00.951+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:04:00.973892003Z [2024-05-26T02:04:00.973+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:04:01.125703995Z [2024-05-26T02:04:01.125+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:04:01.125736021Z 2024-05-26T02:04:01.125742379Z 2024-05-26T02:04:01.125747647Z 2024-05-26T02:04:01.125752723Z 2024-05-26T02:04:01.125951771Z [2024-05-26T02:04:01.125+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:04:01.126251468Z [2024-05-26T02:04:01.125+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:04:01.126478382Z [2024-05-26T02:04:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:04:01.126720890Z [2024-05-26T02:04:01.126+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:04:01.128095174Z [2024-05-26T02:04:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:04:01.128115148Z 2024-05-26T02:04:01.128123081Z 2024-05-26T02:04:01.128130184Z 2024-05-26T02:04:01.128137407Z 2024-05-26T02:04:01.133971654Z [2024-05-26T02:04:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:04:01.134201532Z [2024-05-26T02:04:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:04:01.134482839Z [2024-05-26T02:04:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:04:01.134627951Z [2024-05-26T02:04:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:04:01.134859143Z [2024-05-26T02:04:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:04:01.135031329Z [2024-05-26T02:04:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:04:01.135286221Z [2024-05-26T02:04:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:04:01.135412463Z [2024-05-26T02:04:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:04:01.478408727Z [2024-05-26T02:04:01.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status queued for try_number 1 2024-05-26T02:04:01.481478626Z [2024-05-26T02:04:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:03:00+00:00 exited with status queued for try_number 1 2024-05-26T02:04:01.481711349Z [2024-05-26T02:04:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:03:00+00:00 exited with status queued for try_number 1 2024-05-26T02:04:01.481874847Z [2024-05-26T02:04:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:03:00+00:00 exited with status queued for try_number 1 2024-05-26T02:04:01.503627425Z [2024-05-26T02:04:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03a32495-a188-4e78-9da0-6987baf9a9e6 2024-05-26T02:04:01.503820516Z [2024-05-26T02:04:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to e732d5ae-20b8-405d-b851-3869bf9a21ef 2024-05-26T02:04:01.504000000Z [2024-05-26T02:04:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0280bba5-4882-4ded-80b7-8a0ea2fff50a 2024-05-26T02:04:01.504160579Z [2024-05-26T02:04:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf2054cb-2827-4436-a3cc-c2d0ed4c6397 2024-05-26T02:04:02.726115788Z [2024-05-26T02:04:02.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:04:02.726345157Z [2024-05-26T02:04:02.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:02:00+00:00, run_id=scheduled__2024-05-26T02:02:00+00:00, run_start_date=2024-05-26 02:04:00.999072+00:00, run_end_date=2024-05-26 02:04:02.726013+00:00, run_duration=1.726941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:02:00+00:00, data_interval_end=2024-05-26 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:04:02.734479308Z [2024-05-26T02:04:02.734+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:04:00+00:00, run_after=2024-05-26T02:06:00+00:00 2024-05-26T02:04:02.790730216Z [2024-05-26T02:04:02.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:02:00+00:00 exited with status success for try_number 1 2024-05-26T02:04:02.796096339Z [2024-05-26T02:04:02.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:02:00+00:00, map_index=-1, run_start_date=2024-05-26 02:04:02.025802+00:00, run_end_date=2024-05-26 02:04:02.526683+00:00, run_duration=0.500881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:04:01.129678+00:00, queued_by_job_id=1, pid=13176 2024-05-26T02:04:03.963920884Z [2024-05-26T02:04:03.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:04:03.964496050Z [2024-05-26T02:04:03.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:03:00+00:00, run_id=scheduled__2024-05-26T02:03:00+00:00, run_start_date=2024-05-26 02:04:01.002483+00:00, run_end_date=2024-05-26 02:04:03.964133+00:00, run_duration=2.96165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:03:00+00:00, data_interval_end=2024-05-26 02:04:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:04:03.972826147Z [2024-05-26T02:04:03.972+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:04:00+00:00, run_after=2024-05-26T02:05:00+00:00 2024-05-26T02:04:04.082498338Z [2024-05-26T02:04:04.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:03:00+00:00 exited with status success for try_number 1 2024-05-26T02:04:04.102735077Z [2024-05-26T02:04:04.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:03:00+00:00, map_index=-1, run_start_date=2024-05-26 02:04:02.332928+00:00, run_end_date=2024-05-26 02:04:02.850175+00:00, run_duration=0.517247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:04:01.129678+00:00, queued_by_job_id=1, pid=13177 2024-05-26T02:04:06.276138736Z [2024-05-26T02:04:06.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:04:06.276541934Z [2024-05-26T02:04:06.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:03:00+00:00, run_id=scheduled__2024-05-26T02:03:00+00:00, run_start_date=2024-05-26 02:04:01.008293+00:00, run_end_date=2024-05-26 02:04:06.275980+00:00, run_duration=5.267687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:03:00+00:00, data_interval_end=2024-05-26 02:04:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:04:06.285636577Z [2024-05-26T02:04:06.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:04:00+00:00, run_after=2024-05-26T02:05:00+00:00 2024-05-26T02:04:06.293706634Z [2024-05-26T02:04:06.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:04:06.294108280Z [2024-05-26T02:04:06.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:03:00+00:00, run_id=scheduled__2024-05-26T02:03:00+00:00, run_start_date=2024-05-26 02:04:01.005135+00:00, run_end_date=2024-05-26 02:04:06.293605+00:00, run_duration=5.28847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:03:00+00:00, data_interval_end=2024-05-26 02:04:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:04:06.303645640Z [2024-05-26T02:04:06.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:04:00+00:00, run_after=2024-05-26T02:05:00+00:00 2024-05-26T02:04:06.338932042Z [2024-05-26T02:04:06.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:03:00+00:00 exited with status success for try_number 1 2024-05-26T02:04:06.339219563Z [2024-05-26T02:04:06.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:03:00+00:00 exited with status success for try_number 1 2024-05-26T02:04:06.349712265Z [2024-05-26T02:04:06.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:03:00+00:00, map_index=-1, run_start_date=2024-05-26 02:04:03.606543+00:00, run_end_date=2024-05-26 02:04:05.716827+00:00, run_duration=2.110284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:04:01.129678+00:00, queued_by_job_id=1, pid=13200 2024-05-26T02:04:06.350167918Z [2024-05-26T02:04:06.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:03:00+00:00, map_index=-1, run_start_date=2024-05-26 02:04:03.843335+00:00, run_end_date=2024-05-26 02:04:05.434074+00:00, run_duration=1.590739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:04:01.129678+00:00, queued_by_job_id=1, pid=13201 2024-05-26T02:05:00.875786035Z [2024-05-26T02:05:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:05:00+00:00, run_after=2024-05-26T02:06:00+00:00 2024-05-26T02:05:00.889411783Z [2024-05-26T02:05:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:05:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:05:00.904226320Z [2024-05-26T02:05:00.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:05:00+00:00, run_after=2024-05-26T02:06:00+00:00 2024-05-26T02:05:00.913104275Z [2024-05-26T02:05:00.912+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:05:01.005222677Z [2024-05-26T02:05:01.004+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:05:01.005333000Z 2024-05-26T02:05:01.005345283Z 2024-05-26T02:05:01.005353934Z 2024-05-26T02:05:01.005362686Z 2024-05-26T02:05:01.005394037Z [2024-05-26T02:05:01.005+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:05:01.005631221Z [2024-05-26T02:05:01.005+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:05:01.005851978Z [2024-05-26T02:05:01.005+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:05:01.006076872Z [2024-05-26T02:05:01.005+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:05:01.008225767Z [2024-05-26T02:05:01.007+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:05:01.008253174Z 2024-05-26T02:05:01.008280638Z 2024-05-26T02:05:01.008290185Z 2024-05-26T02:05:01.008298545Z 2024-05-26T02:05:01.014377406Z [2024-05-26T02:05:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:05:01.014636520Z [2024-05-26T02:05:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:05:01.015057815Z [2024-05-26T02:05:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:05:01.015317050Z [2024-05-26T02:05:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:05:01.015617444Z [2024-05-26T02:05:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:05:01.015942025Z [2024-05-26T02:05:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:05:01.016275491Z [2024-05-26T02:05:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:05:01.016471501Z [2024-05-26T02:05:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:05:01.266016516Z [2024-05-26T02:05:01.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:05:01.266254322Z [2024-05-26T02:05:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status queued for try_number 1 2024-05-26T02:05:01.266407089Z [2024-05-26T02:05:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status queued for try_number 1 2024-05-26T02:05:01.266503104Z [2024-05-26T02:05:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status queued for try_number 1 2024-05-26T02:05:01.280008461Z [2024-05-26T02:05:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05b8a521-9c14-426b-8baa-bd3d47eee09c 2024-05-26T02:05:01.280586595Z [2024-05-26T02:05:01.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to fea58099-7b50-46e5-913d-1ae8962c2acf 2024-05-26T02:05:01.281143138Z [2024-05-26T02:05:01.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a61f4dd-89b9-4839-99c4-983c179320bc 2024-05-26T02:05:01.281659632Z [2024-05-26T02:05:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to 360c9083-c059-4cfa-9d6e-fdeb9ef28fc8 2024-05-26T02:05:02.980561562Z [2024-05-26T02:05:02.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:05:02.980945410Z [2024-05-26T02:05:02.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:04:00+00:00, run_id=scheduled__2024-05-26T02:04:00+00:00, run_start_date=2024-05-26 02:05:00.928111+00:00, run_end_date=2024-05-26 02:05:02.980534+00:00, run_duration=2.052423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:04:00+00:00, data_interval_end=2024-05-26 02:05:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:05:02.991169942Z [2024-05-26T02:05:02.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:05:00+00:00, run_after=2024-05-26T02:06:00+00:00 2024-05-26T02:05:03.083993627Z [2024-05-26T02:05:03.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status success for try_number 1 2024-05-26T02:05:03.093323522Z [2024-05-26T02:05:03.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:04:00+00:00, map_index=-1, run_start_date=2024-05-26 02:05:01.918289+00:00, run_end_date=2024-05-26 02:05:02.347223+00:00, run_duration=0.428934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:05:01.010269+00:00, queued_by_job_id=1, pid=13234 2024-05-26T02:05:03.818667074Z [2024-05-26T02:05:03.818+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:05:03.818702684Z 2024-05-26T02:05:03.819115001Z [2024-05-26T02:05:03.818+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:05:03.820142344Z [2024-05-26T02:05:03.819+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:05:03.820158707Z 2024-05-26T02:05:03.824022795Z [2024-05-26T02:05:03.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:05:03.824348230Z [2024-05-26T02:05:03.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:05:03.910338967Z [2024-05-26T02:05:03.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:05:03.912303906Z [2024-05-26T02:05:03.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:05:03.916663360Z [2024-05-26T02:05:03.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b68f7c4-8645-4a88-aca5-cb2f9eb5ca60 2024-05-26T02:05:03.916892328Z [2024-05-26T02:05:03.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=-1, run_start_date=2024-05-26 02:05:02.972777+00:00, run_end_date=2024-05-26 02:05:03.534826+00:00, run_duration=0.562049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:05:01.010269+00:00, queued_by_job_id=1, pid=13258 2024-05-26T02:05:05.088518181Z [2024-05-26T02:05:05.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:05:05.088918867Z [2024-05-26T02:05:05.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:04:00+00:00, run_id=scheduled__2024-05-26T02:04:00+00:00, run_start_date=2024-05-26 02:05:00.929258+00:00, run_end_date=2024-05-26 02:05:05.088569+00:00, run_duration=4.159311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:04:00+00:00, data_interval_end=2024-05-26 02:05:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:05:05.101252348Z [2024-05-26T02:05:05.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:05:00+00:00, run_after=2024-05-26T02:06:00+00:00 2024-05-26T02:05:06.287690292Z [2024-05-26T02:05:06.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:05:06.287733714Z [2024-05-26T02:05:06.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:04:00+00:00, run_id=scheduled__2024-05-26T02:04:00+00:00, run_start_date=2024-05-26 02:05:00.930348+00:00, run_end_date=2024-05-26 02:05:06.282287+00:00, run_duration=5.351939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:04:00+00:00, data_interval_end=2024-05-26 02:05:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:05:06.308706762Z [2024-05-26T02:05:06.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:05:00+00:00, run_after=2024-05-26T02:06:00+00:00 2024-05-26T02:05:06.366446418Z [2024-05-26T02:05:06.365+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:05:06.366507521Z 2024-05-26T02:05:06.366864048Z [2024-05-26T02:05:06.366+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:05:06.368330661Z [2024-05-26T02:05:06.367+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:05:06.368355472Z 2024-05-26T02:05:06.370538758Z [2024-05-26T02:05:06.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:05:06.372017720Z [2024-05-26T02:05:06.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:05:06.442362739Z [2024-05-26T02:05:06.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:05:06.442542267Z [2024-05-26T02:05:06.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status success for try_number 1 2024-05-26T02:05:06.442871511Z [2024-05-26T02:05:06.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status success for try_number 1 2024-05-26T02:05:06.443102924Z [2024-05-26T02:05:06.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:05:06.457084250Z [2024-05-26T02:05:06.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:04:00+00:00, map_index=-1, run_start_date=2024-05-26 02:05:03.167159+00:00, run_end_date=2024-05-26 02:05:05.261802+00:00, run_duration=2.094643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:05:01.010269+00:00, queued_by_job_id=1, pid=13260 2024-05-26T02:05:06.457523392Z [2024-05-26T02:05:06.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97f87e84-1f27-4ae0-898a-55169db8abb7 2024-05-26T02:05:06.457768368Z [2024-05-26T02:05:06.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=-1, run_start_date=2024-05-26 02:05:05.879909+00:00, run_end_date=2024-05-26 02:05:06.265245+00:00, run_duration=0.385336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:05:03.820885+00:00, queued_by_job_id=1, pid=13283 2024-05-26T02:05:06.458009660Z [2024-05-26T02:05:06.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:04:00+00:00, map_index=-1, run_start_date=2024-05-26 02:05:03.128333+00:00, run_end_date=2024-05-26 02:05:05.045072+00:00, run_duration=1.916739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:05:01.010269+00:00, queued_by_job_id=1, pid=13259 2024-05-26T02:05:08.744459208Z [2024-05-26T02:05:08.743+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:05:08.744490885Z 2024-05-26T02:05:08.744770921Z [2024-05-26T02:05:08.744+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:05:08.745954906Z [2024-05-26T02:05:08.745+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:05:08.745965913Z 2024-05-26T02:05:08.750567216Z [2024-05-26T02:05:08.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:05:08.750923763Z [2024-05-26T02:05:08.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:05:08.836237291Z [2024-05-26T02:05:08.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status queued for try_number 1 2024-05-26T02:05:08.837165793Z [2024-05-26T02:05:08.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:05:08.846641666Z [2024-05-26T02:05:08.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5ec338f-06ce-42b0-8994-68d7a5094817 2024-05-26T02:05:08.846923412Z [2024-05-26T02:05:08.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=0, run_start_date=2024-05-26 02:05:07.969243+00:00, run_end_date=2024-05-26 02:05:08.429145+00:00, run_duration=0.459902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:05:06.368028+00:00, queued_by_job_id=1, pid=13291 2024-05-26T02:05:11.188579784Z [2024-05-26T02:05:11.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:05:11.189285224Z [2024-05-26T02:05:11.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:00:00+00:00, run_id=scheduled__2024-05-26T02:00:00+00:00, run_start_date=2024-05-26 02:05:00.926411+00:00, run_end_date=2024-05-26 02:05:11.188419+00:00, run_duration=10.262008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:00:00+00:00, data_interval_end=2024-05-26 02:05:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:05:11.200749591Z [2024-05-26T02:05:11.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:05:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:05:11.235899671Z [2024-05-26T02:05:11.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:00:00+00:00 exited with status success for try_number 1 2024-05-26T02:05:11.242901815Z [2024-05-26T02:05:11.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:00:00+00:00, map_index=-1, run_start_date=2024-05-26 02:05:10.349014+00:00, run_end_date=2024-05-26 02:05:10.728782+00:00, run_duration=0.379768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:05:08.746710+00:00, queued_by_job_id=1, pid=13299 2024-05-26T02:06:00.845407228Z [2024-05-26T02:06:00.844+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:06:00.872030717Z [2024-05-26T02:06:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:06:00+00:00, run_after=2024-05-26T02:07:00+00:00 2024-05-26T02:06:00.886829699Z [2024-05-26T02:06:00.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:06:00+00:00, run_after=2024-05-26T02:07:00+00:00 2024-05-26T02:06:00.895543427Z [2024-05-26T02:06:00.895+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:06:00.988726004Z [2024-05-26T02:06:00.988+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:06:00.988751829Z 2024-05-26T02:06:00.988757671Z 2024-05-26T02:06:00.988761537Z 2024-05-26T02:06:00.988765537Z 2024-05-26T02:06:00.989031747Z [2024-05-26T02:06:00.988+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:06:00.989321932Z [2024-05-26T02:06:00.989+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:06:00.989676515Z [2024-05-26T02:06:00.989+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:06:00.989994651Z [2024-05-26T02:06:00.989+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:06:00.993262509Z [2024-05-26T02:06:00.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:06:00.993291141Z 2024-05-26T02:06:00.993300762Z 2024-05-26T02:06:00.993318685Z 2024-05-26T02:06:00.993324244Z 2024-05-26T02:06:01.000223136Z [2024-05-26T02:06:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:06:01.001870443Z [2024-05-26T02:06:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:06:01.002391689Z [2024-05-26T02:06:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:06:01.002755780Z [2024-05-26T02:06:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:06:01.003226078Z [2024-05-26T02:06:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:06:01.003696757Z [2024-05-26T02:06:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:06:01.004321602Z [2024-05-26T02:06:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:06:01.004736721Z [2024-05-26T02:06:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:06:01.484757972Z [2024-05-26T02:06:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status queued for try_number 1 2024-05-26T02:06:01.488475658Z [2024-05-26T02:06:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status queued for try_number 1 2024-05-26T02:06:01.488607745Z [2024-05-26T02:06:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status queued for try_number 1 2024-05-26T02:06:01.488711634Z [2024-05-26T02:06:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status queued for try_number 1 2024-05-26T02:06:01.509799615Z [2024-05-26T02:06:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce751f6c-db2d-41bb-aa64-74f2bfe21e50 2024-05-26T02:06:01.509984105Z [2024-05-26T02:06:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to e203e6c2-d50a-4ae9-a519-d9db83faff92 2024-05-26T02:06:01.510155697Z [2024-05-26T02:06:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5c8639a-1749-4119-8681-b4b99c733a39 2024-05-26T02:06:01.510326807Z [2024-05-26T02:06:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to fde7d13d-5ba1-4905-ba17-2d60fd6b9db7 2024-05-26T02:06:02.365099081Z [2024-05-26T02:06:02.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:06:02.365717149Z [2024-05-26T02:06:02.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:04:00+00:00, run_id=scheduled__2024-05-26T02:04:00+00:00, run_start_date=2024-05-26 02:06:00.909143+00:00, run_end_date=2024-05-26 02:06:02.365364+00:00, run_duration=1.456221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:04:00+00:00, data_interval_end=2024-05-26 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:06:02.373003271Z [2024-05-26T02:06:02.372+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:06:00+00:00, run_after=2024-05-26T02:08:00+00:00 2024-05-26T02:06:02.467453650Z [2024-05-26T02:06:02.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:04:00+00:00 exited with status success for try_number 1 2024-05-26T02:06:02.476258478Z [2024-05-26T02:06:02.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:04:00+00:00, map_index=-1, run_start_date=2024-05-26 02:06:01.752997+00:00, run_end_date=2024-05-26 02:06:02.132974+00:00, run_duration=0.379977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:06:00.995309+00:00, queued_by_job_id=1, pid=13322 2024-05-26T02:06:03.337912890Z [2024-05-26T02:06:03.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:06:03.338214862Z [2024-05-26T02:06:03.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:05:00+00:00, run_id=scheduled__2024-05-26T02:05:00+00:00, run_start_date=2024-05-26 02:06:00.910474+00:00, run_end_date=2024-05-26 02:06:03.337921+00:00, run_duration=2.427447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:05:00+00:00, data_interval_end=2024-05-26 02:06:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:06:03.346316561Z [2024-05-26T02:06:03.346+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:06:00+00:00, run_after=2024-05-26T02:07:00+00:00 2024-05-26T02:06:03.451708128Z [2024-05-26T02:06:03.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status success for try_number 1 2024-05-26T02:06:03.451732109Z [2024-05-26T02:06:03.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:05:00+00:00, map_index=-1, run_start_date=2024-05-26 02:06:02.046642+00:00, run_end_date=2024-05-26 02:06:02.586893+00:00, run_duration=0.540251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:06:00.995309+00:00, queued_by_job_id=1, pid=13328 2024-05-26T02:06:04.906328173Z [2024-05-26T02:06:04.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:06:04.906670621Z [2024-05-26T02:06:04.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:05:00+00:00, run_id=scheduled__2024-05-26T02:05:00+00:00, run_start_date=2024-05-26 02:06:00.911617+00:00, run_end_date=2024-05-26 02:06:04.906249+00:00, run_duration=3.994632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:05:00+00:00, data_interval_end=2024-05-26 02:06:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:06:04.922489896Z [2024-05-26T02:06:04.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:06:00+00:00, run_after=2024-05-26T02:07:00+00:00 2024-05-26T02:06:04.944688216Z [2024-05-26T02:06:04.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:06:04.945443175Z [2024-05-26T02:06:04.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:05:00+00:00, run_id=scheduled__2024-05-26T02:05:00+00:00, run_start_date=2024-05-26 02:06:00.912847+00:00, run_end_date=2024-05-26 02:06:04.944869+00:00, run_duration=4.032022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:05:00+00:00, data_interval_end=2024-05-26 02:06:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:06:04.961552502Z [2024-05-26T02:06:04.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:06:00+00:00, run_after=2024-05-26T02:07:00+00:00 2024-05-26T02:06:05.016226512Z [2024-05-26T02:06:05.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status success for try_number 1 2024-05-26T02:06:05.022723488Z [2024-05-26T02:06:05.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:05:00+00:00, map_index=-1, run_start_date=2024-05-26 02:06:03.095136+00:00, run_end_date=2024-05-26 02:06:04.501143+00:00, run_duration=1.406007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:06:00.995309+00:00, queued_by_job_id=1, pid=13347 2024-05-26T02:06:06.144711441Z [2024-05-26T02:06:06.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status success for try_number 1 2024-05-26T02:06:06.152194992Z [2024-05-26T02:06:06.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:05:00+00:00, map_index=-1, run_start_date=2024-05-26 02:06:03.095013+00:00, run_end_date=2024-05-26 02:06:04.822586+00:00, run_duration=1.727573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:06:00.995309+00:00, queued_by_job_id=1, pid=13346 2024-05-26T02:07:00.830093344Z [2024-05-26T02:07:00.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:07:00+00:00, run_after=2024-05-26T02:08:00+00:00 2024-05-26T02:07:00.838588301Z [2024-05-26T02:07:00.838+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:07:00.850492859Z [2024-05-26T02:07:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:07:00+00:00, run_after=2024-05-26T02:08:00+00:00 2024-05-26T02:07:00.934399638Z [2024-05-26T02:07:00.933+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:07:00.934427453Z 2024-05-26T02:07:00.934431598Z 2024-05-26T02:07:00.934435317Z 2024-05-26T02:07:00.934438829Z [2024-05-26T02:07:00.934+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:07:00.934853040Z [2024-05-26T02:07:00.934+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:07:00.935028578Z [2024-05-26T02:07:00.934+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:07:00.935800389Z [2024-05-26T02:07:00.935+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:07:00.935814222Z 2024-05-26T02:07:00.935818162Z 2024-05-26T02:07:00.935821677Z 2024-05-26T02:07:00.939862240Z [2024-05-26T02:07:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:07:00.940243761Z [2024-05-26T02:07:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:07:00.940744579Z [2024-05-26T02:07:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:07:00.941052146Z [2024-05-26T02:07:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:07:00.941521691Z [2024-05-26T02:07:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:07:00.941889689Z [2024-05-26T02:07:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:07:01.177373667Z [2024-05-26T02:07:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status queued for try_number 1 2024-05-26T02:07:01.177470994Z [2024-05-26T02:07:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status queued for try_number 1 2024-05-26T02:07:01.177647275Z [2024-05-26T02:07:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status queued for try_number 1 2024-05-26T02:07:01.185525885Z [2024-05-26T02:07:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40604e3e-8aaa-4d31-a967-d2d6e419402d 2024-05-26T02:07:01.185695224Z [2024-05-26T02:07:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to a815c5e3-9d05-4a4a-8e10-9c4cfd5982d4 2024-05-26T02:07:01.185886829Z [2024-05-26T02:07:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 230d5352-6089-44ed-8ecd-078c81c52300 2024-05-26T02:07:02.343371199Z [2024-05-26T02:07:02.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:07:02.343553279Z [2024-05-26T02:07:02.343+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:06:00+00:00, run_id=scheduled__2024-05-26T02:06:00+00:00, run_start_date=2024-05-26 02:07:00.860480+00:00, run_end_date=2024-05-26 02:07:02.343241+00:00, run_duration=1.482761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:06:00+00:00, data_interval_end=2024-05-26 02:07:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:07:02.355565467Z [2024-05-26T02:07:02.355+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:07:00+00:00, run_after=2024-05-26T02:08:00+00:00 2024-05-26T02:07:02.422198111Z [2024-05-26T02:07:02.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status success for try_number 1 2024-05-26T02:07:02.427349423Z [2024-05-26T02:07:02.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:06:00+00:00, map_index=-1, run_start_date=2024-05-26 02:07:01.718486+00:00, run_end_date=2024-05-26 02:07:02.168035+00:00, run_duration=0.449549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:07:00.936592+00:00, queued_by_job_id=1, pid=13379 2024-05-26T02:07:04.801760270Z [2024-05-26T02:07:04.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:07:04.801939142Z [2024-05-26T02:07:04.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:06:00+00:00, run_id=scheduled__2024-05-26T02:06:00+00:00, run_start_date=2024-05-26 02:07:00.862009+00:00, run_end_date=2024-05-26 02:07:04.801651+00:00, run_duration=3.939642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:06:00+00:00, data_interval_end=2024-05-26 02:07:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:07:04.822393980Z [2024-05-26T02:07:04.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:07:00+00:00, run_after=2024-05-26T02:08:00+00:00 2024-05-26T02:07:04.890713776Z [2024-05-26T02:07:04.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status success for try_number 1 2024-05-26T02:07:04.897259684Z [2024-05-26T02:07:04.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:06:00+00:00, map_index=-1, run_start_date=2024-05-26 02:07:02.818552+00:00, run_end_date=2024-05-26 02:07:04.310784+00:00, run_duration=1.492232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:07:00.936592+00:00, queued_by_job_id=1, pid=13397 2024-05-26T02:07:05.942596168Z [2024-05-26T02:07:05.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:07:05.942775696Z [2024-05-26T02:07:05.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:06:00+00:00, run_id=scheduled__2024-05-26T02:06:00+00:00, run_start_date=2024-05-26 02:07:00.864954+00:00, run_end_date=2024-05-26 02:07:05.942435+00:00, run_duration=5.077481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:06:00+00:00, data_interval_end=2024-05-26 02:07:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:07:05.955825834Z [2024-05-26T02:07:05.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:07:00+00:00, run_after=2024-05-26T02:08:00+00:00 2024-05-26T02:07:06.012417740Z [2024-05-26T02:07:06.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status success for try_number 1 2024-05-26T02:07:06.018056444Z [2024-05-26T02:07:06.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:06:00+00:00, map_index=-1, run_start_date=2024-05-26 02:07:02.833185+00:00, run_end_date=2024-05-26 02:07:04.898970+00:00, run_duration=2.065785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:07:00.936592+00:00, queued_by_job_id=1, pid=13398 2024-05-26T02:08:00.224978814Z [2024-05-26T02:08:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:08:00+00:00, run_after=2024-05-26T02:09:00+00:00 2024-05-26T02:08:00.241048668Z [2024-05-26T02:08:00.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:08:00+00:00, run_after=2024-05-26T02:09:00+00:00 2024-05-26T02:08:00.250326760Z [2024-05-26T02:08:00.249+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:08:00.259163106Z [2024-05-26T02:08:00.258+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:08:00.351660155Z [2024-05-26T02:08:00.351+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:08:00.351689119Z 2024-05-26T02:08:00.351695441Z 2024-05-26T02:08:00.351700656Z 2024-05-26T02:08:00.351706140Z 2024-05-26T02:08:00.352033935Z [2024-05-26T02:08:00.351+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:08:00.352407812Z [2024-05-26T02:08:00.352+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:08:00.352667426Z [2024-05-26T02:08:00.352+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:08:00.352916001Z [2024-05-26T02:08:00.352+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:08:00.353861475Z [2024-05-26T02:08:00.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:08:00.353879068Z 2024-05-26T02:08:00.353884997Z 2024-05-26T02:08:00.353890707Z 2024-05-26T02:08:00.353902288Z 2024-05-26T02:08:00.359359957Z [2024-05-26T02:08:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:08:00.359882682Z [2024-05-26T02:08:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:08:00.360427783Z [2024-05-26T02:08:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:08:00.360743847Z [2024-05-26T02:08:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:08:00.361132707Z [2024-05-26T02:08:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:08:00.361358952Z [2024-05-26T02:08:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:08:00.361681259Z [2024-05-26T02:08:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:08:00.361944402Z [2024-05-26T02:08:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:08:00.864581149Z [2024-05-26T02:08:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status queued for try_number 1 2024-05-26T02:08:00.864731763Z [2024-05-26T02:08:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:07:00+00:00 exited with status queued for try_number 1 2024-05-26T02:08:00.864852388Z [2024-05-26T02:08:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:07:00+00:00 exited with status queued for try_number 1 2024-05-26T02:08:00.864942242Z [2024-05-26T02:08:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:07:00+00:00 exited with status queued for try_number 1 2024-05-26T02:08:00.884860375Z [2024-05-26T02:08:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ad2bf9a-9f89-48d7-9b3d-84c14af1bf0d 2024-05-26T02:08:00.887926942Z [2024-05-26T02:08:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f07a35b-1cff-4be7-a56c-2fc9694d4726 2024-05-26T02:08:00.888170513Z [2024-05-26T02:08:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d4bc6e8-4cae-4a22-ab97-82b01d22ba09 2024-05-26T02:08:00.888323440Z [2024-05-26T02:08:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a7c6f43-de5c-4d40-9d98-ebfccf01ada0 2024-05-26T02:08:02.088589483Z [2024-05-26T02:08:02.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:08:02.089191585Z [2024-05-26T02:08:02.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:06:00+00:00, run_id=scheduled__2024-05-26T02:06:00+00:00, run_start_date=2024-05-26 02:08:00.271642+00:00, run_end_date=2024-05-26 02:08:02.088842+00:00, run_duration=1.8172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:06:00+00:00, data_interval_end=2024-05-26 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:08:02.098753857Z [2024-05-26T02:08:02.098+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:08:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:08:02.106574960Z [2024-05-26T02:08:02.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:08:02.106849455Z [2024-05-26T02:08:02.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:07:00+00:00, run_id=scheduled__2024-05-26T02:07:00+00:00, run_start_date=2024-05-26 02:08:00.272999+00:00, run_end_date=2024-05-26 02:08:02.106476+00:00, run_duration=1.833477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:07:00+00:00, data_interval_end=2024-05-26 02:08:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:08:02.120544134Z [2024-05-26T02:08:02.120+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:08:00+00:00, run_after=2024-05-26T02:09:00+00:00 2024-05-26T02:08:02.174130741Z [2024-05-26T02:08:02.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:06:00+00:00 exited with status success for try_number 1 2024-05-26T02:08:02.174398260Z [2024-05-26T02:08:02.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:07:00+00:00 exited with status success for try_number 1 2024-05-26T02:08:02.183962382Z [2024-05-26T02:08:02.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:07:00+00:00, map_index=-1, run_start_date=2024-05-26 02:08:01.528216+00:00, run_end_date=2024-05-26 02:08:01.935667+00:00, run_duration=0.407451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:08:00.355218+00:00, queued_by_job_id=1, pid=13432 2024-05-26T02:08:02.184625487Z [2024-05-26T02:08:02.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:06:00+00:00, map_index=-1, run_start_date=2024-05-26 02:08:01.403910+00:00, run_end_date=2024-05-26 02:08:01.808826+00:00, run_duration=0.404916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:08:00.355218+00:00, queued_by_job_id=1, pid=13431 2024-05-26T02:08:03.961210994Z [2024-05-26T02:08:03.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:08:03.961659670Z [2024-05-26T02:08:03.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:07:00+00:00, run_id=scheduled__2024-05-26T02:07:00+00:00, run_start_date=2024-05-26 02:08:00.274198+00:00, run_end_date=2024-05-26 02:08:03.961085+00:00, run_duration=3.686887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:07:00+00:00, data_interval_end=2024-05-26 02:08:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:08:03.973331166Z [2024-05-26T02:08:03.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:08:00+00:00, run_after=2024-05-26T02:09:00+00:00 2024-05-26T02:08:04.023187811Z [2024-05-26T02:08:04.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:07:00+00:00 exited with status success for try_number 1 2024-05-26T02:08:04.029216357Z [2024-05-26T02:08:04.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:07:00+00:00, map_index=-1, run_start_date=2024-05-26 02:08:02.468902+00:00, run_end_date=2024-05-26 02:08:03.728420+00:00, run_duration=1.259518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:08:00.355218+00:00, queued_by_job_id=1, pid=13455 2024-05-26T02:08:05.112312992Z [2024-05-26T02:08:05.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:08:05.112538089Z [2024-05-26T02:08:05.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:07:00+00:00, run_id=scheduled__2024-05-26T02:07:00+00:00, run_start_date=2024-05-26 02:08:00.275261+00:00, run_end_date=2024-05-26 02:08:05.112211+00:00, run_duration=4.83695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:07:00+00:00, data_interval_end=2024-05-26 02:08:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:08:05.128382859Z [2024-05-26T02:08:05.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:08:00+00:00, run_after=2024-05-26T02:09:00+00:00 2024-05-26T02:08:05.181694258Z [2024-05-26T02:08:05.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:07:00+00:00 exited with status success for try_number 1 2024-05-26T02:08:05.189122241Z [2024-05-26T02:08:05.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:07:00+00:00, map_index=-1, run_start_date=2024-05-26 02:08:02.510416+00:00, run_end_date=2024-05-26 02:08:04.478251+00:00, run_duration=1.967835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:08:00.355218+00:00, queued_by_job_id=1, pid=13456 2024-05-26T02:08:33.147651590Z [2024-05-26T02:08:33.146+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:09:00.192717102Z [2024-05-26T02:09:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:09:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:09:00.204030503Z [2024-05-26T02:09:00.203+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:09:00.220630648Z [2024-05-26T02:09:00.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:09:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:09:00.284621996Z [2024-05-26T02:09:00.284+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:09:00.284793320Z 2024-05-26T02:09:00.284835076Z 2024-05-26T02:09:00.284845187Z 2024-05-26T02:09:00.284990782Z [2024-05-26T02:09:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:09:00.285218209Z [2024-05-26T02:09:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:09:00.285376683Z [2024-05-26T02:09:00.285+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:09:00.286004987Z [2024-05-26T02:09:00.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:09:00.286017987Z 2024-05-26T02:09:00.286026623Z 2024-05-26T02:09:00.286034972Z 2024-05-26T02:09:00.290347437Z [2024-05-26T02:09:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:09:00.290685407Z [2024-05-26T02:09:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:09:00.291095685Z [2024-05-26T02:09:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:09:00.291331379Z [2024-05-26T02:09:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:09:00.291728543Z [2024-05-26T02:09:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:09:00.291929615Z [2024-05-26T02:09:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:09:00.615674650Z [2024-05-26T02:09:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status queued for try_number 1 2024-05-26T02:09:00.615825049Z [2024-05-26T02:09:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status queued for try_number 1 2024-05-26T02:09:00.616033249Z [2024-05-26T02:09:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status queued for try_number 1 2024-05-26T02:09:00.626950600Z [2024-05-26T02:09:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0600f6a-ebb9-4248-8670-b12e334cbe40 2024-05-26T02:09:00.627124880Z [2024-05-26T02:09:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9118c2f7-2ef3-472c-9728-d9aa4e903ec5 2024-05-26T02:09:00.627350624Z [2024-05-26T02:09:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to e122f81b-c216-472b-8f8a-9ded4272d4b0 2024-05-26T02:09:02.888009690Z [2024-05-26T02:09:02.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:09:02.888531794Z [2024-05-26T02:09:02.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:08:00+00:00, run_id=scheduled__2024-05-26T02:08:00+00:00, run_start_date=2024-05-26 02:09:00.232797+00:00, run_end_date=2024-05-26 02:09:02.887905+00:00, run_duration=2.655108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:08:00+00:00, data_interval_end=2024-05-26 02:09:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:09:02.898788230Z [2024-05-26T02:09:02.898+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:09:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:09:02.961882603Z [2024-05-26T02:09:02.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status success for try_number 1 2024-05-26T02:09:02.968572218Z [2024-05-26T02:09:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:08:00+00:00, map_index=-1, run_start_date=2024-05-26 02:09:01.530994+00:00, run_end_date=2024-05-26 02:09:02.001676+00:00, run_duration=0.470682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:09:00.287104+00:00, queued_by_job_id=1, pid=13488 2024-05-26T02:09:04.295066615Z [2024-05-26T02:09:04.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:09:04.295554308Z [2024-05-26T02:09:04.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:08:00+00:00, run_id=scheduled__2024-05-26T02:08:00+00:00, run_start_date=2024-05-26 02:09:00.234173+00:00, run_end_date=2024-05-26 02:09:04.295191+00:00, run_duration=4.061018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:08:00+00:00, data_interval_end=2024-05-26 02:09:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:09:04.306324554Z [2024-05-26T02:09:04.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:09:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:09:04.351107218Z [2024-05-26T02:09:04.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status success for try_number 1 2024-05-26T02:09:04.359363791Z [2024-05-26T02:09:04.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:08:00+00:00, map_index=-1, run_start_date=2024-05-26 02:09:02.464542+00:00, run_end_date=2024-05-26 02:09:04.023494+00:00, run_duration=1.558952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:09:00.287104+00:00, queued_by_job_id=1, pid=13506 2024-05-26T02:09:05.432062133Z [2024-05-26T02:09:05.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:09:05.432505313Z [2024-05-26T02:09:05.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:08:00+00:00, run_id=scheduled__2024-05-26T02:08:00+00:00, run_start_date=2024-05-26 02:09:00.235330+00:00, run_end_date=2024-05-26 02:09:05.431998+00:00, run_duration=5.196668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:08:00+00:00, data_interval_end=2024-05-26 02:09:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:09:05.441890281Z [2024-05-26T02:09:05.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:09:00+00:00, run_after=2024-05-26T02:10:00+00:00 2024-05-26T02:09:05.487936972Z [2024-05-26T02:09:05.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status success for try_number 1 2024-05-26T02:09:05.490591040Z [2024-05-26T02:09:05.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:08:00+00:00, map_index=-1, run_start_date=2024-05-26 02:09:02.637541+00:00, run_end_date=2024-05-26 02:09:04.890672+00:00, run_duration=2.253131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:09:00.287104+00:00, queued_by_job_id=1, pid=13507 2024-05-26T02:10:00.132834573Z [2024-05-26T02:10:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:15:00+00:00 2024-05-26T02:10:00.144504782Z [2024-05-26T02:10:00.144+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:10:00.172311035Z [2024-05-26T02:10:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:11:00+00:00 2024-05-26T02:10:00.190425365Z [2024-05-26T02:10:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:11:00+00:00 2024-05-26T02:10:00.199146425Z [2024-05-26T02:10:00.198+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:10:00.328896149Z [2024-05-26T02:10:00.328+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T02:10:00.328928745Z 2024-05-26T02:10:00.328935027Z 2024-05-26T02:10:00.328941587Z 2024-05-26T02:10:00.328947856Z 2024-05-26T02:10:00.328953596Z 2024-05-26T02:10:00.329356651Z [2024-05-26T02:10:00.329+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:10:00.330068431Z [2024-05-26T02:10:00.329+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:10:00.330421221Z [2024-05-26T02:10:00.330+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:10:00.330769950Z [2024-05-26T02:10:00.330+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:10:00.331255310Z [2024-05-26T02:10:00.330+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:10:00.332524946Z [2024-05-26T02:10:00.332+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:10:00.332543335Z 2024-05-26T02:10:00.332598095Z 2024-05-26T02:10:00.332605594Z 2024-05-26T02:10:00.332611358Z 2024-05-26T02:10:00.332616994Z 2024-05-26T02:10:00.339956874Z [2024-05-26T02:10:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:10:00.340295217Z [2024-05-26T02:10:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:10:00.340876942Z [2024-05-26T02:10:00.340+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:10:00.340990183Z [2024-05-26T02:10:00.340+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:10:00.341435611Z [2024-05-26T02:10:00.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:10:00.341767277Z [2024-05-26T02:10:00.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:10:00.342344500Z [2024-05-26T02:10:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:10:00.342530847Z [2024-05-26T02:10:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:10:00.343005745Z [2024-05-26T02:10:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:10:00.343203514Z [2024-05-26T02:10:00.342+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:10:00.712714274Z [2024-05-26T02:10:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:00.712777106Z [2024-05-26T02:10:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:00.712860052Z [2024-05-26T02:10:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:09:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:00.712923333Z [2024-05-26T02:10:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:09:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:00.712991933Z [2024-05-26T02:10:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:09:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:00.733255994Z [2024-05-26T02:10:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b9e0455-3a1b-4b15-85ee-553f110d6795 2024-05-26T02:10:00.733347203Z [2024-05-26T02:10:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fa1ddb9-3acc-4da7-a17c-cefd6e6a154f 2024-05-26T02:10:00.733417113Z [2024-05-26T02:10:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to de89aaf0-443a-4ecd-bc25-cbff2fa9c0e5 2024-05-26T02:10:00.733512356Z [2024-05-26T02:10:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42517242-a8f0-4eae-a0ed-06a4d571ae05 2024-05-26T02:10:00.733609095Z [2024-05-26T02:10:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce6823bf-b8d5-4728-bc0b-2101551cff31 2024-05-26T02:10:02.058973164Z [2024-05-26T02:10:02.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:10:02.059476023Z [2024-05-26T02:10:02.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:08:00+00:00, run_id=scheduled__2024-05-26T02:08:00+00:00, run_start_date=2024-05-26 02:10:00.209155+00:00, run_end_date=2024-05-26 02:10:02.058863+00:00, run_duration=1.849708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:08:00+00:00, data_interval_end=2024-05-26 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:10:02.072134564Z [2024-05-26T02:10:02.071+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:12:00+00:00 2024-05-26T02:10:02.235860790Z [2024-05-26T02:10:02.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:08:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:02.251494005Z [2024-05-26T02:10:02.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:08:00+00:00, map_index=-1, run_start_date=2024-05-26 02:10:01.408865+00:00, run_end_date=2024-05-26 02:10:01.794362+00:00, run_duration=0.385497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:00.334201+00:00, queued_by_job_id=1, pid=13540 2024-05-26T02:10:03.333109603Z [2024-05-26T02:10:03.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:10:03.333275150Z [2024-05-26T02:10:03.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:09:00+00:00, run_id=scheduled__2024-05-26T02:09:00+00:00, run_start_date=2024-05-26 02:10:00.210155+00:00, run_end_date=2024-05-26 02:10:03.333018+00:00, run_duration=3.122863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:09:00+00:00, data_interval_end=2024-05-26 02:10:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:10:03.350253637Z [2024-05-26T02:10:03.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:11:00+00:00 2024-05-26T02:10:03.473759557Z [2024-05-26T02:10:03.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:09:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:03.479642401Z [2024-05-26T02:10:03.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:09:00+00:00, map_index=-1, run_start_date=2024-05-26 02:10:01.625624+00:00, run_end_date=2024-05-26 02:10:02.118116+00:00, run_duration=0.492492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:00.334201+00:00, queued_by_job_id=1, pid=13543 2024-05-26T02:10:04.142767136Z [2024-05-26T02:10:04.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:10:04.143047863Z [2024-05-26T02:10:04.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:09:00+00:00, run_id=scheduled__2024-05-26T02:09:00+00:00, run_start_date=2024-05-26 02:10:00.211130+00:00, run_end_date=2024-05-26 02:10:04.142711+00:00, run_duration=3.931581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:09:00+00:00, data_interval_end=2024-05-26 02:10:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:10:04.153752927Z [2024-05-26T02:10:04.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:11:00+00:00 2024-05-26T02:10:04.190995328Z [2024-05-26T02:10:04.190+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:10:04.191040646Z 2024-05-26T02:10:04.191111005Z [2024-05-26T02:10:04.190+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:10:04.191561871Z [2024-05-26T02:10:04.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:10:04.191582658Z 2024-05-26T02:10:04.194404341Z [2024-05-26T02:10:04.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:10:04.194420259Z [2024-05-26T02:10:04.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:10:04.280278672Z [2024-05-26T02:10:04.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:04.280371076Z [2024-05-26T02:10:04.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:04.289131080Z [2024-05-26T02:10:04.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43f2e62b-c6d1-4049-b56e-b40e3b56be05 2024-05-26T02:10:04.289480625Z [2024-05-26T02:10:04.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:05:00+00:00, map_index=-1, run_start_date=2024-05-26 02:10:03.027606+00:00, run_end_date=2024-05-26 02:10:03.559733+00:00, run_duration=0.532127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:00.334201+00:00, queued_by_job_id=1, pid=13577 2024-05-26T02:10:04.398108936Z [2024-05-26T02:10:04.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:09:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:04.407222171Z [2024-05-26T02:10:04.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:09:00+00:00, map_index=-1, run_start_date=2024-05-26 02:10:02.801716+00:00, run_end_date=2024-05-26 02:10:04.108996+00:00, run_duration=1.30728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:00.334201+00:00, queued_by_job_id=1, pid=13571 2024-05-26T02:10:04.666139500Z [2024-05-26T02:10:04.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:10:04.666668883Z [2024-05-26T02:10:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:09:00+00:00, run_id=scheduled__2024-05-26T02:09:00+00:00, run_start_date=2024-05-26 02:10:00.212253+00:00, run_end_date=2024-05-26 02:10:04.666055+00:00, run_duration=4.453802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:09:00+00:00, data_interval_end=2024-05-26 02:10:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:10:04.681296063Z [2024-05-26T02:10:04.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:11:00+00:00 2024-05-26T02:10:04.751376027Z [2024-05-26T02:10:04.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:09:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:04.757963925Z [2024-05-26T02:10:04.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:09:00+00:00, map_index=-1, run_start_date=2024-05-26 02:10:02.671019+00:00, run_end_date=2024-05-26 02:10:04.410343+00:00, run_duration=1.739324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:00.334201+00:00, queued_by_job_id=1, pid=13565 2024-05-26T02:10:06.931222147Z [2024-05-26T02:10:06.930+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:10:06.931289311Z 2024-05-26T02:10:06.931297538Z [2024-05-26T02:10:06.930+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:10:06.932064961Z [2024-05-26T02:10:06.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:10:06.932129651Z 2024-05-26T02:10:06.935644998Z [2024-05-26T02:10:06.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:10:06.935893706Z [2024-05-26T02:10:06.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:10:06.996377801Z [2024-05-26T02:10:06.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:06.997612814Z [2024-05-26T02:10:06.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:07.010369737Z [2024-05-26T02:10:07.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7905b2a6-40f1-477d-bca7-c4f491d800df 2024-05-26T02:10:07.010743441Z [2024-05-26T02:10:07.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:05:00+00:00, map_index=-1, run_start_date=2024-05-26 02:10:06.175749+00:00, run_end_date=2024-05-26 02:10:06.546769+00:00, run_duration=0.37102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:04.191818+00:00, queued_by_job_id=1, pid=13595 2024-05-26T02:10:10.433157627Z [2024-05-26T02:10:10.432+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:10:10.433216845Z 2024-05-26T02:10:10.433253938Z [2024-05-26T02:10:10.432+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:10:10.433704792Z [2024-05-26T02:10:10.433+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:10:10.433751227Z 2024-05-26T02:10:10.436681404Z [2024-05-26T02:10:10.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:10:10.439218774Z [2024-05-26T02:10:10.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:10:10.499279828Z [2024-05-26T02:10:10.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status queued for try_number 1 2024-05-26T02:10:10.499681574Z [2024-05-26T02:10:10.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:10.508678553Z [2024-05-26T02:10:10.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bd4ba75-68ea-4d7d-aef3-6f8dd550857a 2024-05-26T02:10:10.509069585Z [2024-05-26T02:10:10.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:05:00+00:00, map_index=0, run_start_date=2024-05-26 02:10:08.698177+00:00, run_end_date=2024-05-26 02:10:10.109220+00:00, run_duration=1.411043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:06.932411+00:00, queued_by_job_id=1, pid=13603 2024-05-26T02:10:12.780259988Z [2024-05-26T02:10:12.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:10:12.780593217Z [2024-05-26T02:10:12.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:05:00+00:00, run_id=scheduled__2024-05-26T02:05:00+00:00, run_start_date=2024-05-26 02:10:00.207963+00:00, run_end_date=2024-05-26 02:10:12.780190+00:00, run_duration=12.572227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:05:00+00:00, data_interval_end=2024-05-26 02:10:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:10:12.791147828Z [2024-05-26T02:10:12.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:10:00+00:00, run_after=2024-05-26T02:15:00+00:00 2024-05-26T02:10:12.845347118Z [2024-05-26T02:10:12.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:05:00+00:00 exited with status success for try_number 1 2024-05-26T02:10:12.851884505Z [2024-05-26T02:10:12.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:05:00+00:00, map_index=-1, run_start_date=2024-05-26 02:10:12.063643+00:00, run_end_date=2024-05-26 02:10:12.506104+00:00, run_duration=0.442461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:10:10.434204+00:00, queued_by_job_id=1, pid=13616 2024-05-26T02:11:00.142652861Z [2024-05-26T02:11:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:11:00+00:00, run_after=2024-05-26T02:12:00+00:00 2024-05-26T02:11:00.157625208Z [2024-05-26T02:11:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:11:00+00:00, run_after=2024-05-26T02:12:00+00:00 2024-05-26T02:11:00.166256382Z [2024-05-26T02:11:00.165+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:11:00.247960109Z [2024-05-26T02:11:00.247+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:11:00.248025664Z 2024-05-26T02:11:00.248033264Z 2024-05-26T02:11:00.248039368Z 2024-05-26T02:11:00.248364877Z [2024-05-26T02:11:00.247+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:11:00.248714846Z [2024-05-26T02:11:00.248+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:11:00.248897934Z [2024-05-26T02:11:00.248+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:11:00.250106406Z [2024-05-26T02:11:00.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:11:00.250126747Z 2024-05-26T02:11:00.250133623Z 2024-05-26T02:11:00.250163142Z 2024-05-26T02:11:00.257220424Z [2024-05-26T02:11:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:11:00.257519335Z [2024-05-26T02:11:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:11:00.258063804Z [2024-05-26T02:11:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:11:00.258270382Z [2024-05-26T02:11:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:11:00.258714377Z [2024-05-26T02:11:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:11:00.258926128Z [2024-05-26T02:11:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:11:00.492833850Z [2024-05-26T02:11:00.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:11:00.493031978Z [2024-05-26T02:11:00.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:11:00.493281066Z [2024-05-26T02:11:00.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:11:00.502308894Z [2024-05-26T02:11:00.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to f50dcbe4-5944-47de-8b45-ff597c088a9d 2024-05-26T02:11:00.502562864Z [2024-05-26T02:11:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to c791f0c8-cd04-408b-a929-d900763f386d 2024-05-26T02:11:00.502832745Z [2024-05-26T02:11:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64ddc7b2-608e-4189-b59d-a0e7df380f28 2024-05-26T02:11:01.671601474Z [2024-05-26T02:11:01.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:11:01.672027401Z [2024-05-26T02:11:01.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:10:00+00:00, run_id=scheduled__2024-05-26T02:10:00+00:00, run_start_date=2024-05-26 02:11:00.178775+00:00, run_end_date=2024-05-26 02:11:01.671504+00:00, run_duration=1.492729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:10:00+00:00, data_interval_end=2024-05-26 02:11:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:11:01.681109482Z [2024-05-26T02:11:01.680+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:11:00+00:00, run_after=2024-05-26T02:12:00+00:00 2024-05-26T02:11:01.735773486Z [2024-05-26T02:11:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:11:01.752627594Z [2024-05-26T02:11:01.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=-1, run_start_date=2024-05-26 02:11:01.057410+00:00, run_end_date=2024-05-26 02:11:01.400511+00:00, run_duration=0.343101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:11:00.251446+00:00, queued_by_job_id=1, pid=13638 2024-05-26T02:11:03.911686497Z [2024-05-26T02:11:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:11:03.912254983Z [2024-05-26T02:11:03.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:10:00+00:00, run_id=scheduled__2024-05-26T02:10:00+00:00, run_start_date=2024-05-26 02:11:00.180220+00:00, run_end_date=2024-05-26 02:11:03.911795+00:00, run_duration=3.731575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:10:00+00:00, data_interval_end=2024-05-26 02:11:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:11:03.922690526Z [2024-05-26T02:11:03.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:11:00+00:00, run_after=2024-05-26T02:12:00+00:00 2024-05-26T02:11:03.929774814Z [2024-05-26T02:11:03.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:11:03.930181429Z [2024-05-26T02:11:03.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:10:00+00:00, run_id=scheduled__2024-05-26T02:10:00+00:00, run_start_date=2024-05-26 02:11:00.181342+00:00, run_end_date=2024-05-26 02:11:03.929873+00:00, run_duration=3.748531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:10:00+00:00, data_interval_end=2024-05-26 02:11:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:11:03.939603330Z [2024-05-26T02:11:03.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:11:00+00:00, run_after=2024-05-26T02:12:00+00:00 2024-05-26T02:11:03.969441083Z [2024-05-26T02:11:03.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:11:03.970083869Z [2024-05-26T02:11:03.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:11:03.985770400Z [2024-05-26T02:11:03.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=-1, run_start_date=2024-05-26 02:11:02.099274+00:00, run_end_date=2024-05-26 02:11:03.330027+00:00, run_duration=1.230753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:11:00.251446+00:00, queued_by_job_id=1, pid=13657 2024-05-26T02:11:03.986481691Z [2024-05-26T02:11:03.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=-1, run_start_date=2024-05-26 02:11:01.952333+00:00, run_end_date=2024-05-26 02:11:03.672086+00:00, run_duration=1.719753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:11:00.251446+00:00, queued_by_job_id=1, pid=13656 2024-05-26T02:12:00.566590396Z [2024-05-26T02:12:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:12:00+00:00, run_after=2024-05-26T02:13:00+00:00 2024-05-26T02:12:00.584848293Z [2024-05-26T02:12:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:12:00+00:00, run_after=2024-05-26T02:13:00+00:00 2024-05-26T02:12:00.596684371Z [2024-05-26T02:12:00.596+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:12:00.606370875Z [2024-05-26T02:12:00.605+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:12:00.756262084Z [2024-05-26T02:12:00.755+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:12:00.756293765Z 2024-05-26T02:12:00.756310041Z 2024-05-26T02:12:00.756313955Z 2024-05-26T02:12:00.756317127Z 2024-05-26T02:12:00.758330182Z [2024-05-26T02:12:00.756+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:12:00.758353110Z [2024-05-26T02:12:00.756+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:12:00.758356429Z [2024-05-26T02:12:00.756+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:12:00.758359513Z [2024-05-26T02:12:00.756+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:12:00.758362457Z [2024-05-26T02:12:00.757+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:12:00.758365692Z 2024-05-26T02:12:00.758368613Z 2024-05-26T02:12:00.758371597Z 2024-05-26T02:12:00.758381749Z 2024-05-26T02:12:00.764116705Z [2024-05-26T02:12:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:12:00.764144182Z [2024-05-26T02:12:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:12:00.764152866Z [2024-05-26T02:12:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:12:00.764159861Z [2024-05-26T02:12:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:12:00.764165275Z [2024-05-26T02:12:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:12:00.764171398Z [2024-05-26T02:12:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:12:00.764426830Z [2024-05-26T02:12:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:12:00.767131050Z [2024-05-26T02:12:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:12:01.124301686Z [2024-05-26T02:12:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:12:01.124702309Z [2024-05-26T02:12:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:11:00+00:00 exited with status queued for try_number 1 2024-05-26T02:12:01.124991655Z [2024-05-26T02:12:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:11:00+00:00 exited with status queued for try_number 1 2024-05-26T02:12:01.125275599Z [2024-05-26T02:12:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:11:00+00:00 exited with status queued for try_number 1 2024-05-26T02:12:01.141134338Z [2024-05-26T02:12:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b046d72-7a0a-43d5-a6dc-2810702a9d34 2024-05-26T02:12:01.141291499Z [2024-05-26T02:12:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to bafb59e5-f6a7-49d7-8453-0b3a9b18d266 2024-05-26T02:12:01.141461637Z [2024-05-26T02:12:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd155c37-d256-4de7-8bf2-4b8f78c0c589 2024-05-26T02:12:01.141656545Z [2024-05-26T02:12:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca9fb403-bbb0-4d44-a55a-77b37f134587 2024-05-26T02:12:02.490481763Z [2024-05-26T02:12:02.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:12:02.490868551Z [2024-05-26T02:12:02.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:10:00+00:00, run_id=scheduled__2024-05-26T02:10:00+00:00, run_start_date=2024-05-26 02:12:00.621184+00:00, run_end_date=2024-05-26 02:12:02.490287+00:00, run_duration=1.869103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:10:00+00:00, data_interval_end=2024-05-26 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:12:02.503278117Z [2024-05-26T02:12:02.502+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:12:00+00:00, run_after=2024-05-26T02:14:00+00:00 2024-05-26T02:12:02.511347015Z [2024-05-26T02:12:02.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:12:02.511413458Z [2024-05-26T02:12:02.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:11:00+00:00, run_id=scheduled__2024-05-26T02:11:00+00:00, run_start_date=2024-05-26 02:12:00.622953+00:00, run_end_date=2024-05-26 02:12:02.511184+00:00, run_duration=1.888231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:11:00+00:00, data_interval_end=2024-05-26 02:12:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:12:02.522418729Z [2024-05-26T02:12:02.521+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:12:00+00:00, run_after=2024-05-26T02:13:00+00:00 2024-05-26T02:12:02.575884131Z [2024-05-26T02:12:02.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:12:02.575939504Z [2024-05-26T02:12:02.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:11:00+00:00 exited with status success for try_number 1 2024-05-26T02:12:02.582596812Z [2024-05-26T02:12:02.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=-1, run_start_date=2024-05-26 02:12:01.785797+00:00, run_end_date=2024-05-26 02:12:02.199429+00:00, run_duration=0.413632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:12:00.759145+00:00, queued_by_job_id=1, pid=13689 2024-05-26T02:12:02.582736322Z [2024-05-26T02:12:02.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:11:00+00:00, map_index=-1, run_start_date=2024-05-26 02:12:01.797592+00:00, run_end_date=2024-05-26 02:12:02.286427+00:00, run_duration=0.488835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:12:00.759145+00:00, queued_by_job_id=1, pid=13690 2024-05-26T02:12:05.232312062Z [2024-05-26T02:12:05.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:12:05.232413200Z [2024-05-26T02:12:05.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:11:00+00:00, run_id=scheduled__2024-05-26T02:11:00+00:00, run_start_date=2024-05-26 02:12:00.624543+00:00, run_end_date=2024-05-26 02:12:05.232168+00:00, run_duration=4.607625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:11:00+00:00, data_interval_end=2024-05-26 02:12:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:12:05.244283557Z [2024-05-26T02:12:05.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:12:00+00:00, run_after=2024-05-26T02:13:00+00:00 2024-05-26T02:12:05.250462299Z [2024-05-26T02:12:05.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:12:05.250544187Z [2024-05-26T02:12:05.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:11:00+00:00, run_id=scheduled__2024-05-26T02:11:00+00:00, run_start_date=2024-05-26 02:12:00.626071+00:00, run_end_date=2024-05-26 02:12:05.250287+00:00, run_duration=4.624216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:11:00+00:00, data_interval_end=2024-05-26 02:12:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:12:05.258713983Z [2024-05-26T02:12:05.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:12:00+00:00, run_after=2024-05-26T02:13:00+00:00 2024-05-26T02:12:05.286328679Z [2024-05-26T02:12:05.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:11:00+00:00 exited with status success for try_number 1 2024-05-26T02:12:05.292455651Z [2024-05-26T02:12:05.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:11:00+00:00, map_index=-1, run_start_date=2024-05-26 02:12:02.852141+00:00, run_end_date=2024-05-26 02:12:04.757939+00:00, run_duration=1.905798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:12:00.759145+00:00, queued_by_job_id=1, pid=13713 2024-05-26T02:12:06.403111830Z [2024-05-26T02:12:06.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:11:00+00:00 exited with status success for try_number 1 2024-05-26T02:12:06.410963529Z [2024-05-26T02:12:06.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:11:00+00:00, map_index=-1, run_start_date=2024-05-26 02:12:03.039049+00:00, run_end_date=2024-05-26 02:12:05.166102+00:00, run_duration=2.127053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:12:00.759145+00:00, queued_by_job_id=1, pid=13714 2024-05-26T02:13:00.505215859Z [2024-05-26T02:13:00.504+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:13:00.523710718Z [2024-05-26T02:13:00.521+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:13:00+00:00, run_after=2024-05-26T02:14:00+00:00 2024-05-26T02:13:00.554015338Z [2024-05-26T02:13:00.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:13:00+00:00, run_after=2024-05-26T02:14:00+00:00 2024-05-26T02:13:00.661442208Z [2024-05-26T02:13:00.660+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:13:00.661488930Z 2024-05-26T02:13:00.661498874Z 2024-05-26T02:13:00.661506936Z 2024-05-26T02:13:00.661977436Z [2024-05-26T02:13:00.661+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:13:00.662474700Z [2024-05-26T02:13:00.662+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:13:00.662847729Z [2024-05-26T02:13:00.662+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:13:00.664371672Z [2024-05-26T02:13:00.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:13:00.664393993Z 2024-05-26T02:13:00.664401807Z 2024-05-26T02:13:00.664409499Z 2024-05-26T02:13:00.674265360Z [2024-05-26T02:13:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:13:00.674606515Z [2024-05-26T02:13:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:13:00.675182963Z [2024-05-26T02:13:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:13:00.675402266Z [2024-05-26T02:13:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:13:00.675849114Z [2024-05-26T02:13:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:13:00.676692925Z [2024-05-26T02:13:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:13:00.952435380Z [2024-05-26T02:13:00.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status queued for try_number 1 2024-05-26T02:13:00.952576762Z [2024-05-26T02:13:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status queued for try_number 1 2024-05-26T02:13:00.952594193Z [2024-05-26T02:13:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status queued for try_number 1 2024-05-26T02:13:00.960980066Z [2024-05-26T02:13:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9b0eba3-7e71-4b61-aa44-76aa4af7400a 2024-05-26T02:13:00.961104916Z [2024-05-26T02:13:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56a3c1f8-4a23-4ed6-ac8f-7b37af8a3d27 2024-05-26T02:13:00.961254082Z [2024-05-26T02:13:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b25a68f-5baa-4a47-bd56-3b78ca5beb31 2024-05-26T02:13:02.099204830Z [2024-05-26T02:13:02.098+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:13:02.099401681Z [2024-05-26T02:13:02.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:12:00+00:00, run_id=scheduled__2024-05-26T02:12:00+00:00, run_start_date=2024-05-26 02:13:00.571744+00:00, run_end_date=2024-05-26 02:13:02.099120+00:00, run_duration=1.527376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:12:00+00:00, data_interval_end=2024-05-26 02:13:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:13:02.113141693Z [2024-05-26T02:13:02.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:13:00+00:00, run_after=2024-05-26T02:14:00+00:00 2024-05-26T02:13:02.165728117Z [2024-05-26T02:13:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status success for try_number 1 2024-05-26T02:13:02.173242463Z [2024-05-26T02:13:02.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:12:00+00:00, map_index=-1, run_start_date=2024-05-26 02:13:01.610936+00:00, run_end_date=2024-05-26 02:13:01.975246+00:00, run_duration=0.36431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:13:00.667576+00:00, queued_by_job_id=1, pid=13746 2024-05-26T02:13:04.591778552Z [2024-05-26T02:13:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:13:04.591964888Z [2024-05-26T02:13:04.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:12:00+00:00, run_id=scheduled__2024-05-26T02:12:00+00:00, run_start_date=2024-05-26 02:13:00.573364+00:00, run_end_date=2024-05-26 02:13:04.591733+00:00, run_duration=4.018369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:12:00+00:00, data_interval_end=2024-05-26 02:13:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:13:04.605604503Z [2024-05-26T02:13:04.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:13:00+00:00, run_after=2024-05-26T02:14:00+00:00 2024-05-26T02:13:04.636908119Z [2024-05-26T02:13:04.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:13:04.637062640Z [2024-05-26T02:13:04.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:12:00+00:00, run_id=scheduled__2024-05-26T02:12:00+00:00, run_start_date=2024-05-26 02:13:00.574675+00:00, run_end_date=2024-05-26 02:13:04.636829+00:00, run_duration=4.062154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:12:00+00:00, data_interval_end=2024-05-26 02:13:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:13:04.651626507Z [2024-05-26T02:13:04.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:13:00+00:00, run_after=2024-05-26T02:14:00+00:00 2024-05-26T02:13:04.718116549Z [2024-05-26T02:13:04.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status success for try_number 1 2024-05-26T02:13:04.725071380Z [2024-05-26T02:13:04.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:12:00+00:00, map_index=-1, run_start_date=2024-05-26 02:13:02.554425+00:00, run_end_date=2024-05-26 02:13:04.088155+00:00, run_duration=1.53373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:13:00.667576+00:00, queued_by_job_id=1, pid=13765 2024-05-26T02:13:05.632628624Z [2024-05-26T02:13:05.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status success for try_number 1 2024-05-26T02:13:05.645047842Z [2024-05-26T02:13:05.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:12:00+00:00, map_index=-1, run_start_date=2024-05-26 02:13:02.480229+00:00, run_end_date=2024-05-26 02:13:04.539586+00:00, run_duration=2.059357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:13:00.667576+00:00, queued_by_job_id=1, pid=13764 2024-05-26T02:13:33.225888114Z [2024-05-26T02:13:33.225+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:14:00.445331953Z [2024-05-26T02:14:00.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:14:00+00:00, run_after=2024-05-26T02:15:00+00:00 2024-05-26T02:14:00.475130344Z [2024-05-26T02:14:00.474+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:14:00+00:00, run_after=2024-05-26T02:15:00+00:00 2024-05-26T02:14:00.487240180Z [2024-05-26T02:14:00.486+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:14:00.496828452Z [2024-05-26T02:14:00.496+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:14:00.593120270Z [2024-05-26T02:14:00.592+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:14:00.593176702Z 2024-05-26T02:14:00.593190336Z 2024-05-26T02:14:00.593196629Z 2024-05-26T02:14:00.593203339Z 2024-05-26T02:14:00.593769512Z [2024-05-26T02:14:00.593+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:14:00.594062662Z [2024-05-26T02:14:00.593+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:14:00.594373040Z [2024-05-26T02:14:00.594+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:14:00.594680840Z [2024-05-26T02:14:00.594+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:14:00.595551862Z [2024-05-26T02:14:00.595+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:14:00.595562124Z 2024-05-26T02:14:00.595568117Z 2024-05-26T02:14:00.595574224Z 2024-05-26T02:14:00.595579818Z 2024-05-26T02:14:00.601984093Z [2024-05-26T02:14:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:14:00.602198857Z [2024-05-26T02:14:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:14:00.602564946Z [2024-05-26T02:14:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:14:00.602817942Z [2024-05-26T02:14:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:14:00.603208888Z [2024-05-26T02:14:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:14:00.603463144Z [2024-05-26T02:14:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:14:00.603969272Z [2024-05-26T02:14:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:14:00.604296799Z [2024-05-26T02:14:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:14:01.188818549Z [2024-05-26T02:14:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status queued for try_number 1 2024-05-26T02:14:01.189015354Z [2024-05-26T02:14:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:13:00+00:00 exited with status queued for try_number 1 2024-05-26T02:14:01.189219789Z [2024-05-26T02:14:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:13:00+00:00 exited with status queued for try_number 1 2024-05-26T02:14:01.189366756Z [2024-05-26T02:14:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:13:00+00:00 exited with status queued for try_number 1 2024-05-26T02:14:01.206938954Z [2024-05-26T02:14:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to b900cff2-6ba7-4944-baac-87dc10ece01e 2024-05-26T02:14:01.209678087Z [2024-05-26T02:14:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c9f579f-c427-4736-b41a-cc2367a4e121 2024-05-26T02:14:01.209962675Z [2024-05-26T02:14:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25f87488-5e9d-43ba-8517-a4719ee62e35 2024-05-26T02:14:01.210161181Z [2024-05-26T02:14:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4363466-30e2-4b4c-86ca-c676634bbd81 2024-05-26T02:14:02.388554287Z [2024-05-26T02:14:02.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:14:02.388748805Z [2024-05-26T02:14:02.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:12:00+00:00, run_id=scheduled__2024-05-26T02:12:00+00:00, run_start_date=2024-05-26 02:14:00.511989+00:00, run_end_date=2024-05-26 02:14:02.388443+00:00, run_duration=1.876454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:12:00+00:00, data_interval_end=2024-05-26 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:14:02.397231420Z [2024-05-26T02:14:02.396+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:14:00+00:00, run_after=2024-05-26T02:16:00+00:00 2024-05-26T02:14:02.409116571Z [2024-05-26T02:14:02.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:14:02.409544789Z [2024-05-26T02:14:02.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:13:00+00:00, run_id=scheduled__2024-05-26T02:13:00+00:00, run_start_date=2024-05-26 02:14:00.513935+00:00, run_end_date=2024-05-26 02:14:02.409054+00:00, run_duration=1.895119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:13:00+00:00, data_interval_end=2024-05-26 02:14:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:14:02.425688890Z [2024-05-26T02:14:02.425+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:14:00+00:00, run_after=2024-05-26T02:15:00+00:00 2024-05-26T02:14:02.470362043Z [2024-05-26T02:14:02.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:12:00+00:00 exited with status success for try_number 1 2024-05-26T02:14:02.470431889Z [2024-05-26T02:14:02.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:13:00+00:00 exited with status success for try_number 1 2024-05-26T02:14:02.484445880Z [2024-05-26T02:14:02.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:13:00+00:00, map_index=-1, run_start_date=2024-05-26 02:14:01.728955+00:00, run_end_date=2024-05-26 02:14:02.207372+00:00, run_duration=0.478417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:14:00.597701+00:00, queued_by_job_id=1, pid=13799 2024-05-26T02:14:02.484541661Z [2024-05-26T02:14:02.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:12:00+00:00, map_index=-1, run_start_date=2024-05-26 02:14:01.519325+00:00, run_end_date=2024-05-26 02:14:01.958744+00:00, run_duration=0.439419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:14:00.597701+00:00, queued_by_job_id=1, pid=13798 2024-05-26T02:14:04.506721385Z [2024-05-26T02:14:04.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:14:04.507249004Z [2024-05-26T02:14:04.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:13:00+00:00, run_id=scheduled__2024-05-26T02:13:00+00:00, run_start_date=2024-05-26 02:14:00.515396+00:00, run_end_date=2024-05-26 02:14:04.506826+00:00, run_duration=3.99143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:13:00+00:00, data_interval_end=2024-05-26 02:14:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:14:04.518431014Z [2024-05-26T02:14:04.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:14:00+00:00, run_after=2024-05-26T02:15:00+00:00 2024-05-26T02:14:05.686811948Z [2024-05-26T02:14:05.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:14:05.687715421Z [2024-05-26T02:14:05.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:13:00+00:00, run_id=scheduled__2024-05-26T02:13:00+00:00, run_start_date=2024-05-26 02:14:00.516841+00:00, run_end_date=2024-05-26 02:14:05.686911+00:00, run_duration=5.17007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:13:00+00:00, data_interval_end=2024-05-26 02:14:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:14:05.700577799Z [2024-05-26T02:14:05.700+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:14:00+00:00, run_after=2024-05-26T02:15:00+00:00 2024-05-26T02:14:05.784256352Z [2024-05-26T02:14:05.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:13:00+00:00 exited with status success for try_number 1 2024-05-26T02:14:05.784512341Z [2024-05-26T02:14:05.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:13:00+00:00 exited with status success for try_number 1 2024-05-26T02:14:05.794315332Z [2024-05-26T02:14:05.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:13:00+00:00, map_index=-1, run_start_date=2024-05-26 02:14:02.675372+00:00, run_end_date=2024-05-26 02:14:04.463492+00:00, run_duration=1.78812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:14:00.597701+00:00, queued_by_job_id=1, pid=13823 2024-05-26T02:14:05.794804024Z [2024-05-26T02:14:05.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:13:00+00:00, map_index=-1, run_start_date=2024-05-26 02:14:02.686207+00:00, run_end_date=2024-05-26 02:14:04.831939+00:00, run_duration=2.145732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:14:00.597701+00:00, queued_by_job_id=1, pid=13822 2024-05-26T02:15:00.465747987Z [2024-05-26T02:15:00.465+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:15:00.498549591Z [2024-05-26T02:15:00.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:15:00+00:00, run_after=2024-05-26T02:16:00+00:00 2024-05-26T02:15:00.513263338Z [2024-05-26T02:15:00.512+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:15:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:15:00.524507673Z [2024-05-26T02:15:00.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:15:00+00:00, run_after=2024-05-26T02:16:00+00:00 2024-05-26T02:15:00.866191608Z [2024-05-26T02:15:00.865+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:15:00.866226366Z 2024-05-26T02:15:00.866237130Z 2024-05-26T02:15:00.866242299Z 2024-05-26T02:15:00.866247348Z 2024-05-26T02:15:00.866814334Z [2024-05-26T02:15:00.866+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:15:00.866825200Z [2024-05-26T02:15:00.866+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:15:00.866830206Z [2024-05-26T02:15:00.866+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:15:00.866835013Z [2024-05-26T02:15:00.866+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:15:00.867597273Z [2024-05-26T02:15:00.867+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:15:00.867610909Z 2024-05-26T02:15:00.867616453Z 2024-05-26T02:15:00.867621318Z 2024-05-26T02:15:00.867695188Z 2024-05-26T02:15:00.872836072Z [2024-05-26T02:15:00.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:15:00.872894368Z [2024-05-26T02:15:00.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:15:00.873233632Z [2024-05-26T02:15:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:15:00.873448858Z [2024-05-26T02:15:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:15:00.873747870Z [2024-05-26T02:15:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:15:00.873984936Z [2024-05-26T02:15:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:15:00.874275700Z [2024-05-26T02:15:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:15:00.874426512Z [2024-05-26T02:15:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:15:01.428480855Z [2024-05-26T02:15:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:15:01.431900476Z [2024-05-26T02:15:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status queued for try_number 1 2024-05-26T02:15:01.432000559Z [2024-05-26T02:15:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status queued for try_number 1 2024-05-26T02:15:01.432183329Z [2024-05-26T02:15:01.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status queued for try_number 1 2024-05-26T02:15:01.452877657Z [2024-05-26T02:15:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff17595d-4aba-435e-9d30-e408df4e77a0 2024-05-26T02:15:01.453041938Z [2024-05-26T02:15:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to d96fe6d0-5d62-4f9c-a6b7-c961b8a88fab 2024-05-26T02:15:01.453201421Z [2024-05-26T02:15:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to 093d601e-6515-45f2-82d0-bae1aa4df9e6 2024-05-26T02:15:01.453342985Z [2024-05-26T02:15:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0869f7b6-d94e-463c-bf39-7de4aade5c03 2024-05-26T02:15:02.750303454Z [2024-05-26T02:15:02.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:15:02.750637713Z [2024-05-26T02:15:02.750+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:14:00+00:00, run_id=scheduled__2024-05-26T02:14:00+00:00, run_start_date=2024-05-26 02:15:00.536994+00:00, run_end_date=2024-05-26 02:15:02.750320+00:00, run_duration=2.213326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:14:00+00:00, data_interval_end=2024-05-26 02:15:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:15:02.769033099Z [2024-05-26T02:15:02.768+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:15:00+00:00, run_after=2024-05-26T02:16:00+00:00 2024-05-26T02:15:02.825692316Z [2024-05-26T02:15:02.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status success for try_number 1 2024-05-26T02:15:02.832517513Z [2024-05-26T02:15:02.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:14:00+00:00, map_index=-1, run_start_date=2024-05-26 02:15:02.148834+00:00, run_end_date=2024-05-26 02:15:02.563500+00:00, run_duration=0.414666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:15:00.868793+00:00, queued_by_job_id=1, pid=13859 2024-05-26T02:15:03.965071387Z [2024-05-26T02:15:03.964+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:15:03.965114502Z 2024-05-26T02:15:03.966122683Z [2024-05-26T02:15:03.964+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:15:03.966679839Z [2024-05-26T02:15:03.966+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:15:03.966693394Z 2024-05-26T02:15:03.969483002Z [2024-05-26T02:15:03.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:15:03.969631291Z [2024-05-26T02:15:03.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:15:04.117003455Z [2024-05-26T02:15:04.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:15:04.117178927Z [2024-05-26T02:15:04.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:15:04.135122361Z [2024-05-26T02:15:04.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 788ca12e-f4f8-474e-9496-2e5cbb32804f 2024-05-26T02:15:04.135286040Z [2024-05-26T02:15:04.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=-1, run_start_date=2024-05-26 02:15:03.001274+00:00, run_end_date=2024-05-26 02:15:03.403244+00:00, run_duration=0.40197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:15:00.868793+00:00, queued_by_job_id=1, pid=13876 2024-05-26T02:15:05.761807766Z [2024-05-26T02:15:05.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:15:05.762128824Z [2024-05-26T02:15:05.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:14:00+00:00, run_id=scheduled__2024-05-26T02:14:00+00:00, run_start_date=2024-05-26 02:15:00.538501+00:00, run_end_date=2024-05-26 02:15:05.761711+00:00, run_duration=5.22321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:14:00+00:00, data_interval_end=2024-05-26 02:15:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:15:05.770198893Z [2024-05-26T02:15:05.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:15:00+00:00, run_after=2024-05-26T02:16:00+00:00 2024-05-26T02:15:05.776157727Z [2024-05-26T02:15:05.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:15:05.776301958Z [2024-05-26T02:15:05.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:14:00+00:00, run_id=scheduled__2024-05-26T02:14:00+00:00, run_start_date=2024-05-26 02:15:00.539622+00:00, run_end_date=2024-05-26 02:15:05.776070+00:00, run_duration=5.236448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:14:00+00:00, data_interval_end=2024-05-26 02:15:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:15:05.784543890Z [2024-05-26T02:15:05.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:15:00+00:00, run_after=2024-05-26T02:16:00+00:00 2024-05-26T02:15:05.823901337Z [2024-05-26T02:15:05.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status success for try_number 1 2024-05-26T02:15:05.824095565Z [2024-05-26T02:15:05.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status success for try_number 1 2024-05-26T02:15:05.829653635Z [2024-05-26T02:15:05.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:14:00+00:00, map_index=-1, run_start_date=2024-05-26 02:15:03.662684+00:00, run_end_date=2024-05-26 02:15:05.173099+00:00, run_duration=1.510415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:15:00.868793+00:00, queued_by_job_id=1, pid=13893 2024-05-26T02:15:05.829941245Z [2024-05-26T02:15:05.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:14:00+00:00, map_index=-1, run_start_date=2024-05-26 02:15:03.009761+00:00, run_end_date=2024-05-26 02:15:04.998348+00:00, run_duration=1.988587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:15:00.868793+00:00, queued_by_job_id=1, pid=13877 2024-05-26T02:15:06.679666470Z [2024-05-26T02:15:06.678+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:15:06.679709116Z 2024-05-26T02:15:06.679933286Z [2024-05-26T02:15:06.679+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:15:06.680769388Z [2024-05-26T02:15:06.680+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:15:06.680776475Z 2024-05-26T02:15:06.683934521Z [2024-05-26T02:15:06.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:15:06.684123852Z [2024-05-26T02:15:06.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:15:06.746405096Z [2024-05-26T02:15:06.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:15:06.746646649Z [2024-05-26T02:15:06.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:15:06.754595734Z [2024-05-26T02:15:06.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cf27352-aebb-4fa4-b372-2e0510de0025 2024-05-26T02:15:06.755032624Z [2024-05-26T02:15:06.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=-1, run_start_date=2024-05-26 02:15:06.044947+00:00, run_end_date=2024-05-26 02:15:06.382724+00:00, run_duration=0.337777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:15:03.967125+00:00, queued_by_job_id=1, pid=13906 2024-05-26T02:15:10.826730473Z [2024-05-26T02:15:10.826+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:15:10.826778210Z 2024-05-26T02:15:10.826977482Z [2024-05-26T02:15:10.826+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:15:10.827869013Z [2024-05-26T02:15:10.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:15:10.827908591Z 2024-05-26T02:15:10.831111282Z [2024-05-26T02:15:10.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:15:10.831333130Z [2024-05-26T02:15:10.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:15:10.893062206Z [2024-05-26T02:15:10.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status queued for try_number 1 2024-05-26T02:15:10.893175845Z [2024-05-26T02:15:10.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:15:10.899081622Z [2024-05-26T02:15:10.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d71fa87-7170-4e2e-aad2-cbbf20a9a3f1 2024-05-26T02:15:10.899278905Z [2024-05-26T02:15:10.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=0, run_start_date=2024-05-26 02:15:08.325281+00:00, run_end_date=2024-05-26 02:15:09.614441+00:00, run_duration=1.28916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:15:06.681315+00:00, queued_by_job_id=1, pid=13914 2024-05-26T02:15:13.137948580Z [2024-05-26T02:15:13.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:15:13.138501858Z [2024-05-26T02:15:13.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:10:00+00:00, run_id=scheduled__2024-05-26T02:10:00+00:00, run_start_date=2024-05-26 02:15:00.535310+00:00, run_end_date=2024-05-26 02:15:13.137775+00:00, run_duration=12.602465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:10:00+00:00, data_interval_end=2024-05-26 02:15:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:15:13.146454992Z [2024-05-26T02:15:13.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:15:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:15:13.180127470Z [2024-05-26T02:15:13.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:10:00+00:00 exited with status success for try_number 1 2024-05-26T02:15:13.184753057Z [2024-05-26T02:15:13.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:10:00+00:00, map_index=-1, run_start_date=2024-05-26 02:15:12.456896+00:00, run_end_date=2024-05-26 02:15:12.870739+00:00, run_duration=0.413843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:15:10.828325+00:00, queued_by_job_id=1, pid=13927 2024-05-26T02:16:00.326827655Z [2024-05-26T02:16:00.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:16:00+00:00, run_after=2024-05-26T02:17:00+00:00 2024-05-26T02:16:00.336576237Z [2024-05-26T02:16:00.336+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:16:00.353114040Z [2024-05-26T02:16:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:16:00+00:00, run_after=2024-05-26T02:17:00+00:00 2024-05-26T02:16:00.363370242Z [2024-05-26T02:16:00.362+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:16:00.465333501Z [2024-05-26T02:16:00.464+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:16:00.465360295Z 2024-05-26T02:16:00.465365162Z 2024-05-26T02:16:00.465369005Z 2024-05-26T02:16:00.465372438Z 2024-05-26T02:16:00.465558936Z [2024-05-26T02:16:00.465+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:16:00.465788928Z [2024-05-26T02:16:00.465+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:16:00.466100413Z [2024-05-26T02:16:00.465+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:16:00.466323328Z [2024-05-26T02:16:00.466+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:16:00.467189313Z [2024-05-26T02:16:00.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:16:00.467198106Z 2024-05-26T02:16:00.467201799Z 2024-05-26T02:16:00.467205334Z 2024-05-26T02:16:00.467208427Z 2024-05-26T02:16:00.471309634Z [2024-05-26T02:16:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:16:00.471628830Z [2024-05-26T02:16:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:16:00.471926569Z [2024-05-26T02:16:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:16:00.472104605Z [2024-05-26T02:16:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:16:00.472382742Z [2024-05-26T02:16:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:16:00.472534682Z [2024-05-26T02:16:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:16:00.472807935Z [2024-05-26T02:16:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:16:00.473032509Z [2024-05-26T02:16:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:16:00.718775892Z [2024-05-26T02:16:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status queued for try_number 1 2024-05-26T02:16:00.718788179Z [2024-05-26T02:16:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status queued for try_number 1 2024-05-26T02:16:00.718791752Z [2024-05-26T02:16:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status queued for try_number 1 2024-05-26T02:16:00.718795234Z [2024-05-26T02:16:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status queued for try_number 1 2024-05-26T02:16:00.737320573Z [2024-05-26T02:16:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba2333f9-d0bc-48ef-9ccd-4d38b38d04b7 2024-05-26T02:16:00.737338158Z [2024-05-26T02:16:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 753e089b-285d-4a2f-bed0-d144220706de 2024-05-26T02:16:00.737352583Z [2024-05-26T02:16:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff2f1cc0-c539-4f55-a8e5-a4b4a46810c8 2024-05-26T02:16:00.737355742Z [2024-05-26T02:16:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8650c63-813c-4c53-88a2-fa1a3029f099 2024-05-26T02:16:01.980054930Z [2024-05-26T02:16:01.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:16:01.980343366Z [2024-05-26T02:16:01.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:14:00+00:00, run_id=scheduled__2024-05-26T02:14:00+00:00, run_start_date=2024-05-26 02:16:00.379480+00:00, run_end_date=2024-05-26 02:16:01.979898+00:00, run_duration=1.600418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:14:00+00:00, data_interval_end=2024-05-26 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:16:01.987929628Z [2024-05-26T02:16:01.987+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:16:00+00:00, run_after=2024-05-26T02:18:00+00:00 2024-05-26T02:16:01.994280432Z [2024-05-26T02:16:01.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:16:01.994555006Z [2024-05-26T02:16:01.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:15:00+00:00, run_id=scheduled__2024-05-26T02:15:00+00:00, run_start_date=2024-05-26 02:16:00.382064+00:00, run_end_date=2024-05-26 02:16:01.994098+00:00, run_duration=1.612034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:15:00+00:00, data_interval_end=2024-05-26 02:16:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:16:02.008870164Z [2024-05-26T02:16:02.008+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:16:00+00:00, run_after=2024-05-26T02:17:00+00:00 2024-05-26T02:16:02.058181563Z [2024-05-26T02:16:02.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:14:00+00:00 exited with status success for try_number 1 2024-05-26T02:16:02.058455395Z [2024-05-26T02:16:02.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status success for try_number 1 2024-05-26T02:16:02.071433810Z [2024-05-26T02:16:02.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:14:00+00:00, map_index=-1, run_start_date=2024-05-26 02:16:01.321137+00:00, run_end_date=2024-05-26 02:16:01.726938+00:00, run_duration=0.405801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:16:00.468229+00:00, queued_by_job_id=1, pid=13950 2024-05-26T02:16:02.071869170Z [2024-05-26T02:16:02.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:15:00+00:00, map_index=-1, run_start_date=2024-05-26 02:16:01.372627+00:00, run_end_date=2024-05-26 02:16:01.745935+00:00, run_duration=0.373308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:16:00.468229+00:00, queued_by_job_id=1, pid=13951 2024-05-26T02:16:04.239656532Z [2024-05-26T02:16:04.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:16:04.240223486Z [2024-05-26T02:16:04.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:15:00+00:00, run_id=scheduled__2024-05-26T02:15:00+00:00, run_start_date=2024-05-26 02:16:00.384556+00:00, run_end_date=2024-05-26 02:16:04.239743+00:00, run_duration=3.855187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:15:00+00:00, data_interval_end=2024-05-26 02:16:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:16:04.253550376Z [2024-05-26T02:16:04.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:16:00+00:00, run_after=2024-05-26T02:17:00+00:00 2024-05-26T02:16:04.330510952Z [2024-05-26T02:16:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status success for try_number 1 2024-05-26T02:16:04.353083046Z [2024-05-26T02:16:04.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:15:00+00:00, map_index=-1, run_start_date=2024-05-26 02:16:02.563863+00:00, run_end_date=2024-05-26 02:16:03.881274+00:00, run_duration=1.317411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:16:00.468229+00:00, queued_by_job_id=1, pid=13974 2024-05-26T02:16:05.405399265Z [2024-05-26T02:16:05.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:16:05.405721188Z [2024-05-26T02:16:05.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:15:00+00:00, run_id=scheduled__2024-05-26T02:15:00+00:00, run_start_date=2024-05-26 02:16:00.386394+00:00, run_end_date=2024-05-26 02:16:05.405339+00:00, run_duration=5.018945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:15:00+00:00, data_interval_end=2024-05-26 02:16:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:16:05.425272299Z [2024-05-26T02:16:05.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:16:00+00:00, run_after=2024-05-26T02:17:00+00:00 2024-05-26T02:16:05.463395163Z [2024-05-26T02:16:05.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status success for try_number 1 2024-05-26T02:16:05.470777525Z [2024-05-26T02:16:05.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:15:00+00:00, map_index=-1, run_start_date=2024-05-26 02:16:02.592066+00:00, run_end_date=2024-05-26 02:16:04.229171+00:00, run_duration=1.637105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:16:00.468229+00:00, queued_by_job_id=1, pid=13975 2024-05-26T02:17:00.822482708Z [2024-05-26T02:17:00.821+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:17:00.841868917Z [2024-05-26T02:17:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:17:00+00:00, run_after=2024-05-26T02:18:00+00:00 2024-05-26T02:17:00.857377362Z [2024-05-26T02:17:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:17:00+00:00, run_after=2024-05-26T02:18:00+00:00 2024-05-26T02:17:00.941057480Z [2024-05-26T02:17:00.940+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:17:00.941102450Z 2024-05-26T02:17:00.941112695Z 2024-05-26T02:17:00.941121555Z 2024-05-26T02:17:00.941579007Z [2024-05-26T02:17:00.940+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:17:00.942100958Z [2024-05-26T02:17:00.941+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:17:00.942528035Z [2024-05-26T02:17:00.942+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:17:00.944252208Z [2024-05-26T02:17:00.943+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:17:00.944308138Z 2024-05-26T02:17:00.944317711Z 2024-05-26T02:17:00.944326332Z 2024-05-26T02:17:00.951334195Z [2024-05-26T02:17:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:17:00.951722878Z [2024-05-26T02:17:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:17:00.952243829Z [2024-05-26T02:17:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:17:00.952575891Z [2024-05-26T02:17:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:17:00.953020592Z [2024-05-26T02:17:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:17:00.953308474Z [2024-05-26T02:17:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:17:01.171165238Z [2024-05-26T02:17:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status queued for try_number 1 2024-05-26T02:17:01.171490716Z [2024-05-26T02:17:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status queued for try_number 1 2024-05-26T02:17:01.171689573Z [2024-05-26T02:17:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status queued for try_number 1 2024-05-26T02:17:01.179608352Z [2024-05-26T02:17:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8441823e-b0d1-427a-9284-f2e4b57e32de 2024-05-26T02:17:01.180779900Z [2024-05-26T02:17:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 784f0dad-54c7-4115-9308-9f7232841a9f 2024-05-26T02:17:01.181030976Z [2024-05-26T02:17:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c78e165-5772-4fa5-87bc-ae8bd817a125 2024-05-26T02:17:02.906180821Z [2024-05-26T02:17:02.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:17:02.907413003Z [2024-05-26T02:17:02.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:16:00+00:00, run_id=scheduled__2024-05-26T02:16:00+00:00, run_start_date=2024-05-26 02:17:00.874369+00:00, run_end_date=2024-05-26 02:17:02.906366+00:00, run_duration=2.031997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:16:00+00:00, data_interval_end=2024-05-26 02:17:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:17:02.925361814Z [2024-05-26T02:17:02.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:17:00+00:00, run_after=2024-05-26T02:18:00+00:00 2024-05-26T02:17:02.985079761Z [2024-05-26T02:17:02.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status success for try_number 1 2024-05-26T02:17:02.991725611Z [2024-05-26T02:17:02.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:16:00+00:00, map_index=-1, run_start_date=2024-05-26 02:17:01.828205+00:00, run_end_date=2024-05-26 02:17:02.216532+00:00, run_duration=0.388327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:17:00.946637+00:00, queued_by_job_id=1, pid=14007 2024-05-26T02:17:05.212981159Z [2024-05-26T02:17:05.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:17:05.213555861Z [2024-05-26T02:17:05.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:16:00+00:00, run_id=scheduled__2024-05-26T02:16:00+00:00, run_start_date=2024-05-26 02:17:00.877041+00:00, run_end_date=2024-05-26 02:17:05.212864+00:00, run_duration=4.335823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:16:00+00:00, data_interval_end=2024-05-26 02:17:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:17:05.225354783Z [2024-05-26T02:17:05.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:17:00+00:00, run_after=2024-05-26T02:18:00+00:00 2024-05-26T02:17:05.231975932Z [2024-05-26T02:17:05.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:17:05.232033389Z [2024-05-26T02:17:05.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:16:00+00:00, run_id=scheduled__2024-05-26T02:16:00+00:00, run_start_date=2024-05-26 02:17:00.875870+00:00, run_end_date=2024-05-26 02:17:05.231825+00:00, run_duration=4.355955, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:16:00+00:00, data_interval_end=2024-05-26 02:17:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:17:05.241672700Z [2024-05-26T02:17:05.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:17:00+00:00, run_after=2024-05-26T02:18:00+00:00 2024-05-26T02:17:05.270542296Z [2024-05-26T02:17:05.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status success for try_number 1 2024-05-26T02:17:05.270579668Z [2024-05-26T02:17:05.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status success for try_number 1 2024-05-26T02:17:05.276029943Z [2024-05-26T02:17:05.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:16:00+00:00, map_index=-1, run_start_date=2024-05-26 02:17:02.892799+00:00, run_end_date=2024-05-26 02:17:04.374624+00:00, run_duration=1.481825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:17:00.946637+00:00, queued_by_job_id=1, pid=14025 2024-05-26T02:17:05.276291382Z [2024-05-26T02:17:05.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:16:00+00:00, map_index=-1, run_start_date=2024-05-26 02:17:02.945026+00:00, run_end_date=2024-05-26 02:17:04.706846+00:00, run_duration=1.76182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:17:00.946637+00:00, queued_by_job_id=1, pid=14026 2024-05-26T02:18:00.232932922Z [2024-05-26T02:18:00.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:18:00+00:00, run_after=2024-05-26T02:19:00+00:00 2024-05-26T02:18:00.244211969Z [2024-05-26T02:18:00.243+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:18:00.254391328Z [2024-05-26T02:18:00.253+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:18:00.274261453Z [2024-05-26T02:18:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:18:00+00:00, run_after=2024-05-26T02:19:00+00:00 2024-05-26T02:18:00.366181929Z [2024-05-26T02:18:00.365+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:18:00.366216049Z 2024-05-26T02:18:00.366232621Z 2024-05-26T02:18:00.366239008Z 2024-05-26T02:18:00.366245146Z 2024-05-26T02:18:00.366346258Z [2024-05-26T02:18:00.366+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:18:00.366645080Z [2024-05-26T02:18:00.366+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:18:00.366826772Z [2024-05-26T02:18:00.366+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:18:00.367015031Z [2024-05-26T02:18:00.366+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:18:00.367849130Z [2024-05-26T02:18:00.367+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:18:00.367893624Z 2024-05-26T02:18:00.367902406Z 2024-05-26T02:18:00.367929409Z 2024-05-26T02:18:00.367935452Z 2024-05-26T02:18:00.373952489Z [2024-05-26T02:18:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:18:00.374207068Z [2024-05-26T02:18:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:18:00.374617386Z [2024-05-26T02:18:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:18:00.374817983Z [2024-05-26T02:18:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:18:00.375223234Z [2024-05-26T02:18:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:18:00.375541263Z [2024-05-26T02:18:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:18:00.375989896Z [2024-05-26T02:18:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:18:00.376323579Z [2024-05-26T02:18:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:18:00.849028331Z [2024-05-26T02:18:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status queued for try_number 1 2024-05-26T02:18:00.851505446Z [2024-05-26T02:18:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:17:00+00:00 exited with status queued for try_number 1 2024-05-26T02:18:00.851520754Z [2024-05-26T02:18:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:17:00+00:00 exited with status queued for try_number 1 2024-05-26T02:18:00.851524542Z [2024-05-26T02:18:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:17:00+00:00 exited with status queued for try_number 1 2024-05-26T02:18:00.869532774Z [2024-05-26T02:18:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 253be491-6af1-43ed-b18b-1cc9c4664ee3 2024-05-26T02:18:00.871657229Z [2024-05-26T02:18:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc9bfb79-9207-43d9-96b6-686e6221c6f9 2024-05-26T02:18:00.871670944Z [2024-05-26T02:18:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 192536af-ff0f-407c-b0df-5e1c4bdc0fae 2024-05-26T02:18:00.871674199Z [2024-05-26T02:18:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31c2eb44-575a-4615-88be-d6dc21fd3009 2024-05-26T02:18:02.102199138Z [2024-05-26T02:18:02.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:18:02.102564376Z [2024-05-26T02:18:02.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:16:00+00:00, run_id=scheduled__2024-05-26T02:16:00+00:00, run_start_date=2024-05-26 02:18:00.285875+00:00, run_end_date=2024-05-26 02:18:02.102251+00:00, run_duration=1.816376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:16:00+00:00, data_interval_end=2024-05-26 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:18:02.110242652Z [2024-05-26T02:18:02.109+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:18:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:18:02.116664045Z [2024-05-26T02:18:02.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:18:02.116969901Z [2024-05-26T02:18:02.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:17:00+00:00, run_id=scheduled__2024-05-26T02:17:00+00:00, run_start_date=2024-05-26 02:18:00.287199+00:00, run_end_date=2024-05-26 02:18:02.116586+00:00, run_duration=1.829387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:17:00+00:00, data_interval_end=2024-05-26 02:18:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:18:02.126592701Z [2024-05-26T02:18:02.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:18:00+00:00, run_after=2024-05-26T02:19:00+00:00 2024-05-26T02:18:02.171644518Z [2024-05-26T02:18:02.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:16:00+00:00 exited with status success for try_number 1 2024-05-26T02:18:02.171744855Z [2024-05-26T02:18:02.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:17:00+00:00 exited with status success for try_number 1 2024-05-26T02:18:02.178325326Z [2024-05-26T02:18:02.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:16:00+00:00, map_index=-1, run_start_date=2024-05-26 02:18:01.284033+00:00, run_end_date=2024-05-26 02:18:01.629827+00:00, run_duration=0.345794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:18:00.369030+00:00, queued_by_job_id=1, pid=14059 2024-05-26T02:18:02.178575130Z [2024-05-26T02:18:02.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:17:00+00:00, map_index=-1, run_start_date=2024-05-26 02:18:01.328007+00:00, run_end_date=2024-05-26 02:18:01.805936+00:00, run_duration=0.477929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:18:00.369030+00:00, queued_by_job_id=1, pid=14060 2024-05-26T02:18:05.026164069Z [2024-05-26T02:18:05.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:18:05.027472225Z [2024-05-26T02:18:05.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:17:00+00:00, run_id=scheduled__2024-05-26T02:17:00+00:00, run_start_date=2024-05-26 02:18:00.288371+00:00, run_end_date=2024-05-26 02:18:05.027184+00:00, run_duration=4.738813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:17:00+00:00, data_interval_end=2024-05-26 02:18:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:18:05.042467682Z [2024-05-26T02:18:05.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:18:00+00:00, run_after=2024-05-26T02:19:00+00:00 2024-05-26T02:18:05.051337421Z [2024-05-26T02:18:05.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:18:05.051761670Z [2024-05-26T02:18:05.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:17:00+00:00, run_id=scheduled__2024-05-26T02:17:00+00:00, run_start_date=2024-05-26 02:18:00.289363+00:00, run_end_date=2024-05-26 02:18:05.051240+00:00, run_duration=4.761877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:17:00+00:00, data_interval_end=2024-05-26 02:18:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:18:05.061838523Z [2024-05-26T02:18:05.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:18:00+00:00, run_after=2024-05-26T02:19:00+00:00 2024-05-26T02:18:05.099048639Z [2024-05-26T02:18:05.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:17:00+00:00 exited with status success for try_number 1 2024-05-26T02:18:05.099408426Z [2024-05-26T02:18:05.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:17:00+00:00 exited with status success for try_number 1 2024-05-26T02:18:05.108882553Z [2024-05-26T02:18:05.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:17:00+00:00, map_index=-1, run_start_date=2024-05-26 02:18:02.534213+00:00, run_end_date=2024-05-26 02:18:04.082716+00:00, run_duration=1.548503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:18:00.369030+00:00, queued_by_job_id=1, pid=14084 2024-05-26T02:18:05.109446114Z [2024-05-26T02:18:05.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:17:00+00:00, map_index=-1, run_start_date=2024-05-26 02:18:02.399219+00:00, run_end_date=2024-05-26 02:18:04.095018+00:00, run_duration=1.695799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:18:00.369030+00:00, queued_by_job_id=1, pid=14083 2024-05-26T02:18:33.332343471Z [2024-05-26T02:18:33.331+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:19:00.860330562Z [2024-05-26T02:19:00.859+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:19:00.883898644Z [2024-05-26T02:19:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:19:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:19:00.900318848Z [2024-05-26T02:19:00.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:19:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:19:01.006408236Z [2024-05-26T02:19:01.005+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:19:01.006451823Z 2024-05-26T02:19:01.006457279Z 2024-05-26T02:19:01.006462125Z 2024-05-26T02:19:01.006630358Z [2024-05-26T02:19:01.006+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:19:01.006812343Z [2024-05-26T02:19:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:19:01.006976734Z [2024-05-26T02:19:01.006+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:19:01.007863126Z [2024-05-26T02:19:01.007+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:19:01.007896329Z 2024-05-26T02:19:01.007903749Z 2024-05-26T02:19:01.007910390Z 2024-05-26T02:19:01.012351306Z [2024-05-26T02:19:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:19:01.012677443Z [2024-05-26T02:19:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:19:01.013048321Z [2024-05-26T02:19:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:19:01.013218271Z [2024-05-26T02:19:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:19:01.013522205Z [2024-05-26T02:19:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:19:01.013673716Z [2024-05-26T02:19:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:19:01.289078432Z [2024-05-26T02:19:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status queued for try_number 1 2024-05-26T02:19:01.289514343Z [2024-05-26T02:19:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status queued for try_number 1 2024-05-26T02:19:01.289913148Z [2024-05-26T02:19:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status queued for try_number 1 2024-05-26T02:19:01.302660478Z [2024-05-26T02:19:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3db91b5f-d24b-4040-b837-d3e2bd40af07 2024-05-26T02:19:01.303071161Z [2024-05-26T02:19:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to abccb1d8-128d-47e3-bf25-b96154766897 2024-05-26T02:19:01.303418369Z [2024-05-26T02:19:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to d89622da-3225-48ee-984a-7e836323d092 2024-05-26T02:19:02.467682117Z [2024-05-26T02:19:02.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:19:02.467747872Z [2024-05-26T02:19:02.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:18:00+00:00, run_id=scheduled__2024-05-26T02:18:00+00:00, run_start_date=2024-05-26 02:19:00.918992+00:00, run_end_date=2024-05-26 02:19:02.466718+00:00, run_duration=1.547726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:18:00+00:00, data_interval_end=2024-05-26 02:19:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:19:02.476702186Z [2024-05-26T02:19:02.476+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:19:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:19:02.528348022Z [2024-05-26T02:19:02.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status success for try_number 1 2024-05-26T02:19:02.536016693Z [2024-05-26T02:19:02.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:18:00+00:00, map_index=-1, run_start_date=2024-05-26 02:19:01.877152+00:00, run_end_date=2024-05-26 02:19:02.305490+00:00, run_duration=0.428338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:19:01.008799+00:00, queued_by_job_id=1, pid=14117 2024-05-26T02:19:04.963253778Z [2024-05-26T02:19:04.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:19:04.964703636Z [2024-05-26T02:19:04.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:18:00+00:00, run_id=scheduled__2024-05-26T02:18:00+00:00, run_start_date=2024-05-26 02:19:00.920538+00:00, run_end_date=2024-05-26 02:19:04.963130+00:00, run_duration=4.042592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:18:00+00:00, data_interval_end=2024-05-26 02:19:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:19:04.981375524Z [2024-05-26T02:19:04.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:19:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:19:04.998987837Z [2024-05-26T02:19:04.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:19:05.000374843Z [2024-05-26T02:19:05.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:18:00+00:00, run_id=scheduled__2024-05-26T02:18:00+00:00, run_start_date=2024-05-26 02:19:00.921682+00:00, run_end_date=2024-05-26 02:19:04.998914+00:00, run_duration=4.077232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:18:00+00:00, data_interval_end=2024-05-26 02:19:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:19:05.013323163Z [2024-05-26T02:19:05.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:19:00+00:00, run_after=2024-05-26T02:20:00+00:00 2024-05-26T02:19:05.048464338Z [2024-05-26T02:19:05.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status success for try_number 1 2024-05-26T02:19:05.048814672Z [2024-05-26T02:19:05.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status success for try_number 1 2024-05-26T02:19:05.056051296Z [2024-05-26T02:19:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:18:00+00:00, map_index=-1, run_start_date=2024-05-26 02:19:02.889527+00:00, run_end_date=2024-05-26 02:19:04.808992+00:00, run_duration=1.919465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:19:01.008799+00:00, queued_by_job_id=1, pid=14136 2024-05-26T02:19:05.056366347Z [2024-05-26T02:19:05.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:18:00+00:00, map_index=-1, run_start_date=2024-05-26 02:19:02.904116+00:00, run_end_date=2024-05-26 02:19:04.295727+00:00, run_duration=1.391611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:19:01.008799+00:00, queued_by_job_id=1, pid=14135 2024-05-26T02:20:00.851653040Z [2024-05-26T02:20:00.850+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:20:00.879846054Z [2024-05-26T02:20:00.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:21:00+00:00 2024-05-26T02:20:00.898803559Z [2024-05-26T02:20:00.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:25:00+00:00 2024-05-26T02:20:00.910394934Z [2024-05-26T02:20:00.909+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:20:00.926769423Z [2024-05-26T02:20:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:21:00+00:00 2024-05-26T02:20:01.051099967Z [2024-05-26T02:20:01.050+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T02:20:01.051134813Z 2024-05-26T02:20:01.051141729Z 2024-05-26T02:20:01.051147916Z 2024-05-26T02:20:01.051153581Z 2024-05-26T02:20:01.051158894Z 2024-05-26T02:20:01.051724981Z [2024-05-26T02:20:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:20:01.052175877Z [2024-05-26T02:20:01.051+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:20:01.052479644Z [2024-05-26T02:20:01.052+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:20:01.052782990Z [2024-05-26T02:20:01.052+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:20:01.053088130Z [2024-05-26T02:20:01.052+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:20:01.054192681Z [2024-05-26T02:20:01.053+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:20:01.054214071Z 2024-05-26T02:20:01.054223079Z 2024-05-26T02:20:01.054228985Z 2024-05-26T02:20:01.054234320Z 2024-05-26T02:20:01.054239746Z 2024-05-26T02:20:01.061691426Z [2024-05-26T02:20:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:20:01.062001155Z [2024-05-26T02:20:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:20:01.062353780Z [2024-05-26T02:20:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:20:01.062585695Z [2024-05-26T02:20:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:20:01.062916543Z [2024-05-26T02:20:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:20:01.063138724Z [2024-05-26T02:20:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:20:01.063451160Z [2024-05-26T02:20:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:20:01.063701095Z [2024-05-26T02:20:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:20:01.064023053Z [2024-05-26T02:20:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:20:01.064274627Z [2024-05-26T02:20:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:20:01.375004017Z [2024-05-26T02:20:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:01.375069607Z [2024-05-26T02:20:01.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:01.377551355Z [2024-05-26T02:20:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:19:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:01.377600287Z [2024-05-26T02:20:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:19:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:01.377623852Z [2024-05-26T02:20:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:19:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:01.404061494Z [2024-05-26T02:20:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00446f1a-7332-4319-b835-cc0a46987f49 2024-05-26T02:20:01.404178998Z [2024-05-26T02:20:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64685c8b-fbe8-4371-9ff3-845bfa6ab47f 2024-05-26T02:20:01.404285929Z [2024-05-26T02:20:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87d04b48-3c7f-4c3a-9d68-3dcaff8714a0 2024-05-26T02:20:01.404501216Z [2024-05-26T02:20:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to e421d0da-74eb-4ae9-8bd9-e74a3a7c9356 2024-05-26T02:20:01.404741377Z [2024-05-26T02:20:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 221fe51a-a24e-4f59-93c4-a8078d1e7f04 2024-05-26T02:20:02.663652898Z [2024-05-26T02:20:02.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:20:02.663822458Z [2024-05-26T02:20:02.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:18:00+00:00, run_id=scheduled__2024-05-26T02:18:00+00:00, run_start_date=2024-05-26 02:20:00.942174+00:00, run_end_date=2024-05-26 02:20:02.663510+00:00, run_duration=1.721336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:18:00+00:00, data_interval_end=2024-05-26 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:20:02.674873399Z [2024-05-26T02:20:02.674+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:22:00+00:00 2024-05-26T02:20:02.682567823Z [2024-05-26T02:20:02.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:20:02.682760181Z [2024-05-26T02:20:02.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:19:00+00:00, run_id=scheduled__2024-05-26T02:19:00+00:00, run_start_date=2024-05-26 02:20:00.943355+00:00, run_end_date=2024-05-26 02:20:02.682455+00:00, run_duration=1.7391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:19:00+00:00, data_interval_end=2024-05-26 02:20:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:20:02.696487728Z [2024-05-26T02:20:02.696+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:21:00+00:00 2024-05-26T02:20:02.746926896Z [2024-05-26T02:20:02.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:18:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:02.746958546Z [2024-05-26T02:20:02.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:19:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:02.753243826Z [2024-05-26T02:20:02.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:18:00+00:00, map_index=-1, run_start_date=2024-05-26 02:20:01.976240+00:00, run_end_date=2024-05-26 02:20:02.365294+00:00, run_duration=0.389054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:01.056761+00:00, queued_by_job_id=1, pid=14170 2024-05-26T02:20:02.753371938Z [2024-05-26T02:20:02.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:19:00+00:00, map_index=-1, run_start_date=2024-05-26 02:20:02.206991+00:00, run_end_date=2024-05-26 02:20:02.559358+00:00, run_duration=0.352367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:01.056761+00:00, queued_by_job_id=1, pid=14171 2024-05-26T02:20:03.877782513Z [2024-05-26T02:20:03.877+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:20:03.877807824Z 2024-05-26T02:20:03.878097917Z [2024-05-26T02:20:03.877+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:20:03.878691982Z [2024-05-26T02:20:03.878+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:20:03.878702771Z 2024-05-26T02:20:03.883989595Z [2024-05-26T02:20:03.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:20:03.884399454Z [2024-05-26T02:20:03.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:20:04.008912786Z [2024-05-26T02:20:04.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:04.008998953Z [2024-05-26T02:20:04.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:04.020821040Z [2024-05-26T02:20:04.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to e995a982-c307-4c06-baee-229905d1d2d2 2024-05-26T02:20:04.020917443Z [2024-05-26T02:20:04.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:15:00+00:00, map_index=-1, run_start_date=2024-05-26 02:20:03.133231+00:00, run_end_date=2024-05-26 02:20:03.556596+00:00, run_duration=0.423365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:01.056761+00:00, queued_by_job_id=1, pid=14195 2024-05-26T02:20:05.986399262Z [2024-05-26T02:20:05.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:20:05.986741150Z [2024-05-26T02:20:05.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:19:00+00:00, run_id=scheduled__2024-05-26T02:19:00+00:00, run_start_date=2024-05-26 02:20:00.945748+00:00, run_end_date=2024-05-26 02:20:05.986253+00:00, run_duration=5.040505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:19:00+00:00, data_interval_end=2024-05-26 02:20:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:20:05.998475638Z [2024-05-26T02:20:05.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:21:00+00:00 2024-05-26T02:20:06.100391299Z [2024-05-26T02:20:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:19:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:06.120741980Z [2024-05-26T02:20:06.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:19:00+00:00, map_index=-1, run_start_date=2024-05-26 02:20:03.821989+00:00, run_end_date=2024-05-26 02:20:05.759183+00:00, run_duration=1.937194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:01.056761+00:00, queued_by_job_id=1, pid=14212 2024-05-26T02:20:07.183926922Z [2024-05-26T02:20:07.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:20:07.184291404Z [2024-05-26T02:20:07.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:19:00+00:00, run_id=scheduled__2024-05-26T02:19:00+00:00, run_start_date=2024-05-26 02:20:00.944596+00:00, run_end_date=2024-05-26 02:20:07.183902+00:00, run_duration=6.239306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:19:00+00:00, data_interval_end=2024-05-26 02:20:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:20:07.194185982Z [2024-05-26T02:20:07.193+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:21:00+00:00 2024-05-26T02:20:07.232013736Z [2024-05-26T02:20:07.231+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:20:07.232040548Z 2024-05-26T02:20:07.232452621Z [2024-05-26T02:20:07.232+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:20:07.233173543Z [2024-05-26T02:20:07.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:20:07.233190387Z 2024-05-26T02:20:07.236628933Z [2024-05-26T02:20:07.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:20:07.237053022Z [2024-05-26T02:20:07.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:20:07.298968717Z [2024-05-26T02:20:07.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:07.299239945Z [2024-05-26T02:20:07.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:19:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:07.299492962Z [2024-05-26T02:20:07.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:07.308745590Z [2024-05-26T02:20:07.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:15:00+00:00, map_index=-1, run_start_date=2024-05-26 02:20:05.931008+00:00, run_end_date=2024-05-26 02:20:06.380345+00:00, run_duration=0.449337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:03.879254+00:00, queued_by_job_id=1, pid=14225 2024-05-26T02:20:07.309212887Z [2024-05-26T02:20:07.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:19:00+00:00, map_index=-1, run_start_date=2024-05-26 02:20:03.203051+00:00, run_end_date=2024-05-26 02:20:05.998001+00:00, run_duration=2.79495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:01.056761+00:00, queued_by_job_id=1, pid=14196 2024-05-26T02:20:07.309496495Z [2024-05-26T02:20:07.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to b17752a6-8ed2-41d9-b744-9b1fd92f9b33 2024-05-26T02:20:11.141107363Z [2024-05-26T02:20:11.140+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:20:11.141158856Z 2024-05-26T02:20:11.141315636Z [2024-05-26T02:20:11.140+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:20:11.143169384Z [2024-05-26T02:20:11.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:20:11.143190273Z 2024-05-26T02:20:11.147184823Z [2024-05-26T02:20:11.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:20:11.147226061Z [2024-05-26T02:20:11.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:20:11.222057375Z [2024-05-26T02:20:11.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status queued for try_number 1 2024-05-26T02:20:11.222092545Z [2024-05-26T02:20:11.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:11.234776005Z [2024-05-26T02:20:11.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e107b94-b5ca-43a7-aafe-86fd6a3d61f2 2024-05-26T02:20:11.235095582Z [2024-05-26T02:20:11.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:15:00+00:00, map_index=0, run_start_date=2024-05-26 02:20:08.936733+00:00, run_end_date=2024-05-26 02:20:10.257704+00:00, run_duration=1.320971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:07.233751+00:00, queued_by_job_id=1, pid=14233 2024-05-26T02:20:13.509772422Z [2024-05-26T02:20:13.509+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:20:13.510144700Z [2024-05-26T02:20:13.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:15:00+00:00, run_id=scheduled__2024-05-26T02:15:00+00:00, run_start_date=2024-05-26 02:20:00.940788+00:00, run_end_date=2024-05-26 02:20:13.509574+00:00, run_duration=12.568786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:15:00+00:00, data_interval_end=2024-05-26 02:20:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:20:13.516634048Z [2024-05-26T02:20:13.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:20:00+00:00, run_after=2024-05-26T02:25:00+00:00 2024-05-26T02:20:13.558651452Z [2024-05-26T02:20:13.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:15:00+00:00 exited with status success for try_number 1 2024-05-26T02:20:13.567355471Z [2024-05-26T02:20:13.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:15:00+00:00, map_index=-1, run_start_date=2024-05-26 02:20:12.770276+00:00, run_end_date=2024-05-26 02:20:13.141526+00:00, run_duration=0.37125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:20:11.143859+00:00, queued_by_job_id=1, pid=14246 2024-05-26T02:21:00.497312013Z [2024-05-26T02:21:00.496+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:21:00.513737904Z [2024-05-26T02:21:00.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:21:00+00:00, run_after=2024-05-26T02:22:00+00:00 2024-05-26T02:21:00.529290074Z [2024-05-26T02:21:00.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:21:00+00:00, run_after=2024-05-26T02:22:00+00:00 2024-05-26T02:21:00.628731751Z [2024-05-26T02:21:00.628+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:21:00.628771253Z 2024-05-26T02:21:00.628780276Z 2024-05-26T02:21:00.628813717Z 2024-05-26T02:21:00.629326596Z [2024-05-26T02:21:00.628+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:21:00.629857221Z [2024-05-26T02:21:00.629+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:21:00.630397358Z [2024-05-26T02:21:00.630+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:21:00.631977327Z [2024-05-26T02:21:00.631+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:21:00.632002322Z 2024-05-26T02:21:00.632011865Z 2024-05-26T02:21:00.632020489Z 2024-05-26T02:21:00.639720628Z [2024-05-26T02:21:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:21:00.640323104Z [2024-05-26T02:21:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:21:00.641046095Z [2024-05-26T02:21:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:21:00.641633742Z [2024-05-26T02:21:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:21:00.642350893Z [2024-05-26T02:21:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:21:00.643093333Z [2024-05-26T02:21:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:21:00.880536752Z [2024-05-26T02:21:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:21:00.880747492Z [2024-05-26T02:21:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:21:00.880932609Z [2024-05-26T02:21:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:21:00.888557449Z [2024-05-26T02:21:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bdb5dab-9518-4a61-be36-3b95d5017790 2024-05-26T02:21:00.888771505Z [2024-05-26T02:21:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 465b4f44-1ee3-4bf7-a07e-917d858221bb 2024-05-26T02:21:00.888989221Z [2024-05-26T02:21:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00975678-5860-4cf4-b67a-0a53bdcbdded 2024-05-26T02:21:02.067281191Z [2024-05-26T02:21:02.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:21:02.069361215Z [2024-05-26T02:21:02.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:20:00+00:00, run_id=scheduled__2024-05-26T02:20:00+00:00, run_start_date=2024-05-26 02:21:00.546471+00:00, run_end_date=2024-05-26 02:21:02.067202+00:00, run_duration=1.520731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:20:00+00:00, data_interval_end=2024-05-26 02:21:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:21:02.079790390Z [2024-05-26T02:21:02.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:21:00+00:00, run_after=2024-05-26T02:22:00+00:00 2024-05-26T02:21:02.133479933Z [2024-05-26T02:21:02.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:21:02.144455556Z [2024-05-26T02:21:02.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=-1, run_start_date=2024-05-26 02:21:01.520211+00:00, run_end_date=2024-05-26 02:21:01.925491+00:00, run_duration=0.40528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:21:00.633817+00:00, queued_by_job_id=1, pid=14267 2024-05-26T02:21:04.339202065Z [2024-05-26T02:21:04.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:21:04.339228066Z [2024-05-26T02:21:04.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:20:00+00:00, run_id=scheduled__2024-05-26T02:20:00+00:00, run_start_date=2024-05-26 02:21:00.548311+00:00, run_end_date=2024-05-26 02:21:04.338259+00:00, run_duration=3.789948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:20:00+00:00, data_interval_end=2024-05-26 02:21:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:21:04.354449071Z [2024-05-26T02:21:04.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:21:00+00:00, run_after=2024-05-26T02:22:00+00:00 2024-05-26T02:21:04.457868829Z [2024-05-26T02:21:04.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:21:04.465588593Z [2024-05-26T02:21:04.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=-1, run_start_date=2024-05-26 02:21:02.291320+00:00, run_end_date=2024-05-26 02:21:03.615401+00:00, run_duration=1.324081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:21:00.633817+00:00, queued_by_job_id=1, pid=14285 2024-05-26T02:21:05.530631081Z [2024-05-26T02:21:05.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:21:05.531015372Z [2024-05-26T02:21:05.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:20:00+00:00, run_id=scheduled__2024-05-26T02:20:00+00:00, run_start_date=2024-05-26 02:21:00.549716+00:00, run_end_date=2024-05-26 02:21:05.530612+00:00, run_duration=4.980896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:20:00+00:00, data_interval_end=2024-05-26 02:21:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:21:05.544100369Z [2024-05-26T02:21:05.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:21:00+00:00, run_after=2024-05-26T02:22:00+00:00 2024-05-26T02:21:05.625861022Z [2024-05-26T02:21:05.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:21:05.633428410Z [2024-05-26T02:21:05.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=-1, run_start_date=2024-05-26 02:21:02.396379+00:00, run_end_date=2024-05-26 02:21:04.322476+00:00, run_duration=1.926097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:21:00.633817+00:00, queued_by_job_id=1, pid=14286 2024-05-26T02:22:00.997476898Z [2024-05-26T02:22:00.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:22:00+00:00, run_after=2024-05-26T02:23:00+00:00 2024-05-26T02:22:01.011410009Z [2024-05-26T02:22:01.010+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:22:01.021462408Z [2024-05-26T02:22:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:22:01.053200576Z [2024-05-26T02:22:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:22:00+00:00, run_after=2024-05-26T02:23:00+00:00 2024-05-26T02:22:01.205518018Z [2024-05-26T02:22:01.204+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:22:01.205561177Z 2024-05-26T02:22:01.205571466Z 2024-05-26T02:22:01.205580335Z 2024-05-26T02:22:01.205588908Z 2024-05-26T02:22:01.206089306Z [2024-05-26T02:22:01.205+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:22:01.206305616Z [2024-05-26T02:22:01.205+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:22:01.206597651Z [2024-05-26T02:22:01.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:22:01.206878821Z [2024-05-26T02:22:01.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:22:01.208381965Z [2024-05-26T02:22:01.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:22:01.208405459Z 2024-05-26T02:22:01.208414647Z 2024-05-26T02:22:01.208423352Z 2024-05-26T02:22:01.208431731Z 2024-05-26T02:22:01.216193465Z [2024-05-26T02:22:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:22:01.216498102Z [2024-05-26T02:22:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:22:01.217002238Z [2024-05-26T02:22:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:22:01.217105878Z [2024-05-26T02:22:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:22:01.217522819Z [2024-05-26T02:22:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:22:01.217798055Z [2024-05-26T02:22:01.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:22:01.218172346Z [2024-05-26T02:22:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:22:01.218412962Z [2024-05-26T02:22:01.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:22:01.529806412Z [2024-05-26T02:22:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:22:01.529859696Z [2024-05-26T02:22:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:21:00+00:00 exited with status queued for try_number 1 2024-05-26T02:22:01.531831694Z [2024-05-26T02:22:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:21:00+00:00 exited with status queued for try_number 1 2024-05-26T02:22:01.532049958Z [2024-05-26T02:22:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:21:00+00:00 exited with status queued for try_number 1 2024-05-26T02:22:01.556746321Z [2024-05-26T02:22:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dad967b-0504-47c7-af70-95e7614be10c 2024-05-26T02:22:01.557007559Z [2024-05-26T02:22:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to f394c1cc-9dd2-4c47-a259-b5836b57e652 2024-05-26T02:22:01.557177432Z [2024-05-26T02:22:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7be2ade7-a9ec-48a0-8023-fe76e63ff0bd 2024-05-26T02:22:01.557316951Z [2024-05-26T02:22:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 785d4276-1eca-41b4-9847-81e9b8c47a60 2024-05-26T02:22:02.913866570Z [2024-05-26T02:22:02.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:22:02.914283888Z [2024-05-26T02:22:02.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:20:00+00:00, run_id=scheduled__2024-05-26T02:20:00+00:00, run_start_date=2024-05-26 02:22:01.077713+00:00, run_end_date=2024-05-26 02:22:02.913808+00:00, run_duration=1.836095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:20:00+00:00, data_interval_end=2024-05-26 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:22:02.932867490Z [2024-05-26T02:22:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:22:00+00:00, run_after=2024-05-26T02:24:00+00:00 2024-05-26T02:22:02.945510030Z [2024-05-26T02:22:02.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:22:02.945869736Z [2024-05-26T02:22:02.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:21:00+00:00, run_id=scheduled__2024-05-26T02:21:00+00:00, run_start_date=2024-05-26 02:22:01.080879+00:00, run_end_date=2024-05-26 02:22:02.945452+00:00, run_duration=1.864573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:21:00+00:00, data_interval_end=2024-05-26 02:22:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:22:02.961102911Z [2024-05-26T02:22:02.960+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:22:00+00:00, run_after=2024-05-26T02:23:00+00:00 2024-05-26T02:22:03.006473634Z [2024-05-26T02:22:03.006+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:22:03.006504975Z 2024-05-26T02:22:03.006641064Z [2024-05-26T02:22:03.006+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-26T02:22:03.007226262Z [2024-05-26T02:22:03.007+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:22:03.007238327Z 2024-05-26T02:22:03.009547341Z [2024-05-26T02:22:03.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240526022201_019869', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:22:03.009739840Z [2024-05-26T02:22:03.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240526022201_019869', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-26T02:22:03.098016427Z [2024-05-26T02:22:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240526022201_019869 exited with status queued for try_number 1 2024-05-26T02:22:03.098058946Z [2024-05-26T02:22:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:22:03.098197928Z [2024-05-26T02:22:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:21:00+00:00 exited with status success for try_number 1 2024-05-26T02:22:03.107881410Z [2024-05-26T02:22:03.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b319f3d-276e-45cd-a380-44c3d5a0c001 2024-05-26T02:22:03.108195949Z [2024-05-26T02:22:03.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=-1, run_start_date=2024-05-26 02:22:02.185773+00:00, run_end_date=2024-05-26 02:22:02.499046+00:00, run_duration=0.313273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:22:01.210360+00:00, queued_by_job_id=1, pid=14320 2024-05-26T02:22:03.108523827Z [2024-05-26T02:22:03.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:21:00+00:00, map_index=-1, run_start_date=2024-05-26 02:22:02.115710+00:00, run_end_date=2024-05-26 02:22:02.535221+00:00, run_duration=0.419511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:22:01.210360+00:00, queued_by_job_id=1, pid=14319 2024-05-26T02:22:04.337857546Z [2024-05-26T02:22:04.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:22:04.338145484Z [2024-05-26T02:22:04.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-26 02:22:02.233301+00:00, run_id=scaleout_vdu_20240526022201_019869, run_start_date=2024-05-26 02:22:02.878551+00:00, run_end_date=2024-05-26 02:22:04.337821+00:00, run_duration=1.45927, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-26 02:22:02.233301+00:00, data_interval_end=2024-05-26 02:22:02.233301+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-26T02:22:04.342073709Z [2024-05-26T02:22:04.341+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-26T02:22:05.415676999Z [2024-05-26T02:22:05.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:22:05.415705947Z [2024-05-26T02:22:05.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:21:00+00:00, run_id=scheduled__2024-05-26T02:21:00+00:00, run_start_date=2024-05-26 02:22:01.083069+00:00, run_end_date=2024-05-26 02:22:05.414745+00:00, run_duration=4.331676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:21:00+00:00, data_interval_end=2024-05-26 02:22:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:22:05.429291374Z [2024-05-26T02:22:05.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:22:00+00:00, run_after=2024-05-26T02:23:00+00:00 2024-05-26T02:22:05.437786555Z [2024-05-26T02:22:05.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:22:05.439597875Z [2024-05-26T02:22:05.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:21:00+00:00, run_id=scheduled__2024-05-26T02:21:00+00:00, run_start_date=2024-05-26 02:22:01.087452+00:00, run_end_date=2024-05-26 02:22:05.437708+00:00, run_duration=4.350256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:21:00+00:00, data_interval_end=2024-05-26 02:22:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:22:05.453364222Z [2024-05-26T02:22:05.453+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:22:00+00:00, run_after=2024-05-26T02:23:00+00:00 2024-05-26T02:22:05.501546155Z [2024-05-26T02:22:05.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:21:00+00:00 exited with status success for try_number 1 2024-05-26T02:22:05.501590019Z [2024-05-26T02:22:05.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:21:00+00:00 exited with status success for try_number 1 2024-05-26T02:22:05.501594178Z [2024-05-26T02:22:05.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240526022201_019869 exited with status success for try_number 1 2024-05-26T02:22:05.509647742Z [2024-05-26T02:22:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240526022201_019869, map_index=-1, run_start_date=2024-05-26 02:22:03.744657+00:00, run_end_date=2024-05-26 02:22:04.220863+00:00, run_duration=0.476206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:22:03.007594+00:00, queued_by_job_id=1, pid=14356 2024-05-26T02:22:05.509673615Z [2024-05-26T02:22:05.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:21:00+00:00, map_index=-1, run_start_date=2024-05-26 02:22:03.096043+00:00, run_end_date=2024-05-26 02:22:04.570716+00:00, run_duration=1.474673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:22:01.210360+00:00, queued_by_job_id=1, pid=14344 2024-05-26T02:22:05.509677909Z [2024-05-26T02:22:05.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:21:00+00:00, map_index=-1, run_start_date=2024-05-26 02:22:03.105306+00:00, run_end_date=2024-05-26 02:22:05.068447+00:00, run_duration=1.963141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:22:01.210360+00:00, queued_by_job_id=1, pid=14345 2024-05-26T02:23:00.314380770Z [2024-05-26T02:23:00.314+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:23:00+00:00, run_after=2024-05-26T02:24:00+00:00 2024-05-26T02:23:00.326909989Z [2024-05-26T02:23:00.326+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:23:00.350067744Z [2024-05-26T02:23:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:23:00+00:00, run_after=2024-05-26T02:24:00+00:00 2024-05-26T02:23:00.445146947Z [2024-05-26T02:23:00.444+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:23:00.445280224Z 2024-05-26T02:23:00.445287776Z 2024-05-26T02:23:00.445313350Z 2024-05-26T02:23:00.445348179Z [2024-05-26T02:23:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:23:00.445464175Z [2024-05-26T02:23:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:23:00.445707521Z [2024-05-26T02:23:00.445+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:23:00.447134222Z [2024-05-26T02:23:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:23:00.447151098Z 2024-05-26T02:23:00.447157135Z 2024-05-26T02:23:00.447162967Z 2024-05-26T02:23:00.451898789Z [2024-05-26T02:23:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:23:00.452031281Z [2024-05-26T02:23:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:23:00.452511684Z [2024-05-26T02:23:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:23:00.452825569Z [2024-05-26T02:23:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:23:00.453069547Z [2024-05-26T02:23:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:23:00.453184818Z [2024-05-26T02:23:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:23:00.689823993Z [2024-05-26T02:23:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status queued for try_number 1 2024-05-26T02:23:00.689894266Z [2024-05-26T02:23:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status queued for try_number 1 2024-05-26T02:23:00.690039412Z [2024-05-26T02:23:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status queued for try_number 1 2024-05-26T02:23:00.697219134Z [2024-05-26T02:23:00.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82e5d9dc-26ae-4eb4-bb01-a9074d2386a4 2024-05-26T02:23:00.697376206Z [2024-05-26T02:23:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee07b60c-fb3e-4e5a-adcb-6dc74cafb82e 2024-05-26T02:23:00.697602578Z [2024-05-26T02:23:00.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f36f7e5-1565-4cfc-b348-b2739dd11ec5 2024-05-26T02:23:01.944664401Z [2024-05-26T02:23:01.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:23:01.949850809Z [2024-05-26T02:23:01.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:22:00+00:00, run_id=scheduled__2024-05-26T02:22:00+00:00, run_start_date=2024-05-26 02:23:00.367010+00:00, run_end_date=2024-05-26 02:23:01.944932+00:00, run_duration=1.577922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:22:00+00:00, data_interval_end=2024-05-26 02:23:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:23:01.966474760Z [2024-05-26T02:23:01.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:23:00+00:00, run_after=2024-05-26T02:24:00+00:00 2024-05-26T02:23:02.032322700Z [2024-05-26T02:23:02.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status success for try_number 1 2024-05-26T02:23:02.045860905Z [2024-05-26T02:23:02.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:22:00+00:00, map_index=-1, run_start_date=2024-05-26 02:23:01.234325+00:00, run_end_date=2024-05-26 02:23:01.631942+00:00, run_duration=0.397617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:23:00.448307+00:00, queued_by_job_id=1, pid=14383 2024-05-26T02:23:03.856648728Z [2024-05-26T02:23:03.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:23:03.856913418Z [2024-05-26T02:23:03.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:22:00+00:00, run_id=scheduled__2024-05-26T02:22:00+00:00, run_start_date=2024-05-26 02:23:00.368612+00:00, run_end_date=2024-05-26 02:23:03.856601+00:00, run_duration=3.487989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:22:00+00:00, data_interval_end=2024-05-26 02:23:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:23:03.865709040Z [2024-05-26T02:23:03.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:23:00+00:00, run_after=2024-05-26T02:24:00+00:00 2024-05-26T02:23:03.905683248Z [2024-05-26T02:23:03.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status success for try_number 1 2024-05-26T02:23:03.916847802Z [2024-05-26T02:23:03.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:22:00+00:00, map_index=-1, run_start_date=2024-05-26 02:23:02.197077+00:00, run_end_date=2024-05-26 02:23:03.489457+00:00, run_duration=1.29238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:23:00.448307+00:00, queued_by_job_id=1, pid=14401 2024-05-26T02:23:04.952920430Z [2024-05-26T02:23:04.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:23:04.953350551Z [2024-05-26T02:23:04.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:22:00+00:00, run_id=scheduled__2024-05-26T02:22:00+00:00, run_start_date=2024-05-26 02:23:00.370245+00:00, run_end_date=2024-05-26 02:23:04.953013+00:00, run_duration=4.582768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:22:00+00:00, data_interval_end=2024-05-26 02:23:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:23:04.967489272Z [2024-05-26T02:23:04.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:23:00+00:00, run_after=2024-05-26T02:24:00+00:00 2024-05-26T02:23:05.000238374Z [2024-05-26T02:23:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status success for try_number 1 2024-05-26T02:23:05.008023011Z [2024-05-26T02:23:05.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:22:00+00:00, map_index=-1, run_start_date=2024-05-26 02:23:02.272066+00:00, run_end_date=2024-05-26 02:23:03.919949+00:00, run_duration=1.647883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:23:00.448307+00:00, queued_by_job_id=1, pid=14402 2024-05-26T02:23:33.434673778Z [2024-05-26T02:23:33.434+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:24:00.899675914Z [2024-05-26T02:24:00.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:24:00+00:00, run_after=2024-05-26T02:25:00+00:00 2024-05-26T02:24:00.911744147Z [2024-05-26T02:24:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:24:00+00:00, run_after=2024-05-26T02:25:00+00:00 2024-05-26T02:24:00.918710720Z [2024-05-26T02:24:00.918+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:24:00.927561152Z [2024-05-26T02:24:00.927+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:24:01.056835117Z [2024-05-26T02:24:01.056+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:24:01.056872138Z 2024-05-26T02:24:01.056881441Z 2024-05-26T02:24:01.056888999Z 2024-05-26T02:24:01.056896513Z 2024-05-26T02:24:01.057021169Z [2024-05-26T02:24:01.056+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:24:01.057455177Z [2024-05-26T02:24:01.057+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:24:01.057744250Z [2024-05-26T02:24:01.057+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:24:01.058014681Z [2024-05-26T02:24:01.057+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:24:01.059293610Z [2024-05-26T02:24:01.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:24:01.059315134Z 2024-05-26T02:24:01.059325087Z 2024-05-26T02:24:01.059333450Z 2024-05-26T02:24:01.059342650Z 2024-05-26T02:24:01.063958798Z [2024-05-26T02:24:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:24:01.064202445Z [2024-05-26T02:24:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:24:01.064623828Z [2024-05-26T02:24:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:24:01.064803260Z [2024-05-26T02:24:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:24:01.065193374Z [2024-05-26T02:24:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:24:01.065384720Z [2024-05-26T02:24:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:24:01.065696694Z [2024-05-26T02:24:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:24:01.065888028Z [2024-05-26T02:24:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:24:01.601004654Z [2024-05-26T02:24:01.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status queued for try_number 1 2024-05-26T02:24:01.603373668Z [2024-05-26T02:24:01.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:23:00+00:00 exited with status queued for try_number 1 2024-05-26T02:24:01.603551070Z [2024-05-26T02:24:01.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:23:00+00:00 exited with status queued for try_number 1 2024-05-26T02:24:01.603626087Z [2024-05-26T02:24:01.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:23:00+00:00 exited with status queued for try_number 1 2024-05-26T02:24:01.629410487Z [2024-05-26T02:24:01.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82f8ac95-4407-45a3-9f4d-f7b01572761d 2024-05-26T02:24:01.636703710Z [2024-05-26T02:24:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b15ea71-1549-47ed-8934-2d990ad09709 2024-05-26T02:24:01.636956668Z [2024-05-26T02:24:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc21e98a-7e1c-4d64-8c0c-e6d981635f0d 2024-05-26T02:24:01.637236321Z [2024-05-26T02:24:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78b2c932-8aaa-4c01-959b-aa82cae6f80b 2024-05-26T02:24:03.041531819Z [2024-05-26T02:24:03.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:24:03.044040130Z [2024-05-26T02:24:03.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:22:00+00:00, run_id=scheduled__2024-05-26T02:22:00+00:00, run_start_date=2024-05-26 02:24:00.941955+00:00, run_end_date=2024-05-26 02:24:03.043470+00:00, run_duration=2.101515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:22:00+00:00, data_interval_end=2024-05-26 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:24:03.070225835Z [2024-05-26T02:24:03.065+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:24:00+00:00, run_after=2024-05-26T02:26:00+00:00 2024-05-26T02:24:03.089172948Z [2024-05-26T02:24:03.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:24:03.089778601Z [2024-05-26T02:24:03.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:23:00+00:00, run_id=scheduled__2024-05-26T02:23:00+00:00, run_start_date=2024-05-26 02:24:00.943616+00:00, run_end_date=2024-05-26 02:24:03.089437+00:00, run_duration=2.145821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:23:00+00:00, data_interval_end=2024-05-26 02:24:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:24:03.117967011Z [2024-05-26T02:24:03.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:24:00+00:00, run_after=2024-05-26T02:25:00+00:00 2024-05-26T02:24:03.928800161Z [2024-05-26T02:24:03.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:22:00+00:00 exited with status success for try_number 1 2024-05-26T02:24:03.928844364Z [2024-05-26T02:24:03.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:23:00+00:00 exited with status success for try_number 1 2024-05-26T02:24:03.953775753Z [2024-05-26T02:24:03.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:22:00+00:00, map_index=-1, run_start_date=2024-05-26 02:24:02.382862+00:00, run_end_date=2024-05-26 02:24:02.930132+00:00, run_duration=0.54727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:24:01.060805+00:00, queued_by_job_id=1, pid=14436 2024-05-26T02:24:03.953887777Z [2024-05-26T02:24:03.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:23:00+00:00, map_index=-1, run_start_date=2024-05-26 02:24:02.357681+00:00, run_end_date=2024-05-26 02:24:03.009126+00:00, run_duration=0.651445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:24:01.060805+00:00, queued_by_job_id=1, pid=14437 2024-05-26T02:24:07.427984949Z [2024-05-26T02:24:07.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:24:07.428334369Z [2024-05-26T02:24:07.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:23:00+00:00, run_id=scheduled__2024-05-26T02:23:00+00:00, run_start_date=2024-05-26 02:24:00.946610+00:00, run_end_date=2024-05-26 02:24:07.427958+00:00, run_duration=6.481348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:23:00+00:00, data_interval_end=2024-05-26 02:24:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:24:07.436908023Z [2024-05-26T02:24:07.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:24:00+00:00, run_after=2024-05-26T02:25:00+00:00 2024-05-26T02:24:07.442661527Z [2024-05-26T02:24:07.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:24:07.442834351Z [2024-05-26T02:24:07.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:23:00+00:00, run_id=scheduled__2024-05-26T02:23:00+00:00, run_start_date=2024-05-26 02:24:00.948092+00:00, run_end_date=2024-05-26 02:24:07.442393+00:00, run_duration=6.494301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:23:00+00:00, data_interval_end=2024-05-26 02:24:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:24:07.450913141Z [2024-05-26T02:24:07.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:24:00+00:00, run_after=2024-05-26T02:25:00+00:00 2024-05-26T02:24:07.476546145Z [2024-05-26T02:24:07.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:23:00+00:00 exited with status success for try_number 1 2024-05-26T02:24:07.481148064Z [2024-05-26T02:24:07.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:23:00+00:00, map_index=-1, run_start_date=2024-05-26 02:24:04.484965+00:00, run_end_date=2024-05-26 02:24:07.255548+00:00, run_duration=2.770583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:24:01.060805+00:00, queued_by_job_id=1, pid=14461 2024-05-26T02:24:08.579317559Z [2024-05-26T02:24:08.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:23:00+00:00 exited with status success for try_number 1 2024-05-26T02:24:08.589906820Z [2024-05-26T02:24:08.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:23:00+00:00, map_index=-1, run_start_date=2024-05-26 02:24:04.362231+00:00, run_end_date=2024-05-26 02:24:07.345478+00:00, run_duration=2.983247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:24:01.060805+00:00, queued_by_job_id=1, pid=14460 2024-05-26T02:25:00.934277314Z [2024-05-26T02:25:00.933+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:25:00.947234580Z [2024-05-26T02:25:00.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:25:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:25:00.959277225Z [2024-05-26T02:25:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:25:00+00:00, run_after=2024-05-26T02:26:00+00:00 2024-05-26T02:25:00.971057212Z [2024-05-26T02:25:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:25:00+00:00, run_after=2024-05-26T02:26:00+00:00 2024-05-26T02:25:01.088239345Z [2024-05-26T02:25:01.087+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:25:01.088279603Z 2024-05-26T02:25:01.088287471Z 2024-05-26T02:25:01.088293950Z 2024-05-26T02:25:01.088300710Z 2024-05-26T02:25:01.088582887Z [2024-05-26T02:25:01.088+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:25:01.089166890Z [2024-05-26T02:25:01.088+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:25:01.089193651Z [2024-05-26T02:25:01.088+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:25:01.089500970Z [2024-05-26T02:25:01.089+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:25:01.090790644Z [2024-05-26T02:25:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:25:01.090812755Z 2024-05-26T02:25:01.090820858Z 2024-05-26T02:25:01.090828597Z 2024-05-26T02:25:01.090835273Z 2024-05-26T02:25:01.097466455Z [2024-05-26T02:25:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:25:01.098201454Z [2024-05-26T02:25:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:25:01.098745260Z [2024-05-26T02:25:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:25:01.098827822Z [2024-05-26T02:25:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:25:01.099450480Z [2024-05-26T02:25:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:25:01.099487997Z [2024-05-26T02:25:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:25:01.099907266Z [2024-05-26T02:25:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:25:01.099953178Z [2024-05-26T02:25:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:25:01.457736145Z [2024-05-26T02:25:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:25:01.457882622Z [2024-05-26T02:25:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status queued for try_number 1 2024-05-26T02:25:01.458000189Z [2024-05-26T02:25:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status queued for try_number 1 2024-05-26T02:25:01.458115644Z [2024-05-26T02:25:01.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status queued for try_number 1 2024-05-26T02:25:01.467101591Z [2024-05-26T02:25:01.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6d0e3f4-fd16-43aa-9d7d-41aad16c9ebd 2024-05-26T02:25:01.467377224Z [2024-05-26T02:25:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to d642b57a-664b-4007-b918-e52c834caff0 2024-05-26T02:25:01.467554818Z [2024-05-26T02:25:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to a34cd524-bb4d-4c3a-b045-7b5ace7205e4 2024-05-26T02:25:01.467904682Z [2024-05-26T02:25:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to afbc1b4c-3532-4d82-8b9c-91be84d64f09 2024-05-26T02:25:03.357058507Z [2024-05-26T02:25:03.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:25:03.362740357Z [2024-05-26T02:25:03.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:24:00+00:00, run_id=scheduled__2024-05-26T02:24:00+00:00, run_start_date=2024-05-26 02:25:00.981867+00:00, run_end_date=2024-05-26 02:25:03.356968+00:00, run_duration=2.375101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:24:00+00:00, data_interval_end=2024-05-26 02:25:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:25:03.382279898Z [2024-05-26T02:25:03.381+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:25:00+00:00, run_after=2024-05-26T02:26:00+00:00 2024-05-26T02:25:03.537752411Z [2024-05-26T02:25:03.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status success for try_number 1 2024-05-26T02:25:03.554949612Z [2024-05-26T02:25:03.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:24:00+00:00, map_index=-1, run_start_date=2024-05-26 02:25:01.956042+00:00, run_end_date=2024-05-26 02:25:02.453178+00:00, run_duration=0.497136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:25:01.092638+00:00, queued_by_job_id=1, pid=14495 2024-05-26T02:25:04.629592250Z [2024-05-26T02:25:04.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:25:04.630112424Z [2024-05-26T02:25:04.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:24:00+00:00, run_id=scheduled__2024-05-26T02:24:00+00:00, run_start_date=2024-05-26 02:25:00.982844+00:00, run_end_date=2024-05-26 02:25:04.629533+00:00, run_duration=3.646689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:24:00+00:00, data_interval_end=2024-05-26 02:25:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:25:04.640853008Z [2024-05-26T02:25:04.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:25:00+00:00, run_after=2024-05-26T02:26:00+00:00 2024-05-26T02:25:04.670705363Z [2024-05-26T02:25:04.670+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:25:04.670738419Z 2024-05-26T02:25:04.671123640Z [2024-05-26T02:25:04.670+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:25:04.672137032Z [2024-05-26T02:25:04.671+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:25:04.672166206Z 2024-05-26T02:25:04.675057824Z [2024-05-26T02:25:04.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:25:04.675334687Z [2024-05-26T02:25:04.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:25:04.753693318Z [2024-05-26T02:25:04.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:25:04.753896759Z [2024-05-26T02:25:04.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:25:04.759764994Z [2024-05-26T02:25:04.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92450f41-d0b5-400b-9283-fe42b41dc823 2024-05-26T02:25:04.760232849Z [2024-05-26T02:25:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=-1, run_start_date=2024-05-26 02:25:03.100890+00:00, run_end_date=2024-05-26 02:25:03.778768+00:00, run_duration=0.677878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:25:01.092638+00:00, queued_by_job_id=1, pid=14519 2024-05-26T02:25:04.917170799Z [2024-05-26T02:25:04.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status success for try_number 1 2024-05-26T02:25:04.923967855Z [2024-05-26T02:25:04.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:24:00+00:00, map_index=-1, run_start_date=2024-05-26 02:25:03.183926+00:00, run_end_date=2024-05-26 02:25:04.589494+00:00, run_duration=1.405568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:25:01.092638+00:00, queued_by_job_id=1, pid=14520 2024-05-26T02:25:05.987508377Z [2024-05-26T02:25:05.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:25:05.988113602Z [2024-05-26T02:25:05.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:24:00+00:00, run_id=scheduled__2024-05-26T02:24:00+00:00, run_start_date=2024-05-26 02:25:00.983851+00:00, run_end_date=2024-05-26 02:25:05.987758+00:00, run_duration=5.003907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:24:00+00:00, data_interval_end=2024-05-26 02:25:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:25:05.997664113Z [2024-05-26T02:25:05.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:25:00+00:00, run_after=2024-05-26T02:26:00+00:00 2024-05-26T02:25:06.048586640Z [2024-05-26T02:25:06.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status success for try_number 1 2024-05-26T02:25:06.053915851Z [2024-05-26T02:25:06.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:24:00+00:00, map_index=-1, run_start_date=2024-05-26 02:25:03.283669+00:00, run_end_date=2024-05-26 02:25:05.570479+00:00, run_duration=2.28681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:25:01.092638+00:00, queued_by_job_id=1, pid=14521 2024-05-26T02:25:07.184703125Z [2024-05-26T02:25:07.183+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:25:07.184725724Z 2024-05-26T02:25:07.184729417Z [2024-05-26T02:25:07.184+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:25:07.185315513Z [2024-05-26T02:25:07.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:25:07.185361589Z 2024-05-26T02:25:07.190764005Z [2024-05-26T02:25:07.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:25:07.190821523Z [2024-05-26T02:25:07.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:25:07.272324580Z [2024-05-26T02:25:07.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:25:07.279929609Z [2024-05-26T02:25:07.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e99a318-1de1-435d-8f70-6f9657dad231 2024-05-26T02:25:07.420254604Z [2024-05-26T02:25:07.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:25:07.434041530Z [2024-05-26T02:25:07.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=-1, run_start_date=2024-05-26 02:25:06.680211+00:00, run_end_date=2024-05-26 02:25:07.028657+00:00, run_duration=0.348446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:25:04.672670+00:00, queued_by_job_id=1, pid=14544 2024-05-26T02:25:11.147824070Z [2024-05-26T02:25:11.147+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:25:11.147889376Z 2024-05-26T02:25:11.148017889Z [2024-05-26T02:25:11.147+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:25:11.148823312Z [2024-05-26T02:25:11.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:25:11.148843223Z 2024-05-26T02:25:11.151621166Z [2024-05-26T02:25:11.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:25:11.151838371Z [2024-05-26T02:25:11.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:25:11.213873157Z [2024-05-26T02:25:11.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status queued for try_number 1 2024-05-26T02:25:11.214156094Z [2024-05-26T02:25:11.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:25:11.220578019Z [2024-05-26T02:25:11.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50d2cd4b-0b81-481f-9292-3d9e2663534d 2024-05-26T02:25:11.220876944Z [2024-05-26T02:25:11.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=0, run_start_date=2024-05-26 02:25:08.969369+00:00, run_end_date=2024-05-26 02:25:10.612973+00:00, run_duration=1.643604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:25:07.185608+00:00, queued_by_job_id=1, pid=14552 2024-05-26T02:25:14.537756113Z [2024-05-26T02:25:14.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:25:14.537953111Z [2024-05-26T02:25:14.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:20:00+00:00, run_id=scheduled__2024-05-26T02:20:00+00:00, run_start_date=2024-05-26 02:25:00.980582+00:00, run_end_date=2024-05-26 02:25:14.537488+00:00, run_duration=13.556906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:20:00+00:00, data_interval_end=2024-05-26 02:25:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:25:14.543652346Z [2024-05-26T02:25:14.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:25:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:25:14.570579393Z [2024-05-26T02:25:14.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:20:00+00:00 exited with status success for try_number 1 2024-05-26T02:25:14.574950738Z [2024-05-26T02:25:14.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:20:00+00:00, map_index=-1, run_start_date=2024-05-26 02:25:12.938175+00:00, run_end_date=2024-05-26 02:25:13.407381+00:00, run_duration=0.469206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:25:11.149293+00:00, queued_by_job_id=1, pid=14565 2024-05-26T02:26:00.794069898Z [2024-05-26T02:26:00.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:26:00+00:00, run_after=2024-05-26T02:27:00+00:00 2024-05-26T02:26:00.808829518Z [2024-05-26T02:26:00.808+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:26:00+00:00, run_after=2024-05-26T02:27:00+00:00 2024-05-26T02:26:00.816559744Z [2024-05-26T02:26:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:26:00.823634561Z [2024-05-26T02:26:00.823+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:26:00.931005825Z [2024-05-26T02:26:00.930+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:26:00.931027276Z 2024-05-26T02:26:00.931031627Z 2024-05-26T02:26:00.931034830Z 2024-05-26T02:26:00.931037967Z 2024-05-26T02:26:00.931239590Z [2024-05-26T02:26:00.930+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:26:00.931490961Z [2024-05-26T02:26:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:26:00.931826222Z [2024-05-26T02:26:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:26:00.931836906Z [2024-05-26T02:26:00.931+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:26:00.932631126Z [2024-05-26T02:26:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:26:00.932642511Z 2024-05-26T02:26:00.932646348Z 2024-05-26T02:26:00.932678294Z 2024-05-26T02:26:00.932682009Z 2024-05-26T02:26:00.936734718Z [2024-05-26T02:26:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:26:00.936802859Z [2024-05-26T02:26:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:26:00.937137999Z [2024-05-26T02:26:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:26:00.937287463Z [2024-05-26T02:26:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:26:00.937568088Z [2024-05-26T02:26:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:26:00.937641492Z [2024-05-26T02:26:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:26:00.937872583Z [2024-05-26T02:26:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:26:00.937981512Z [2024-05-26T02:26:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:26:01.265574502Z [2024-05-26T02:26:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status queued for try_number 1 2024-05-26T02:26:01.265608073Z [2024-05-26T02:26:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status queued for try_number 1 2024-05-26T02:26:01.265660169Z [2024-05-26T02:26:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status queued for try_number 1 2024-05-26T02:26:01.265727672Z [2024-05-26T02:26:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status queued for try_number 1 2024-05-26T02:26:01.284861804Z [2024-05-26T02:26:01.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9d794d8-f8fd-49e7-9f9c-8bee3079e9ff 2024-05-26T02:26:01.284901440Z [2024-05-26T02:26:01.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11a3eac4-4cb3-4335-b0b0-28046d27a45f 2024-05-26T02:26:01.285018456Z [2024-05-26T02:26:01.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57354baa-1434-4250-bfa9-e4ccce50b797 2024-05-26T02:26:01.285093494Z [2024-05-26T02:26:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 405d96a5-dd8f-4344-a386-6badf3437999 2024-05-26T02:26:02.563812526Z [2024-05-26T02:26:02.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:26:02.564416308Z [2024-05-26T02:26:02.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:24:00+00:00, run_id=scheduled__2024-05-26T02:24:00+00:00, run_start_date=2024-05-26 02:26:00.834210+00:00, run_end_date=2024-05-26 02:26:02.563943+00:00, run_duration=1.729733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:24:00+00:00, data_interval_end=2024-05-26 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:26:02.574205566Z [2024-05-26T02:26:02.573+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:26:00+00:00, run_after=2024-05-26T02:28:00+00:00 2024-05-26T02:26:02.584699691Z [2024-05-26T02:26:02.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:26:02.584962246Z [2024-05-26T02:26:02.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:25:00+00:00, run_id=scheduled__2024-05-26T02:25:00+00:00, run_start_date=2024-05-26 02:26:00.836745+00:00, run_end_date=2024-05-26 02:26:02.584552+00:00, run_duration=1.747807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:25:00+00:00, data_interval_end=2024-05-26 02:26:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:26:02.596616115Z [2024-05-26T02:26:02.596+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:26:00+00:00, run_after=2024-05-26T02:27:00+00:00 2024-05-26T02:26:02.672288649Z [2024-05-26T02:26:02.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:24:00+00:00 exited with status success for try_number 1 2024-05-26T02:26:02.672601941Z [2024-05-26T02:26:02.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status success for try_number 1 2024-05-26T02:26:02.680646435Z [2024-05-26T02:26:02.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:25:00+00:00, map_index=-1, run_start_date=2024-05-26 02:26:01.859292+00:00, run_end_date=2024-05-26 02:26:02.262534+00:00, run_duration=0.403242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:26:00.933765+00:00, queued_by_job_id=1, pid=14588 2024-05-26T02:26:02.681025476Z [2024-05-26T02:26:02.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:24:00+00:00, map_index=-1, run_start_date=2024-05-26 02:26:01.970962+00:00, run_end_date=2024-05-26 02:26:02.348827+00:00, run_duration=0.377865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:26:00.933765+00:00, queued_by_job_id=1, pid=14589 2024-05-26T02:26:04.860644088Z [2024-05-26T02:26:04.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:26:04.861536300Z [2024-05-26T02:26:04.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:25:00+00:00, run_id=scheduled__2024-05-26T02:25:00+00:00, run_start_date=2024-05-26 02:26:00.838927+00:00, run_end_date=2024-05-26 02:26:04.859652+00:00, run_duration=4.020725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:25:00+00:00, data_interval_end=2024-05-26 02:26:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:26:04.876963058Z [2024-05-26T02:26:04.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:26:00+00:00, run_after=2024-05-26T02:27:00+00:00 2024-05-26T02:26:05.968765648Z [2024-05-26T02:26:05.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:26:05.969643306Z [2024-05-26T02:26:05.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:25:00+00:00, run_id=scheduled__2024-05-26T02:25:00+00:00, run_start_date=2024-05-26 02:26:00.841180+00:00, run_end_date=2024-05-26 02:26:05.968710+00:00, run_duration=5.12753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:25:00+00:00, data_interval_end=2024-05-26 02:26:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:26:05.978891655Z [2024-05-26T02:26:05.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:26:00+00:00, run_after=2024-05-26T02:27:00+00:00 2024-05-26T02:26:06.039112325Z [2024-05-26T02:26:06.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status success for try_number 1 2024-05-26T02:26:06.039135108Z [2024-05-26T02:26:06.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status success for try_number 1 2024-05-26T02:26:06.050479195Z [2024-05-26T02:26:06.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:25:00+00:00, map_index=-1, run_start_date=2024-05-26 02:26:03.062868+00:00, run_end_date=2024-05-26 02:26:04.793222+00:00, run_duration=1.730354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:26:00.933765+00:00, queued_by_job_id=1, pid=14613 2024-05-26T02:26:06.050540183Z [2024-05-26T02:26:06.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:25:00+00:00, map_index=-1, run_start_date=2024-05-26 02:26:02.923779+00:00, run_end_date=2024-05-26 02:26:05.129590+00:00, run_duration=2.205811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:26:00.933765+00:00, queued_by_job_id=1, pid=14612 2024-05-26T02:27:00.390299428Z [2024-05-26T02:27:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:27:00+00:00, run_after=2024-05-26T02:28:00+00:00 2024-05-26T02:27:00.400239405Z [2024-05-26T02:27:00.399+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:27:00.415536372Z [2024-05-26T02:27:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:27:00+00:00, run_after=2024-05-26T02:28:00+00:00 2024-05-26T02:27:00.479787208Z [2024-05-26T02:27:00.479+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:27:00.479818409Z 2024-05-26T02:27:00.479822883Z 2024-05-26T02:27:00.479827713Z 2024-05-26T02:27:00.480844576Z [2024-05-26T02:27:00.480+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:27:00.481034218Z [2024-05-26T02:27:00.480+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:27:00.481218882Z [2024-05-26T02:27:00.481+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:27:00.482317089Z [2024-05-26T02:27:00.482+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:27:00.482325746Z 2024-05-26T02:27:00.482330016Z 2024-05-26T02:27:00.482334928Z 2024-05-26T02:27:00.486846136Z [2024-05-26T02:27:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:27:00.487082235Z [2024-05-26T02:27:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:27:00.487562301Z [2024-05-26T02:27:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:27:00.487828687Z [2024-05-26T02:27:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:27:00.488253784Z [2024-05-26T02:27:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:27:00.488516877Z [2024-05-26T02:27:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:27:00.710096975Z [2024-05-26T02:27:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status queued for try_number 1 2024-05-26T02:27:00.710120710Z [2024-05-26T02:27:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status queued for try_number 1 2024-05-26T02:27:00.710124251Z [2024-05-26T02:27:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status queued for try_number 1 2024-05-26T02:27:00.732531326Z [2024-05-26T02:27:00.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b6683b2-6e56-4ace-a85b-11e79d785f21 2024-05-26T02:27:00.732551730Z [2024-05-26T02:27:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69bfed65-76da-41e2-bea4-bbb33730ad9e 2024-05-26T02:27:00.732555541Z [2024-05-26T02:27:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef0d99a2-c0dd-471e-98ca-c630c41ada3a 2024-05-26T02:27:01.923387806Z [2024-05-26T02:27:01.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:27:01.923765610Z [2024-05-26T02:27:01.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:26:00+00:00, run_id=scheduled__2024-05-26T02:26:00+00:00, run_start_date=2024-05-26 02:27:00.425196+00:00, run_end_date=2024-05-26 02:27:01.923388+00:00, run_duration=1.498192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:26:00+00:00, data_interval_end=2024-05-26 02:27:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:27:01.932842852Z [2024-05-26T02:27:01.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:27:00+00:00, run_after=2024-05-26T02:28:00+00:00 2024-05-26T02:27:01.984874601Z [2024-05-26T02:27:01.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status success for try_number 1 2024-05-26T02:27:01.992508026Z [2024-05-26T02:27:01.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:26:00+00:00, map_index=-1, run_start_date=2024-05-26 02:27:01.375353+00:00, run_end_date=2024-05-26 02:27:01.770734+00:00, run_duration=0.395381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:27:00.483426+00:00, queued_by_job_id=1, pid=14645 2024-05-26T02:27:04.203998037Z [2024-05-26T02:27:04.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:27:04.204754768Z [2024-05-26T02:27:04.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:26:00+00:00, run_id=scheduled__2024-05-26T02:26:00+00:00, run_start_date=2024-05-26 02:27:00.426450+00:00, run_end_date=2024-05-26 02:27:04.203904+00:00, run_duration=3.777454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:26:00+00:00, data_interval_end=2024-05-26 02:27:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:27:04.214555886Z [2024-05-26T02:27:04.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:27:00+00:00, run_after=2024-05-26T02:28:00+00:00 2024-05-26T02:27:04.221249158Z [2024-05-26T02:27:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:27:04.221569774Z [2024-05-26T02:27:04.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:26:00+00:00, run_id=scheduled__2024-05-26T02:26:00+00:00, run_start_date=2024-05-26 02:27:00.427625+00:00, run_end_date=2024-05-26 02:27:04.221139+00:00, run_duration=3.793514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:26:00+00:00, data_interval_end=2024-05-26 02:27:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:27:04.231380070Z [2024-05-26T02:27:04.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:27:00+00:00, run_after=2024-05-26T02:28:00+00:00 2024-05-26T02:27:04.295353334Z [2024-05-26T02:27:04.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status success for try_number 1 2024-05-26T02:27:04.295492284Z [2024-05-26T02:27:04.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status success for try_number 1 2024-05-26T02:27:04.302782011Z [2024-05-26T02:27:04.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:26:00+00:00, map_index=-1, run_start_date=2024-05-26 02:27:02.216534+00:00, run_end_date=2024-05-26 02:27:03.589618+00:00, run_duration=1.373084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:27:00.483426+00:00, queued_by_job_id=1, pid=14664 2024-05-26T02:27:04.303075754Z [2024-05-26T02:27:04.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:26:00+00:00, map_index=-1, run_start_date=2024-05-26 02:27:02.167261+00:00, run_end_date=2024-05-26 02:27:03.726567+00:00, run_duration=1.559306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:27:00.483426+00:00, queued_by_job_id=1, pid=14663 2024-05-26T02:28:00.228167231Z [2024-05-26T02:28:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:28:00+00:00, run_after=2024-05-26T02:29:00+00:00 2024-05-26T02:28:00.237301665Z [2024-05-26T02:28:00.237+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:28:00.247253505Z [2024-05-26T02:28:00.246+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:28:00.262330413Z [2024-05-26T02:28:00.262+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:28:00+00:00, run_after=2024-05-26T02:29:00+00:00 2024-05-26T02:28:00.371576214Z [2024-05-26T02:28:00.370+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:28:00.371606723Z 2024-05-26T02:28:00.371613239Z 2024-05-26T02:28:00.371618604Z 2024-05-26T02:28:00.371623717Z 2024-05-26T02:28:00.371629446Z [2024-05-26T02:28:00.371+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:28:00.371695116Z [2024-05-26T02:28:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:28:00.371814207Z [2024-05-26T02:28:00.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:28:00.371983747Z [2024-05-26T02:28:00.371+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:28:00.372684464Z [2024-05-26T02:28:00.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:28:00.372700023Z 2024-05-26T02:28:00.372705687Z 2024-05-26T02:28:00.372710639Z 2024-05-26T02:28:00.372718167Z 2024-05-26T02:28:00.377614878Z [2024-05-26T02:28:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:28:00.377656963Z [2024-05-26T02:28:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:28:00.377964658Z [2024-05-26T02:28:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:28:00.378074489Z [2024-05-26T02:28:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:28:00.378286611Z [2024-05-26T02:28:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:28:00.378351674Z [2024-05-26T02:28:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:28:00.378564983Z [2024-05-26T02:28:00.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:28:00.378652957Z [2024-05-26T02:28:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:28:00.614338126Z [2024-05-26T02:28:00.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status queued for try_number 1 2024-05-26T02:28:00.614391348Z [2024-05-26T02:28:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:27:00+00:00 exited with status queued for try_number 1 2024-05-26T02:28:00.614512212Z [2024-05-26T02:28:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:27:00+00:00 exited with status queued for try_number 1 2024-05-26T02:28:00.614666987Z [2024-05-26T02:28:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:27:00+00:00 exited with status queued for try_number 1 2024-05-26T02:28:00.622745597Z [2024-05-26T02:28:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d59e44a-cf47-4e29-a5d1-a2815c439f49 2024-05-26T02:28:00.622774471Z [2024-05-26T02:28:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27282937-8913-4e00-8166-3f7cbfa3503e 2024-05-26T02:28:00.622950817Z [2024-05-26T02:28:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f06ef3a-f7f6-4185-b0b1-8fabe540f8cb 2024-05-26T02:28:00.623082735Z [2024-05-26T02:28:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0f72c99-3468-4f57-aff1-80023f5ba027 2024-05-26T02:28:01.835756139Z [2024-05-26T02:28:01.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:28:01.835780704Z [2024-05-26T02:28:01.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:26:00+00:00, run_id=scheduled__2024-05-26T02:26:00+00:00, run_start_date=2024-05-26 02:28:00.275840+00:00, run_end_date=2024-05-26 02:28:01.832878+00:00, run_duration=1.557038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:26:00+00:00, data_interval_end=2024-05-26 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:28:01.845869073Z [2024-05-26T02:28:01.845+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:28:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:28:01.860015134Z [2024-05-26T02:28:01.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:28:01.860157142Z [2024-05-26T02:28:01.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:27:00+00:00, run_id=scheduled__2024-05-26T02:27:00+00:00, run_start_date=2024-05-26 02:28:00.278713+00:00, run_end_date=2024-05-26 02:28:01.859937+00:00, run_duration=1.581224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:27:00+00:00, data_interval_end=2024-05-26 02:28:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:28:01.869128356Z [2024-05-26T02:28:01.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:28:00+00:00, run_after=2024-05-26T02:29:00+00:00 2024-05-26T02:28:01.915508272Z [2024-05-26T02:28:01.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:26:00+00:00 exited with status success for try_number 1 2024-05-26T02:28:01.915563150Z [2024-05-26T02:28:01.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:27:00+00:00 exited with status success for try_number 1 2024-05-26T02:28:01.924759671Z [2024-05-26T02:28:01.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:26:00+00:00, map_index=-1, run_start_date=2024-05-26 02:28:01.093580+00:00, run_end_date=2024-05-26 02:28:01.439359+00:00, run_duration=0.345779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:28:00.373756+00:00, queued_by_job_id=1, pid=14697 2024-05-26T02:28:01.924846434Z [2024-05-26T02:28:01.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:27:00+00:00, map_index=-1, run_start_date=2024-05-26 02:28:01.308647+00:00, run_end_date=2024-05-26 02:28:01.669819+00:00, run_duration=0.361172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:28:00.373756+00:00, queued_by_job_id=1, pid=14698 2024-05-26T02:28:03.023932697Z [2024-05-26T02:28:03.023+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:28:03.024053494Z 2024-05-26T02:28:03.024323014Z [2024-05-26T02:28:03.024+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-26T02:28:03.025287617Z [2024-05-26T02:28:03.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:28:03.025306213Z 2024-05-26T02:28:03.030321796Z [2024-05-26T02:28:03.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240526022801_284434', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:28:03.030611246Z [2024-05-26T02:28:03.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240526022801_284434', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-26T02:28:03.097997591Z [2024-05-26T02:28:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240526022801_284434 exited with status queued for try_number 1 2024-05-26T02:28:03.104201825Z [2024-05-26T02:28:03.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ddeddd1-66dd-4fc6-8697-0f6887b55383 2024-05-26T02:28:03.523724264Z [2024-05-26T02:28:03.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:28:03.524084916Z [2024-05-26T02:28:03.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:27:00+00:00, run_id=scheduled__2024-05-26T02:27:00+00:00, run_start_date=2024-05-26 02:28:00.280278+00:00, run_end_date=2024-05-26 02:28:03.523612+00:00, run_duration=3.243334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:27:00+00:00, data_interval_end=2024-05-26 02:28:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:28:03.532112333Z [2024-05-26T02:28:03.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:28:00+00:00, run_after=2024-05-26T02:29:00+00:00 2024-05-26T02:28:04.674358310Z [2024-05-26T02:28:04.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:28:04.674791862Z [2024-05-26T02:28:04.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:27:00+00:00, run_id=scheduled__2024-05-26T02:27:00+00:00, run_start_date=2024-05-26 02:28:00.281691+00:00, run_end_date=2024-05-26 02:28:04.674269+00:00, run_duration=4.392578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:27:00+00:00, data_interval_end=2024-05-26 02:28:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:28:04.683847861Z [2024-05-26T02:28:04.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:28:00+00:00, run_after=2024-05-26T02:29:00+00:00 2024-05-26T02:28:04.690524900Z [2024-05-26T02:28:04.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:28:04.690819564Z [2024-05-26T02:28:04.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-26 02:28:02.176298+00:00, run_id=scaleout_vdu_20240526022801_284434, run_start_date=2024-05-26 02:28:02.975393+00:00, run_end_date=2024-05-26 02:28:04.690435+00:00, run_duration=1.715042, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-26 02:28:02.176298+00:00, data_interval_end=2024-05-26 02:28:02.176298+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-26T02:28:04.704545243Z [2024-05-26T02:28:04.704+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-26T02:28:04.735825194Z [2024-05-26T02:28:04.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:27:00+00:00 exited with status success for try_number 1 2024-05-26T02:28:04.735985335Z [2024-05-26T02:28:04.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:27:00+00:00 exited with status success for try_number 1 2024-05-26T02:28:04.736139689Z [2024-05-26T02:28:04.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240526022801_284434 exited with status success for try_number 1 2024-05-26T02:28:04.742360431Z [2024-05-26T02:28:04.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:27:00+00:00, map_index=-1, run_start_date=2024-05-26 02:28:02.236104+00:00, run_end_date=2024-05-26 02:28:03.466868+00:00, run_duration=1.230764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:28:00.373756+00:00, queued_by_job_id=1, pid=14721 2024-05-26T02:28:04.742716602Z [2024-05-26T02:28:04.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:27:00+00:00, map_index=-1, run_start_date=2024-05-26 02:28:02.328585+00:00, run_end_date=2024-05-26 02:28:03.882247+00:00, run_duration=1.553662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:28:00.373756+00:00, queued_by_job_id=1, pid=14722 2024-05-26T02:28:04.743045140Z [2024-05-26T02:28:04.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240526022801_284434, map_index=-1, run_start_date=2024-05-26 02:28:03.848759+00:00, run_end_date=2024-05-26 02:28:04.341043+00:00, run_duration=0.492284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:28:03.025854+00:00, queued_by_job_id=1, pid=14734 2024-05-26T02:28:33.524497395Z [2024-05-26T02:28:33.523+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:29:00.122011541Z [2024-05-26T02:29:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:29:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:29:00.129133253Z [2024-05-26T02:29:00.128+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:29:00.141110372Z [2024-05-26T02:29:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:29:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:29:00.233953061Z [2024-05-26T02:29:00.233+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:29:00.233983878Z 2024-05-26T02:29:00.233988130Z 2024-05-26T02:29:00.233991439Z 2024-05-26T02:29:00.234074333Z [2024-05-26T02:29:00.233+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:29:00.234084159Z [2024-05-26T02:29:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:29:00.234223676Z [2024-05-26T02:29:00.234+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:29:00.235156095Z [2024-05-26T02:29:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:29:00.235172416Z 2024-05-26T02:29:00.235179847Z 2024-05-26T02:29:00.235206077Z 2024-05-26T02:29:00.240264494Z [2024-05-26T02:29:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:29:00.240373845Z [2024-05-26T02:29:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:29:00.240656020Z [2024-05-26T02:29:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:29:00.240781160Z [2024-05-26T02:29:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:29:00.240989817Z [2024-05-26T02:29:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:29:00.241110485Z [2024-05-26T02:29:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:29:00.456285161Z [2024-05-26T02:29:00.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status queued for try_number 1 2024-05-26T02:29:00.456323198Z [2024-05-26T02:29:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status queued for try_number 1 2024-05-26T02:29:00.456502079Z [2024-05-26T02:29:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status queued for try_number 1 2024-05-26T02:29:00.470053754Z [2024-05-26T02:29:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8affa407-983f-4f0f-aeae-6df0f2bb41e0 2024-05-26T02:29:00.470707748Z [2024-05-26T02:29:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to be22daa7-aab5-44e5-b325-606e7092d2f0 2024-05-26T02:29:00.470915529Z [2024-05-26T02:29:00.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to c98e19ab-dd9e-429a-97d2-6b0f4ee3a44c 2024-05-26T02:29:01.609040402Z [2024-05-26T02:29:01.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:29:01.610579616Z [2024-05-26T02:29:01.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:28:00+00:00, run_id=scheduled__2024-05-26T02:28:00+00:00, run_start_date=2024-05-26 02:29:00.155221+00:00, run_end_date=2024-05-26 02:29:01.610183+00:00, run_duration=1.454962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:28:00+00:00, data_interval_end=2024-05-26 02:29:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:29:01.619716166Z [2024-05-26T02:29:01.619+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:29:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:29:01.671292518Z [2024-05-26T02:29:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status success for try_number 1 2024-05-26T02:29:01.681178312Z [2024-05-26T02:29:01.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:28:00+00:00, map_index=-1, run_start_date=2024-05-26 02:29:01.074803+00:00, run_end_date=2024-05-26 02:29:01.459340+00:00, run_duration=0.384537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:29:00.236407+00:00, queued_by_job_id=1, pid=14761 2024-05-26T02:29:03.856459545Z [2024-05-26T02:29:03.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:29:03.856718370Z [2024-05-26T02:29:03.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:28:00+00:00, run_id=scheduled__2024-05-26T02:28:00+00:00, run_start_date=2024-05-26 02:29:00.158077+00:00, run_end_date=2024-05-26 02:29:03.856093+00:00, run_duration=3.698016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:28:00+00:00, data_interval_end=2024-05-26 02:29:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:29:03.870731782Z [2024-05-26T02:29:03.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:29:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:29:03.879645024Z [2024-05-26T02:29:03.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:29:03.879952521Z [2024-05-26T02:29:03.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:28:00+00:00, run_id=scheduled__2024-05-26T02:28:00+00:00, run_start_date=2024-05-26 02:29:00.160694+00:00, run_end_date=2024-05-26 02:29:03.879429+00:00, run_duration=3.718735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:28:00+00:00, data_interval_end=2024-05-26 02:29:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:29:03.893448215Z [2024-05-26T02:29:03.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:29:00+00:00, run_after=2024-05-26T02:30:00+00:00 2024-05-26T02:29:03.935251895Z [2024-05-26T02:29:03.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status success for try_number 1 2024-05-26T02:29:03.935655239Z [2024-05-26T02:29:03.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status success for try_number 1 2024-05-26T02:29:03.944888057Z [2024-05-26T02:29:03.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:28:00+00:00, map_index=-1, run_start_date=2024-05-26 02:29:01.946022+00:00, run_end_date=2024-05-26 02:29:03.243892+00:00, run_duration=1.29787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:29:00.236407+00:00, queued_by_job_id=1, pid=14779 2024-05-26T02:29:03.945574431Z [2024-05-26T02:29:03.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:28:00+00:00, map_index=-1, run_start_date=2024-05-26 02:29:01.975837+00:00, run_end_date=2024-05-26 02:29:03.614303+00:00, run_duration=1.638466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:29:00.236407+00:00, queued_by_job_id=1, pid=14780 2024-05-26T02:30:00.056312193Z [2024-05-26T02:30:00.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:35:00+00:00 2024-05-26T02:30:00.064419721Z [2024-05-26T02:30:00.064+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:30:00.072098440Z [2024-05-26T02:30:00.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:30:00.085853862Z [2024-05-26T02:30:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:31:00+00:00 2024-05-26T02:30:00.098757164Z [2024-05-26T02:30:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:31:00+00:00 2024-05-26T02:30:00.206164866Z [2024-05-26T02:30:00.205+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T02:30:00.206198687Z 2024-05-26T02:30:00.206203865Z 2024-05-26T02:30:00.206213738Z 2024-05-26T02:30:00.206217923Z 2024-05-26T02:30:00.206221995Z 2024-05-26T02:30:00.206599740Z [2024-05-26T02:30:00.206+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:30:00.207008891Z [2024-05-26T02:30:00.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:30:00.207352188Z [2024-05-26T02:30:00.207+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:30:00.208646021Z [2024-05-26T02:30:00.207+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:30:00.209810424Z [2024-05-26T02:30:00.209+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:30:00.212214550Z [2024-05-26T02:30:00.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:30:00.212235999Z 2024-05-26T02:30:00.212243288Z 2024-05-26T02:30:00.212249663Z 2024-05-26T02:30:00.212255468Z 2024-05-26T02:30:00.212261385Z 2024-05-26T02:30:00.219196650Z [2024-05-26T02:30:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:30:00.219568109Z [2024-05-26T02:30:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:30:00.219967147Z [2024-05-26T02:30:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:30:00.220257181Z [2024-05-26T02:30:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:30:00.220606038Z [2024-05-26T02:30:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:30:00.220857301Z [2024-05-26T02:30:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:30:00.221183517Z [2024-05-26T02:30:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:30:00.221435538Z [2024-05-26T02:30:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:30:00.221789375Z [2024-05-26T02:30:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:30:00.222070987Z [2024-05-26T02:30:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:30:00.865416492Z [2024-05-26T02:30:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:00.865442390Z [2024-05-26T02:30:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:00.865527321Z [2024-05-26T02:30:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:29:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:00.865561887Z [2024-05-26T02:30:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:29:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:00.865647450Z [2024-05-26T02:30:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:29:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:00.876914107Z [2024-05-26T02:30:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 003c74f3-f9c4-4854-840e-23c8999cc825 2024-05-26T02:30:00.876980631Z [2024-05-26T02:30:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7a11c77-329f-4421-b1a0-2a2a80ef9ce7 2024-05-26T02:30:00.877098770Z [2024-05-26T02:30:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9992980-1a6a-4215-9167-4d9927b29fec 2024-05-26T02:30:00.877174918Z [2024-05-26T02:30:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to daaaae9e-2873-4437-b35a-7d8981aaf344 2024-05-26T02:30:00.877280469Z [2024-05-26T02:30:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to f55fe186-658f-4049-adbb-67d46471a9cd 2024-05-26T02:30:02.116408330Z [2024-05-26T02:30:02.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:30:02.116917375Z [2024-05-26T02:30:02.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:29:00+00:00, run_id=scheduled__2024-05-26T02:29:00+00:00, run_start_date=2024-05-26 02:30:00.114138+00:00, run_end_date=2024-05-26 02:30:02.116473+00:00, run_duration=2.002335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:29:00+00:00, data_interval_end=2024-05-26 02:30:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:30:02.125812374Z [2024-05-26T02:30:02.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:31:00+00:00 2024-05-26T02:30:02.149174700Z [2024-05-26T02:30:02.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:30:02.149593404Z [2024-05-26T02:30:02.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:28:00+00:00, run_id=scheduled__2024-05-26T02:28:00+00:00, run_start_date=2024-05-26 02:30:00.113059+00:00, run_end_date=2024-05-26 02:30:02.149296+00:00, run_duration=2.036237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:28:00+00:00, data_interval_end=2024-05-26 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:30:02.171640898Z [2024-05-26T02:30:02.170+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:32:00+00:00 2024-05-26T02:30:02.268778727Z [2024-05-26T02:30:02.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:28:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:02.269116712Z [2024-05-26T02:30:02.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:29:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:02.277188480Z [2024-05-26T02:30:02.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:28:00+00:00, map_index=-1, run_start_date=2024-05-26 02:30:01.397415+00:00, run_end_date=2024-05-26 02:30:01.829407+00:00, run_duration=0.431992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:00.214355+00:00, queued_by_job_id=1, pid=14815 2024-05-26T02:30:02.279928643Z [2024-05-26T02:30:02.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:29:00+00:00, map_index=-1, run_start_date=2024-05-26 02:30:01.157322+00:00, run_end_date=2024-05-26 02:30:01.640624+00:00, run_duration=0.483302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:00.214355+00:00, queued_by_job_id=1, pid=14814 2024-05-26T02:30:03.419654952Z [2024-05-26T02:30:03.415+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-05-26T02:30:03.419689652Z 2024-05-26T02:30:03.419693272Z 2024-05-26T02:30:03.419697589Z [2024-05-26T02:30:03.415+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:30:03.419702244Z [2024-05-26T02:30:03.416+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-05-26T02:30:03.419705272Z [2024-05-26T02:30:03.416+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:30:03.419708467Z 2024-05-26T02:30:03.419711552Z 2024-05-26T02:30:03.420808844Z [2024-05-26T02:30:03.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:30:03.420823072Z [2024-05-26T02:30:03.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:30:03.420827991Z [2024-05-26T02:30:03.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240526023001_586149', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:30:03.420832974Z [2024-05-26T02:30:03.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240526023001_586149', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-26T02:30:03.623828643Z [2024-05-26T02:30:03.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:03.623908165Z [2024-05-26T02:30:03.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240526023001_586149 exited with status queued for try_number 1 2024-05-26T02:30:03.624056901Z [2024-05-26T02:30:03.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:03.631213505Z [2024-05-26T02:30:03.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:25:00+00:00, map_index=-1, run_start_date=2024-05-26 02:30:02.436365+00:00, run_end_date=2024-05-26 02:30:02.862672+00:00, run_duration=0.426307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:00.214355+00:00, queued_by_job_id=1, pid=14841 2024-05-26T02:30:03.631479419Z [2024-05-26T02:30:03.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1656f2e-bef2-4c6a-b875-ad833aceec7a 2024-05-26T02:30:03.631698113Z [2024-05-26T02:30:03.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8c1f327-5d6c-4793-b526-c748d852e25e 2024-05-26T02:30:04.583165585Z [2024-05-26T02:30:04.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:30:04.583622526Z [2024-05-26T02:30:04.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:29:00+00:00, run_id=scheduled__2024-05-26T02:29:00+00:00, run_start_date=2024-05-26 02:30:00.115258+00:00, run_end_date=2024-05-26 02:30:04.583253+00:00, run_duration=4.467995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:29:00+00:00, data_interval_end=2024-05-26 02:30:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:30:04.595627724Z [2024-05-26T02:30:04.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:31:00+00:00 2024-05-26T02:30:04.604895232Z [2024-05-26T02:30:04.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:30:04.604921153Z [2024-05-26T02:30:04.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:29:00+00:00, run_id=scheduled__2024-05-26T02:29:00+00:00, run_start_date=2024-05-26 02:30:00.116420+00:00, run_end_date=2024-05-26 02:30:04.603678+00:00, run_duration=4.487258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:29:00+00:00, data_interval_end=2024-05-26 02:30:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:30:04.625512672Z [2024-05-26T02:30:04.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:31:00+00:00 2024-05-26T02:30:04.743329596Z [2024-05-26T02:30:04.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:29:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:04.751294427Z [2024-05-26T02:30:04.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:29:00+00:00, map_index=-1, run_start_date=2024-05-26 02:30:02.548811+00:00, run_end_date=2024-05-26 02:30:03.842409+00:00, run_duration=1.293598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:00.214355+00:00, queued_by_job_id=1, pid=14845 2024-05-26T02:30:05.815051428Z [2024-05-26T02:30:05.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:30:05.815336065Z [2024-05-26T02:30:05.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-05-26 02:30:02.220264+00:00, run_id=scaleout_vdu_20240526023001_586149, run_start_date=2024-05-26 02:30:03.316919+00:00, run_end_date=2024-05-26 02:30:05.814948+00:00, run_duration=2.498029, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-26 02:30:02.220264+00:00, data_interval_end=2024-05-26 02:30:02.220264+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-05-26T02:30:05.818697948Z [2024-05-26T02:30:05.818+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-05-26T02:30:05.867943225Z [2024-05-26T02:30:05.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:29:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:05.868171618Z [2024-05-26T02:30:05.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240526023001_586149 exited with status success for try_number 1 2024-05-26T02:30:05.884899475Z [2024-05-26T02:30:05.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240526023001_586149, map_index=-1, run_start_date=2024-05-26 02:30:04.364399+00:00, run_end_date=2024-05-26 02:30:04.962596+00:00, run_duration=0.598197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:03.417237+00:00, queued_by_job_id=1, pid=14864 2024-05-26T02:30:05.885354611Z [2024-05-26T02:30:05.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:29:00+00:00, map_index=-1, run_start_date=2024-05-26 02:30:02.690602+00:00, run_end_date=2024-05-26 02:30:04.417416+00:00, run_duration=1.726814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:00.214355+00:00, queued_by_job_id=1, pid=14846 2024-05-26T02:30:07.122443752Z [2024-05-26T02:30:07.121+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:30:07.122520541Z 2024-05-26T02:30:07.122875183Z [2024-05-26T02:30:07.122+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:30:07.124320746Z [2024-05-26T02:30:07.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:30:07.124376890Z 2024-05-26T02:30:07.129228752Z [2024-05-26T02:30:07.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:30:07.129631884Z [2024-05-26T02:30:07.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:30:07.181569628Z [2024-05-26T02:30:07.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:07.181756322Z [2024-05-26T02:30:07.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:07.194400297Z [2024-05-26T02:30:07.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05ad07bf-8d81-4e9b-8da1-98adbd151cfb 2024-05-26T02:30:07.195832269Z [2024-05-26T02:30:07.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:25:00+00:00, map_index=-1, run_start_date=2024-05-26 02:30:05.821022+00:00, run_end_date=2024-05-26 02:30:06.232680+00:00, run_duration=0.411658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:03.417237+00:00, queued_by_job_id=1, pid=14876 2024-05-26T02:30:10.447876887Z [2024-05-26T02:30:10.447+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:30:10.447925007Z 2024-05-26T02:30:10.448440815Z [2024-05-26T02:30:10.448+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:30:10.449740534Z [2024-05-26T02:30:10.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:30:10.449758500Z 2024-05-26T02:30:10.454653332Z [2024-05-26T02:30:10.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:30:10.455160416Z [2024-05-26T02:30:10.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:30:10.524960013Z [2024-05-26T02:30:10.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status queued for try_number 1 2024-05-26T02:30:10.525198701Z [2024-05-26T02:30:10.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:10.535661212Z [2024-05-26T02:30:10.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to e72de2f2-1f3d-489c-b4b8-4ac64cb53303 2024-05-26T02:30:10.536135028Z [2024-05-26T02:30:10.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:25:00+00:00, map_index=0, run_start_date=2024-05-26 02:30:08.725167+00:00, run_end_date=2024-05-26 02:30:09.944807+00:00, run_duration=1.21964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:07.125194+00:00, queued_by_job_id=1, pid=14884 2024-05-26T02:30:13.269304978Z [2024-05-26T02:30:13.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:30:13.270819276Z [2024-05-26T02:30:13.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:25:00+00:00, run_id=scheduled__2024-05-26T02:25:00+00:00, run_start_date=2024-05-26 02:30:00.111783+00:00, run_end_date=2024-05-26 02:30:13.269162+00:00, run_duration=13.157379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:25:00+00:00, data_interval_end=2024-05-26 02:30:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:30:13.281302796Z [2024-05-26T02:30:13.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:30:00+00:00, run_after=2024-05-26T02:35:00+00:00 2024-05-26T02:30:13.325951148Z [2024-05-26T02:30:13.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:25:00+00:00 exited with status success for try_number 1 2024-05-26T02:30:13.332765118Z [2024-05-26T02:30:13.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:25:00+00:00, map_index=-1, run_start_date=2024-05-26 02:30:12.050064+00:00, run_end_date=2024-05-26 02:30:12.430212+00:00, run_duration=0.380148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:30:10.450577+00:00, queued_by_job_id=1, pid=14897 2024-05-26T02:31:01.037553347Z [2024-05-26T02:31:01.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:31:00+00:00, run_after=2024-05-26T02:32:00+00:00 2024-05-26T02:31:01.053475678Z [2024-05-26T02:31:01.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:31:00+00:00, run_after=2024-05-26T02:32:00+00:00 2024-05-26T02:31:01.060502848Z [2024-05-26T02:31:01.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:31:01.142942081Z [2024-05-26T02:31:01.142+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:31:01.142986914Z 2024-05-26T02:31:01.142995245Z 2024-05-26T02:31:01.143002670Z 2024-05-26T02:31:01.143466239Z [2024-05-26T02:31:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:31:01.144033684Z [2024-05-26T02:31:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:31:01.144514484Z [2024-05-26T02:31:01.144+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:31:01.146654699Z [2024-05-26T02:31:01.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:31:01.146672536Z 2024-05-26T02:31:01.146678499Z 2024-05-26T02:31:01.146683271Z 2024-05-26T02:31:01.153411148Z [2024-05-26T02:31:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:31:01.153933610Z [2024-05-26T02:31:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:31:01.154817919Z [2024-05-26T02:31:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:31:01.155171192Z [2024-05-26T02:31:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:31:01.155576572Z [2024-05-26T02:31:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:31:01.155840733Z [2024-05-26T02:31:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:31:01.454124800Z [2024-05-26T02:31:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:31:01.454514643Z [2024-05-26T02:31:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:31:01.454709829Z [2024-05-26T02:31:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:31:01.462246650Z [2024-05-26T02:31:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed635274-25de-493a-bcd9-b75dc7e488b9 2024-05-26T02:31:01.462620863Z [2024-05-26T02:31:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to c73f12eb-b6fe-4984-b8c5-fcda53a3df21 2024-05-26T02:31:01.462854809Z [2024-05-26T02:31:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71abe9b4-d7a8-4f35-b626-4bae91a1ef44 2024-05-26T02:31:03.000228258Z [2024-05-26T02:31:02.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:31:03.000388164Z [2024-05-26T02:31:03.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:30:00+00:00, run_id=scheduled__2024-05-26T02:30:00+00:00, run_start_date=2024-05-26 02:31:01.070957+00:00, run_end_date=2024-05-26 02:31:03.000084+00:00, run_duration=1.929127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:30:00+00:00, data_interval_end=2024-05-26 02:31:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:31:03.010648067Z [2024-05-26T02:31:03.010+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:31:00+00:00, run_after=2024-05-26T02:32:00+00:00 2024-05-26T02:31:03.059700282Z [2024-05-26T02:31:03.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:31:03.065834636Z [2024-05-26T02:31:03.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=-1, run_start_date=2024-05-26 02:31:01.941319+00:00, run_end_date=2024-05-26 02:31:02.342469+00:00, run_duration=0.40115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:31:01.148647+00:00, queued_by_job_id=1, pid=14918 2024-05-26T02:31:05.172135949Z [2024-05-26T02:31:05.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:31:05.172306709Z [2024-05-26T02:31:05.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:30:00+00:00, run_id=scheduled__2024-05-26T02:30:00+00:00, run_start_date=2024-05-26 02:31:01.072245+00:00, run_end_date=2024-05-26 02:31:05.172021+00:00, run_duration=4.099776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:30:00+00:00, data_interval_end=2024-05-26 02:31:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:31:05.180485188Z [2024-05-26T02:31:05.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:31:00+00:00, run_after=2024-05-26T02:32:00+00:00 2024-05-26T02:31:05.188407858Z [2024-05-26T02:31:05.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:31:05.188742702Z [2024-05-26T02:31:05.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:30:00+00:00, run_id=scheduled__2024-05-26T02:30:00+00:00, run_start_date=2024-05-26 02:31:01.073388+00:00, run_end_date=2024-05-26 02:31:05.188334+00:00, run_duration=4.114946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:30:00+00:00, data_interval_end=2024-05-26 02:31:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:31:05.199630135Z [2024-05-26T02:31:05.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:31:00+00:00, run_after=2024-05-26T02:32:00+00:00 2024-05-26T02:31:05.254721026Z [2024-05-26T02:31:05.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:31:05.257991502Z [2024-05-26T02:31:05.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:31:05.270641653Z [2024-05-26T02:31:05.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=-1, run_start_date=2024-05-26 02:31:02.865230+00:00, run_end_date=2024-05-26 02:31:04.608276+00:00, run_duration=1.743046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:31:01.148647+00:00, queued_by_job_id=1, pid=14937 2024-05-26T02:31:05.271267450Z [2024-05-26T02:31:05.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=-1, run_start_date=2024-05-26 02:31:02.837684+00:00, run_end_date=2024-05-26 02:31:04.836708+00:00, run_duration=1.999024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:31:01.148647+00:00, queued_by_job_id=1, pid=14936 2024-05-26T02:32:01.053683677Z [2024-05-26T02:32:01.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:32:00+00:00, run_after=2024-05-26T02:33:00+00:00 2024-05-26T02:32:01.064379325Z [2024-05-26T02:32:01.063+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:32:01.091191372Z [2024-05-26T02:32:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:32:00+00:00, run_after=2024-05-26T02:33:00+00:00 2024-05-26T02:32:01.101215646Z [2024-05-26T02:32:01.100+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:32:01.199459444Z [2024-05-26T02:32:01.198+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:32:01.199489469Z 2024-05-26T02:32:01.199495130Z 2024-05-26T02:32:01.199570329Z 2024-05-26T02:32:01.199576757Z 2024-05-26T02:32:01.199815046Z [2024-05-26T02:32:01.199+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:32:01.200036726Z [2024-05-26T02:32:01.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:32:01.200257151Z [2024-05-26T02:32:01.199+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:32:01.200424059Z [2024-05-26T02:32:01.200+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:32:01.201483795Z [2024-05-26T02:32:01.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:32:01.201504233Z 2024-05-26T02:32:01.201514032Z 2024-05-26T02:32:01.201522978Z 2024-05-26T02:32:01.201531499Z 2024-05-26T02:32:01.210904676Z [2024-05-26T02:32:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:32:01.211660907Z [2024-05-26T02:32:01.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:32:01.212542249Z [2024-05-26T02:32:01.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:32:01.213113410Z [2024-05-26T02:32:01.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:32:01.213646530Z [2024-05-26T02:32:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:32:01.214009834Z [2024-05-26T02:32:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:32:01.214841064Z [2024-05-26T02:32:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:32:01.215267076Z [2024-05-26T02:32:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:32:01.613178693Z [2024-05-26T02:32:01.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:32:01.613372639Z [2024-05-26T02:32:01.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:31:00+00:00 exited with status queued for try_number 1 2024-05-26T02:32:01.613557107Z [2024-05-26T02:32:01.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:31:00+00:00 exited with status queued for try_number 1 2024-05-26T02:32:01.613754380Z [2024-05-26T02:32:01.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:31:00+00:00 exited with status queued for try_number 1 2024-05-26T02:32:01.622457595Z [2024-05-26T02:32:01.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 422c2b33-32ba-4bf2-be3e-3bede7cc2807 2024-05-26T02:32:01.622614802Z [2024-05-26T02:32:01.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d0dbd4d-11f1-43cd-a9c7-9d5842717e4a 2024-05-26T02:32:01.622764030Z [2024-05-26T02:32:01.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a69b33e-5748-43a0-861d-59d0b9331c3b 2024-05-26T02:32:01.622912966Z [2024-05-26T02:32:01.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6ad3d29-8a33-4f43-ade9-3e5553b4862f 2024-05-26T02:32:02.783403336Z [2024-05-26T02:32:02.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:32:02.783971260Z [2024-05-26T02:32:02.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:30:00+00:00, run_id=scheduled__2024-05-26T02:30:00+00:00, run_start_date=2024-05-26 02:32:01.112353+00:00, run_end_date=2024-05-26 02:32:02.783600+00:00, run_duration=1.671247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:30:00+00:00, data_interval_end=2024-05-26 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:32:02.791971878Z [2024-05-26T02:32:02.791+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:32:00+00:00, run_after=2024-05-26T02:34:00+00:00 2024-05-26T02:32:02.798692387Z [2024-05-26T02:32:02.798+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:32:02.798876602Z [2024-05-26T02:32:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:31:00+00:00, run_id=scheduled__2024-05-26T02:31:00+00:00, run_start_date=2024-05-26 02:32:01.113615+00:00, run_end_date=2024-05-26 02:32:02.798597+00:00, run_duration=1.684982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:31:00+00:00, data_interval_end=2024-05-26 02:32:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:32:02.809929118Z [2024-05-26T02:32:02.809+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:32:00+00:00, run_after=2024-05-26T02:33:00+00:00 2024-05-26T02:32:02.876256597Z [2024-05-26T02:32:02.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:32:02.876308728Z [2024-05-26T02:32:02.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:31:00+00:00 exited with status success for try_number 1 2024-05-26T02:32:02.883961916Z [2024-05-26T02:32:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:31:00+00:00, map_index=-1, run_start_date=2024-05-26 02:32:02.216556+00:00, run_end_date=2024-05-26 02:32:02.637143+00:00, run_duration=0.420587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:32:01.204624+00:00, queued_by_job_id=1, pid=14971 2024-05-26T02:32:02.884097623Z [2024-05-26T02:32:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=-1, run_start_date=2024-05-26 02:32:02.250910+00:00, run_end_date=2024-05-26 02:32:02.553510+00:00, run_duration=0.3026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:32:01.204624+00:00, queued_by_job_id=1, pid=14972 2024-05-26T02:32:05.033096277Z [2024-05-26T02:32:05.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:32:05.036467093Z [2024-05-26T02:32:05.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:31:00+00:00, run_id=scheduled__2024-05-26T02:31:00+00:00, run_start_date=2024-05-26 02:32:01.114748+00:00, run_end_date=2024-05-26 02:32:05.032990+00:00, run_duration=3.918242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:31:00+00:00, data_interval_end=2024-05-26 02:32:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:32:05.049525460Z [2024-05-26T02:32:05.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:32:00+00:00, run_after=2024-05-26T02:33:00+00:00 2024-05-26T02:32:05.090661812Z [2024-05-26T02:32:05.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:31:00+00:00 exited with status success for try_number 1 2024-05-26T02:32:05.099491199Z [2024-05-26T02:32:05.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:31:00+00:00, map_index=-1, run_start_date=2024-05-26 02:32:03.243486+00:00, run_end_date=2024-05-26 02:32:04.799330+00:00, run_duration=1.555844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:32:01.204624+00:00, queued_by_job_id=1, pid=14995 2024-05-26T02:32:05.699605549Z [2024-05-26T02:32:05.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:32:05.699631790Z [2024-05-26T02:32:05.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:31:00+00:00, run_id=scheduled__2024-05-26T02:31:00+00:00, run_start_date=2024-05-26 02:32:01.115859+00:00, run_end_date=2024-05-26 02:32:05.695682+00:00, run_duration=4.579823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:31:00+00:00, data_interval_end=2024-05-26 02:32:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:32:05.712771357Z [2024-05-26T02:32:05.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:32:00+00:00, run_after=2024-05-26T02:33:00+00:00 2024-05-26T02:32:05.756968046Z [2024-05-26T02:32:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:31:00+00:00 exited with status success for try_number 1 2024-05-26T02:32:05.767591139Z [2024-05-26T02:32:05.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:31:00+00:00, map_index=-1, run_start_date=2024-05-26 02:32:03.456752+00:00, run_end_date=2024-05-26 02:32:05.364087+00:00, run_duration=1.907335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:32:01.204624+00:00, queued_by_job_id=1, pid=14996 2024-05-26T02:33:00.840617594Z [2024-05-26T02:33:00.839+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:33:00.877119864Z [2024-05-26T02:33:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:33:00+00:00, run_after=2024-05-26T02:34:00+00:00 2024-05-26T02:33:00.910634498Z [2024-05-26T02:33:00.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:33:00+00:00, run_after=2024-05-26T02:34:00+00:00 2024-05-26T02:33:00.994516272Z [2024-05-26T02:33:00.994+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:33:00.994556815Z 2024-05-26T02:33:00.994566516Z 2024-05-26T02:33:00.994575275Z 2024-05-26T02:33:00.994610127Z [2024-05-26T02:33:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:33:00.994715092Z [2024-05-26T02:33:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:33:00.994727061Z [2024-05-26T02:33:00.994+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:33:00.995138630Z [2024-05-26T02:33:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:33:00.995159061Z 2024-05-26T02:33:00.995169244Z 2024-05-26T02:33:00.995177899Z 2024-05-26T02:33:00.998417605Z [2024-05-26T02:33:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:33:00.998560003Z [2024-05-26T02:33:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:33:00.998572937Z [2024-05-26T02:33:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:33:00.998721521Z [2024-05-26T02:33:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:33:00.998816973Z [2024-05-26T02:33:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:33:00.998908306Z [2024-05-26T02:33:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:33:01.177573933Z [2024-05-26T02:33:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status queued for try_number 1 2024-05-26T02:33:01.177637689Z [2024-05-26T02:33:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status queued for try_number 1 2024-05-26T02:33:01.177677392Z [2024-05-26T02:33:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status queued for try_number 1 2024-05-26T02:33:01.187793882Z [2024-05-26T02:33:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to 034c0c63-53a1-42d1-9b0f-ddf0e3258055 2024-05-26T02:33:01.187882310Z [2024-05-26T02:33:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a01312b-4904-4799-9f02-8a823b04b91f 2024-05-26T02:33:01.187987080Z [2024-05-26T02:33:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dac5b5b-d412-4f96-8abb-112d78ffdbb0 2024-05-26T02:33:02.506958554Z [2024-05-26T02:33:02.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:33:02.507553955Z [2024-05-26T02:33:02.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:32:00+00:00, run_id=scheduled__2024-05-26T02:32:00+00:00, run_start_date=2024-05-26 02:33:00.923331+00:00, run_end_date=2024-05-26 02:33:02.506852+00:00, run_duration=1.583521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:32:00+00:00, data_interval_end=2024-05-26 02:33:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:33:02.519638855Z [2024-05-26T02:33:02.519+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:33:00+00:00, run_after=2024-05-26T02:34:00+00:00 2024-05-26T02:33:02.584820717Z [2024-05-26T02:33:02.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status success for try_number 1 2024-05-26T02:33:02.590350061Z [2024-05-26T02:33:02.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:32:00+00:00, map_index=-1, run_start_date=2024-05-26 02:33:01.914770+00:00, run_end_date=2024-05-26 02:33:02.328929+00:00, run_duration=0.414159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:33:00.995694+00:00, queued_by_job_id=1, pid=15027 2024-05-26T02:33:04.905018967Z [2024-05-26T02:33:04.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:33:04.907905357Z [2024-05-26T02:33:04.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:32:00+00:00, run_id=scheduled__2024-05-26T02:32:00+00:00, run_start_date=2024-05-26 02:33:00.925213+00:00, run_end_date=2024-05-26 02:33:04.904928+00:00, run_duration=3.979715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:32:00+00:00, data_interval_end=2024-05-26 02:33:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:33:04.920631407Z [2024-05-26T02:33:04.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:33:00+00:00, run_after=2024-05-26T02:34:00+00:00 2024-05-26T02:33:04.969744521Z [2024-05-26T02:33:04.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status success for try_number 1 2024-05-26T02:33:04.980200944Z [2024-05-26T02:33:04.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:32:00+00:00, map_index=-1, run_start_date=2024-05-26 02:33:02.899673+00:00, run_end_date=2024-05-26 02:33:04.206480+00:00, run_duration=1.306807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:33:00.995694+00:00, queued_by_job_id=1, pid=15045 2024-05-26T02:33:06.049440855Z [2024-05-26T02:33:06.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:33:06.050259911Z [2024-05-26T02:33:06.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:32:00+00:00, run_id=scheduled__2024-05-26T02:32:00+00:00, run_start_date=2024-05-26 02:33:00.933615+00:00, run_end_date=2024-05-26 02:33:06.049314+00:00, run_duration=5.115699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:32:00+00:00, data_interval_end=2024-05-26 02:33:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:33:06.064449966Z [2024-05-26T02:33:06.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:33:00+00:00, run_after=2024-05-26T02:34:00+00:00 2024-05-26T02:33:06.104574622Z [2024-05-26T02:33:06.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status success for try_number 1 2024-05-26T02:33:06.111888015Z [2024-05-26T02:33:06.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:32:00+00:00, map_index=-1, run_start_date=2024-05-26 02:33:02.989254+00:00, run_end_date=2024-05-26 02:33:05.366839+00:00, run_duration=2.377585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:33:00.995694+00:00, queued_by_job_id=1, pid=15046 2024-05-26T02:33:33.599065829Z [2024-05-26T02:33:33.598+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:34:00.770680813Z [2024-05-26T02:34:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:34:00+00:00, run_after=2024-05-26T02:35:00+00:00 2024-05-26T02:34:00.778233457Z [2024-05-26T02:34:00.777+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:34:00.785184947Z [2024-05-26T02:34:00.784+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:34:00.798300982Z [2024-05-26T02:34:00.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:34:00+00:00, run_after=2024-05-26T02:35:00+00:00 2024-05-26T02:34:00.894012761Z [2024-05-26T02:34:00.893+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:34:00.894077185Z 2024-05-26T02:34:00.894087382Z 2024-05-26T02:34:00.894095946Z 2024-05-26T02:34:00.894104290Z 2024-05-26T02:34:00.894227207Z [2024-05-26T02:34:00.893+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:34:00.894238310Z [2024-05-26T02:34:00.893+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:34:00.894246182Z [2024-05-26T02:34:00.894+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:34:00.894341911Z [2024-05-26T02:34:00.894+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:34:00.895014634Z [2024-05-26T02:34:00.894+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:34:00.895055632Z 2024-05-26T02:34:00.895066463Z 2024-05-26T02:34:00.895075018Z 2024-05-26T02:34:00.895083381Z 2024-05-26T02:34:00.899001697Z [2024-05-26T02:34:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:34:00.899135140Z [2024-05-26T02:34:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:34:00.899294657Z [2024-05-26T02:34:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:34:00.899481862Z [2024-05-26T02:34:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:34:00.899720704Z [2024-05-26T02:34:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:34:00.899735728Z [2024-05-26T02:34:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:34:00.900021153Z [2024-05-26T02:34:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:34:00.900035974Z [2024-05-26T02:34:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:34:01.313309082Z [2024-05-26T02:34:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status queued for try_number 1 2024-05-26T02:34:01.313358906Z [2024-05-26T02:34:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:33:00+00:00 exited with status queued for try_number 1 2024-05-26T02:34:01.313412938Z [2024-05-26T02:34:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:33:00+00:00 exited with status queued for try_number 1 2024-05-26T02:34:01.313499541Z [2024-05-26T02:34:01.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:33:00+00:00 exited with status queued for try_number 1 2024-05-26T02:34:01.323559587Z [2024-05-26T02:34:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa008a12-2989-4b2c-a269-412e3fcf7974 2024-05-26T02:34:01.323729649Z [2024-05-26T02:34:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07cca266-b1e3-4fdf-bd89-31f90ff928ad 2024-05-26T02:34:01.323922402Z [2024-05-26T02:34:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5b2a74e-4497-4d3d-b1e8-4f71155374d4 2024-05-26T02:34:01.324100605Z [2024-05-26T02:34:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4730be2-a9fe-4d92-aeb0-ea2cb1b3baba 2024-05-26T02:34:02.464068535Z [2024-05-26T02:34:02.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:34:02.464384381Z [2024-05-26T02:34:02.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:32:00+00:00, run_id=scheduled__2024-05-26T02:32:00+00:00, run_start_date=2024-05-26 02:34:00.809783+00:00, run_end_date=2024-05-26 02:34:02.463991+00:00, run_duration=1.654208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:32:00+00:00, data_interval_end=2024-05-26 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:34:02.472793298Z [2024-05-26T02:34:02.472+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:34:00+00:00, run_after=2024-05-26T02:36:00+00:00 2024-05-26T02:34:02.479527216Z [2024-05-26T02:34:02.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:34:02.479971256Z [2024-05-26T02:34:02.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:33:00+00:00, run_id=scheduled__2024-05-26T02:33:00+00:00, run_start_date=2024-05-26 02:34:00.811104+00:00, run_end_date=2024-05-26 02:34:02.479446+00:00, run_duration=1.668342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:33:00+00:00, data_interval_end=2024-05-26 02:34:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:34:02.489608899Z [2024-05-26T02:34:02.489+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:34:00+00:00, run_after=2024-05-26T02:35:00+00:00 2024-05-26T02:34:02.533824270Z [2024-05-26T02:34:02.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:32:00+00:00 exited with status success for try_number 1 2024-05-26T02:34:02.533897892Z [2024-05-26T02:34:02.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:33:00+00:00 exited with status success for try_number 1 2024-05-26T02:34:02.546228364Z [2024-05-26T02:34:02.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:32:00+00:00, map_index=-1, run_start_date=2024-05-26 02:34:01.755728+00:00, run_end_date=2024-05-26 02:34:02.107891+00:00, run_duration=0.352163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:34:00.895874+00:00, queued_by_job_id=1, pid=15080 2024-05-26T02:34:02.546389405Z [2024-05-26T02:34:02.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:33:00+00:00, map_index=-1, run_start_date=2024-05-26 02:34:01.725542+00:00, run_end_date=2024-05-26 02:34:02.130593+00:00, run_duration=0.405051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:34:00.895874+00:00, queued_by_job_id=1, pid=15079 2024-05-26T02:34:04.693323921Z [2024-05-26T02:34:04.692+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:34:04.693479700Z [2024-05-26T02:34:04.693+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:33:00+00:00, run_id=scheduled__2024-05-26T02:33:00+00:00, run_start_date=2024-05-26 02:34:00.812269+00:00, run_end_date=2024-05-26 02:34:04.693202+00:00, run_duration=3.880933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:33:00+00:00, data_interval_end=2024-05-26 02:34:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:34:04.728959592Z [2024-05-26T02:34:04.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:34:00+00:00, run_after=2024-05-26T02:35:00+00:00 2024-05-26T02:34:04.804500105Z [2024-05-26T02:34:04.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:33:00+00:00 exited with status success for try_number 1 2024-05-26T02:34:04.821109514Z [2024-05-26T02:34:04.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:33:00+00:00, map_index=-1, run_start_date=2024-05-26 02:34:02.897903+00:00, run_end_date=2024-05-26 02:34:04.332734+00:00, run_duration=1.434831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:34:00.895874+00:00, queued_by_job_id=1, pid=15104 2024-05-26T02:34:05.889813227Z [2024-05-26T02:34:05.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:34:05.890327075Z [2024-05-26T02:34:05.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:33:00+00:00, run_id=scheduled__2024-05-26T02:33:00+00:00, run_start_date=2024-05-26 02:34:00.813394+00:00, run_end_date=2024-05-26 02:34:05.889445+00:00, run_duration=5.076051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:33:00+00:00, data_interval_end=2024-05-26 02:34:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:34:05.919829867Z [2024-05-26T02:34:05.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:34:00+00:00, run_after=2024-05-26T02:35:00+00:00 2024-05-26T02:34:05.992731656Z [2024-05-26T02:34:05.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:33:00+00:00 exited with status success for try_number 1 2024-05-26T02:34:05.999385358Z [2024-05-26T02:34:05.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:33:00+00:00, map_index=-1, run_start_date=2024-05-26 02:34:02.856168+00:00, run_end_date=2024-05-26 02:34:04.665024+00:00, run_duration=1.808856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:34:00.895874+00:00, queued_by_job_id=1, pid=15103 2024-05-26T02:35:00.160802123Z [2024-05-26T02:35:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:35:00.181450345Z [2024-05-26T02:35:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:35:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:35:00.197422990Z [2024-05-26T02:35:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:35:00+00:00, run_after=2024-05-26T02:36:00+00:00 2024-05-26T02:35:00.210854688Z [2024-05-26T02:35:00.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:35:00+00:00, run_after=2024-05-26T02:36:00+00:00 2024-05-26T02:35:00.322680626Z [2024-05-26T02:35:00.322+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:35:00.322722494Z 2024-05-26T02:35:00.322733253Z 2024-05-26T02:35:00.322742504Z 2024-05-26T02:35:00.322751416Z 2024-05-26T02:35:00.322902743Z [2024-05-26T02:35:00.322+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:35:00.323168991Z [2024-05-26T02:35:00.322+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:35:00.323359599Z [2024-05-26T02:35:00.323+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:35:00.323659201Z [2024-05-26T02:35:00.323+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:35:00.324504462Z [2024-05-26T02:35:00.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:35:00.324628248Z 2024-05-26T02:35:00.324649759Z 2024-05-26T02:35:00.324659312Z 2024-05-26T02:35:00.324667993Z 2024-05-26T02:35:00.328917319Z [2024-05-26T02:35:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:35:00.329140870Z [2024-05-26T02:35:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:35:00.329432582Z [2024-05-26T02:35:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:35:00.329640104Z [2024-05-26T02:35:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:35:00.330119821Z [2024-05-26T02:35:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:35:00.330626771Z [2024-05-26T02:35:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:35:00.330644141Z [2024-05-26T02:35:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:35:00.330863906Z [2024-05-26T02:35:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:35:00.632600045Z [2024-05-26T02:35:00.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:35:00.632871247Z [2024-05-26T02:35:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status queued for try_number 1 2024-05-26T02:35:00.633072714Z [2024-05-26T02:35:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status queued for try_number 1 2024-05-26T02:35:00.633254100Z [2024-05-26T02:35:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status queued for try_number 1 2024-05-26T02:35:00.642215429Z [2024-05-26T02:35:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to daa56f24-f7e8-4851-8e32-7aa7dc8c294a 2024-05-26T02:35:00.642554352Z [2024-05-26T02:35:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47479b35-4e81-4815-b984-4c75bad0b6ec 2024-05-26T02:35:00.642798501Z [2024-05-26T02:35:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc7fd087-698a-4098-8957-9dd9d5e97bf8 2024-05-26T02:35:00.643018371Z [2024-05-26T02:35:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 154b4a70-9329-480b-89e8-cbc14df100c6 2024-05-26T02:35:01.845226406Z [2024-05-26T02:35:01.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:35:01.845574358Z [2024-05-26T02:35:01.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:34:00+00:00, run_id=scheduled__2024-05-26T02:34:00+00:00, run_start_date=2024-05-26 02:35:00.224639+00:00, run_end_date=2024-05-26 02:35:01.845220+00:00, run_duration=1.620581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:34:00+00:00, data_interval_end=2024-05-26 02:35:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:35:01.856338619Z [2024-05-26T02:35:01.856+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:35:00+00:00, run_after=2024-05-26T02:36:00+00:00 2024-05-26T02:35:01.906551832Z [2024-05-26T02:35:01.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status success for try_number 1 2024-05-26T02:35:01.913592357Z [2024-05-26T02:35:01.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:34:00+00:00, map_index=-1, run_start_date=2024-05-26 02:35:01.287601+00:00, run_end_date=2024-05-26 02:35:01.697380+00:00, run_duration=0.409779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:35:00.325435+00:00, queued_by_job_id=1, pid=15136 2024-05-26T02:35:03.004578254Z [2024-05-26T02:35:03.004+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:35:03.004621121Z 2024-05-26T02:35:03.004720060Z [2024-05-26T02:35:03.004+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:35:03.005308314Z [2024-05-26T02:35:03.005+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:35:03.005324605Z 2024-05-26T02:35:03.007946643Z [2024-05-26T02:35:03.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:35:03.008051015Z [2024-05-26T02:35:03.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:35:03.064443329Z [2024-05-26T02:35:03.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:35:03.065366712Z [2024-05-26T02:35:03.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:35:03.070869752Z [2024-05-26T02:35:03.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65b02702-1bc9-4c10-b3ae-6ac6f1fb4676 2024-05-26T02:35:03.071122188Z [2024-05-26T02:35:03.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=-1, run_start_date=2024-05-26 02:35:02.172997+00:00, run_end_date=2024-05-26 02:35:02.556921+00:00, run_duration=0.383924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:35:00.325435+00:00, queued_by_job_id=1, pid=15156 2024-05-26T02:35:04.229946385Z [2024-05-26T02:35:04.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:35:04.230126142Z [2024-05-26T02:35:04.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:34:00+00:00, run_id=scheduled__2024-05-26T02:34:00+00:00, run_start_date=2024-05-26 02:35:00.225675+00:00, run_end_date=2024-05-26 02:35:04.229811+00:00, run_duration=4.004136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:34:00+00:00, data_interval_end=2024-05-26 02:35:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:35:04.238967095Z [2024-05-26T02:35:04.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:35:00+00:00, run_after=2024-05-26T02:36:00+00:00 2024-05-26T02:35:04.245410507Z [2024-05-26T02:35:04.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:35:04.245615809Z [2024-05-26T02:35:04.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:34:00+00:00, run_id=scheduled__2024-05-26T02:34:00+00:00, run_start_date=2024-05-26 02:35:00.226739+00:00, run_end_date=2024-05-26 02:35:04.245320+00:00, run_duration=4.018581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:34:00+00:00, data_interval_end=2024-05-26 02:35:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:35:04.255444941Z [2024-05-26T02:35:04.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:35:00+00:00, run_after=2024-05-26T02:36:00+00:00 2024-05-26T02:35:04.299158773Z [2024-05-26T02:35:04.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status success for try_number 1 2024-05-26T02:35:04.299185959Z [2024-05-26T02:35:04.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status success for try_number 1 2024-05-26T02:35:04.308242495Z [2024-05-26T02:35:04.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:34:00+00:00, map_index=-1, run_start_date=2024-05-26 02:35:02.130889+00:00, run_end_date=2024-05-26 02:35:03.959741+00:00, run_duration=1.828852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:35:00.325435+00:00, queued_by_job_id=1, pid=15155 2024-05-26T02:35:04.308378273Z [2024-05-26T02:35:04.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:34:00+00:00, map_index=-1, run_start_date=2024-05-26 02:35:02.509035+00:00, run_end_date=2024-05-26 02:35:03.893186+00:00, run_duration=1.384151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:35:00.325435+00:00, queued_by_job_id=1, pid=15172 2024-05-26T02:35:05.730717643Z [2024-05-26T02:35:05.730+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:35:05.730747441Z 2024-05-26T02:35:05.730770256Z [2024-05-26T02:35:05.730+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:35:05.731243295Z [2024-05-26T02:35:05.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:35:05.731271352Z 2024-05-26T02:35:05.733286826Z [2024-05-26T02:35:05.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:35:05.733346325Z [2024-05-26T02:35:05.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:35:05.805826105Z [2024-05-26T02:35:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:35:05.805873695Z [2024-05-26T02:35:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:35:05.815070877Z [2024-05-26T02:35:05.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2b5129a-2951-4702-8534-f8fb508c342f 2024-05-26T02:35:05.815160835Z [2024-05-26T02:35:05.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=-1, run_start_date=2024-05-26 02:35:05.014652+00:00, run_end_date=2024-05-26 02:35:05.393362+00:00, run_duration=0.37871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:35:03.005646+00:00, queued_by_job_id=1, pid=15185 2024-05-26T02:35:09.300989768Z [2024-05-26T02:35:09.300+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:35:09.301027849Z 2024-05-26T02:35:09.301034245Z [2024-05-26T02:35:09.300+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:35:09.301501817Z [2024-05-26T02:35:09.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:35:09.301513573Z 2024-05-26T02:35:09.303706218Z [2024-05-26T02:35:09.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:35:09.303807012Z [2024-05-26T02:35:09.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:35:09.447686515Z [2024-05-26T02:35:09.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status queued for try_number 1 2024-05-26T02:35:09.447713869Z [2024-05-26T02:35:09.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:35:09.457524342Z [2024-05-26T02:35:09.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58c0b0df-0a94-4e00-ad01-220df9bb68ba 2024-05-26T02:35:09.459383874Z [2024-05-26T02:35:09.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=0, run_start_date=2024-05-26 02:35:07.505099+00:00, run_end_date=2024-05-26 02:35:08.670349+00:00, run_duration=1.16525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:35:05.731565+00:00, queued_by_job_id=1, pid=15193 2024-05-26T02:35:11.850315544Z [2024-05-26T02:35:11.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:35:11.850996864Z [2024-05-26T02:35:11.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:30:00+00:00, run_id=scheduled__2024-05-26T02:30:00+00:00, run_start_date=2024-05-26 02:35:00.223357+00:00, run_end_date=2024-05-26 02:35:11.850219+00:00, run_duration=11.626862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:30:00+00:00, data_interval_end=2024-05-26 02:35:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:35:11.861445009Z [2024-05-26T02:35:11.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:35:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:35:11.914754140Z [2024-05-26T02:35:11.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:30:00+00:00 exited with status success for try_number 1 2024-05-26T02:35:11.926669170Z [2024-05-26T02:35:11.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:30:00+00:00, map_index=-1, run_start_date=2024-05-26 02:35:10.931205+00:00, run_end_date=2024-05-26 02:35:11.290437+00:00, run_duration=0.359232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:35:09.301759+00:00, queued_by_job_id=1, pid=15206 2024-05-26T02:36:00.655639235Z [2024-05-26T02:36:00.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:36:00+00:00, run_after=2024-05-26T02:37:00+00:00 2024-05-26T02:36:00.668563739Z [2024-05-26T02:36:00.668+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:36:00.675300182Z [2024-05-26T02:36:00.674+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:36:00.687118385Z [2024-05-26T02:36:00.686+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:36:00+00:00, run_after=2024-05-26T02:37:00+00:00 2024-05-26T02:36:00.769013600Z [2024-05-26T02:36:00.765+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:36:00.769049247Z 2024-05-26T02:36:00.769062618Z 2024-05-26T02:36:00.769068522Z 2024-05-26T02:36:00.769074008Z 2024-05-26T02:36:00.769079802Z [2024-05-26T02:36:00.765+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:36:00.769085983Z [2024-05-26T02:36:00.765+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:36:00.769091480Z [2024-05-26T02:36:00.765+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:36:00.769096714Z [2024-05-26T02:36:00.765+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:36:00.769101994Z [2024-05-26T02:36:00.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:36:00.769107205Z 2024-05-26T02:36:00.769112597Z 2024-05-26T02:36:00.769117848Z 2024-05-26T02:36:00.769140983Z 2024-05-26T02:36:00.770954438Z [2024-05-26T02:36:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:36:00.770969351Z [2024-05-26T02:36:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:36:00.770975733Z [2024-05-26T02:36:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:36:00.770978959Z [2024-05-26T02:36:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:36:00.770981973Z [2024-05-26T02:36:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:36:00.770984983Z [2024-05-26T02:36:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:36:00.771071364Z [2024-05-26T02:36:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:36:00.771076249Z [2024-05-26T02:36:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:36:01.048269697Z [2024-05-26T02:36:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status queued for try_number 1 2024-05-26T02:36:01.048556841Z [2024-05-26T02:36:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status queued for try_number 1 2024-05-26T02:36:01.048929770Z [2024-05-26T02:36:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status queued for try_number 1 2024-05-26T02:36:01.049167313Z [2024-05-26T02:36:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status queued for try_number 1 2024-05-26T02:36:01.061307203Z [2024-05-26T02:36:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85d02155-2e4d-4c57-bc8b-e979bcf43de3 2024-05-26T02:36:01.061466990Z [2024-05-26T02:36:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb686022-51b9-459d-beea-d501e1edde50 2024-05-26T02:36:01.061668157Z [2024-05-26T02:36:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9982c7f-b6eb-4d51-8760-9b9b2c688bef 2024-05-26T02:36:01.061840214Z [2024-05-26T02:36:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25af4b29-45f8-4ab2-b4b0-750dbda6be86 2024-05-26T02:36:02.968308173Z [2024-05-26T02:36:02.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:36:02.969358425Z [2024-05-26T02:36:02.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:34:00+00:00, run_id=scheduled__2024-05-26T02:34:00+00:00, run_start_date=2024-05-26 02:36:00.698650+00:00, run_end_date=2024-05-26 02:36:02.968991+00:00, run_duration=2.270341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:34:00+00:00, data_interval_end=2024-05-26 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:36:02.976312660Z [2024-05-26T02:36:02.976+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:36:00+00:00, run_after=2024-05-26T02:38:00+00:00 2024-05-26T02:36:02.984559626Z [2024-05-26T02:36:02.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:36:02.985414778Z [2024-05-26T02:36:02.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:35:00+00:00, run_id=scheduled__2024-05-26T02:35:00+00:00, run_start_date=2024-05-26 02:36:00.699998+00:00, run_end_date=2024-05-26 02:36:02.985039+00:00, run_duration=2.285041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:35:00+00:00, data_interval_end=2024-05-26 02:36:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:36:02.996976321Z [2024-05-26T02:36:02.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:36:00+00:00, run_after=2024-05-26T02:37:00+00:00 2024-05-26T02:36:03.092882846Z [2024-05-26T02:36:03.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:34:00+00:00 exited with status success for try_number 1 2024-05-26T02:36:03.093246430Z [2024-05-26T02:36:03.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status success for try_number 1 2024-05-26T02:36:03.101500548Z [2024-05-26T02:36:03.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:35:00+00:00, map_index=-1, run_start_date=2024-05-26 02:36:01.725176+00:00, run_end_date=2024-05-26 02:36:02.174873+00:00, run_duration=0.449697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:36:00.767274+00:00, queued_by_job_id=1, pid=15230 2024-05-26T02:36:03.101965627Z [2024-05-26T02:36:03.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:34:00+00:00, map_index=-1, run_start_date=2024-05-26 02:36:01.592294+00:00, run_end_date=2024-05-26 02:36:02.064579+00:00, run_duration=0.472285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:36:00.767274+00:00, queued_by_job_id=1, pid=15229 2024-05-26T02:36:04.136391694Z [2024-05-26T02:36:04.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:36:04.136811261Z [2024-05-26T02:36:04.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:35:00+00:00, run_id=scheduled__2024-05-26T02:35:00+00:00, run_start_date=2024-05-26 02:36:00.701114+00:00, run_end_date=2024-05-26 02:36:04.136243+00:00, run_duration=3.435129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:35:00+00:00, data_interval_end=2024-05-26 02:36:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:36:04.145316266Z [2024-05-26T02:36:04.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:36:00+00:00, run_after=2024-05-26T02:37:00+00:00 2024-05-26T02:36:04.179716183Z [2024-05-26T02:36:04.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status success for try_number 1 2024-05-26T02:36:04.184256076Z [2024-05-26T02:36:04.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:35:00+00:00, map_index=-1, run_start_date=2024-05-26 02:36:02.669739+00:00, run_end_date=2024-05-26 02:36:03.961669+00:00, run_duration=1.29193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:36:00.767274+00:00, queued_by_job_id=1, pid=15253 2024-05-26T02:36:05.239795435Z [2024-05-26T02:36:05.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:36:05.240152073Z [2024-05-26T02:36:05.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:35:00+00:00, run_id=scheduled__2024-05-26T02:35:00+00:00, run_start_date=2024-05-26 02:36:00.702161+00:00, run_end_date=2024-05-26 02:36:05.239792+00:00, run_duration=4.537631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:35:00+00:00, data_interval_end=2024-05-26 02:36:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:36:05.251082967Z [2024-05-26T02:36:05.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:36:00+00:00, run_after=2024-05-26T02:37:00+00:00 2024-05-26T02:36:05.280281767Z [2024-05-26T02:36:05.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status success for try_number 1 2024-05-26T02:36:05.291164746Z [2024-05-26T02:36:05.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:35:00+00:00, map_index=-1, run_start_date=2024-05-26 02:36:02.778437+00:00, run_end_date=2024-05-26 02:36:04.532318+00:00, run_duration=1.753881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:36:00.767274+00:00, queued_by_job_id=1, pid=15254 2024-05-26T02:36:35.577434639Z [2024-05-26T02:36:35.576+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:36:35.577460589Z 2024-05-26T02:36:35.577701341Z [2024-05-26T02:36:35.577+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-26T02:36:35.579693624Z [2024-05-26T02:36:35.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:36:35.579706331Z 2024-05-26T02:36:35.584123808Z [2024-05-26T02:36:35.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240526023635_598193', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:36:35.584359941Z [2024-05-26T02:36:35.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240526023635_598193', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-26T02:36:35.639981855Z [2024-05-26T02:36:35.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240526023635_598193 exited with status queued for try_number 1 2024-05-26T02:36:35.647555629Z [2024-05-26T02:36:35.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to d32e9f76-fb58-4754-885e-821050eae750 2024-05-26T02:36:36.791121361Z [2024-05-26T02:36:36.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:36:36.791217616Z [2024-05-26T02:36:36.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-26 02:36:35.394900+00:00, run_id=vdu_alarm_20240526023635_598193, run_start_date=2024-05-26 02:36:35.522151+00:00, run_end_date=2024-05-26 02:36:36.790858+00:00, run_duration=1.268707, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-26 02:36:35.394900+00:00, data_interval_end=2024-05-26 02:36:35.394900+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-26T02:36:36.795065549Z [2024-05-26T02:36:36.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-26T02:36:37.435801213Z [2024-05-26T02:36:37.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240526023635_598193 exited with status success for try_number 1 2024-05-26T02:36:37.446084300Z [2024-05-26T02:36:37.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240526023635_598193, map_index=-1, run_start_date=2024-05-26 02:36:36.321315+00:00, run_end_date=2024-05-26 02:36:36.711415+00:00, run_duration=0.3901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:36:35.580600+00:00, queued_by_job_id=1, pid=15279 2024-05-26T02:37:01.097113022Z [2024-05-26T02:37:01.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:37:00+00:00, run_after=2024-05-26T02:38:00+00:00 2024-05-26T02:37:01.107122447Z [2024-05-26T02:37:01.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:37:01.123071966Z [2024-05-26T02:37:01.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:37:00+00:00, run_after=2024-05-26T02:38:00+00:00 2024-05-26T02:37:01.219652401Z [2024-05-26T02:37:01.219+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:37:01.219705723Z 2024-05-26T02:37:01.219715496Z 2024-05-26T02:37:01.219722831Z 2024-05-26T02:37:01.220187344Z [2024-05-26T02:37:01.219+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:37:01.220537353Z [2024-05-26T02:37:01.220+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:37:01.220828198Z [2024-05-26T02:37:01.220+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:37:01.221952523Z [2024-05-26T02:37:01.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:37:01.221967287Z 2024-05-26T02:37:01.221975939Z 2024-05-26T02:37:01.221984743Z 2024-05-26T02:37:01.228974456Z [2024-05-26T02:37:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:37:01.229492086Z [2024-05-26T02:37:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:37:01.230019551Z [2024-05-26T02:37:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:37:01.230312686Z [2024-05-26T02:37:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:37:01.230721748Z [2024-05-26T02:37:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:37:01.231037516Z [2024-05-26T02:37:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:37:01.543028356Z [2024-05-26T02:37:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status queued for try_number 1 2024-05-26T02:37:01.543650814Z [2024-05-26T02:37:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status queued for try_number 1 2024-05-26T02:37:01.544083733Z [2024-05-26T02:37:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status queued for try_number 1 2024-05-26T02:37:01.559891930Z [2024-05-26T02:37:01.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9b928d5-b04f-4447-bfc2-7922adc71c9d 2024-05-26T02:37:01.560377465Z [2024-05-26T02:37:01.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e513170-2625-4e8b-84e5-0b1e7ea62d5e 2024-05-26T02:37:01.560787298Z [2024-05-26T02:37:01.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04a0a0e0-024f-4524-8fe2-633d6d104185 2024-05-26T02:37:02.714950479Z [2024-05-26T02:37:02.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:37:02.715443516Z [2024-05-26T02:37:02.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:36:00+00:00, run_id=scheduled__2024-05-26T02:36:00+00:00, run_start_date=2024-05-26 02:37:01.136597+00:00, run_end_date=2024-05-26 02:37:02.715075+00:00, run_duration=1.578478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:36:00+00:00, data_interval_end=2024-05-26 02:37:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:37:02.734589475Z [2024-05-26T02:37:02.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:37:00+00:00, run_after=2024-05-26T02:38:00+00:00 2024-05-26T02:37:02.812046896Z [2024-05-26T02:37:02.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status success for try_number 1 2024-05-26T02:37:02.818651093Z [2024-05-26T02:37:02.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:36:00+00:00, map_index=-1, run_start_date=2024-05-26 02:37:02.009529+00:00, run_end_date=2024-05-26 02:37:02.360206+00:00, run_duration=0.350677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:37:01.223440+00:00, queued_by_job_id=1, pid=15293 2024-05-26T02:37:05.024447552Z [2024-05-26T02:37:05.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:37:05.024549329Z [2024-05-26T02:37:05.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:36:00+00:00, run_id=scheduled__2024-05-26T02:36:00+00:00, run_start_date=2024-05-26 02:37:01.137953+00:00, run_end_date=2024-05-26 02:37:05.024345+00:00, run_duration=3.886392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:36:00+00:00, data_interval_end=2024-05-26 02:37:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:37:05.032490099Z [2024-05-26T02:37:05.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:37:00+00:00, run_after=2024-05-26T02:38:00+00:00 2024-05-26T02:37:06.112000125Z [2024-05-26T02:37:06.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:37:06.112419216Z [2024-05-26T02:37:06.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:36:00+00:00, run_id=scheduled__2024-05-26T02:36:00+00:00, run_start_date=2024-05-26 02:37:01.139077+00:00, run_end_date=2024-05-26 02:37:06.111875+00:00, run_duration=4.972798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:36:00+00:00, data_interval_end=2024-05-26 02:37:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:37:06.122382530Z [2024-05-26T02:37:06.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:37:00+00:00, run_after=2024-05-26T02:38:00+00:00 2024-05-26T02:37:06.159171961Z [2024-05-26T02:37:06.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status success for try_number 1 2024-05-26T02:37:06.159485622Z [2024-05-26T02:37:06.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status success for try_number 1 2024-05-26T02:37:06.168112795Z [2024-05-26T02:37:06.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:36:00+00:00, map_index=-1, run_start_date=2024-05-26 02:37:03.017165+00:00, run_end_date=2024-05-26 02:37:04.958903+00:00, run_duration=1.941738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:37:01.223440+00:00, queued_by_job_id=1, pid=15312 2024-05-26T02:37:06.168577852Z [2024-05-26T02:37:06.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:36:00+00:00, map_index=-1, run_start_date=2024-05-26 02:37:02.990213+00:00, run_end_date=2024-05-26 02:37:05.288086+00:00, run_duration=2.297873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:37:01.223440+00:00, queued_by_job_id=1, pid=15311 2024-05-26T02:38:00.901231066Z [2024-05-26T02:38:00.900+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:38:00.922424509Z [2024-05-26T02:38:00.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:38:00+00:00, run_after=2024-05-26T02:39:00+00:00 2024-05-26T02:38:00.934784628Z [2024-05-26T02:38:00.934+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:38:00.950991688Z [2024-05-26T02:38:00.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:38:00+00:00, run_after=2024-05-26T02:39:00+00:00 2024-05-26T02:38:01.062372171Z [2024-05-26T02:38:01.061+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:38:01.062421704Z 2024-05-26T02:38:01.062433114Z 2024-05-26T02:38:01.062441972Z 2024-05-26T02:38:01.062450575Z 2024-05-26T02:38:01.062967473Z [2024-05-26T02:38:01.062+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:38:01.063434130Z [2024-05-26T02:38:01.063+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:38:01.063882855Z [2024-05-26T02:38:01.063+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:38:01.065291857Z [2024-05-26T02:38:01.064+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:38:01.066932809Z [2024-05-26T02:38:01.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:38:01.066953145Z 2024-05-26T02:38:01.066957050Z 2024-05-26T02:38:01.066960196Z 2024-05-26T02:38:01.066978676Z 2024-05-26T02:38:01.074956859Z [2024-05-26T02:38:01.074+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:38:01.075387099Z [2024-05-26T02:38:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:38:01.075864100Z [2024-05-26T02:38:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:38:01.076105198Z [2024-05-26T02:38:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:38:01.076501883Z [2024-05-26T02:38:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:38:01.076731653Z [2024-05-26T02:38:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:38:01.077121886Z [2024-05-26T02:38:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:38:01.077381537Z [2024-05-26T02:38:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:38:01.534287455Z [2024-05-26T02:38:01.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status queued for try_number 1 2024-05-26T02:38:01.534417817Z [2024-05-26T02:38:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:37:00+00:00 exited with status queued for try_number 1 2024-05-26T02:38:01.534566932Z [2024-05-26T02:38:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:37:00+00:00 exited with status queued for try_number 1 2024-05-26T02:38:01.534705740Z [2024-05-26T02:38:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:37:00+00:00 exited with status queued for try_number 1 2024-05-26T02:38:01.557028647Z [2024-05-26T02:38:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e837080-e0c3-4d93-9490-a24a6f372fad 2024-05-26T02:38:01.557222445Z [2024-05-26T02:38:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to a21475ef-32b7-484f-9b6a-33db0fd8479f 2024-05-26T02:38:01.557389130Z [2024-05-26T02:38:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ef103d0-feb1-472d-94b1-ab31892de5a2 2024-05-26T02:38:01.557559323Z [2024-05-26T02:38:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f5b2212-46ef-47a3-9c6f-2dfaa9f47db1 2024-05-26T02:38:02.756160763Z [2024-05-26T02:38:02.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:38:02.756644068Z [2024-05-26T02:38:02.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:36:00+00:00, run_id=scheduled__2024-05-26T02:36:00+00:00, run_start_date=2024-05-26 02:38:00.963943+00:00, run_end_date=2024-05-26 02:38:02.756119+00:00, run_duration=1.792176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:36:00+00:00, data_interval_end=2024-05-26 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:38:02.765346932Z [2024-05-26T02:38:02.765+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:38:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:38:02.781126711Z [2024-05-26T02:38:02.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:38:02.781995785Z [2024-05-26T02:38:02.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:37:00+00:00, run_id=scheduled__2024-05-26T02:37:00+00:00, run_start_date=2024-05-26 02:38:00.965692+00:00, run_end_date=2024-05-26 02:38:02.781065+00:00, run_duration=1.815373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:37:00+00:00, data_interval_end=2024-05-26 02:38:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:38:02.797294228Z [2024-05-26T02:38:02.797+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:38:00+00:00, run_after=2024-05-26T02:39:00+00:00 2024-05-26T02:38:02.900350797Z [2024-05-26T02:38:02.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:36:00+00:00 exited with status success for try_number 1 2024-05-26T02:38:02.906041590Z [2024-05-26T02:38:02.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:36:00+00:00, map_index=-1, run_start_date=2024-05-26 02:38:01.918188+00:00, run_end_date=2024-05-26 02:38:02.294710+00:00, run_duration=0.376522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:38:01.069266+00:00, queued_by_job_id=1, pid=15340 2024-05-26T02:38:03.969280593Z [2024-05-26T02:38:03.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:37:00+00:00 exited with status success for try_number 1 2024-05-26T02:38:03.973824299Z [2024-05-26T02:38:03.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:37:00+00:00, map_index=-1, run_start_date=2024-05-26 02:38:02.279358+00:00, run_end_date=2024-05-26 02:38:02.703639+00:00, run_duration=0.424281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:38:01.069266+00:00, queued_by_job_id=1, pid=15352 2024-05-26T02:38:06.118221394Z [2024-05-26T02:38:06.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:38:06.118442902Z [2024-05-26T02:38:06.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:37:00+00:00, run_id=scheduled__2024-05-26T02:37:00+00:00, run_start_date=2024-05-26 02:38:00.968879+00:00, run_end_date=2024-05-26 02:38:06.118110+00:00, run_duration=5.149231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:37:00+00:00, data_interval_end=2024-05-26 02:38:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:38:06.126997985Z [2024-05-26T02:38:06.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:38:00+00:00, run_after=2024-05-26T02:39:00+00:00 2024-05-26T02:38:06.133989165Z [2024-05-26T02:38:06.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:38:06.134163740Z [2024-05-26T02:38:06.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:37:00+00:00, run_id=scheduled__2024-05-26T02:37:00+00:00, run_start_date=2024-05-26 02:38:00.967337+00:00, run_end_date=2024-05-26 02:38:06.133903+00:00, run_duration=5.166566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:37:00+00:00, data_interval_end=2024-05-26 02:38:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:38:06.147486003Z [2024-05-26T02:38:06.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:38:00+00:00, run_after=2024-05-26T02:39:00+00:00 2024-05-26T02:38:06.186079358Z [2024-05-26T02:38:06.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:37:00+00:00 exited with status success for try_number 1 2024-05-26T02:38:06.186102748Z [2024-05-26T02:38:06.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:37:00+00:00 exited with status success for try_number 1 2024-05-26T02:38:06.194297720Z [2024-05-26T02:38:06.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:37:00+00:00, map_index=-1, run_start_date=2024-05-26 02:38:03.489882+00:00, run_end_date=2024-05-26 02:38:05.434098+00:00, run_duration=1.944216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:38:01.069266+00:00, queued_by_job_id=1, pid=15375 2024-05-26T02:38:06.194465667Z [2024-05-26T02:38:06.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:37:00+00:00, map_index=-1, run_start_date=2024-05-26 02:38:02.949979+00:00, run_end_date=2024-05-26 02:38:05.458899+00:00, run_duration=2.50892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:38:01.069266+00:00, queued_by_job_id=1, pid=15364 2024-05-26T02:38:33.659270460Z [2024-05-26T02:38:33.658+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:39:00.817440736Z [2024-05-26T02:39:00.816+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:39:00.833742757Z [2024-05-26T02:39:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:39:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:39:00.860631123Z [2024-05-26T02:39:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:39:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:39:00.945574254Z [2024-05-26T02:39:00.945+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:39:00.945619414Z 2024-05-26T02:39:00.945624521Z 2024-05-26T02:39:00.945629105Z 2024-05-26T02:39:00.945633382Z [2024-05-26T02:39:00.945+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:39:00.946123301Z [2024-05-26T02:39:00.945+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:39:00.946398669Z [2024-05-26T02:39:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:39:00.947307510Z [2024-05-26T02:39:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:39:00.947323723Z 2024-05-26T02:39:00.947329146Z 2024-05-26T02:39:00.947334637Z 2024-05-26T02:39:00.952349012Z [2024-05-26T02:39:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:39:00.952760727Z [2024-05-26T02:39:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:39:00.953227681Z [2024-05-26T02:39:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:39:00.953540421Z [2024-05-26T02:39:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:39:00.955011060Z [2024-05-26T02:39:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:39:00.955026662Z [2024-05-26T02:39:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:39:01.171935175Z [2024-05-26T02:39:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status queued for try_number 1 2024-05-26T02:39:01.172048068Z [2024-05-26T02:39:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status queued for try_number 1 2024-05-26T02:39:01.172134969Z [2024-05-26T02:39:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status queued for try_number 1 2024-05-26T02:39:01.181732450Z [2024-05-26T02:39:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9929e067-e6a5-4c13-a278-8aa422384530 2024-05-26T02:39:01.181916092Z [2024-05-26T02:39:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfbfd2a1-588f-48db-bdf9-0e7fc7a4cab0 2024-05-26T02:39:01.182086418Z [2024-05-26T02:39:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bb269e0-859a-479b-b109-851992e2ec73 2024-05-26T02:39:03.525157098Z [2024-05-26T02:39:03.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:39:03.525208843Z [2024-05-26T02:39:03.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:38:00+00:00, run_id=scheduled__2024-05-26T02:38:00+00:00, run_start_date=2024-05-26 02:39:00.877820+00:00, run_end_date=2024-05-26 02:39:03.520866+00:00, run_duration=2.643046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:38:00+00:00, data_interval_end=2024-05-26 02:39:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:39:03.539662414Z [2024-05-26T02:39:03.531+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:39:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:39:03.612582302Z [2024-05-26T02:39:03.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status success for try_number 1 2024-05-26T02:39:03.619759355Z [2024-05-26T02:39:03.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:38:00+00:00, map_index=-1, run_start_date=2024-05-26 02:39:01.871003+00:00, run_end_date=2024-05-26 02:39:02.352391+00:00, run_duration=0.481388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:39:00.948435+00:00, queued_by_job_id=1, pid=15402 2024-05-26T02:39:05.839664545Z [2024-05-26T02:39:05.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:39:05.839698506Z [2024-05-26T02:39:05.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:38:00+00:00, run_id=scheduled__2024-05-26T02:38:00+00:00, run_start_date=2024-05-26 02:39:00.880302+00:00, run_end_date=2024-05-26 02:39:05.838540+00:00, run_duration=4.958238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:38:00+00:00, data_interval_end=2024-05-26 02:39:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:39:05.891504823Z [2024-05-26T02:39:05.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:39:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:39:05.927206862Z [2024-05-26T02:39:05.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:39:05.927403671Z [2024-05-26T02:39:05.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:38:00+00:00, run_id=scheduled__2024-05-26T02:38:00+00:00, run_start_date=2024-05-26 02:39:00.882242+00:00, run_end_date=2024-05-26 02:39:05.927161+00:00, run_duration=5.044919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:38:00+00:00, data_interval_end=2024-05-26 02:39:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:39:05.937873132Z [2024-05-26T02:39:05.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:39:00+00:00, run_after=2024-05-26T02:40:00+00:00 2024-05-26T02:39:05.978235847Z [2024-05-26T02:39:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status success for try_number 1 2024-05-26T02:39:05.979713893Z [2024-05-26T02:39:05.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status success for try_number 1 2024-05-26T02:39:05.995279934Z [2024-05-26T02:39:05.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:38:00+00:00, map_index=-1, run_start_date=2024-05-26 02:39:02.771386+00:00, run_end_date=2024-05-26 02:39:05.084427+00:00, run_duration=2.313041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:39:00.948435+00:00, queued_by_job_id=1, pid=15420 2024-05-26T02:39:06.002162087Z [2024-05-26T02:39:05.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:38:00+00:00, map_index=-1, run_start_date=2024-05-26 02:39:02.783322+00:00, run_end_date=2024-05-26 02:39:04.689161+00:00, run_duration=1.905839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:39:00.948435+00:00, queued_by_job_id=1, pid=15421 2024-05-26T02:40:00.121765238Z [2024-05-26T02:40:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:41:00+00:00 2024-05-26T02:40:00.141115682Z [2024-05-26T02:40:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:45:00+00:00 2024-05-26T02:40:00.153260603Z [2024-05-26T02:40:00.152+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:40:00.162168928Z [2024-05-26T02:40:00.161+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:40:00.177491252Z [2024-05-26T02:40:00.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:41:00+00:00 2024-05-26T02:40:00.285018009Z [2024-05-26T02:40:00.284+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T02:40:00.285061681Z 2024-05-26T02:40:00.285072203Z 2024-05-26T02:40:00.285081539Z 2024-05-26T02:40:00.285090030Z 2024-05-26T02:40:00.285098623Z 2024-05-26T02:40:00.285162917Z [2024-05-26T02:40:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:40:00.285408745Z [2024-05-26T02:40:00.285+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:40:00.285636494Z [2024-05-26T02:40:00.285+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:40:00.285837044Z [2024-05-26T02:40:00.285+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:40:00.286048470Z [2024-05-26T02:40:00.285+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:40:00.286797945Z [2024-05-26T02:40:00.286+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:40:00.286821219Z 2024-05-26T02:40:00.286831918Z 2024-05-26T02:40:00.286841037Z 2024-05-26T02:40:00.286849563Z 2024-05-26T02:40:00.286858051Z 2024-05-26T02:40:00.292034758Z [2024-05-26T02:40:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:40:00.292415997Z [2024-05-26T02:40:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:40:00.292730823Z [2024-05-26T02:40:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:40:00.292980285Z [2024-05-26T02:40:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:40:00.293275850Z [2024-05-26T02:40:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:40:00.293487572Z [2024-05-26T02:40:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:40:00.293855461Z [2024-05-26T02:40:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:40:00.294088622Z [2024-05-26T02:40:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:40:00.294386164Z [2024-05-26T02:40:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:40:00.294696574Z [2024-05-26T02:40:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:40:00.823946216Z [2024-05-26T02:40:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:00.823969333Z [2024-05-26T02:40:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:00.823974327Z [2024-05-26T02:40:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:39:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:00.823977415Z [2024-05-26T02:40:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:39:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:00.823980404Z [2024-05-26T02:40:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:39:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:00.845255610Z [2024-05-26T02:40:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd5125fa-9f15-4e7d-a9c3-58f3327fa2d8 2024-05-26T02:40:00.848208953Z [2024-05-26T02:40:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdb3da4a-b194-4d46-83ff-117839fecd09 2024-05-26T02:40:00.848229420Z [2024-05-26T02:40:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10d10852-307f-41d8-beaf-4c808f7abd18 2024-05-26T02:40:00.848234618Z [2024-05-26T02:40:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to 690d19dc-d23d-4867-aa18-275d719bceba 2024-05-26T02:40:00.848238989Z [2024-05-26T02:40:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to a947894f-409b-4a30-a96b-ea61ee92f058 2024-05-26T02:40:02.071364943Z [2024-05-26T02:40:02.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:40:02.071980791Z [2024-05-26T02:40:02.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:38:00+00:00, run_id=scheduled__2024-05-26T02:38:00+00:00, run_start_date=2024-05-26 02:40:00.194676+00:00, run_end_date=2024-05-26 02:40:02.071556+00:00, run_duration=1.87688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:38:00+00:00, data_interval_end=2024-05-26 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:40:02.094715833Z [2024-05-26T02:40:02.094+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:42:00+00:00 2024-05-26T02:40:02.104970722Z [2024-05-26T02:40:02.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:40:02.105339980Z [2024-05-26T02:40:02.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:39:00+00:00, run_id=scheduled__2024-05-26T02:39:00+00:00, run_start_date=2024-05-26 02:40:00.196661+00:00, run_end_date=2024-05-26 02:40:02.104910+00:00, run_duration=1.908249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:39:00+00:00, data_interval_end=2024-05-26 02:40:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:40:02.117821394Z [2024-05-26T02:40:02.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:41:00+00:00 2024-05-26T02:40:02.162923258Z [2024-05-26T02:40:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:38:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:02.162956979Z [2024-05-26T02:40:02.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:39:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:02.172190180Z [2024-05-26T02:40:02.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:38:00+00:00, map_index=-1, run_start_date=2024-05-26 02:40:01.325466+00:00, run_end_date=2024-05-26 02:40:01.808778+00:00, run_duration=0.483312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:00.288556+00:00, queued_by_job_id=1, pid=15456 2024-05-26T02:40:02.172419768Z [2024-05-26T02:40:02.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:39:00+00:00, map_index=-1, run_start_date=2024-05-26 02:40:01.413929+00:00, run_end_date=2024-05-26 02:40:01.905668+00:00, run_duration=0.491739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:00.288556+00:00, queued_by_job_id=1, pid=15457 2024-05-26T02:40:03.268008895Z [2024-05-26T02:40:03.267+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:40:03.268047763Z 2024-05-26T02:40:03.268219697Z [2024-05-26T02:40:03.267+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:40:03.268945171Z [2024-05-26T02:40:03.268+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:40:03.268955869Z 2024-05-26T02:40:03.271624144Z [2024-05-26T02:40:03.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:40:03.271789902Z [2024-05-26T02:40:03.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:40:03.353052482Z [2024-05-26T02:40:03.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:03.361145944Z [2024-05-26T02:40:03.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f95cb9f-0fdf-4027-b33f-988cf6ab3d19 2024-05-26T02:40:03.524380164Z [2024-05-26T02:40:03.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:03.537778694Z [2024-05-26T02:40:03.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:35:00+00:00, map_index=-1, run_start_date=2024-05-26 02:40:02.820401+00:00, run_end_date=2024-05-26 02:40:03.202028+00:00, run_duration=0.381627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:00.288556+00:00, queued_by_job_id=1, pid=15488 2024-05-26T02:40:04.609505659Z [2024-05-26T02:40:04.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:40:04.612879753Z [2024-05-26T02:40:04.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:39:00+00:00, run_id=scheduled__2024-05-26T02:39:00+00:00, run_start_date=2024-05-26 02:40:00.197955+00:00, run_end_date=2024-05-26 02:40:04.607146+00:00, run_duration=4.409191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:39:00+00:00, data_interval_end=2024-05-26 02:40:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:40:04.626497003Z [2024-05-26T02:40:04.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:41:00+00:00 2024-05-26T02:40:04.643588730Z [2024-05-26T02:40:04.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:40:04.643621379Z [2024-05-26T02:40:04.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:39:00+00:00, run_id=scheduled__2024-05-26T02:39:00+00:00, run_start_date=2024-05-26 02:40:00.199327+00:00, run_end_date=2024-05-26 02:40:04.641119+00:00, run_duration=4.441792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:39:00+00:00, data_interval_end=2024-05-26 02:40:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:40:04.740993530Z [2024-05-26T02:40:04.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:41:00+00:00 2024-05-26T02:40:04.839940945Z [2024-05-26T02:40:04.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:39:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:04.848552536Z [2024-05-26T02:40:04.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:39:00+00:00, map_index=-1, run_start_date=2024-05-26 02:40:02.699420+00:00, run_end_date=2024-05-26 02:40:04.184811+00:00, run_duration=1.485391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:00.288556+00:00, queued_by_job_id=1, pid=15486 2024-05-26T02:40:06.006313990Z [2024-05-26T02:40:06.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:39:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:06.010749210Z [2024-05-26T02:40:06.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:39:00+00:00, map_index=-1, run_start_date=2024-05-26 02:40:02.799373+00:00, run_end_date=2024-05-26 02:40:04.553789+00:00, run_duration=1.754416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:00.288556+00:00, queued_by_job_id=1, pid=15487 2024-05-26T02:40:07.108103931Z [2024-05-26T02:40:07.107+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:40:07.108133696Z 2024-05-26T02:40:07.108138089Z [2024-05-26T02:40:07.107+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:40:07.108928958Z [2024-05-26T02:40:07.108+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:40:07.108942703Z 2024-05-26T02:40:07.111867436Z [2024-05-26T02:40:07.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:40:07.112094203Z [2024-05-26T02:40:07.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:40:07.169172979Z [2024-05-26T02:40:07.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:07.169211495Z [2024-05-26T02:40:07.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:07.173292975Z [2024-05-26T02:40:07.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78aa99f4-d59b-477a-81d0-3d69f26e37d4 2024-05-26T02:40:07.173336359Z [2024-05-26T02:40:07.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:35:00+00:00, map_index=-1, run_start_date=2024-05-26 02:40:05.574326+00:00, run_end_date=2024-05-26 02:40:05.962593+00:00, run_duration=0.388267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:03.269320+00:00, queued_by_job_id=1, pid=15511 2024-05-26T02:40:10.249278790Z [2024-05-26T02:40:10.248+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:40:10.249349892Z 2024-05-26T02:40:10.249717575Z [2024-05-26T02:40:10.249+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:40:10.251493751Z [2024-05-26T02:40:10.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:40:10.251546816Z 2024-05-26T02:40:10.257314416Z [2024-05-26T02:40:10.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:40:10.257713351Z [2024-05-26T02:40:10.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:40:10.324957323Z [2024-05-26T02:40:10.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status queued for try_number 1 2024-05-26T02:40:10.325685129Z [2024-05-26T02:40:10.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:10.335920750Z [2024-05-26T02:40:10.335+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0a39625-60b1-4ddb-a719-104f22437c85 2024-05-26T02:40:10.336580092Z [2024-05-26T02:40:10.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:35:00+00:00, map_index=0, run_start_date=2024-05-26 02:40:08.749617+00:00, run_end_date=2024-05-26 02:40:09.162133+00:00, run_duration=0.412516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:07.109333+00:00, queued_by_job_id=1, pid=15519 2024-05-26T02:40:13.252787049Z [2024-05-26T02:40:13.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:40:13.253979389Z [2024-05-26T02:40:13.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:35:00+00:00, run_id=scheduled__2024-05-26T02:35:00+00:00, run_start_date=2024-05-26 02:40:00.192304+00:00, run_end_date=2024-05-26 02:40:13.252698+00:00, run_duration=13.060394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:35:00+00:00, data_interval_end=2024-05-26 02:40:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:40:13.261020457Z [2024-05-26T02:40:13.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:40:00+00:00, run_after=2024-05-26T02:45:00+00:00 2024-05-26T02:40:13.298876538Z [2024-05-26T02:40:13.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:35:00+00:00 exited with status success for try_number 1 2024-05-26T02:40:13.304660760Z [2024-05-26T02:40:13.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:35:00+00:00, map_index=-1, run_start_date=2024-05-26 02:40:12.014691+00:00, run_end_date=2024-05-26 02:40:12.481943+00:00, run_duration=0.467252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:10.252300+00:00, queued_by_job_id=1, pid=15527 2024-05-26T02:40:35.701968721Z [2024-05-26T02:40:35.696+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:40:35.702028521Z 2024-05-26T02:40:35.702047646Z [2024-05-26T02:40:35.697+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-05-26T02:40:35.702063524Z [2024-05-26T02:40:35.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:40:35.702079312Z 2024-05-26T02:40:35.702121892Z [2024-05-26T02:40:35.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240526024035_023481', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:40:35.702192225Z [2024-05-26T02:40:35.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240526024035_023481', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-26T02:40:35.769002691Z [2024-05-26T02:40:35.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240526024035_023481 exited with status queued for try_number 1 2024-05-26T02:40:35.774820644Z [2024-05-26T02:40:35.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf2af192-c7f1-460b-8573-eba260f1beaf 2024-05-26T02:40:37.626651426Z [2024-05-26T02:40:37.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:40:37.627004543Z [2024-05-26T02:40:37.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-05-26 02:40:35.400372+00:00, run_id=vdu_alarm_20240526024035_023481, run_start_date=2024-05-26 02:40:35.656540+00:00, run_end_date=2024-05-26 02:40:37.626546+00:00, run_duration=1.970006, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-05-26 02:40:35.400372+00:00, data_interval_end=2024-05-26 02:40:35.400372+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-05-26T02:40:37.629699202Z [2024-05-26T02:40:37.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-05-26T02:40:37.653964295Z [2024-05-26T02:40:37.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240526024035_023481 exited with status success for try_number 1 2024-05-26T02:40:37.663266266Z [2024-05-26T02:40:37.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240526024035_023481, map_index=-1, run_start_date=2024-05-26 02:40:36.420109+00:00, run_end_date=2024-05-26 02:40:36.821262+00:00, run_duration=0.401153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:40:35.698582+00:00, queued_by_job_id=1, pid=15543 2024-05-26T02:41:00.544509142Z [2024-05-26T02:41:00.543+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:41:00+00:00, run_after=2024-05-26T02:42:00+00:00 2024-05-26T02:41:00.559672948Z [2024-05-26T02:41:00.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:41:00+00:00, run_after=2024-05-26T02:42:00+00:00 2024-05-26T02:41:00.566731018Z [2024-05-26T02:41:00.566+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:41:00.668542862Z [2024-05-26T02:41:00.667+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:41:00.668588990Z 2024-05-26T02:41:00.668599262Z 2024-05-26T02:41:00.668608021Z 2024-05-26T02:41:00.670554114Z [2024-05-26T02:41:00.669+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:41:00.671249021Z [2024-05-26T02:41:00.670+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:41:00.671686192Z [2024-05-26T02:41:00.671+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:41:00.673172638Z [2024-05-26T02:41:00.672+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:41:00.673191594Z 2024-05-26T02:41:00.673197847Z 2024-05-26T02:41:00.673203618Z 2024-05-26T02:41:00.679659869Z [2024-05-26T02:41:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:41:00.679905252Z [2024-05-26T02:41:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:41:00.680317079Z [2024-05-26T02:41:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:41:00.680595426Z [2024-05-26T02:41:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:41:00.680955299Z [2024-05-26T02:41:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:41:00.681175323Z [2024-05-26T02:41:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:41:01.166250136Z [2024-05-26T02:41:01.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:41:01.166477938Z [2024-05-26T02:41:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:41:01.166569150Z [2024-05-26T02:41:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:41:01.190144889Z [2024-05-26T02:41:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9bdbbe4-7a89-4be8-b11c-1b0a58e75501 2024-05-26T02:41:01.190179092Z [2024-05-26T02:41:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44a04c11-65cf-41fa-9aee-659bee22fc6f 2024-05-26T02:41:01.190182605Z [2024-05-26T02:41:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee16910c-f69b-4777-8149-3808fd56b1f6 2024-05-26T02:41:03.021081867Z [2024-05-26T02:41:03.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:41:03.021430558Z [2024-05-26T02:41:03.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:40:00+00:00, run_id=scheduled__2024-05-26T02:40:00+00:00, run_start_date=2024-05-26 02:41:00.580190+00:00, run_end_date=2024-05-26 02:41:03.020874+00:00, run_duration=2.440684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:40:00+00:00, data_interval_end=2024-05-26 02:41:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:41:03.035054705Z [2024-05-26T02:41:03.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:41:00+00:00, run_after=2024-05-26T02:42:00+00:00 2024-05-26T02:41:03.097702311Z [2024-05-26T02:41:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:41:03.107688134Z [2024-05-26T02:41:03.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=-1, run_start_date=2024-05-26 02:41:01.527146+00:00, run_end_date=2024-05-26 02:41:01.921058+00:00, run_duration=0.393912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:41:00.674540+00:00, queued_by_job_id=1, pid=15557 2024-05-26T02:41:04.185973837Z [2024-05-26T02:41:04.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:41:04.186359793Z [2024-05-26T02:41:04.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:40:00+00:00, run_id=scheduled__2024-05-26T02:40:00+00:00, run_start_date=2024-05-26 02:41:00.581867+00:00, run_end_date=2024-05-26 02:41:04.185890+00:00, run_duration=3.604023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:40:00+00:00, data_interval_end=2024-05-26 02:41:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:41:04.196459475Z [2024-05-26T02:41:04.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:41:00+00:00, run_after=2024-05-26T02:42:00+00:00 2024-05-26T02:41:04.213399620Z [2024-05-26T02:41:04.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:41:04.214316020Z [2024-05-26T02:41:04.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:40:00+00:00, run_id=scheduled__2024-05-26T02:40:00+00:00, run_start_date=2024-05-26 02:41:00.583387+00:00, run_end_date=2024-05-26 02:41:04.213324+00:00, run_duration=3.629937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:40:00+00:00, data_interval_end=2024-05-26 02:41:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:41:04.229574340Z [2024-05-26T02:41:04.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:41:00+00:00, run_after=2024-05-26T02:42:00+00:00 2024-05-26T02:41:04.265645804Z [2024-05-26T02:41:04.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:41:04.276109775Z [2024-05-26T02:41:04.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=-1, run_start_date=2024-05-26 02:41:02.520972+00:00, run_end_date=2024-05-26 02:41:03.726724+00:00, run_duration=1.205752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:41:00.674540+00:00, queued_by_job_id=1, pid=15575 2024-05-26T02:41:05.367389029Z [2024-05-26T02:41:05.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:41:05.374493821Z [2024-05-26T02:41:05.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=-1, run_start_date=2024-05-26 02:41:02.591834+00:00, run_end_date=2024-05-26 02:41:04.159561+00:00, run_duration=1.567727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:41:00.674540+00:00, queued_by_job_id=1, pid=15576 2024-05-26T02:42:00.948470610Z [2024-05-26T02:42:00.947+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:42:00.961545211Z [2024-05-26T02:42:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:42:00+00:00, run_after=2024-05-26T02:43:00+00:00 2024-05-26T02:42:00.973288969Z [2024-05-26T02:42:00.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:42:00+00:00, run_after=2024-05-26T02:43:00+00:00 2024-05-26T02:42:00.979234434Z [2024-05-26T02:42:00.978+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:42:01.078570278Z [2024-05-26T02:42:01.078+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:42:01.078603970Z 2024-05-26T02:42:01.078611299Z 2024-05-26T02:42:01.078639538Z 2024-05-26T02:42:01.078645730Z 2024-05-26T02:42:01.079131943Z [2024-05-26T02:42:01.078+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:42:01.079661373Z [2024-05-26T02:42:01.079+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:42:01.080562964Z [2024-05-26T02:42:01.079+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:42:01.081027215Z [2024-05-26T02:42:01.080+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:42:01.082913403Z [2024-05-26T02:42:01.082+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:42:01.082933969Z 2024-05-26T02:42:01.082941155Z 2024-05-26T02:42:01.082947067Z 2024-05-26T02:42:01.082952992Z 2024-05-26T02:42:01.092466146Z [2024-05-26T02:42:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:42:01.093230013Z [2024-05-26T02:42:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:42:01.094234490Z [2024-05-26T02:42:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:42:01.094698883Z [2024-05-26T02:42:01.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:42:01.095352054Z [2024-05-26T02:42:01.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:42:01.096116869Z [2024-05-26T02:42:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:42:01.096811535Z [2024-05-26T02:42:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:42:01.097278192Z [2024-05-26T02:42:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:42:01.656048297Z [2024-05-26T02:42:01.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:42:01.656323026Z [2024-05-26T02:42:01.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:41:00+00:00 exited with status queued for try_number 1 2024-05-26T02:42:01.656462067Z [2024-05-26T02:42:01.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:41:00+00:00 exited with status queued for try_number 1 2024-05-26T02:42:01.656593095Z [2024-05-26T02:42:01.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:41:00+00:00 exited with status queued for try_number 1 2024-05-26T02:42:01.676112643Z [2024-05-26T02:42:01.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to f496ff3c-971b-482d-b953-2ff325809327 2024-05-26T02:42:01.676358050Z [2024-05-26T02:42:01.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e2d18db-254f-485f-ab59-1c580805a968 2024-05-26T02:42:01.676550134Z [2024-05-26T02:42:01.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3f477cd-bfbc-472b-8029-c37edd2a25ad 2024-05-26T02:42:01.676735865Z [2024-05-26T02:42:01.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to baf0bf8b-a015-428e-baf2-99cd6197f205 2024-05-26T02:42:02.833037988Z [2024-05-26T02:42:02.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:42:02.833410145Z [2024-05-26T02:42:02.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:40:00+00:00, run_id=scheduled__2024-05-26T02:40:00+00:00, run_start_date=2024-05-26 02:42:00.993610+00:00, run_end_date=2024-05-26 02:42:02.832958+00:00, run_duration=1.839348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:40:00+00:00, data_interval_end=2024-05-26 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:42:02.844420796Z [2024-05-26T02:42:02.844+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:42:00+00:00, run_after=2024-05-26T02:44:00+00:00 2024-05-26T02:42:02.867658135Z [2024-05-26T02:42:02.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:42:02.868010527Z [2024-05-26T02:42:02.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:41:00+00:00, run_id=scheduled__2024-05-26T02:41:00+00:00, run_start_date=2024-05-26 02:42:00.997052+00:00, run_end_date=2024-05-26 02:42:02.867613+00:00, run_duration=1.870561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:41:00+00:00, data_interval_end=2024-05-26 02:42:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:42:02.885544753Z [2024-05-26T02:42:02.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:42:00+00:00, run_after=2024-05-26T02:43:00+00:00 2024-05-26T02:42:02.965390018Z [2024-05-26T02:42:02.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:42:02.965524899Z [2024-05-26T02:42:02.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:41:00+00:00 exited with status success for try_number 1 2024-05-26T02:42:02.974054403Z [2024-05-26T02:42:02.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=-1, run_start_date=2024-05-26 02:42:02.109997+00:00, run_end_date=2024-05-26 02:42:02.571589+00:00, run_duration=0.461592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:42:01.085194+00:00, queued_by_job_id=1, pid=15611 2024-05-26T02:42:02.974604783Z [2024-05-26T02:42:02.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:41:00+00:00, map_index=-1, run_start_date=2024-05-26 02:42:01.990574+00:00, run_end_date=2024-05-26 02:42:02.442903+00:00, run_duration=0.452329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:42:01.085194+00:00, queued_by_job_id=1, pid=15610 2024-05-26T02:42:05.156032664Z [2024-05-26T02:42:05.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:42:05.156178900Z [2024-05-26T02:42:05.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:41:00+00:00, run_id=scheduled__2024-05-26T02:41:00+00:00, run_start_date=2024-05-26 02:42:00.999088+00:00, run_end_date=2024-05-26 02:42:05.155953+00:00, run_duration=4.156865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:41:00+00:00, data_interval_end=2024-05-26 02:42:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:42:05.170128406Z [2024-05-26T02:42:05.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:42:00+00:00, run_after=2024-05-26T02:43:00+00:00 2024-05-26T02:42:05.221069308Z [2024-05-26T02:42:05.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:41:00+00:00 exited with status success for try_number 1 2024-05-26T02:42:05.227414235Z [2024-05-26T02:42:05.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:41:00+00:00, map_index=-1, run_start_date=2024-05-26 02:42:03.364139+00:00, run_end_date=2024-05-26 02:42:05.012711+00:00, run_duration=1.648572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:42:01.085194+00:00, queued_by_job_id=1, pid=15635 2024-05-26T02:42:06.283043362Z [2024-05-26T02:42:06.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:42:06.283128715Z [2024-05-26T02:42:06.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:41:00+00:00, run_id=scheduled__2024-05-26T02:41:00+00:00, run_start_date=2024-05-26 02:42:01.005992+00:00, run_end_date=2024-05-26 02:42:06.282847+00:00, run_duration=5.276855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:41:00+00:00, data_interval_end=2024-05-26 02:42:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:42:06.293060572Z [2024-05-26T02:42:06.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:42:00+00:00, run_after=2024-05-26T02:43:00+00:00 2024-05-26T02:42:06.330132952Z [2024-05-26T02:42:06.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:41:00+00:00 exited with status success for try_number 1 2024-05-26T02:42:06.341597387Z [2024-05-26T02:42:06.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:41:00+00:00, map_index=-1, run_start_date=2024-05-26 02:42:03.129703+00:00, run_end_date=2024-05-26 02:42:05.172244+00:00, run_duration=2.042541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:42:01.085194+00:00, queued_by_job_id=1, pid=15634 2024-05-26T02:43:00.150985335Z [2024-05-26T02:43:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:43:00.165747632Z [2024-05-26T02:43:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:43:00+00:00, run_after=2024-05-26T02:44:00+00:00 2024-05-26T02:43:00.181622494Z [2024-05-26T02:43:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:43:00+00:00, run_after=2024-05-26T02:44:00+00:00 2024-05-26T02:43:00.267733256Z [2024-05-26T02:43:00.267+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:43:00.267762718Z 2024-05-26T02:43:00.267766092Z 2024-05-26T02:43:00.267769206Z 2024-05-26T02:43:00.268038946Z [2024-05-26T02:43:00.267+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:43:00.268272190Z [2024-05-26T02:43:00.268+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:43:00.268434259Z [2024-05-26T02:43:00.268+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:43:00.269794999Z [2024-05-26T02:43:00.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:43:00.269809872Z 2024-05-26T02:43:00.269816092Z 2024-05-26T02:43:00.269821655Z 2024-05-26T02:43:00.274046158Z [2024-05-26T02:43:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:43:00.274502485Z [2024-05-26T02:43:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:43:00.275034385Z [2024-05-26T02:43:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:43:00.275307676Z [2024-05-26T02:43:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:43:00.275810354Z [2024-05-26T02:43:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:43:00.276243075Z [2024-05-26T02:43:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:43:00.562957844Z [2024-05-26T02:43:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status queued for try_number 1 2024-05-26T02:43:00.563117188Z [2024-05-26T02:43:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status queued for try_number 1 2024-05-26T02:43:00.563294230Z [2024-05-26T02:43:00.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status queued for try_number 1 2024-05-26T02:43:00.571566322Z [2024-05-26T02:43:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7c570f6-6232-4f35-beb6-78cb9b164c01 2024-05-26T02:43:00.571670052Z [2024-05-26T02:43:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cdd2e23-24a0-4fdb-b37c-7d7f669611e5 2024-05-26T02:43:00.571766794Z [2024-05-26T02:43:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e59fbbb-2ddb-493a-b54a-e3085667d53d 2024-05-26T02:43:02.811260750Z [2024-05-26T02:43:02.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:43:02.811793388Z [2024-05-26T02:43:02.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:42:00+00:00, run_id=scheduled__2024-05-26T02:42:00+00:00, run_start_date=2024-05-26 02:43:00.196753+00:00, run_end_date=2024-05-26 02:43:02.811133+00:00, run_duration=2.61438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:42:00+00:00, data_interval_end=2024-05-26 02:43:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:43:02.826627189Z [2024-05-26T02:43:02.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:43:00+00:00, run_after=2024-05-26T02:44:00+00:00 2024-05-26T02:43:02.914174091Z [2024-05-26T02:43:02.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status success for try_number 1 2024-05-26T02:43:02.921486266Z [2024-05-26T02:43:02.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:42:00+00:00, map_index=-1, run_start_date=2024-05-26 02:43:01.404576+00:00, run_end_date=2024-05-26 02:43:01.805165+00:00, run_duration=0.400589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:43:00.270724+00:00, queued_by_job_id=1, pid=15667 2024-05-26T02:43:04.981522913Z [2024-05-26T02:43:04.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:43:04.981950656Z [2024-05-26T02:43:04.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:42:00+00:00, run_id=scheduled__2024-05-26T02:42:00+00:00, run_start_date=2024-05-26 02:43:00.198294+00:00, run_end_date=2024-05-26 02:43:04.981424+00:00, run_duration=4.78313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:42:00+00:00, data_interval_end=2024-05-26 02:43:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:43:04.993332814Z [2024-05-26T02:43:04.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:43:00+00:00, run_after=2024-05-26T02:44:00+00:00 2024-05-26T02:43:05.010393585Z [2024-05-26T02:43:05.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:43:05.010766004Z [2024-05-26T02:43:05.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:42:00+00:00, run_id=scheduled__2024-05-26T02:42:00+00:00, run_start_date=2024-05-26 02:43:00.199558+00:00, run_end_date=2024-05-26 02:43:05.010309+00:00, run_duration=4.810751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:42:00+00:00, data_interval_end=2024-05-26 02:43:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:43:05.030315308Z [2024-05-26T02:43:05.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:43:00+00:00, run_after=2024-05-26T02:44:00+00:00 2024-05-26T02:43:05.085467386Z [2024-05-26T02:43:05.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status success for try_number 1 2024-05-26T02:43:05.092442077Z [2024-05-26T02:43:05.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:42:00+00:00, map_index=-1, run_start_date=2024-05-26 02:43:02.531195+00:00, run_end_date=2024-05-26 02:43:04.056834+00:00, run_duration=1.525639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:43:00.270724+00:00, queued_by_job_id=1, pid=15685 2024-05-26T02:43:06.159141259Z [2024-05-26T02:43:06.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status success for try_number 1 2024-05-26T02:43:06.167337307Z [2024-05-26T02:43:06.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:42:00+00:00, map_index=-1, run_start_date=2024-05-26 02:43:02.646114+00:00, run_end_date=2024-05-26 02:43:04.959449+00:00, run_duration=2.313335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:43:00.270724+00:00, queued_by_job_id=1, pid=15686 2024-05-26T02:43:33.729134724Z [2024-05-26T02:43:33.728+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:44:00.814516501Z [2024-05-26T02:44:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:44:00+00:00, run_after=2024-05-26T02:45:00+00:00 2024-05-26T02:44:00.826904233Z [2024-05-26T02:44:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:44:00+00:00, run_after=2024-05-26T02:45:00+00:00 2024-05-26T02:44:00.835964304Z [2024-05-26T02:44:00.835+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:44:00.846681650Z [2024-05-26T02:44:00.846+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:44:00.962001835Z [2024-05-26T02:44:00.961+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:44:00.962034553Z 2024-05-26T02:44:00.962038932Z 2024-05-26T02:44:00.962042623Z 2024-05-26T02:44:00.962045837Z 2024-05-26T02:44:00.962193950Z [2024-05-26T02:44:00.961+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:44:00.962446548Z [2024-05-26T02:44:00.962+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:44:00.962599737Z [2024-05-26T02:44:00.962+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:44:00.962774130Z [2024-05-26T02:44:00.962+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:44:00.963461941Z [2024-05-26T02:44:00.963+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:44:00.963473320Z 2024-05-26T02:44:00.963476716Z 2024-05-26T02:44:00.963479749Z 2024-05-26T02:44:00.963482665Z 2024-05-26T02:44:00.967790208Z [2024-05-26T02:44:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:44:00.968050190Z [2024-05-26T02:44:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:44:00.968399474Z [2024-05-26T02:44:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:44:00.968644132Z [2024-05-26T02:44:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:44:00.968994733Z [2024-05-26T02:44:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:44:00.969228800Z [2024-05-26T02:44:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:44:00.969557097Z [2024-05-26T02:44:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:44:00.969739802Z [2024-05-26T02:44:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:44:01.196390230Z [2024-05-26T02:44:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status queued for try_number 1 2024-05-26T02:44:01.196586132Z [2024-05-26T02:44:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:43:00+00:00 exited with status queued for try_number 1 2024-05-26T02:44:01.196747933Z [2024-05-26T02:44:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:43:00+00:00 exited with status queued for try_number 1 2024-05-26T02:44:01.196883510Z [2024-05-26T02:44:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:43:00+00:00 exited with status queued for try_number 1 2024-05-26T02:44:01.209032105Z [2024-05-26T02:44:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to e93f2a62-3e0d-40c7-9382-5d9a4a16da2c 2024-05-26T02:44:01.209525745Z [2024-05-26T02:44:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 946a43c4-4b74-49d9-adcf-1660f9884ec4 2024-05-26T02:44:01.209817082Z [2024-05-26T02:44:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 216e49a0-b101-450d-bf2e-57aa3591362c 2024-05-26T02:44:01.210033792Z [2024-05-26T02:44:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62c1a512-e635-4f74-9330-f203b999da30 2024-05-26T02:44:02.372117974Z [2024-05-26T02:44:02.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:44:02.372620097Z [2024-05-26T02:44:02.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:42:00+00:00, run_id=scheduled__2024-05-26T02:42:00+00:00, run_start_date=2024-05-26 02:44:00.879732+00:00, run_end_date=2024-05-26 02:44:02.372031+00:00, run_duration=1.492299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:42:00+00:00, data_interval_end=2024-05-26 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:44:02.380068794Z [2024-05-26T02:44:02.379+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:44:00+00:00, run_after=2024-05-26T02:46:00+00:00 2024-05-26T02:44:02.389157556Z [2024-05-26T02:44:02.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:44:02.390082987Z [2024-05-26T02:44:02.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:43:00+00:00, run_id=scheduled__2024-05-26T02:43:00+00:00, run_start_date=2024-05-26 02:44:00.881931+00:00, run_end_date=2024-05-26 02:44:02.389105+00:00, run_duration=1.507174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:43:00+00:00, data_interval_end=2024-05-26 02:44:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:44:02.411093910Z [2024-05-26T02:44:02.410+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:44:00+00:00, run_after=2024-05-26T02:45:00+00:00 2024-05-26T02:44:02.473835857Z [2024-05-26T02:44:02.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:42:00+00:00 exited with status success for try_number 1 2024-05-26T02:44:02.473875646Z [2024-05-26T02:44:02.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:43:00+00:00 exited with status success for try_number 1 2024-05-26T02:44:02.485026322Z [2024-05-26T02:44:02.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:43:00+00:00, map_index=-1, run_start_date=2024-05-26 02:44:01.832528+00:00, run_end_date=2024-05-26 02:44:02.137787+00:00, run_duration=0.305259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:44:00.964480+00:00, queued_by_job_id=1, pid=15721 2024-05-26T02:44:02.485239603Z [2024-05-26T02:44:02.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:42:00+00:00, map_index=-1, run_start_date=2024-05-26 02:44:01.742552+00:00, run_end_date=2024-05-26 02:44:02.074779+00:00, run_duration=0.332227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:44:00.964480+00:00, queued_by_job_id=1, pid=15720 2024-05-26T02:44:05.861955320Z [2024-05-26T02:44:05.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:44:05.862370911Z [2024-05-26T02:44:05.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:43:00+00:00, run_id=scheduled__2024-05-26T02:43:00+00:00, run_start_date=2024-05-26 02:44:00.883377+00:00, run_end_date=2024-05-26 02:44:05.861859+00:00, run_duration=4.978482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:43:00+00:00, data_interval_end=2024-05-26 02:44:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:44:05.872414390Z [2024-05-26T02:44:05.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:44:00+00:00, run_after=2024-05-26T02:45:00+00:00 2024-05-26T02:44:05.880015893Z [2024-05-26T02:44:05.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:44:05.880401754Z [2024-05-26T02:44:05.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:43:00+00:00, run_id=scheduled__2024-05-26T02:43:00+00:00, run_start_date=2024-05-26 02:44:00.884453+00:00, run_end_date=2024-05-26 02:44:05.879929+00:00, run_duration=4.995476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:43:00+00:00, data_interval_end=2024-05-26 02:44:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:44:05.898670459Z [2024-05-26T02:44:05.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:44:00+00:00, run_after=2024-05-26T02:45:00+00:00 2024-05-26T02:44:05.937652042Z [2024-05-26T02:44:05.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:43:00+00:00 exited with status success for try_number 1 2024-05-26T02:44:05.937974420Z [2024-05-26T02:44:05.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:43:00+00:00 exited with status success for try_number 1 2024-05-26T02:44:05.944724604Z [2024-05-26T02:44:05.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:43:00+00:00, map_index=-1, run_start_date=2024-05-26 02:44:02.987956+00:00, run_end_date=2024-05-26 02:44:04.767011+00:00, run_duration=1.779055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:44:00.964480+00:00, queued_by_job_id=1, pid=15745 2024-05-26T02:44:05.945312633Z [2024-05-26T02:44:05.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:43:00+00:00, map_index=-1, run_start_date=2024-05-26 02:44:02.912979+00:00, run_end_date=2024-05-26 02:44:05.112942+00:00, run_duration=2.199963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:44:00.964480+00:00, queued_by_job_id=1, pid=15744 2024-05-26T02:45:00.710472291Z [2024-05-26T02:45:00.709+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:45:00.729111721Z [2024-05-26T02:45:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:45:00+00:00, run_after=2024-05-26T02:46:00+00:00 2024-05-26T02:45:00.753346473Z [2024-05-26T02:45:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:45:00+00:00, run_after=2024-05-26T02:46:00+00:00 2024-05-26T02:45:00.768768803Z [2024-05-26T02:45:00.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:45:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:45:00.862972159Z [2024-05-26T02:45:00.862+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:45:00.862999581Z 2024-05-26T02:45:00.863008258Z 2024-05-26T02:45:00.863015949Z 2024-05-26T02:45:00.863023582Z 2024-05-26T02:45:00.863053626Z [2024-05-26T02:45:00.862+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:45:00.863255401Z [2024-05-26T02:45:00.863+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:45:00.863348429Z [2024-05-26T02:45:00.863+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:45:00.863487875Z [2024-05-26T02:45:00.863+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:45:00.864141188Z [2024-05-26T02:45:00.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:45:00.864153453Z 2024-05-26T02:45:00.864156899Z 2024-05-26T02:45:00.864159866Z 2024-05-26T02:45:00.864162782Z 2024-05-26T02:45:00.868453020Z [2024-05-26T02:45:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:45:00.868640428Z [2024-05-26T02:45:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:45:00.869135931Z [2024-05-26T02:45:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:45:00.869343872Z [2024-05-26T02:45:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:45:00.869571224Z [2024-05-26T02:45:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:45:00.869672456Z [2024-05-26T02:45:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:45:00.869870224Z [2024-05-26T02:45:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:45:00.869978074Z [2024-05-26T02:45:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:45:01.356040276Z [2024-05-26T02:45:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:45:01.357251831Z [2024-05-26T02:45:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status queued for try_number 1 2024-05-26T02:45:01.358087023Z [2024-05-26T02:45:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status queued for try_number 1 2024-05-26T02:45:01.358184327Z [2024-05-26T02:45:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status queued for try_number 1 2024-05-26T02:45:01.377035893Z [2024-05-26T02:45:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c521da4-8b9d-4284-8d5e-94b82d2dc865 2024-05-26T02:45:01.377126209Z [2024-05-26T02:45:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39e61382-0ba6-4049-8577-5d831ea0d767 2024-05-26T02:45:01.377176324Z [2024-05-26T02:45:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3efecbb-6f81-4da3-a918-9b6a2e5ce51b 2024-05-26T02:45:01.377400377Z [2024-05-26T02:45:01.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44712868-cf60-43d0-b88d-939bfc8dbaa6 2024-05-26T02:45:02.652048230Z [2024-05-26T02:45:02.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:45:02.652488709Z [2024-05-26T02:45:02.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:44:00+00:00, run_id=scheduled__2024-05-26T02:44:00+00:00, run_start_date=2024-05-26 02:45:00.779287+00:00, run_end_date=2024-05-26 02:45:02.651897+00:00, run_duration=1.87261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:44:00+00:00, data_interval_end=2024-05-26 02:45:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:45:02.674609048Z [2024-05-26T02:45:02.674+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:45:00+00:00, run_after=2024-05-26T02:46:00+00:00 2024-05-26T02:45:02.729824328Z [2024-05-26T02:45:02.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status success for try_number 1 2024-05-26T02:45:02.736872862Z [2024-05-26T02:45:02.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:44:00+00:00, map_index=-1, run_start_date=2024-05-26 02:45:01.854266+00:00, run_end_date=2024-05-26 02:45:02.209601+00:00, run_duration=0.355335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:45:00.865043+00:00, queued_by_job_id=1, pid=15778 2024-05-26T02:45:03.833572741Z [2024-05-26T02:45:03.833+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:45:03.833603211Z 2024-05-26T02:45:03.841446487Z [2024-05-26T02:45:03.841+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:45:03.842207929Z [2024-05-26T02:45:03.841+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:45:03.842222116Z 2024-05-26T02:45:03.850736168Z [2024-05-26T02:45:03.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:45:03.851251264Z [2024-05-26T02:45:03.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:45:03.915999488Z [2024-05-26T02:45:03.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:45:03.916243537Z [2024-05-26T02:45:03.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:45:03.922163183Z [2024-05-26T02:45:03.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a1e1e76-610f-46db-b3b9-36b091c43924 2024-05-26T02:45:03.922574387Z [2024-05-26T02:45:03.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=-1, run_start_date=2024-05-26 02:45:03.239304+00:00, run_end_date=2024-05-26 02:45:03.643936+00:00, run_duration=0.404632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:45:00.865043+00:00, queued_by_job_id=1, pid=15804 2024-05-26T02:45:05.062749140Z [2024-05-26T02:45:05.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:45:05.067200071Z [2024-05-26T02:45:05.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:44:00+00:00, run_id=scheduled__2024-05-26T02:44:00+00:00, run_start_date=2024-05-26 02:45:00.780805+00:00, run_end_date=2024-05-26 02:45:05.066732+00:00, run_duration=4.285927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:44:00+00:00, data_interval_end=2024-05-26 02:45:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:45:05.088493339Z [2024-05-26T02:45:05.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:45:00+00:00, run_after=2024-05-26T02:46:00+00:00 2024-05-26T02:45:05.095364883Z [2024-05-26T02:45:05.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:45:05.095667258Z [2024-05-26T02:45:05.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:44:00+00:00, run_id=scheduled__2024-05-26T02:44:00+00:00, run_start_date=2024-05-26 02:45:00.781851+00:00, run_end_date=2024-05-26 02:45:05.095347+00:00, run_duration=4.313496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:44:00+00:00, data_interval_end=2024-05-26 02:45:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:45:05.115367778Z [2024-05-26T02:45:05.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:45:00+00:00, run_after=2024-05-26T02:46:00+00:00 2024-05-26T02:45:05.171855530Z [2024-05-26T02:45:05.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status success for try_number 1 2024-05-26T02:45:05.172020299Z [2024-05-26T02:45:05.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status success for try_number 1 2024-05-26T02:45:05.177651697Z [2024-05-26T02:45:05.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:44:00+00:00, map_index=-1, run_start_date=2024-05-26 02:45:03.108182+00:00, run_end_date=2024-05-26 02:45:04.510591+00:00, run_duration=1.402409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:45:00.865043+00:00, queued_by_job_id=1, pid=15803 2024-05-26T02:45:05.177939998Z [2024-05-26T02:45:05.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:44:00+00:00, map_index=-1, run_start_date=2024-05-26 02:45:03.009448+00:00, run_end_date=2024-05-26 02:45:04.627990+00:00, run_duration=1.618542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:45:00.865043+00:00, queued_by_job_id=1, pid=15802 2024-05-26T02:45:06.464309711Z [2024-05-26T02:45:06.463+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:45:06.464342643Z 2024-05-26T02:45:06.464346807Z [2024-05-26T02:45:06.464+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:45:06.464788963Z [2024-05-26T02:45:06.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:45:06.464798355Z 2024-05-26T02:45:06.467011806Z [2024-05-26T02:45:06.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:45:06.467061726Z [2024-05-26T02:45:06.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:45:06.530505090Z [2024-05-26T02:45:06.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:45:06.535770646Z [2024-05-26T02:45:06.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8db4d508-46ad-4754-b88b-09ebb84c3240 2024-05-26T02:45:06.668655164Z [2024-05-26T02:45:06.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:45:06.687253793Z [2024-05-26T02:45:06.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=-1, run_start_date=2024-05-26 02:45:05.924266+00:00, run_end_date=2024-05-26 02:45:06.302100+00:00, run_duration=0.377834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:45:03.842705+00:00, queued_by_job_id=1, pid=15827 2024-05-26T02:45:08.866737101Z [2024-05-26T02:45:08.866+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:45:08.866764637Z 2024-05-26T02:45:08.867041052Z [2024-05-26T02:45:08.866+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:45:08.867870830Z [2024-05-26T02:45:08.867+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:45:08.867880075Z 2024-05-26T02:45:08.870775188Z [2024-05-26T02:45:08.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:45:08.871008597Z [2024-05-26T02:45:08.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:45:08.929958374Z [2024-05-26T02:45:08.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status queued for try_number 1 2024-05-26T02:45:08.929998876Z [2024-05-26T02:45:08.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:45:08.937108937Z [2024-05-26T02:45:08.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d5a01cd-a772-4a8e-9ee9-c6fd7419c65e 2024-05-26T02:45:08.937305187Z [2024-05-26T02:45:08.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=0, run_start_date=2024-05-26 02:45:08.139113+00:00, run_end_date=2024-05-26 02:45:08.569175+00:00, run_duration=0.430062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:45:06.465040+00:00, queued_by_job_id=1, pid=15835 2024-05-26T02:45:11.159655761Z [2024-05-26T02:45:11.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:45:11.159876879Z [2024-05-26T02:45:11.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:40:00+00:00, run_id=scheduled__2024-05-26T02:40:00+00:00, run_start_date=2024-05-26 02:45:00.778007+00:00, run_end_date=2024-05-26 02:45:11.159497+00:00, run_duration=10.38149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:40:00+00:00, data_interval_end=2024-05-26 02:45:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:45:11.165342501Z [2024-05-26T02:45:11.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:45:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:45:11.195029448Z [2024-05-26T02:45:11.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:40:00+00:00 exited with status success for try_number 1 2024-05-26T02:45:11.199974797Z [2024-05-26T02:45:11.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:40:00+00:00, map_index=-1, run_start_date=2024-05-26 02:45:10.544271+00:00, run_end_date=2024-05-26 02:45:10.939182+00:00, run_duration=0.394911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:45:08.868373+00:00, queued_by_job_id=1, pid=15843 2024-05-26T02:46:01.023489078Z [2024-05-26T02:46:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:46:00+00:00, run_after=2024-05-26T02:47:00+00:00 2024-05-26T02:46:01.030404736Z [2024-05-26T02:46:01.030+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:46:01.041714088Z [2024-05-26T02:46:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:46:00+00:00, run_after=2024-05-26T02:47:00+00:00 2024-05-26T02:46:01.049810171Z [2024-05-26T02:46:01.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:46:01.122501039Z [2024-05-26T02:46:01.122+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:46:01.122525275Z 2024-05-26T02:46:01.122540758Z 2024-05-26T02:46:01.122544302Z 2024-05-26T02:46:01.122547351Z 2024-05-26T02:46:01.122823269Z [2024-05-26T02:46:01.122+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:46:01.123021745Z [2024-05-26T02:46:01.122+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:46:01.123203391Z [2024-05-26T02:46:01.123+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:46:01.123377940Z [2024-05-26T02:46:01.123+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:46:01.124197729Z [2024-05-26T02:46:01.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:46:01.124210373Z 2024-05-26T02:46:01.124213889Z 2024-05-26T02:46:01.124217327Z 2024-05-26T02:46:01.124239098Z 2024-05-26T02:46:01.127925012Z [2024-05-26T02:46:01.127+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:46:01.128184578Z [2024-05-26T02:46:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:46:01.128588453Z [2024-05-26T02:46:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:46:01.128810638Z [2024-05-26T02:46:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:46:01.129153235Z [2024-05-26T02:46:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:46:01.129404576Z [2024-05-26T02:46:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:46:01.129711132Z [2024-05-26T02:46:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:46:01.129911395Z [2024-05-26T02:46:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:46:01.491648125Z [2024-05-26T02:46:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status queued for try_number 1 2024-05-26T02:46:01.491854511Z [2024-05-26T02:46:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status queued for try_number 1 2024-05-26T02:46:01.492085555Z [2024-05-26T02:46:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status queued for try_number 1 2024-05-26T02:46:01.492245445Z [2024-05-26T02:46:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status queued for try_number 1 2024-05-26T02:46:01.502894760Z [2024-05-26T02:46:01.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47d800b7-4f20-4f45-80f7-cc0f14aec4f0 2024-05-26T02:46:01.503235001Z [2024-05-26T02:46:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceb1b314-c862-4531-bd03-34413a06709e 2024-05-26T02:46:01.503451578Z [2024-05-26T02:46:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to c41e1a99-021d-4748-b01e-5a2aad1bade0 2024-05-26T02:46:01.503794505Z [2024-05-26T02:46:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to b48ca0dd-02c8-4d73-a7f9-e863f9f8cfa3 2024-05-26T02:46:03.522141058Z [2024-05-26T02:46:03.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:46:03.522552267Z [2024-05-26T02:46:03.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:44:00+00:00, run_id=scheduled__2024-05-26T02:44:00+00:00, run_start_date=2024-05-26 02:46:01.060052+00:00, run_end_date=2024-05-26 02:46:03.522055+00:00, run_duration=2.462003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:44:00+00:00, data_interval_end=2024-05-26 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:46:03.529578811Z [2024-05-26T02:46:03.529+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:46:00+00:00, run_after=2024-05-26T02:48:00+00:00 2024-05-26T02:46:03.535674696Z [2024-05-26T02:46:03.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:46:03.536005251Z [2024-05-26T02:46:03.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:45:00+00:00, run_id=scheduled__2024-05-26T02:45:00+00:00, run_start_date=2024-05-26 02:46:01.061343+00:00, run_end_date=2024-05-26 02:46:03.535602+00:00, run_duration=2.474259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:45:00+00:00, data_interval_end=2024-05-26 02:46:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:46:03.546826462Z [2024-05-26T02:46:03.546+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:46:00+00:00, run_after=2024-05-26T02:47:00+00:00 2024-05-26T02:46:03.611970049Z [2024-05-26T02:46:03.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:44:00+00:00 exited with status success for try_number 1 2024-05-26T02:46:03.612230363Z [2024-05-26T02:46:03.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status success for try_number 1 2024-05-26T02:46:03.619065913Z [2024-05-26T02:46:03.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:45:00+00:00, map_index=-1, run_start_date=2024-05-26 02:46:02.057612+00:00, run_end_date=2024-05-26 02:46:02.447165+00:00, run_duration=0.389553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:46:01.125208+00:00, queued_by_job_id=1, pid=15867 2024-05-26T02:46:03.619410335Z [2024-05-26T02:46:03.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:44:00+00:00, map_index=-1, run_start_date=2024-05-26 02:46:02.004899+00:00, run_end_date=2024-05-26 02:46:02.435512+00:00, run_duration=0.430613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:46:01.125208+00:00, queued_by_job_id=1, pid=15866 2024-05-26T02:46:04.717767936Z [2024-05-26T02:46:04.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:46:04.718156423Z [2024-05-26T02:46:04.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:45:00+00:00, run_id=scheduled__2024-05-26T02:45:00+00:00, run_start_date=2024-05-26 02:46:01.062373+00:00, run_end_date=2024-05-26 02:46:04.717670+00:00, run_duration=3.655297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:45:00+00:00, data_interval_end=2024-05-26 02:46:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:46:04.741520078Z [2024-05-26T02:46:04.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:46:00+00:00, run_after=2024-05-26T02:47:00+00:00 2024-05-26T02:46:04.790834013Z [2024-05-26T02:46:04.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status success for try_number 1 2024-05-26T02:46:04.795690368Z [2024-05-26T02:46:04.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:45:00+00:00, map_index=-1, run_start_date=2024-05-26 02:46:03.167842+00:00, run_end_date=2024-05-26 02:46:04.550859+00:00, run_duration=1.383017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:46:01.125208+00:00, queued_by_job_id=1, pid=15890 2024-05-26T02:46:05.838099096Z [2024-05-26T02:46:05.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:46:05.839218625Z [2024-05-26T02:46:05.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:45:00+00:00, run_id=scheduled__2024-05-26T02:45:00+00:00, run_start_date=2024-05-26 02:46:01.063553+00:00, run_end_date=2024-05-26 02:46:05.838441+00:00, run_duration=4.774888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:45:00+00:00, data_interval_end=2024-05-26 02:46:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:46:05.849810321Z [2024-05-26T02:46:05.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:46:00+00:00, run_after=2024-05-26T02:47:00+00:00 2024-05-26T02:46:05.885057954Z [2024-05-26T02:46:05.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status success for try_number 1 2024-05-26T02:46:05.893747558Z [2024-05-26T02:46:05.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:45:00+00:00, map_index=-1, run_start_date=2024-05-26 02:46:03.452982+00:00, run_end_date=2024-05-26 02:46:05.134197+00:00, run_duration=1.681215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:46:01.125208+00:00, queued_by_job_id=1, pid=15891 2024-05-26T02:47:00.214826665Z [2024-05-26T02:47:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:47:00+00:00, run_after=2024-05-26T02:48:00+00:00 2024-05-26T02:47:00.222151996Z [2024-05-26T02:47:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:47:00.238429338Z [2024-05-26T02:47:00.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:47:00+00:00, run_after=2024-05-26T02:48:00+00:00 2024-05-26T02:47:00.304751039Z [2024-05-26T02:47:00.304+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:47:00.304785483Z 2024-05-26T02:47:00.304796232Z 2024-05-26T02:47:00.304802281Z 2024-05-26T02:47:00.304818697Z [2024-05-26T02:47:00.304+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:47:00.305186015Z [2024-05-26T02:47:00.304+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:47:00.305351019Z [2024-05-26T02:47:00.305+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:47:00.305885863Z [2024-05-26T02:47:00.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:47:00.305902427Z 2024-05-26T02:47:00.305906625Z 2024-05-26T02:47:00.305909717Z 2024-05-26T02:47:00.308657755Z [2024-05-26T02:47:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:47:00.308814365Z [2024-05-26T02:47:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:47:00.309019921Z [2024-05-26T02:47:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:47:00.309083861Z [2024-05-26T02:47:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:47:00.309259415Z [2024-05-26T02:47:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:47:00.309322650Z [2024-05-26T02:47:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:47:00.571185778Z [2024-05-26T02:47:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status queued for try_number 1 2024-05-26T02:47:00.571241434Z [2024-05-26T02:47:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status queued for try_number 1 2024-05-26T02:47:00.571355556Z [2024-05-26T02:47:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status queued for try_number 1 2024-05-26T02:47:00.589926759Z [2024-05-26T02:47:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d35520e-1f7f-4e87-9239-e8ca37049abe 2024-05-26T02:47:00.590057528Z [2024-05-26T02:47:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cd098b9-6fac-483c-83af-80f450438d8e 2024-05-26T02:47:00.590233356Z [2024-05-26T02:47:00.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6fd1b25-0cd7-4922-b555-5f4740de289d 2024-05-26T02:47:01.727834207Z [2024-05-26T02:47:01.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:47:01.729879353Z [2024-05-26T02:47:01.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:46:00+00:00, run_id=scheduled__2024-05-26T02:46:00+00:00, run_start_date=2024-05-26 02:47:00.250314+00:00, run_end_date=2024-05-26 02:47:01.727713+00:00, run_duration=1.477399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:46:00+00:00, data_interval_end=2024-05-26 02:47:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:47:01.755131520Z [2024-05-26T02:47:01.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:47:00+00:00, run_after=2024-05-26T02:48:00+00:00 2024-05-26T02:47:01.807678093Z [2024-05-26T02:47:01.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status success for try_number 1 2024-05-26T02:47:01.816435390Z [2024-05-26T02:47:01.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:46:00+00:00, map_index=-1, run_start_date=2024-05-26 02:47:01.080351+00:00, run_end_date=2024-05-26 02:47:01.508142+00:00, run_duration=0.427791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:47:00.306525+00:00, queued_by_job_id=1, pid=15923 2024-05-26T02:47:04.366201248Z [2024-05-26T02:47:04.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:47:04.366469339Z [2024-05-26T02:47:04.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:46:00+00:00, run_id=scheduled__2024-05-26T02:46:00+00:00, run_start_date=2024-05-26 02:47:00.251502+00:00, run_end_date=2024-05-26 02:47:04.366143+00:00, run_duration=4.114641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:46:00+00:00, data_interval_end=2024-05-26 02:47:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:47:04.381323699Z [2024-05-26T02:47:04.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:47:00+00:00, run_after=2024-05-26T02:48:00+00:00 2024-05-26T02:47:04.452014545Z [2024-05-26T02:47:04.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status success for try_number 1 2024-05-26T02:47:04.475223390Z [2024-05-26T02:47:04.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:46:00+00:00, map_index=-1, run_start_date=2024-05-26 02:47:02.183991+00:00, run_end_date=2024-05-26 02:47:03.768188+00:00, run_duration=1.584197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:47:00.306525+00:00, queued_by_job_id=1, pid=15942 2024-05-26T02:47:05.527660481Z [2024-05-26T02:47:05.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:47:05.527689529Z [2024-05-26T02:47:05.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:46:00+00:00, run_id=scheduled__2024-05-26T02:46:00+00:00, run_start_date=2024-05-26 02:47:00.252522+00:00, run_end_date=2024-05-26 02:47:05.526903+00:00, run_duration=5.274381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:46:00+00:00, data_interval_end=2024-05-26 02:47:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:47:05.536124698Z [2024-05-26T02:47:05.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:47:00+00:00, run_after=2024-05-26T02:48:00+00:00 2024-05-26T02:47:05.584249673Z [2024-05-26T02:47:05.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status success for try_number 1 2024-05-26T02:47:05.589550489Z [2024-05-26T02:47:05.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:46:00+00:00, map_index=-1, run_start_date=2024-05-26 02:47:02.068095+00:00, run_end_date=2024-05-26 02:47:04.375452+00:00, run_duration=2.307357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:47:00.306525+00:00, queued_by_job_id=1, pid=15941 2024-05-26T02:48:00.271074902Z [2024-05-26T02:48:00.270+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:48:00.286002377Z [2024-05-26T02:48:00.285+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:48:00.307291103Z [2024-05-26T02:48:00.306+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:48:00+00:00, run_after=2024-05-26T02:49:00+00:00 2024-05-26T02:48:00.322828531Z [2024-05-26T02:48:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:48:00+00:00, run_after=2024-05-26T02:49:00+00:00 2024-05-26T02:48:00.432810619Z [2024-05-26T02:48:00.432+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:48:00.432851161Z 2024-05-26T02:48:00.432917017Z 2024-05-26T02:48:00.432927712Z 2024-05-26T02:48:00.432934564Z 2024-05-26T02:48:00.432957451Z [2024-05-26T02:48:00.432+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:48:00.432964585Z [2024-05-26T02:48:00.432+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:48:00.433084919Z [2024-05-26T02:48:00.432+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:48:00.433389860Z [2024-05-26T02:48:00.433+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:48:00.434375645Z [2024-05-26T02:48:00.434+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:48:00.434399713Z 2024-05-26T02:48:00.434407285Z 2024-05-26T02:48:00.434413190Z 2024-05-26T02:48:00.434418911Z 2024-05-26T02:48:00.447264932Z [2024-05-26T02:48:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:48:00.447793520Z [2024-05-26T02:48:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:48:00.448731675Z [2024-05-26T02:48:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:48:00.449076099Z [2024-05-26T02:48:00.448+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:48:00.449724776Z [2024-05-26T02:48:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:48:00.450283693Z [2024-05-26T02:48:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:48:00.450855286Z [2024-05-26T02:48:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:48:00.451196765Z [2024-05-26T02:48:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:48:01.022355907Z [2024-05-26T02:48:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status queued for try_number 1 2024-05-26T02:48:01.022395905Z [2024-05-26T02:48:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:47:00+00:00 exited with status queued for try_number 1 2024-05-26T02:48:01.022482827Z [2024-05-26T02:48:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:47:00+00:00 exited with status queued for try_number 1 2024-05-26T02:48:01.022530288Z [2024-05-26T02:48:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:47:00+00:00 exited with status queued for try_number 1 2024-05-26T02:48:01.042956963Z [2024-05-26T02:48:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1540279-6312-4303-b186-4a1a41246876 2024-05-26T02:48:01.043013301Z [2024-05-26T02:48:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 351add3f-2317-4bb4-a9ca-f2fc0040b844 2024-05-26T02:48:01.043258811Z [2024-05-26T02:48:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4d7b1cc-d866-4bca-8076-e5c2ac0d65fc 2024-05-26T02:48:01.043369297Z [2024-05-26T02:48:01.043+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb70d9e5-87ee-4d12-a3e5-612ba7e7b148 2024-05-26T02:48:02.251731958Z [2024-05-26T02:48:02.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:48:02.252551444Z [2024-05-26T02:48:02.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:46:00+00:00, run_id=scheduled__2024-05-26T02:46:00+00:00, run_start_date=2024-05-26 02:48:00.336965+00:00, run_end_date=2024-05-26 02:48:02.251806+00:00, run_duration=1.914841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:46:00+00:00, data_interval_end=2024-05-26 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:48:02.262587165Z [2024-05-26T02:48:02.262+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:48:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:48:02.268766603Z [2024-05-26T02:48:02.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:48:02.269123002Z [2024-05-26T02:48:02.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:47:00+00:00, run_id=scheduled__2024-05-26T02:47:00+00:00, run_start_date=2024-05-26 02:48:00.338541+00:00, run_end_date=2024-05-26 02:48:02.268702+00:00, run_duration=1.930161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:47:00+00:00, data_interval_end=2024-05-26 02:48:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:48:02.278837347Z [2024-05-26T02:48:02.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:48:00+00:00, run_after=2024-05-26T02:49:00+00:00 2024-05-26T02:48:02.328728102Z [2024-05-26T02:48:02.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:46:00+00:00 exited with status success for try_number 1 2024-05-26T02:48:02.329662320Z [2024-05-26T02:48:02.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:47:00+00:00 exited with status success for try_number 1 2024-05-26T02:48:02.337486534Z [2024-05-26T02:48:02.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:46:00+00:00, map_index=-1, run_start_date=2024-05-26 02:48:01.305899+00:00, run_end_date=2024-05-26 02:48:01.707979+00:00, run_duration=0.40208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:48:00.438924+00:00, queued_by_job_id=1, pid=15975 2024-05-26T02:48:02.337866488Z [2024-05-26T02:48:02.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:47:00+00:00, map_index=-1, run_start_date=2024-05-26 02:48:01.299092+00:00, run_end_date=2024-05-26 02:48:01.783167+00:00, run_duration=0.484075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:48:00.438924+00:00, queued_by_job_id=1, pid=15974 2024-05-26T02:48:03.951840135Z [2024-05-26T02:48:03.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:48:03.952559268Z [2024-05-26T02:48:03.952+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:47:00+00:00, run_id=scheduled__2024-05-26T02:47:00+00:00, run_start_date=2024-05-26 02:48:00.340051+00:00, run_end_date=2024-05-26 02:48:03.951753+00:00, run_duration=3.611702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:47:00+00:00, data_interval_end=2024-05-26 02:48:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:48:03.973534638Z [2024-05-26T02:48:03.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:48:00+00:00, run_after=2024-05-26T02:49:00+00:00 2024-05-26T02:48:04.019181007Z [2024-05-26T02:48:04.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:47:00+00:00 exited with status success for try_number 1 2024-05-26T02:48:04.025481780Z [2024-05-26T02:48:04.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:47:00+00:00, map_index=-1, run_start_date=2024-05-26 02:48:02.412388+00:00, run_end_date=2024-05-26 02:48:03.670401+00:00, run_duration=1.258013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:48:00.438924+00:00, queued_by_job_id=1, pid=15998 2024-05-26T02:48:06.503025998Z [2024-05-26T02:48:06.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:48:06.503381090Z [2024-05-26T02:48:06.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:47:00+00:00, run_id=scheduled__2024-05-26T02:47:00+00:00, run_start_date=2024-05-26 02:48:00.341524+00:00, run_end_date=2024-05-26 02:48:06.502769+00:00, run_duration=6.161245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:47:00+00:00, data_interval_end=2024-05-26 02:48:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:48:06.519610217Z [2024-05-26T02:48:06.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:48:00+00:00, run_after=2024-05-26T02:49:00+00:00 2024-05-26T02:48:06.560442883Z [2024-05-26T02:48:06.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:47:00+00:00 exited with status success for try_number 1 2024-05-26T02:48:06.568806268Z [2024-05-26T02:48:06.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:47:00+00:00, map_index=-1, run_start_date=2024-05-26 02:48:02.414618+00:00, run_end_date=2024-05-26 02:48:05.897526+00:00, run_duration=3.482908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:48:00.438924+00:00, queued_by_job_id=1, pid=15999 2024-05-26T02:48:33.816023564Z [2024-05-26T02:48:33.814+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:49:00.150201426Z [2024-05-26T02:49:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:49:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:49:00.166479793Z [2024-05-26T02:49:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:49:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:49:00.176949184Z [2024-05-26T02:49:00.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:49:00.259476996Z [2024-05-26T02:49:00.258+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:49:00.259564554Z 2024-05-26T02:49:00.259574963Z 2024-05-26T02:49:00.259581211Z 2024-05-26T02:49:00.259989762Z [2024-05-26T02:49:00.259+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:49:00.260107214Z [2024-05-26T02:49:00.259+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:49:00.260357518Z [2024-05-26T02:49:00.260+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:49:00.261573003Z [2024-05-26T02:49:00.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:49:00.261631419Z 2024-05-26T02:49:00.261667873Z 2024-05-26T02:49:00.261676601Z 2024-05-26T02:49:00.266564956Z [2024-05-26T02:49:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:49:00.266689877Z [2024-05-26T02:49:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:49:00.266702820Z [2024-05-26T02:49:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:49:00.266791934Z [2024-05-26T02:49:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:49:00.267023416Z [2024-05-26T02:49:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:49:00.267060188Z [2024-05-26T02:49:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:49:00.537424665Z [2024-05-26T02:49:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status queued for try_number 1 2024-05-26T02:49:00.537592718Z [2024-05-26T02:49:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status queued for try_number 1 2024-05-26T02:49:00.537796900Z [2024-05-26T02:49:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status queued for try_number 1 2024-05-26T02:49:00.547658681Z [2024-05-26T02:49:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f5cc887-3814-4932-8214-f19a593fc9ed 2024-05-26T02:49:00.547685443Z [2024-05-26T02:49:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef1b6df0-4368-422f-95f8-0b702511a29e 2024-05-26T02:49:00.547875538Z [2024-05-26T02:49:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8324d98d-0fcc-4d09-b8e0-2afbaf18e3d1 2024-05-26T02:49:02.419411778Z [2024-05-26T02:49:02.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:49:02.419644729Z [2024-05-26T02:49:02.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:48:00+00:00, run_id=scheduled__2024-05-26T02:48:00+00:00, run_start_date=2024-05-26 02:49:00.189081+00:00, run_end_date=2024-05-26 02:49:02.419129+00:00, run_duration=2.230048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:48:00+00:00, data_interval_end=2024-05-26 02:49:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:49:02.433019843Z [2024-05-26T02:49:02.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:49:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:49:02.493431957Z [2024-05-26T02:49:02.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status success for try_number 1 2024-05-26T02:49:02.501844721Z [2024-05-26T02:49:02.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:48:00+00:00, map_index=-1, run_start_date=2024-05-26 02:49:01.150238+00:00, run_end_date=2024-05-26 02:49:01.558845+00:00, run_duration=0.408607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:49:00.262337+00:00, queued_by_job_id=1, pid=16031 2024-05-26T02:49:04.391403011Z [2024-05-26T02:49:04.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:49:04.392126711Z [2024-05-26T02:49:04.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:48:00+00:00, run_id=scheduled__2024-05-26T02:48:00+00:00, run_start_date=2024-05-26 02:49:00.191400+00:00, run_end_date=2024-05-26 02:49:04.391676+00:00, run_duration=4.200276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:48:00+00:00, data_interval_end=2024-05-26 02:49:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:49:04.403341315Z [2024-05-26T02:49:04.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:49:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:49:04.463976275Z [2024-05-26T02:49:04.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status success for try_number 1 2024-05-26T02:49:04.470430675Z [2024-05-26T02:49:04.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:48:00+00:00, map_index=-1, run_start_date=2024-05-26 02:49:02.001271+00:00, run_end_date=2024-05-26 02:49:03.796140+00:00, run_duration=1.794869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:49:00.262337+00:00, queued_by_job_id=1, pid=16049 2024-05-26T02:49:05.548919147Z [2024-05-26T02:49:05.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:49:05.549246290Z [2024-05-26T02:49:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:48:00+00:00, run_id=scheduled__2024-05-26T02:48:00+00:00, run_start_date=2024-05-26 02:49:00.190419+00:00, run_end_date=2024-05-26 02:49:05.548846+00:00, run_duration=5.358427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:48:00+00:00, data_interval_end=2024-05-26 02:49:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:49:05.557642543Z [2024-05-26T02:49:05.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:49:00+00:00, run_after=2024-05-26T02:50:00+00:00 2024-05-26T02:49:05.588786599Z [2024-05-26T02:49:05.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status success for try_number 1 2024-05-26T02:49:05.603615392Z [2024-05-26T02:49:05.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:48:00+00:00, map_index=-1, run_start_date=2024-05-26 02:49:02.165051+00:00, run_end_date=2024-05-26 02:49:04.670227+00:00, run_duration=2.505176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:49:00.262337+00:00, queued_by_job_id=1, pid=16050 2024-05-26T02:50:00.701560484Z [2024-05-26T02:50:00.700+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:50:00.724685366Z [2024-05-26T02:50:00.724+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:50:00.751794520Z [2024-05-26T02:50:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:55:00+00:00 2024-05-26T02:50:00.764962640Z [2024-05-26T02:50:00.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:51:00+00:00 2024-05-26T02:50:00.791436945Z [2024-05-26T02:50:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:51:00+00:00 2024-05-26T02:50:00.936427597Z [2024-05-26T02:50:00.935+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-05-26T02:50:00.936479998Z 2024-05-26T02:50:00.936494056Z 2024-05-26T02:50:00.936536540Z 2024-05-26T02:50:00.936547681Z 2024-05-26T02:50:00.936558382Z 2024-05-26T02:50:00.936933555Z [2024-05-26T02:50:00.936+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:50:00.937438272Z [2024-05-26T02:50:00.937+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:50:00.937867628Z [2024-05-26T02:50:00.937+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:50:00.938496622Z [2024-05-26T02:50:00.937+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:50:00.938992448Z [2024-05-26T02:50:00.938+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:50:00.940517297Z [2024-05-26T02:50:00.940+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:50:00.940549822Z 2024-05-26T02:50:00.940562265Z 2024-05-26T02:50:00.940573970Z 2024-05-26T02:50:00.940586264Z 2024-05-26T02:50:00.940598942Z 2024-05-26T02:50:00.949978845Z [2024-05-26T02:50:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:50:00.950251690Z [2024-05-26T02:50:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:50:00.950754853Z [2024-05-26T02:50:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:50:00.951033297Z [2024-05-26T02:50:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:50:00.951479401Z [2024-05-26T02:50:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:50:00.951875725Z [2024-05-26T02:50:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:50:00.952407522Z [2024-05-26T02:50:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:50:00.952770550Z [2024-05-26T02:50:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:50:00.953320369Z [2024-05-26T02:50:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:50:00.953573602Z [2024-05-26T02:50:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:50:01.643459229Z [2024-05-26T02:50:01.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:01.643698270Z [2024-05-26T02:50:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:01.643832441Z [2024-05-26T02:50:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:49:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:01.644103905Z [2024-05-26T02:50:01.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:49:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:01.644304934Z [2024-05-26T02:50:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:49:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:01.662989146Z [2024-05-26T02:50:01.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 468ea27c-26a6-4dff-815f-ff17b86e0958 2024-05-26T02:50:01.663276115Z [2024-05-26T02:50:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 065bfa3e-85b3-4813-8111-2cc0bc7c917b 2024-05-26T02:50:01.663459894Z [2024-05-26T02:50:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to de9e06b6-fdba-4d30-acd5-c33fcc9981b2 2024-05-26T02:50:01.663647916Z [2024-05-26T02:50:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to d73725be-0379-4250-87f1-58af6c0807d7 2024-05-26T02:50:01.663807461Z [2024-05-26T02:50:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to f105445b-bc90-4c79-ae40-d3a44e82dd7a 2024-05-26T02:50:02.893778959Z [2024-05-26T02:50:02.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:50:02.894257023Z [2024-05-26T02:50:02.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:49:00+00:00, run_id=scheduled__2024-05-26T02:49:00+00:00, run_start_date=2024-05-26 02:50:00.810134+00:00, run_end_date=2024-05-26 02:50:02.893899+00:00, run_duration=2.083765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:49:00+00:00, data_interval_end=2024-05-26 02:50:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:50:02.911955493Z [2024-05-26T02:50:02.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:51:00+00:00 2024-05-26T02:50:02.932868104Z [2024-05-26T02:50:02.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:50:02.933144981Z [2024-05-26T02:50:02.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:48:00+00:00, run_id=scheduled__2024-05-26T02:48:00+00:00, run_start_date=2024-05-26 02:50:00.808923+00:00, run_end_date=2024-05-26 02:50:02.932776+00:00, run_duration=2.123853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:48:00+00:00, data_interval_end=2024-05-26 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:50:02.943267323Z [2024-05-26T02:50:02.942+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:52:00+00:00 2024-05-26T02:50:03.008285930Z [2024-05-26T02:50:03.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:48:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:03.008333699Z [2024-05-26T02:50:03.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:49:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:03.019630287Z [2024-05-26T02:50:03.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:49:00+00:00, map_index=-1, run_start_date=2024-05-26 02:50:01.925639+00:00, run_end_date=2024-05-26 02:50:02.546921+00:00, run_duration=0.621282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:00.944466+00:00, queued_by_job_id=1, pid=16083 2024-05-26T02:50:03.019902767Z [2024-05-26T02:50:03.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:48:00+00:00, map_index=-1, run_start_date=2024-05-26 02:50:02.145353+00:00, run_end_date=2024-05-26 02:50:02.647140+00:00, run_duration=0.501787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:00.944466+00:00, queued_by_job_id=1, pid=16084 2024-05-26T02:50:05.065727426Z [2024-05-26T02:50:05.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:50:05.067769047Z [2024-05-26T02:50:05.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:49:00+00:00, run_id=scheduled__2024-05-26T02:49:00+00:00, run_start_date=2024-05-26 02:50:00.811145+00:00, run_end_date=2024-05-26 02:50:05.065819+00:00, run_duration=4.254674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:49:00+00:00, data_interval_end=2024-05-26 02:50:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:50:05.093000374Z [2024-05-26T02:50:05.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:51:00+00:00 2024-05-26T02:50:05.126210065Z [2024-05-26T02:50:05.125+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:50:05.126236909Z 2024-05-26T02:50:05.126280445Z [2024-05-26T02:50:05.126+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:50:05.126856104Z [2024-05-26T02:50:05.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:50:05.126875949Z 2024-05-26T02:50:05.129551392Z [2024-05-26T02:50:05.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:50:05.129744210Z [2024-05-26T02:50:05.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:50:05.177905857Z [2024-05-26T02:50:05.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:05.180354281Z [2024-05-26T02:50:05.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:05.180608720Z [2024-05-26T02:50:05.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:49:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:05.191026125Z [2024-05-26T02:50:05.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:49:00+00:00, map_index=-1, run_start_date=2024-05-26 02:50:03.346316+00:00, run_end_date=2024-05-26 02:50:04.847317+00:00, run_duration=1.501001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:00.944466+00:00, queued_by_job_id=1, pid=16108 2024-05-26T02:50:05.193037756Z [2024-05-26T02:50:05.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:45:00+00:00, map_index=-1, run_start_date=2024-05-26 02:50:03.546656+00:00, run_end_date=2024-05-26 02:50:03.986317+00:00, run_duration=0.439661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:00.944466+00:00, queued_by_job_id=1, pid=16109 2024-05-26T02:50:05.193300899Z [2024-05-26T02:50:05.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to f12f4b9b-5213-4f10-83c2-ded34cd1fc4a 2024-05-26T02:50:06.314169285Z [2024-05-26T02:50:06.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:50:06.314468902Z [2024-05-26T02:50:06.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:49:00+00:00, run_id=scheduled__2024-05-26T02:49:00+00:00, run_start_date=2024-05-26 02:50:00.812187+00:00, run_end_date=2024-05-26 02:50:06.314078+00:00, run_duration=5.501891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:49:00+00:00, data_interval_end=2024-05-26 02:50:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:50:06.324633431Z [2024-05-26T02:50:06.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:51:00+00:00 2024-05-26T02:50:06.384162207Z [2024-05-26T02:50:06.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:49:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:06.390919681Z [2024-05-26T02:50:06.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:49:00+00:00, map_index=-1, run_start_date=2024-05-26 02:50:04.195236+00:00, run_end_date=2024-05-26 02:50:06.092109+00:00, run_duration=1.896873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:00.944466+00:00, queued_by_job_id=1, pid=16125 2024-05-26T02:50:07.937353532Z [2024-05-26T02:50:07.936+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:50:07.937386509Z 2024-05-26T02:50:07.937503138Z [2024-05-26T02:50:07.937+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:50:07.938068821Z [2024-05-26T02:50:07.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:50:07.938102366Z 2024-05-26T02:50:07.940650390Z [2024-05-26T02:50:07.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:50:07.940861555Z [2024-05-26T02:50:07.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:50:08.010313385Z [2024-05-26T02:50:08.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:08.010343482Z [2024-05-26T02:50:08.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:08.018603704Z [2024-05-26T02:50:08.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to c885e1d9-fed2-4ce1-b086-3a254a06c8e3 2024-05-26T02:50:08.018843089Z [2024-05-26T02:50:08.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:45:00+00:00, map_index=-1, run_start_date=2024-05-26 02:50:07.079345+00:00, run_end_date=2024-05-26 02:50:07.491509+00:00, run_duration=0.412164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:05.127465+00:00, queued_by_job_id=1, pid=16138 2024-05-26T02:50:10.322557358Z [2024-05-26T02:50:10.321+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:50:10.322612133Z 2024-05-26T02:50:10.323196845Z [2024-05-26T02:50:10.322+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:50:10.324616912Z [2024-05-26T02:50:10.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:50:10.324647761Z 2024-05-26T02:50:10.330654123Z [2024-05-26T02:50:10.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:50:10.331226315Z [2024-05-26T02:50:10.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:50:10.402197399Z [2024-05-26T02:50:10.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status queued for try_number 1 2024-05-26T02:50:10.402877828Z [2024-05-26T02:50:10.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:10.411128786Z [2024-05-26T02:50:10.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0c85aa0-ed1b-4ee5-a17a-8ac7d46e4dbe 2024-05-26T02:50:10.411577393Z [2024-05-26T02:50:10.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:45:00+00:00, map_index=0, run_start_date=2024-05-26 02:50:09.483593+00:00, run_end_date=2024-05-26 02:50:09.889652+00:00, run_duration=0.406059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:07.938438+00:00, queued_by_job_id=1, pid=16146 2024-05-26T02:50:13.013618555Z [2024-05-26T02:50:13.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:50:13.013791922Z [2024-05-26T02:50:13.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:45:00+00:00, run_id=scheduled__2024-05-26T02:45:00+00:00, run_start_date=2024-05-26 02:50:00.807442+00:00, run_end_date=2024-05-26 02:50:13.013374+00:00, run_duration=12.205932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:45:00+00:00, data_interval_end=2024-05-26 02:50:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:50:13.021013518Z [2024-05-26T02:50:13.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:50:00+00:00, run_after=2024-05-26T02:55:00+00:00 2024-05-26T02:50:13.059186444Z [2024-05-26T02:50:13.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:45:00+00:00 exited with status success for try_number 1 2024-05-26T02:50:13.064815635Z [2024-05-26T02:50:13.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:45:00+00:00, map_index=-1, run_start_date=2024-05-26 02:50:11.874382+00:00, run_end_date=2024-05-26 02:50:12.310723+00:00, run_duration=0.436341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:50:10.325453+00:00, queued_by_job_id=1, pid=16154 2024-05-26T02:51:00.766379654Z [2024-05-26T02:51:00.765+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:51:00+00:00, run_after=2024-05-26T02:52:00+00:00 2024-05-26T02:51:00.774362786Z [2024-05-26T02:51:00.774+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:51:00.786835037Z [2024-05-26T02:51:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:51:00+00:00, run_after=2024-05-26T02:52:00+00:00 2024-05-26T02:51:00.871738858Z [2024-05-26T02:51:00.871+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:51:00.871795598Z 2024-05-26T02:51:00.871804638Z 2024-05-26T02:51:00.871813304Z 2024-05-26T02:51:00.871951321Z [2024-05-26T02:51:00.871+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:51:00.872423695Z [2024-05-26T02:51:00.871+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:51:00.872450253Z [2024-05-26T02:51:00.872+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:51:00.873614147Z [2024-05-26T02:51:00.873+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:51:00.873636937Z 2024-05-26T02:51:00.873645256Z 2024-05-26T02:51:00.873653255Z 2024-05-26T02:51:00.878626819Z [2024-05-26T02:51:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:51:00.878952244Z [2024-05-26T02:51:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:51:00.879500035Z [2024-05-26T02:51:00.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:51:00.879755292Z [2024-05-26T02:51:00.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:51:00.880064038Z [2024-05-26T02:51:00.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:51:00.880312461Z [2024-05-26T02:51:00.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:51:01.107484257Z [2024-05-26T02:51:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:51:01.108140091Z [2024-05-26T02:51:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:51:01.108325058Z [2024-05-26T02:51:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:51:01.119725967Z [2024-05-26T02:51:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to a359e7b1-bbbe-4074-86e7-eb6a93bb9ce8 2024-05-26T02:51:01.120019600Z [2024-05-26T02:51:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bdc7dca-60ff-4260-a54f-7311a978a444 2024-05-26T02:51:01.120303240Z [2024-05-26T02:51:01.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c203089-30cf-4ed2-a3d6-628944b4f965 2024-05-26T02:51:02.682982073Z [2024-05-26T02:51:02.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:51:02.683207032Z [2024-05-26T02:51:02.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:50:00+00:00, run_id=scheduled__2024-05-26T02:50:00+00:00, run_start_date=2024-05-26 02:51:00.799983+00:00, run_end_date=2024-05-26 02:51:02.682917+00:00, run_duration=1.882934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:50:00+00:00, data_interval_end=2024-05-26 02:51:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:51:02.703567259Z [2024-05-26T02:51:02.702+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:51:00+00:00, run_after=2024-05-26T02:52:00+00:00 2024-05-26T02:51:02.777131739Z [2024-05-26T02:51:02.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:51:02.790799007Z [2024-05-26T02:51:02.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=-1, run_start_date=2024-05-26 02:51:01.839782+00:00, run_end_date=2024-05-26 02:51:02.239821+00:00, run_duration=0.400039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:51:00.874721+00:00, queued_by_job_id=1, pid=16177 2024-05-26T02:51:04.382532309Z [2024-05-26T02:51:04.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:51:04.382809585Z [2024-05-26T02:51:04.382+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:50:00+00:00, run_id=scheduled__2024-05-26T02:50:00+00:00, run_start_date=2024-05-26 02:51:00.801512+00:00, run_end_date=2024-05-26 02:51:04.382401+00:00, run_duration=3.580889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:50:00+00:00, data_interval_end=2024-05-26 02:51:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:51:04.394073914Z [2024-05-26T02:51:04.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:51:00+00:00, run_after=2024-05-26T02:52:00+00:00 2024-05-26T02:51:04.448896284Z [2024-05-26T02:51:04.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:51:04.455050334Z [2024-05-26T02:51:04.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=-1, run_start_date=2024-05-26 02:51:02.818512+00:00, run_end_date=2024-05-26 02:51:04.188039+00:00, run_duration=1.369527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:51:00.874721+00:00, queued_by_job_id=1, pid=16196 2024-05-26T02:51:05.507756542Z [2024-05-26T02:51:05.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:51:05.507786629Z [2024-05-26T02:51:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:50:00+00:00, run_id=scheduled__2024-05-26T02:50:00+00:00, run_start_date=2024-05-26 02:51:00.802729+00:00, run_end_date=2024-05-26 02:51:05.506632+00:00, run_duration=4.703903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:50:00+00:00, data_interval_end=2024-05-26 02:51:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:51:05.519634666Z [2024-05-26T02:51:05.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:51:00+00:00, run_after=2024-05-26T02:52:00+00:00 2024-05-26T02:51:05.544569958Z [2024-05-26T02:51:05.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:51:05.549476029Z [2024-05-26T02:51:05.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=-1, run_start_date=2024-05-26 02:51:02.714417+00:00, run_end_date=2024-05-26 02:51:04.721413+00:00, run_duration=2.006996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:51:00.874721+00:00, queued_by_job_id=1, pid=16195 2024-05-26T02:52:00.840312912Z [2024-05-26T02:52:00.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:52:00+00:00, run_after=2024-05-26T02:53:00+00:00 2024-05-26T02:52:00.847858349Z [2024-05-26T02:52:00.847+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:52:00.853950334Z [2024-05-26T02:52:00.853+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:52:00.873386391Z [2024-05-26T02:52:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:52:00+00:00, run_after=2024-05-26T02:53:00+00:00 2024-05-26T02:52:00.942039193Z [2024-05-26T02:52:00.941+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:52:00.942063973Z 2024-05-26T02:52:00.942068803Z 2024-05-26T02:52:00.942072038Z 2024-05-26T02:52:00.942075353Z 2024-05-26T02:52:00.942166630Z [2024-05-26T02:52:00.941+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:52:00.942330629Z [2024-05-26T02:52:00.942+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:52:00.942897825Z [2024-05-26T02:52:00.942+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:52:00.943062352Z [2024-05-26T02:52:00.942+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:52:00.943694643Z [2024-05-26T02:52:00.943+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:52:00.943702981Z 2024-05-26T02:52:00.943706509Z 2024-05-26T02:52:00.943711282Z 2024-05-26T02:52:00.943714484Z 2024-05-26T02:52:00.947318045Z [2024-05-26T02:52:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:52:00.947570817Z [2024-05-26T02:52:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:52:00.948034558Z [2024-05-26T02:52:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:52:00.948214339Z [2024-05-26T02:52:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:52:00.948554594Z [2024-05-26T02:52:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:52:00.948717966Z [2024-05-26T02:52:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:52:00.949282584Z [2024-05-26T02:52:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:52:00.949556390Z [2024-05-26T02:52:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:52:01.429492595Z [2024-05-26T02:52:01.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:52:01.429576968Z [2024-05-26T02:52:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:51:00+00:00 exited with status queued for try_number 1 2024-05-26T02:52:01.429647747Z [2024-05-26T02:52:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:51:00+00:00 exited with status queued for try_number 1 2024-05-26T02:52:01.429708779Z [2024-05-26T02:52:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:51:00+00:00 exited with status queued for try_number 1 2024-05-26T02:52:01.449133441Z [2024-05-26T02:52:01.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b54c19b-d847-4d43-b3ae-da64d6c0ad57 2024-05-26T02:52:01.449162181Z [2024-05-26T02:52:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa63245d-552c-457c-890c-8204ae3be704 2024-05-26T02:52:01.449308548Z [2024-05-26T02:52:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5eb3c938-e35f-4cd2-9a5b-6eb397fc9040 2024-05-26T02:52:01.449390727Z [2024-05-26T02:52:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67a23c78-5e9b-4163-b79d-66bdb1893c35 2024-05-26T02:52:03.471634271Z [2024-05-26T02:52:03.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:52:03.471660823Z [2024-05-26T02:52:03.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:50:00+00:00, run_id=scheduled__2024-05-26T02:50:00+00:00, run_start_date=2024-05-26 02:52:00.886673+00:00, run_end_date=2024-05-26 02:52:03.464961+00:00, run_duration=2.578288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:50:00+00:00, data_interval_end=2024-05-26 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:52:03.515288769Z [2024-05-26T02:52:03.514+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:52:00+00:00, run_after=2024-05-26T02:54:00+00:00 2024-05-26T02:52:03.521899534Z [2024-05-26T02:52:03.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:52:03.522171781Z [2024-05-26T02:52:03.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:51:00+00:00, run_id=scheduled__2024-05-26T02:51:00+00:00, run_start_date=2024-05-26 02:52:00.888480+00:00, run_end_date=2024-05-26 02:52:03.521834+00:00, run_duration=2.633354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:51:00+00:00, data_interval_end=2024-05-26 02:52:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:52:03.531319006Z [2024-05-26T02:52:03.531+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:52:00+00:00, run_after=2024-05-26T02:53:00+00:00 2024-05-26T02:52:03.696233066Z [2024-05-26T02:52:03.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:52:03.700289581Z [2024-05-26T02:52:03.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:51:00+00:00 exited with status success for try_number 1 2024-05-26T02:52:03.765818629Z [2024-05-26T02:52:03.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=-1, run_start_date=2024-05-26 02:52:02.090945+00:00, run_end_date=2024-05-26 02:52:02.684928+00:00, run_duration=0.593983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:52:00.944466+00:00, queued_by_job_id=1, pid=16230 2024-05-26T02:52:03.768091934Z [2024-05-26T02:52:03.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:51:00+00:00, map_index=-1, run_start_date=2024-05-26 02:52:02.114464+00:00, run_end_date=2024-05-26 02:52:02.765749+00:00, run_duration=0.651285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:52:00.944466+00:00, queued_by_job_id=1, pid=16229 2024-05-26T02:52:07.008963427Z [2024-05-26T02:52:07.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:52:07.009166534Z [2024-05-26T02:52:07.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:51:00+00:00, run_id=scheduled__2024-05-26T02:51:00+00:00, run_start_date=2024-05-26 02:52:00.889659+00:00, run_end_date=2024-05-26 02:52:07.008790+00:00, run_duration=6.119131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:51:00+00:00, data_interval_end=2024-05-26 02:52:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:52:07.019183326Z [2024-05-26T02:52:07.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:52:00+00:00, run_after=2024-05-26T02:53:00+00:00 2024-05-26T02:52:07.025476599Z [2024-05-26T02:52:07.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:52:07.025596111Z [2024-05-26T02:52:07.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:51:00+00:00, run_id=scheduled__2024-05-26T02:51:00+00:00, run_start_date=2024-05-26 02:52:00.891306+00:00, run_end_date=2024-05-26 02:52:07.025307+00:00, run_duration=6.134001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:51:00+00:00, data_interval_end=2024-05-26 02:52:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:52:07.034115213Z [2024-05-26T02:52:07.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:52:00+00:00, run_after=2024-05-26T02:53:00+00:00 2024-05-26T02:52:07.078600352Z [2024-05-26T02:52:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:51:00+00:00 exited with status success for try_number 1 2024-05-26T02:52:07.078841213Z [2024-05-26T02:52:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:51:00+00:00 exited with status success for try_number 1 2024-05-26T02:52:07.091044182Z [2024-05-26T02:52:07.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:51:00+00:00, map_index=-1, run_start_date=2024-05-26 02:52:04.097930+00:00, run_end_date=2024-05-26 02:52:05.832994+00:00, run_duration=1.735064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:52:00.944466+00:00, queued_by_job_id=1, pid=16253 2024-05-26T02:52:07.091065539Z [2024-05-26T02:52:07.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:51:00+00:00, map_index=-1, run_start_date=2024-05-26 02:52:04.295649+00:00, run_end_date=2024-05-26 02:52:06.850139+00:00, run_duration=2.55449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:52:00.944466+00:00, queued_by_job_id=1, pid=16254 2024-05-26T02:53:00.802700856Z [2024-05-26T02:53:00.802+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:53:00.818989090Z [2024-05-26T02:53:00.818+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:53:00+00:00, run_after=2024-05-26T02:54:00+00:00 2024-05-26T02:53:00.832266789Z [2024-05-26T02:53:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:53:00+00:00, run_after=2024-05-26T02:54:00+00:00 2024-05-26T02:53:00.899815601Z [2024-05-26T02:53:00.899+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:53:00.899839035Z 2024-05-26T02:53:00.899842803Z 2024-05-26T02:53:00.899845863Z 2024-05-26T02:53:00.900050820Z [2024-05-26T02:53:00.899+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:53:00.900311407Z [2024-05-26T02:53:00.900+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:53:00.900476523Z [2024-05-26T02:53:00.900+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:53:00.901116548Z [2024-05-26T02:53:00.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:53:00.901127447Z 2024-05-26T02:53:00.901131255Z 2024-05-26T02:53:00.901134356Z 2024-05-26T02:53:00.904236518Z [2024-05-26T02:53:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:53:00.904447042Z [2024-05-26T02:53:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:53:00.904736278Z [2024-05-26T02:53:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:53:00.904920708Z [2024-05-26T02:53:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:53:00.905206335Z [2024-05-26T02:53:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:53:00.905425691Z [2024-05-26T02:53:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:53:01.142707426Z [2024-05-26T02:53:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status queued for try_number 1 2024-05-26T02:53:01.142938272Z [2024-05-26T02:53:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status queued for try_number 1 2024-05-26T02:53:01.143087743Z [2024-05-26T02:53:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status queued for try_number 1 2024-05-26T02:53:01.153511603Z [2024-05-26T02:53:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to d382e4f2-af96-422a-9039-5d2e2b1c84aa 2024-05-26T02:53:01.153863495Z [2024-05-26T02:53:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fbf451d-9b0a-4129-b4d5-7f96aea9f76d 2024-05-26T02:53:01.154128460Z [2024-05-26T02:53:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to 106d0015-ea2c-4635-ace5-57141953478e 2024-05-26T02:53:02.367676153Z [2024-05-26T02:53:02.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:53:02.368098430Z [2024-05-26T02:53:02.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:52:00+00:00, run_id=scheduled__2024-05-26T02:52:00+00:00, run_start_date=2024-05-26 02:53:00.844306+00:00, run_end_date=2024-05-26 02:53:02.367509+00:00, run_duration=1.523203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:52:00+00:00, data_interval_end=2024-05-26 02:53:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:53:02.378851671Z [2024-05-26T02:53:02.378+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:53:00+00:00, run_after=2024-05-26T02:54:00+00:00 2024-05-26T02:53:02.430910338Z [2024-05-26T02:53:02.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status success for try_number 1 2024-05-26T02:53:02.435881673Z [2024-05-26T02:53:02.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:52:00+00:00, map_index=-1, run_start_date=2024-05-26 02:53:01.710828+00:00, run_end_date=2024-05-26 02:53:02.083636+00:00, run_duration=0.372808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:53:00.901821+00:00, queued_by_job_id=1, pid=16285 2024-05-26T02:53:04.797483758Z [2024-05-26T02:53:04.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:53:04.799223161Z [2024-05-26T02:53:04.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:52:00+00:00, run_id=scheduled__2024-05-26T02:52:00+00:00, run_start_date=2024-05-26 02:53:00.847332+00:00, run_end_date=2024-05-26 02:53:04.797405+00:00, run_duration=3.950073, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:52:00+00:00, data_interval_end=2024-05-26 02:53:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:53:04.834136505Z [2024-05-26T02:53:04.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:53:00+00:00, run_after=2024-05-26T02:54:00+00:00 2024-05-26T02:53:04.851272397Z [2024-05-26T02:53:04.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:53:04.852047860Z [2024-05-26T02:53:04.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:52:00+00:00, run_id=scheduled__2024-05-26T02:52:00+00:00, run_start_date=2024-05-26 02:53:00.846256+00:00, run_end_date=2024-05-26 02:53:04.851172+00:00, run_duration=4.004916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:52:00+00:00, data_interval_end=2024-05-26 02:53:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:53:04.871259633Z [2024-05-26T02:53:04.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:53:00+00:00, run_after=2024-05-26T02:54:00+00:00 2024-05-26T02:53:04.919239439Z [2024-05-26T02:53:04.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status success for try_number 1 2024-05-26T02:53:04.919263372Z [2024-05-26T02:53:04.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status success for try_number 1 2024-05-26T02:53:04.925510387Z [2024-05-26T02:53:04.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:52:00+00:00, map_index=-1, run_start_date=2024-05-26 02:53:02.722352+00:00, run_end_date=2024-05-26 02:53:04.472845+00:00, run_duration=1.750493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:53:00.901821+00:00, queued_by_job_id=1, pid=16304 2024-05-26T02:53:04.925709499Z [2024-05-26T02:53:04.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:52:00+00:00, map_index=-1, run_start_date=2024-05-26 02:53:02.558443+00:00, run_end_date=2024-05-26 02:53:04.571020+00:00, run_duration=2.012577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:53:00.901821+00:00, queued_by_job_id=1, pid=16303 2024-05-26T02:53:33.885067318Z [2024-05-26T02:53:33.883+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:54:00.745980104Z [2024-05-26T02:54:00.745+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:54:00.773362268Z [2024-05-26T02:54:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:54:00+00:00, run_after=2024-05-26T02:55:00+00:00 2024-05-26T02:54:00.783778631Z [2024-05-26T02:54:00.777+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:54:00.791176217Z [2024-05-26T02:54:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:54:00+00:00, run_after=2024-05-26T02:55:00+00:00 2024-05-26T02:54:00.901599414Z [2024-05-26T02:54:00.901+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:54:00.901635488Z 2024-05-26T02:54:00.901643726Z 2024-05-26T02:54:00.901649996Z 2024-05-26T02:54:00.901656084Z 2024-05-26T02:54:00.901867433Z [2024-05-26T02:54:00.901+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:54:00.902060434Z [2024-05-26T02:54:00.901+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:54:00.902316245Z [2024-05-26T02:54:00.902+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:54:00.902589452Z [2024-05-26T02:54:00.902+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:54:00.903347011Z [2024-05-26T02:54:00.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:54:00.903356827Z 2024-05-26T02:54:00.903363557Z 2024-05-26T02:54:00.903371312Z 2024-05-26T02:54:00.903378843Z 2024-05-26T02:54:00.909501432Z [2024-05-26T02:54:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:54:00.909775242Z [2024-05-26T02:54:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:54:00.910249563Z [2024-05-26T02:54:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:54:00.910521351Z [2024-05-26T02:54:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:54:00.910931045Z [2024-05-26T02:54:00.910+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:54:00.911127826Z [2024-05-26T02:54:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:54:00.911593356Z [2024-05-26T02:54:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:54:00.911802998Z [2024-05-26T02:54:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:54:01.505194372Z [2024-05-26T02:54:01.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status queued for try_number 1 2024-05-26T02:54:01.505302889Z [2024-05-26T02:54:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:53:00+00:00 exited with status queued for try_number 1 2024-05-26T02:54:01.505437925Z [2024-05-26T02:54:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:53:00+00:00 exited with status queued for try_number 1 2024-05-26T02:54:01.505529552Z [2024-05-26T02:54:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:53:00+00:00 exited with status queued for try_number 1 2024-05-26T02:54:01.534399465Z [2024-05-26T02:54:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to c925577f-f263-42ba-9eae-f24b633e5283 2024-05-26T02:54:01.534431052Z [2024-05-26T02:54:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to c62d32f9-2f0d-4f17-bc59-03c8a6e5bf13 2024-05-26T02:54:01.534447037Z [2024-05-26T02:54:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 337cf216-880c-4cf5-b355-b07f3f9fda5e 2024-05-26T02:54:01.534450342Z [2024-05-26T02:54:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ff6a3b-796f-4239-a98b-9f1068ce3a24 2024-05-26T02:54:02.732217960Z [2024-05-26T02:54:02.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:54:02.732832900Z [2024-05-26T02:54:02.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:52:00+00:00, run_id=scheduled__2024-05-26T02:52:00+00:00, run_start_date=2024-05-26 02:54:00.805422+00:00, run_end_date=2024-05-26 02:54:02.732121+00:00, run_duration=1.926699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:52:00+00:00, data_interval_end=2024-05-26 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:54:02.741715058Z [2024-05-26T02:54:02.741+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:54:00+00:00, run_after=2024-05-26T02:56:00+00:00 2024-05-26T02:54:02.754287227Z [2024-05-26T02:54:02.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:54:02.754635419Z [2024-05-26T02:54:02.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:53:00+00:00, run_id=scheduled__2024-05-26T02:53:00+00:00, run_start_date=2024-05-26 02:54:00.808631+00:00, run_end_date=2024-05-26 02:54:02.754193+00:00, run_duration=1.945562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:53:00+00:00, data_interval_end=2024-05-26 02:54:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:54:02.769073873Z [2024-05-26T02:54:02.768+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:54:00+00:00, run_after=2024-05-26T02:55:00+00:00 2024-05-26T02:54:02.830232787Z [2024-05-26T02:54:02.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:52:00+00:00 exited with status success for try_number 1 2024-05-26T02:54:02.830551419Z [2024-05-26T02:54:02.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:53:00+00:00 exited with status success for try_number 1 2024-05-26T02:54:02.840736272Z [2024-05-26T02:54:02.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:53:00+00:00, map_index=-1, run_start_date=2024-05-26 02:54:01.856143+00:00, run_end_date=2024-05-26 02:54:02.222725+00:00, run_duration=0.366582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:54:00.904689+00:00, queued_by_job_id=1, pid=16338 2024-05-26T02:54:02.841224274Z [2024-05-26T02:54:02.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:52:00+00:00, map_index=-1, run_start_date=2024-05-26 02:54:01.949048+00:00, run_end_date=2024-05-26 02:54:02.374570+00:00, run_duration=0.425522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:54:00.904689+00:00, queued_by_job_id=1, pid=16339 2024-05-26T02:54:04.980482634Z [2024-05-26T02:54:04.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:54:04.981158698Z [2024-05-26T02:54:04.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:53:00+00:00, run_id=scheduled__2024-05-26T02:53:00+00:00, run_start_date=2024-05-26 02:54:00.811420+00:00, run_end_date=2024-05-26 02:54:04.980664+00:00, run_duration=4.169244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:53:00+00:00, data_interval_end=2024-05-26 02:54:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:54:04.992687474Z [2024-05-26T02:54:04.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:54:00+00:00, run_after=2024-05-26T02:55:00+00:00 2024-05-26T02:54:05.073381991Z [2024-05-26T02:54:05.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:53:00+00:00 exited with status success for try_number 1 2024-05-26T02:54:05.089090282Z [2024-05-26T02:54:05.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:53:00+00:00, map_index=-1, run_start_date=2024-05-26 02:54:03.058418+00:00, run_end_date=2024-05-26 02:54:04.716925+00:00, run_duration=1.658507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:54:00.904689+00:00, queued_by_job_id=1, pid=16363 2024-05-26T02:54:05.683659074Z [2024-05-26T02:54:05.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:54:05.683711624Z [2024-05-26T02:54:05.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:53:00+00:00, run_id=scheduled__2024-05-26T02:53:00+00:00, run_start_date=2024-05-26 02:54:00.813745+00:00, run_end_date=2024-05-26 02:54:05.682257+00:00, run_duration=4.868512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:53:00+00:00, data_interval_end=2024-05-26 02:54:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:54:05.695664718Z [2024-05-26T02:54:05.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:54:00+00:00, run_after=2024-05-26T02:55:00+00:00 2024-05-26T02:54:05.735685234Z [2024-05-26T02:54:05.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:53:00+00:00 exited with status success for try_number 1 2024-05-26T02:54:05.741554264Z [2024-05-26T02:54:05.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:53:00+00:00, map_index=-1, run_start_date=2024-05-26 02:54:02.868237+00:00, run_end_date=2024-05-26 02:54:05.050647+00:00, run_duration=2.18241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:54:00.904689+00:00, queued_by_job_id=1, pid=16362 2024-05-26T02:55:00.482846999Z [2024-05-26T02:55:00.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:55:00+00:00, run_after=2024-05-26T02:56:00+00:00 2024-05-26T02:55:00.497979067Z [2024-05-26T02:55:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:55:00+00:00, run_after=2024-05-26T02:56:00+00:00 2024-05-26T02:55:00.510221870Z [2024-05-26T02:55:00.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:55:00+00:00, run_after=2024-05-26T03:00:00+00:00 2024-05-26T02:55:00.516643264Z [2024-05-26T02:55:00.516+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:55:00.602019563Z [2024-05-26T02:55:00.601+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:55:00.602045763Z 2024-05-26T02:55:00.602051511Z 2024-05-26T02:55:00.602055780Z 2024-05-26T02:55:00.602060094Z 2024-05-26T02:55:00.602130556Z [2024-05-26T02:55:00.601+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:55:00.602877897Z [2024-05-26T02:55:00.602+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:55:00.602911140Z [2024-05-26T02:55:00.602+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:55:00.602932599Z [2024-05-26T02:55:00.602+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:55:00.604354041Z [2024-05-26T02:55:00.603+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:55:00.604407001Z 2024-05-26T02:55:00.604417048Z 2024-05-26T02:55:00.604425482Z 2024-05-26T02:55:00.604462269Z 2024-05-26T02:55:00.611610064Z [2024-05-26T02:55:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-05-26T02:55:00.611769980Z [2024-05-26T02:55:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:55:00.612060504Z [2024-05-26T02:55:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:55:00.612205644Z [2024-05-26T02:55:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:55:00.612531939Z [2024-05-26T02:55:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:55:00.612692690Z [2024-05-26T02:55:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:55:00.612944481Z [2024-05-26T02:55:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:55:00.613079186Z [2024-05-26T02:55:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:55:00.924686776Z [2024-05-26T02:55:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:55:00.927630677Z [2024-05-26T02:55:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status queued for try_number 1 2024-05-26T02:55:00.927856717Z [2024-05-26T02:55:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status queued for try_number 1 2024-05-26T02:55:00.928048954Z [2024-05-26T02:55:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status queued for try_number 1 2024-05-26T02:55:00.944821316Z [2024-05-26T02:55:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd750cd6-5dac-4a71-bfce-4ec6dd61ff46 2024-05-26T02:55:00.945059662Z [2024-05-26T02:55:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d2f72ec-0617-4c97-a96f-8afe41b78214 2024-05-26T02:55:00.945209328Z [2024-05-26T02:55:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7079b3e9-18b9-4e3c-b4ca-303571d2dab0 2024-05-26T02:55:00.945377708Z [2024-05-26T02:55:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc039aaa-b4dd-4a8b-952c-e8a2f59a8893 2024-05-26T02:55:02.124602428Z [2024-05-26T02:55:02.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:55:02.125027681Z [2024-05-26T02:55:02.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:54:00+00:00, run_id=scheduled__2024-05-26T02:54:00+00:00, run_start_date=2024-05-26 02:55:00.528445+00:00, run_end_date=2024-05-26 02:55:02.124554+00:00, run_duration=1.596109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:54:00+00:00, data_interval_end=2024-05-26 02:55:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:55:02.136624220Z [2024-05-26T02:55:02.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:55:00+00:00, run_after=2024-05-26T02:56:00+00:00 2024-05-26T02:55:02.195278696Z [2024-05-26T02:55:02.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status success for try_number 1 2024-05-26T02:55:02.201988789Z [2024-05-26T02:55:02.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:54:00+00:00, map_index=-1, run_start_date=2024-05-26 02:55:01.467396+00:00, run_end_date=2024-05-26 02:55:01.930257+00:00, run_duration=0.462861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:55:00.606504+00:00, queued_by_job_id=1, pid=16396 2024-05-26T02:55:04.183589969Z [2024-05-26T02:55:04.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:55:04.184136028Z [2024-05-26T02:55:04.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:54:00+00:00, run_id=scheduled__2024-05-26T02:54:00+00:00, run_start_date=2024-05-26 02:55:00.529444+00:00, run_end_date=2024-05-26 02:55:04.183717+00:00, run_duration=3.654273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:54:00+00:00, data_interval_end=2024-05-26 02:55:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:55:04.206295100Z [2024-05-26T02:55:04.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:55:00+00:00, run_after=2024-05-26T02:56:00+00:00 2024-05-26T02:55:04.232881528Z [2024-05-26T02:55:04.232+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:55:04.232910771Z 2024-05-26T02:55:04.233056252Z [2024-05-26T02:55:04.232+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:55:04.234023455Z [2024-05-26T02:55:04.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:55:04.234038124Z 2024-05-26T02:55:04.236352707Z [2024-05-26T02:55:04.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='split_metrics', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-05-26T02:55:04.236543018Z [2024-05-26T02:55:04.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'split_metrics', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:55:04.290704595Z [2024-05-26T02:55:04.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:55:04.290987982Z [2024-05-26T02:55:04.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.extract_metrics_from_vnfrs run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:55:04.291193149Z [2024-05-26T02:55:04.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status success for try_number 1 2024-05-26T02:55:04.300073207Z [2024-05-26T02:55:04.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0dacef3-6e8b-41d6-a182-553e16811081 2024-05-26T02:55:04.300368400Z [2024-05-26T02:55:04.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=-1, run_start_date=2024-05-26 02:55:02.807836+00:00, run_end_date=2024-05-26 02:55:03.262028+00:00, run_duration=0.454192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:55:00.606504+00:00, queued_by_job_id=1, pid=16422 2024-05-26T02:55:04.300647540Z [2024-05-26T02:55:04.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:54:00+00:00, map_index=-1, run_start_date=2024-05-26 02:55:02.669859+00:00, run_end_date=2024-05-26 02:55:03.898789+00:00, run_duration=1.22893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:55:00.606504+00:00, queued_by_job_id=1, pid=16421 2024-05-26T02:55:04.385376494Z [2024-05-26T02:55:04.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:55:04.386722002Z [2024-05-26T02:55:04.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:54:00+00:00, run_id=scheduled__2024-05-26T02:54:00+00:00, run_start_date=2024-05-26 02:55:00.530402+00:00, run_end_date=2024-05-26 02:55:04.386373+00:00, run_duration=3.855971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:54:00+00:00, data_interval_end=2024-05-26 02:55:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:55:04.402435257Z [2024-05-26T02:55:04.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:55:00+00:00, run_after=2024-05-26T02:56:00+00:00 2024-05-26T02:55:05.642713446Z [2024-05-26T02:55:05.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status success for try_number 1 2024-05-26T02:55:05.648021143Z [2024-05-26T02:55:05.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:54:00+00:00, map_index=-1, run_start_date=2024-05-26 02:55:02.599675+00:00, run_end_date=2024-05-26 02:55:04.337667+00:00, run_duration=1.737992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:55:00.606504+00:00, queued_by_job_id=1, pid=16420 2024-05-26T02:55:07.350440079Z [2024-05-26T02:55:07.349+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:55:07.350495320Z 2024-05-26T02:55:07.350608385Z [2024-05-26T02:55:07.350+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:55:07.351441282Z [2024-05-26T02:55:07.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:55:07.351473022Z 2024-05-26T02:55:07.354851620Z [2024-05-26T02:55:07.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='collect_metrics', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-05-26T02:55:07.355101050Z [2024-05-26T02:55:07.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'collect_metrics', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-26T02:55:07.411219247Z [2024-05-26T02:55:07.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:55:07.411386967Z [2024-05-26T02:55:07.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.split_metrics run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:55:07.418220958Z [2024-05-26T02:55:07.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78fc71c5-c3a9-4c62-a5ca-775085c0095e 2024-05-26T02:55:07.418534652Z [2024-05-26T02:55:07.418+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=split_metrics, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=-1, run_start_date=2024-05-26 02:55:06.154584+00:00, run_end_date=2024-05-26 02:55:06.524735+00:00, run_duration=0.370151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:55:04.234398+00:00, queued_by_job_id=1, pid=16445 2024-05-26T02:55:09.700237909Z [2024-05-26T02:55:09.699+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-05-26T02:55:09.700287401Z 2024-05-26T02:55:09.700625941Z [2024-05-26T02:55:09.700+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:55:09.701720275Z [2024-05-26T02:55:09.701+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:55:09.701745053Z 2024-05-26T02:55:09.705106792Z [2024-05-26T02:55:09.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='send_prometheus', run_id='scheduled__2024-05-26T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:55:09.705375720Z [2024-05-26T02:55:09.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'send_prometheus', 'scheduled__2024-05-26T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-26T02:55:09.765886547Z [2024-05-26T02:55:09.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status queued for try_number 1 2024-05-26T02:55:09.766213023Z [2024-05-26T02:55:09.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.collect_metrics run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:55:09.776498354Z [2024-05-26T02:55:09.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed09835c-8288-4eea-9eb0-20efa436d4c7 2024-05-26T02:55:09.776910308Z [2024-05-26T02:55:09.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=collect_metrics, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=0, run_start_date=2024-05-26 02:55:08.946789+00:00, run_end_date=2024-05-26 02:55:09.410545+00:00, run_duration=0.463756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:55:07.352164+00:00, queued_by_job_id=1, pid=16453 2024-05-26T02:55:12.037700451Z [2024-05-26T02:55:12.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:55:12.037858128Z [2024-05-26T02:55:12.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:50:00+00:00, run_id=scheduled__2024-05-26T02:50:00+00:00, run_start_date=2024-05-26 02:55:00.527247+00:00, run_end_date=2024-05-26 02:55:12.037572+00:00, run_duration=11.510325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:50:00+00:00, data_interval_end=2024-05-26 02:55:00+00:00, dag_hash=fa70417d582594c40abf982f4700fcea 2024-05-26T02:55:12.044277131Z [2024-05-26T02:55:12.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:55:00+00:00, run_after=2024-05-26T03:00:00+00:00 2024-05-26T02:55:12.101370131Z [2024-05-26T02:55:12.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.send_prometheus run_id=scheduled__2024-05-26T02:50:00+00:00 exited with status success for try_number 1 2024-05-26T02:55:12.114011885Z [2024-05-26T02:55:12.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=send_prometheus, run_id=scheduled__2024-05-26T02:50:00+00:00, map_index=-1, run_start_date=2024-05-26 02:55:11.330921+00:00, run_end_date=2024-05-26 02:55:11.750376+00:00, run_duration=0.419455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:55:09.702450+00:00, queued_by_job_id=1, pid=16461 2024-05-26T02:56:00.395534766Z [2024-05-26T02:56:00.394+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:56:00.417794745Z [2024-05-26T02:56:00.417+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:56:00+00:00, run_after=2024-05-26T02:57:00+00:00 2024-05-26T02:56:00.435820345Z [2024-05-26T02:56:00.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:56:00+00:00, run_after=2024-05-26T02:57:00+00:00 2024-05-26T02:56:00.446449773Z [2024-05-26T02:56:00.445+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:56:00.534328435Z [2024-05-26T02:56:00.533+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:56:00.534380347Z 2024-05-26T02:56:00.534417146Z 2024-05-26T02:56:00.534429084Z 2024-05-26T02:56:00.534442234Z 2024-05-26T02:56:00.534558521Z [2024-05-26T02:56:00.534+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:56:00.534957697Z [2024-05-26T02:56:00.534+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:56:00.535317785Z [2024-05-26T02:56:00.535+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:56:00.535680257Z [2024-05-26T02:56:00.535+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:56:00.536830565Z [2024-05-26T02:56:00.536+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:56:00.536851680Z 2024-05-26T02:56:00.536859015Z 2024-05-26T02:56:00.536865084Z 2024-05-26T02:56:00.536871310Z 2024-05-26T02:56:00.542855021Z [2024-05-26T02:56:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:56:00.543162705Z [2024-05-26T02:56:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:56:00.543497067Z [2024-05-26T02:56:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:56:00.543764084Z [2024-05-26T02:56:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:56:00.544146058Z [2024-05-26T02:56:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:56:00.544406768Z [2024-05-26T02:56:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:56:00.544703387Z [2024-05-26T02:56:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:56:00.544823186Z [2024-05-26T02:56:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:56:00.978174882Z [2024-05-26T02:56:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status queued for try_number 1 2024-05-26T02:56:00.978452384Z [2024-05-26T02:56:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:55:00+00:00 exited with status queued for try_number 1 2024-05-26T02:56:00.978676191Z [2024-05-26T02:56:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:55:00+00:00 exited with status queued for try_number 1 2024-05-26T02:56:00.978804215Z [2024-05-26T02:56:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:55:00+00:00 exited with status queued for try_number 1 2024-05-26T02:56:01.000924534Z [2024-05-26T02:56:01.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec4135ad-f6e7-4a95-8285-c8b015fbf457 2024-05-26T02:56:01.002475565Z [2024-05-26T02:56:01.002+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb260e44-41e1-4275-82a6-3bd03ee70c44 2024-05-26T02:56:01.008061341Z [2024-05-26T02:56:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to 635a2ef7-9b45-477c-a23d-42d96c04439d 2024-05-26T02:56:01.008389339Z [2024-05-26T02:56:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d91324d-d85d-42d7-a760-ea60c6b1c00f 2024-05-26T02:56:02.234721819Z [2024-05-26T02:56:02.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:56:02.235321266Z [2024-05-26T02:56:02.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:54:00+00:00, run_id=scheduled__2024-05-26T02:54:00+00:00, run_start_date=2024-05-26 02:56:00.459565+00:00, run_end_date=2024-05-26 02:56:02.234728+00:00, run_duration=1.775163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:54:00+00:00, data_interval_end=2024-05-26 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:56:02.248088328Z [2024-05-26T02:56:02.247+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:56:00+00:00, run_after=2024-05-26T02:58:00+00:00 2024-05-26T02:56:02.261972306Z [2024-05-26T02:56:02.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:56:02.262432337Z [2024-05-26T02:56:02.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:55:00+00:00, run_id=scheduled__2024-05-26T02:55:00+00:00, run_start_date=2024-05-26 02:56:00.461156+00:00, run_end_date=2024-05-26 02:56:02.261880+00:00, run_duration=1.800724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:55:00+00:00, data_interval_end=2024-05-26 02:56:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:56:02.294832364Z [2024-05-26T02:56:02.294+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:56:00+00:00, run_after=2024-05-26T02:57:00+00:00 2024-05-26T02:56:02.363582757Z [2024-05-26T02:56:02.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:54:00+00:00 exited with status success for try_number 1 2024-05-26T02:56:02.363608946Z [2024-05-26T02:56:02.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:55:00+00:00 exited with status success for try_number 1 2024-05-26T02:56:02.370742890Z [2024-05-26T02:56:02.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:54:00+00:00, map_index=-1, run_start_date=2024-05-26 02:56:01.387216+00:00, run_end_date=2024-05-26 02:56:01.751678+00:00, run_duration=0.364462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:56:00.538380+00:00, queued_by_job_id=1, pid=16485 2024-05-26T02:56:02.370890108Z [2024-05-26T02:56:02.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:55:00+00:00, map_index=-1, run_start_date=2024-05-26 02:56:01.356836+00:00, run_end_date=2024-05-26 02:56:01.731717+00:00, run_duration=0.374881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:56:00.538380+00:00, queued_by_job_id=1, pid=16484 2024-05-26T02:56:04.548749859Z [2024-05-26T02:56:04.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:56:04.549157509Z [2024-05-26T02:56:04.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:55:00+00:00, run_id=scheduled__2024-05-26T02:55:00+00:00, run_start_date=2024-05-26 02:56:00.462608+00:00, run_end_date=2024-05-26 02:56:04.548843+00:00, run_duration=4.086235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:55:00+00:00, data_interval_end=2024-05-26 02:56:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:56:04.559202163Z [2024-05-26T02:56:04.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:56:00+00:00, run_after=2024-05-26T02:57:00+00:00 2024-05-26T02:56:04.565795747Z [2024-05-26T02:56:04.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:56:04.566103675Z [2024-05-26T02:56:04.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:55:00+00:00, run_id=scheduled__2024-05-26T02:55:00+00:00, run_start_date=2024-05-26 02:56:00.463863+00:00, run_end_date=2024-05-26 02:56:04.565816+00:00, run_duration=4.101953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:55:00+00:00, data_interval_end=2024-05-26 02:56:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:56:04.575436774Z [2024-05-26T02:56:04.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:56:00+00:00, run_after=2024-05-26T02:57:00+00:00 2024-05-26T02:56:04.615223990Z [2024-05-26T02:56:04.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:55:00+00:00 exited with status success for try_number 1 2024-05-26T02:56:04.615583046Z [2024-05-26T02:56:04.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:55:00+00:00 exited with status success for try_number 1 2024-05-26T02:56:04.624403119Z [2024-05-26T02:56:04.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:55:00+00:00, map_index=-1, run_start_date=2024-05-26 02:56:02.627279+00:00, run_end_date=2024-05-26 02:56:04.326485+00:00, run_duration=1.699206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:56:00.538380+00:00, queued_by_job_id=1, pid=16509 2024-05-26T02:56:04.624895289Z [2024-05-26T02:56:04.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:55:00+00:00, map_index=-1, run_start_date=2024-05-26 02:56:02.514700+00:00, run_end_date=2024-05-26 02:56:03.667253+00:00, run_duration=1.152553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:56:00.538380+00:00, queued_by_job_id=1, pid=16508 2024-05-26T02:57:00.334726449Z [2024-05-26T02:57:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:57:00+00:00, run_after=2024-05-26T02:58:00+00:00 2024-05-26T02:57:00.347014668Z [2024-05-26T02:57:00.346+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:57:00+00:00, run_after=2024-05-26T02:58:00+00:00 2024-05-26T02:57:00.352904529Z [2024-05-26T02:57:00.352+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:57:00.442508801Z [2024-05-26T02:57:00.442+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:57:00.442531584Z 2024-05-26T02:57:00.442534997Z 2024-05-26T02:57:00.442537947Z 2024-05-26T02:57:00.442702492Z [2024-05-26T02:57:00.442+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:57:00.442909396Z [2024-05-26T02:57:00.442+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:57:00.443058365Z [2024-05-26T02:57:00.442+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:57:00.443686243Z [2024-05-26T02:57:00.443+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:57:00.443698137Z 2024-05-26T02:57:00.443701203Z 2024-05-26T02:57:00.443704377Z 2024-05-26T02:57:00.447089304Z [2024-05-26T02:57:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:57:00.447351686Z [2024-05-26T02:57:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:57:00.447544041Z [2024-05-26T02:57:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:57:00.447709822Z [2024-05-26T02:57:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:57:00.447966091Z [2024-05-26T02:57:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:57:00.448126552Z [2024-05-26T02:57:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:57:00.690455025Z [2024-05-26T02:57:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status queued for try_number 1 2024-05-26T02:57:00.690829186Z [2024-05-26T02:57:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status queued for try_number 1 2024-05-26T02:57:00.691129253Z [2024-05-26T02:57:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status queued for try_number 1 2024-05-26T02:57:00.702090641Z [2024-05-26T02:57:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77fe2ee9-dc33-44e7-a067-71fc62719916 2024-05-26T02:57:00.702481122Z [2024-05-26T02:57:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3bed4cb-bd28-4274-a6fd-234acd6c4972 2024-05-26T02:57:00.702848942Z [2024-05-26T02:57:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3836e424-fba1-470c-ae6b-f07f085b2831 2024-05-26T02:57:01.893448029Z [2024-05-26T02:57:01.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:57:01.893806219Z [2024-05-26T02:57:01.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:56:00+00:00, run_id=scheduled__2024-05-26T02:56:00+00:00, run_start_date=2024-05-26 02:57:00.369679+00:00, run_end_date=2024-05-26 02:57:01.893320+00:00, run_duration=1.523641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:56:00+00:00, data_interval_end=2024-05-26 02:57:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:57:01.906237071Z [2024-05-26T02:57:01.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:57:00+00:00, run_after=2024-05-26T02:58:00+00:00 2024-05-26T02:57:01.963080986Z [2024-05-26T02:57:01.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status success for try_number 1 2024-05-26T02:57:01.969116441Z [2024-05-26T02:57:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:56:00+00:00, map_index=-1, run_start_date=2024-05-26 02:57:01.206115+00:00, run_end_date=2024-05-26 02:57:01.608170+00:00, run_duration=0.402055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:57:00.444273+00:00, queued_by_job_id=1, pid=16541 2024-05-26T02:57:03.699133444Z [2024-05-26T02:57:03.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:57:03.699305903Z [2024-05-26T02:57:03.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:56:00+00:00, run_id=scheduled__2024-05-26T02:56:00+00:00, run_start_date=2024-05-26 02:57:00.372130+00:00, run_end_date=2024-05-26 02:57:03.699013+00:00, run_duration=3.326883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:56:00+00:00, data_interval_end=2024-05-26 02:57:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:57:03.708151234Z [2024-05-26T02:57:03.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:57:00+00:00, run_after=2024-05-26T02:58:00+00:00 2024-05-26T02:57:03.762091467Z [2024-05-26T02:57:03.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status success for try_number 1 2024-05-26T02:57:03.770812814Z [2024-05-26T02:57:03.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:56:00+00:00, map_index=-1, run_start_date=2024-05-26 02:57:02.142413+00:00, run_end_date=2024-05-26 02:57:03.522073+00:00, run_duration=1.37966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:57:00.444273+00:00, queued_by_job_id=1, pid=16559 2024-05-26T02:57:04.350087035Z [2024-05-26T02:57:04.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:57:04.350850878Z [2024-05-26T02:57:04.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:56:00+00:00, run_id=scheduled__2024-05-26T02:56:00+00:00, run_start_date=2024-05-26 02:57:00.373792+00:00, run_end_date=2024-05-26 02:57:04.350078+00:00, run_duration=3.976286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:56:00+00:00, data_interval_end=2024-05-26 02:57:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:57:04.373051780Z [2024-05-26T02:57:04.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:57:00+00:00, run_after=2024-05-26T02:58:00+00:00 2024-05-26T02:57:04.449335988Z [2024-05-26T02:57:04.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status success for try_number 1 2024-05-26T02:57:04.472266924Z [2024-05-26T02:57:04.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:56:00+00:00, map_index=-1, run_start_date=2024-05-26 02:57:02.298923+00:00, run_end_date=2024-05-26 02:57:03.989698+00:00, run_duration=1.690775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:57:00.444273+00:00, queued_by_job_id=1, pid=16560 2024-05-26T02:58:00.398071719Z [2024-05-26T02:58:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:58:00+00:00, run_after=2024-05-26T02:59:00+00:00 2024-05-26T02:58:00.404908576Z [2024-05-26T02:58:00.404+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:58:00.412507185Z [2024-05-26T02:58:00.412+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:58:00.425827462Z [2024-05-26T02:58:00.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:58:00+00:00, run_after=2024-05-26T02:59:00+00:00 2024-05-26T02:58:00.513113871Z [2024-05-26T02:58:00.512+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-05-26T02:58:00.513145988Z 2024-05-26T02:58:00.513153235Z 2024-05-26T02:58:00.513179857Z 2024-05-26T02:58:00.513185462Z 2024-05-26T02:58:00.513194697Z [2024-05-26T02:58:00.512+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-05-26T02:58:00.513211671Z [2024-05-26T02:58:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:58:00.513541300Z [2024-05-26T02:58:00.513+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:58:00.513922439Z [2024-05-26T02:58:00.513+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:58:00.515365689Z [2024-05-26T02:58:00.515+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:58:00.515381328Z 2024-05-26T02:58:00.515388002Z 2024-05-26T02:58:00.515392703Z 2024-05-26T02:58:00.515397116Z 2024-05-26T02:58:00.522624899Z [2024-05-26T02:58:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-05-26T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:58:00.523071296Z [2024-05-26T02:58:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-26T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-26T02:58:00.523554550Z [2024-05-26T02:58:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:58:00.523842706Z [2024-05-26T02:58:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:58:00.524342490Z [2024-05-26T02:58:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:58:00.524627855Z [2024-05-26T02:58:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:58:00.525109938Z [2024-05-26T02:58:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:58:00.525296940Z [2024-05-26T02:58:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-26T02:58:00.873658874Z [2024-05-26T02:58:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status queued for try_number 1 2024-05-26T02:58:00.873796732Z [2024-05-26T02:58:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:57:00+00:00 exited with status queued for try_number 1 2024-05-26T02:58:00.873890793Z [2024-05-26T02:58:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:57:00+00:00 exited with status queued for try_number 1 2024-05-26T02:58:00.874008873Z [2024-05-26T02:58:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:57:00+00:00 exited with status queued for try_number 1 2024-05-26T02:58:00.881959868Z [2024-05-26T02:58:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca8098c2-0544-461d-a4ca-b98d960b47d4 2024-05-26T02:58:00.882047124Z [2024-05-26T02:58:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to de86bdc0-a911-41f3-8aef-352cb01e0596 2024-05-26T02:58:00.882224399Z [2024-05-26T02:58:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f63e430-c4a0-40bf-b490-ed84e76c87e8 2024-05-26T02:58:00.882375795Z [2024-05-26T02:58:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3ae12e5-ee52-4dd7-a9ec-20f8c16b2d4f 2024-05-26T02:58:02.032199525Z [2024-05-26T02:58:02.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:58:02.035385379Z [2024-05-26T02:58:02.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-05-26 02:56:00+00:00, run_id=scheduled__2024-05-26T02:56:00+00:00, run_start_date=2024-05-26 02:58:00.437557+00:00, run_end_date=2024-05-26 02:58:02.032119+00:00, run_duration=1.594562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:56:00+00:00, data_interval_end=2024-05-26 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-05-26T02:58:02.046362483Z [2024-05-26T02:58:02.046+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-05-26T02:58:00+00:00, run_after=2024-05-26T03:00:00+00:00 2024-05-26T02:58:02.059101743Z [2024-05-26T02:58:02.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:58:02.059330739Z [2024-05-26T02:58:02.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, execution_date=2024-05-26 02:57:00+00:00, run_id=scheduled__2024-05-26T02:57:00+00:00, run_start_date=2024-05-26 02:58:00.438859+00:00, run_end_date=2024-05-26 02:58:02.059025+00:00, run_duration=1.620166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:57:00+00:00, data_interval_end=2024-05-26 02:58:00+00:00, dag_hash=92d8392ea53f00dfeaa7ddd67fd62fd2 2024-05-26T02:58:02.070441218Z [2024-05-26T02:58:02.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:58:00+00:00, run_after=2024-05-26T02:59:00+00:00 2024-05-26T02:58:02.113803958Z [2024-05-26T02:58:02.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-05-26T02:56:00+00:00 exited with status success for try_number 1 2024-05-26T02:58:02.121070180Z [2024-05-26T02:58:02.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-05-26T02:56:00+00:00, map_index=-1, run_start_date=2024-05-26 02:58:01.475853+00:00, run_end_date=2024-05-26 02:58:01.810059+00:00, run_duration=0.334206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:58:00.516975+00:00, queued_by_job_id=1, pid=16594 2024-05-26T02:58:03.250003765Z [2024-05-26T02:58:03.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:57:00+00:00 exited with status success for try_number 1 2024-05-26T02:58:03.260710553Z [2024-05-26T02:58:03.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:57:00+00:00, map_index=-1, run_start_date=2024-05-26 02:58:01.499704+00:00, run_end_date=2024-05-26 02:58:02.023545+00:00, run_duration=0.523841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:58:00.516975+00:00, queued_by_job_id=1, pid=16593 2024-05-26T02:58:05.231249941Z [2024-05-26T02:58:05.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:58:05.231802848Z [2024-05-26T02:58:05.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:57:00+00:00, run_id=scheduled__2024-05-26T02:57:00+00:00, run_start_date=2024-05-26 02:58:00.439930+00:00, run_end_date=2024-05-26 02:58:05.231004+00:00, run_duration=4.791074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:57:00+00:00, data_interval_end=2024-05-26 02:58:00+00:00, dag_hash=c70b9d73e0c75d317635853498d0a34e 2024-05-26T02:58:05.242466034Z [2024-05-26T02:58:05.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:58:00+00:00, run_after=2024-05-26T02:59:00+00:00 2024-05-26T02:58:05.251262594Z [2024-05-26T02:58:05.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-05-26T02:58:05.251778472Z [2024-05-26T02:58:05.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, execution_date=2024-05-26 02:57:00+00:00, run_id=scheduled__2024-05-26T02:57:00+00:00, run_start_date=2024-05-26 02:58:00.441113+00:00, run_end_date=2024-05-26 02:58:05.251092+00:00, run_duration=4.809979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-05-26 02:57:00+00:00, data_interval_end=2024-05-26 02:58:00+00:00, dag_hash=390a73da61e8b33fce8981a20b373961 2024-05-26T02:58:05.265620514Z [2024-05-26T02:58:05.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:58:00+00:00, run_after=2024-05-26T02:59:00+00:00 2024-05-26T02:58:05.309691139Z [2024-05-26T02:58:05.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:57:00+00:00 exited with status success for try_number 1 2024-05-26T02:58:05.309882264Z [2024-05-26T02:58:05.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-05-26T02:57:00+00:00 exited with status success for try_number 1 2024-05-26T02:58:05.319937272Z [2024-05-26T02:58:05.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:57:00+00:00, map_index=-1, run_start_date=2024-05-26 02:58:02.702639+00:00, run_end_date=2024-05-26 02:58:04.250439+00:00, run_duration=1.5478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:58:00.516975+00:00, queued_by_job_id=1, pid=16618 2024-05-26T02:58:05.320332431Z [2024-05-26T02:58:05.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-05-26T02:57:00+00:00, map_index=-1, run_start_date=2024-05-26 02:58:02.626827+00:00, run_end_date=2024-05-26 02:58:04.252297+00:00, run_duration=1.62547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-05-26 02:58:00.516975+00:00, queued_by_job_id=1, pid=16617 2024-05-26T02:58:33.934889503Z [2024-05-26T02:58:33.934+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-05-26T02:59:00.959586920Z [2024-05-26T02:59:00.959+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-05-26T02:59:00.971267870Z [2024-05-26T02:59:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 to 2024-05-26T02:59:00+00:00, run_after=2024-05-26T03:00:00+00:00 2024-05-26T02:59:00.981975890Z [2024-05-26T02:59:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb to 2024-05-26T02:59:00+00:00, run_after=2024-05-26T03:00:00+00:00 2024-05-26T02:59:01.065032735Z [2024-05-26T02:59:01.064+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-05-26T02:59:01.065064193Z 2024-05-26T02:59:01.065090736Z 2024-05-26T02:59:01.065094573Z 2024-05-26T02:59:01.067872275Z [2024-05-26T02:59:01.066+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:59:01.069759637Z [2024-05-26T02:59:01.069+0000] {scheduler_job.py:425} INFO - DAG vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2 has 0/16 running and queued tasks 2024-05-26T02:59:01.070400945Z [2024-05-26T02:59:01.069+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb has 0/16 running and queued tasks 2024-05-26T02:59:01.072805168Z [2024-05-26T02:59:01.071+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-05-26T02:59:01.072819382Z 2024-05-26T02:59:01.072823348Z 2024-05-26T02:59:01.072827048Z 2024-05-26T02:59:01.078640001Z [2024-05-26T02:59:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:59:01.078776657Z [2024-05-26T02:59:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-26T02:59:01.079063944Z [2024-05-26T02:59:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:59:01.079618248Z [2024-05-26T02:59:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_9e45e75f-34ef-41d0-9c7f-7c96e2f09ac2', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-26T02:59:01.080462249Z [2024-05-26T02:59:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-05-26T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-05-26T02:59:01.082098535Z [2024-05-26T02:59:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_568de5b1-b2fc-405e-8cde-21b557a0f2fb', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-26T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T22:38:20.563966008Z 2024-05-25T22:38:20.579629420Z Cleaning logs every 900 seconds 2024-05-25T22:38:20.579651727Z Trimming airflow logs to 15 days. 2024-05-25T22:45:00.655651317Z Trimming airflow logs to 15 days. 2024-05-25T22:45:01.678585768Z Trimming airflow logs to 15 days. 2024-05-25T23:00:00.727803133Z Trimming airflow logs to 15 days. 2024-05-25T23:00:01.764328798Z Trimming airflow logs to 15 days. 2024-05-25T23:15:00.799714714Z Trimming airflow logs to 15 days. 2024-05-25T23:15:01.824022821Z Trimming airflow logs to 15 days. 2024-05-25T23:30:00.879242485Z Trimming airflow logs to 15 days. 2024-05-25T23:30:01.916049141Z Trimming airflow logs to 15 days. 2024-05-25T23:45:00.970072193Z Trimming airflow logs to 15 days. 2024-05-25T23:45:02.003960121Z Trimming airflow logs to 15 days. 2024-05-26T00:00:00.039807933Z Trimming airflow logs to 15 days. 2024-05-26T00:00:01.067759010Z Trimming airflow logs to 15 days. 2024-05-26T00:15:00.132106349Z Trimming airflow logs to 15 days. 2024-05-26T00:15:01.166218405Z Trimming airflow logs to 15 days. 2024-05-26T00:30:00.208272733Z Trimming airflow logs to 15 days. 2024-05-26T00:30:01.240315481Z Trimming airflow logs to 15 days. 2024-05-26T00:45:00.270984001Z Trimming airflow logs to 15 days. 2024-05-26T00:45:01.308008489Z Trimming airflow logs to 15 days. 2024-05-26T01:00:00.355729179Z Trimming airflow logs to 15 days. 2024-05-26T01:00:01.394391537Z Trimming airflow logs to 15 days. 2024-05-26T01:15:00.430271324Z Trimming airflow logs to 15 days. 2024-05-26T01:15:01.460747769Z Trimming airflow logs to 15 days. 2024-05-26T01:30:00.481153425Z Trimming airflow logs to 15 days. 2024-05-26T01:30:01.529156533Z Trimming airflow logs to 15 days. 2024-05-26T01:45:00.574935707Z Trimming airflow logs to 15 days. 2024-05-26T01:45:01.604307361Z Trimming airflow logs to 15 days. 2024-05-26T02:00:00.631432501Z Trimming airflow logs to 15 days. 2024-05-26T02:00:01.663770500Z Trimming airflow logs to 15 days. 2024-05-26T02:15:00.706375316Z Trimming airflow logs to 15 days. 2024-05-26T02:15:01.745184654Z Trimming airflow logs to 15 days. 2024-05-26T02:30:00.786411587Z Trimming airflow logs to 15 days. 2024-05-26T02:30:01.850291140Z Trimming airflow logs to 15 days. 2024-05-26T02:45:00.888446177Z Trimming airflow logs to 15 days. 2024-05-26T02:45:01.909086849Z Trimming airflow logs to 15 days.